amogh-jahagirdar commented on PR #9953: URL: https://github.com/apache/iceberg/pull/9953#issuecomment-2007499715
@ajantha-bhat Replied my thoughts on the Trino PR and I'll summarize what I think here: To be clear, there is no extra I/O being done in practice for `newInputfile(DataFile)` since that code path does not look to be exercised yet in the latest release. What's remaining is the `newInputFile(ManifestFile)` where there would be an extra I/O during engine planning. Since the I/O is an extra head request to object stores which typically is low double digit milliseconds + the fact that only a subset of manifess are read during planning I think that it's not significant enough to warrant a patch release, but I can be convinced otherwise if folks hit a latency regression this in their workloads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org