grantatspothero commented on PR #16281: URL: https://github.com/apache/iceberg/pull/16281#issuecomment-4417282493
The ReplaceDeleteFilesBenchmark doesn't show a difference because the benchmark triggers the optimization from this PR: https://github.com/apache/iceberg/pull/11131 But for workloads that delete files which do not have manifestLocation populated, the optimization does not trigger. This can occur if a representation of content file is serialized because the client does not want to hold in memory all the content files while compaction is occurring. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
