ajantha-bhat opened a new pull request, #6695: URL: https://github.com/apache/iceberg/pull/6695
Incase of no-op (when the manifests are already optimized), rewrite manifest can still create one new file from the old file with the same contents. Which is a waste of resources. Hence, handling the no-op scenario. Examples of no-op scenarios: a) have one manifest and user calls rewrite manifests. b) output of previous rewrite has created one smaller manifest (residual manifest after rewriting all the manifest to the target size) and user calls rewrite-manifests again. - Have four manifests of 5MB each and target size is 8MB. The first time calling rewrite will create three 8MB file and one 1MB file. If the rewrite is called again, no need to write just 1MB file into a new 1MB file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
