ConeyLiu opened a new pull request, #6335: URL: https://github.com/apache/iceberg/pull/6335
In our production env, we noticed the manifest files have a large random size, ranging from several KB to larger than 100 MB. It seems the `MANIFEST_TARGET_SIZE_BYTES` has not worked during the commit phase. In this PR, we avoid generating a manifest file larger than `MANIFEST_TARGET_SIZE_BYTES` for newly added content files and will generate multiple manifest files when the size is covered. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
