udaysagar2177 opened a new pull request, #13373: URL: https://github.com/apache/iceberg/pull/13373
We commit data to our Iceberg table frequently and noticed periodic spikes in commit latency that were difficult to diagnose. After instrumenting a custom S3FileIO implementation with [LoggingMetricPublisher](https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/metrics/LoggingMetricPublisher.html), we discovered that a non-trivial amount time was being spent downloading around 100 manifest files from S3 during these spikes. It turned out that manifest merging was being triggered automatically because the default value of `commit.manifest-merge.enabled` is `true`. A clear log message indicating that automatic manifest merging is occurring would have helped us identify this much earlier. I’m submitting this pull request to add such a message, in the hope that it helps others avoid similar troubleshooting efforts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
