HenryCaiHaiying opened a new issue, #17026: URL: https://github.com/apache/iceberg/issues/17026
### Feature Request / Improvement The current Kafka-connect-iceberg component did not add any new JMX metrics, we can only use the existing metrics from Kafka consumer and Kafka Connect framework. When we were diagnosing performance problems related to slow or paused commit from Coordinator, we have to turn on many low level DEBUG/TRACE logging category to sense the system bottleneck. A well designed framework should have its own metrics reporting system for its key operational components for monitoring and diagnostic purposes. I think the following metrics would be useful to report: For Coordinator: commit-time, consume-available-time, commit-buffer size, ready-buffer size, message counts for START_COMMIT and COMMIT_COMPLETE messages. For Worker: save-time, consume-available-time, message counts for DATA_WRITTEN and DATA_COMPLETE messages. ### Query engine None ### Willingness to contribute - [x] I can contribute this improvement/feature independently - [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community - [ ] I cannot contribute this improvement/feature at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
