blcksrx opened a new pull request, #13291: URL: https://github.com/apache/iceberg/pull/13291
## Description The `KafkaMetricsReporter` is a custom implementation of the `MetricsReporter` interface that allows reporting Iceberg metrics to a Kafka topic. This reporter is designed to serialize metrics reports into JSON format and send them as Kafka messages. ## Motivation This change introduces to address that gap by enabling: - **Observable Metrics Pipeline**s: Metrics like `ScanReport` and `CommitReport` can now be serialized and emitted to a Kafka topic in real-time, making them consumable by monitoring systems, dashboards, or alerting tools. - **Event-Driven Integration**: By pushing metrics into Kafka, Iceberg actions can now trigger downstream workflows, such as audits, data lineage tracking, or compaction jobs via Kafka consumers. ## Usage To use the KafkaMetricsReporter, configure the following properties in your catalog: ```bash metrics-reporter-impl=org.apache.iceberg.experimental.KafkaMetricsReporter metrics-reporter.kafka.bootstrap.servers=localhost:9092 metrics-reporter.kafka.topic=iceberg-metrics ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
