navina opened a new pull request, #9800: URL: https://github.com/apache/pinot/pull/9800
## Description This PR enables Pinot to publish consumer lag as a metric for realtime tables. It is emitted via a periodic task in the controller that will periodically query `/consumingSegmentsInfo` API and record the max consuming lag among the partition's replicas. Currently, it publishes the following metrics: - `MAX_RECORDS_LAG` - `MAX_AVAILABILITY_LAG_MS` The task can be configured to run at a given frequency so as to not overwhelm the server (and through that, not to overwhelm the data source). Labels: `observability` ## Release Notes * Consumer lag for realtime tables can be monitored using metrics `MAX_RECORDS_LAG` and `MAX_AVAILABILITY_LAG_MS` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
