navina opened a new pull request, #9515: URL: https://github.com/apache/pinot/pull/9515
Re-work of the PR : https://github.com/apache/pinot/pull/8280 Changes in this PR: - `/consumingSegmentsInfo` API was moved into `PinotRealtimeTableResource` . - This returns additional per-partition map for upstream latest record offset and partition lag (when calculated) - Introduces new API in `StreamMetadataProvider#getCurrentPartitionLagState` - This PR only adds support for Kafka. - Any stream connector that hasn't implemented this method will return `NOT_CALCULATED` for these new lag status - Additionally, connectors can extend `PartitionLagState` interface to return more custom lag definitions Things to be addressed in a follow-up PR: - Define a time-based lag status - Add partition lag info for kinesis and pulsar stream Pending in this PR: - Integration test with Kafka -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
