rohityadav1993 commented on issue #13277: URL: https://github.com/apache/pinot/issues/13277#issuecomment-2140254442
The delay tracking metric `REALTIME_INGESTION_DELAY_MS` in #9994 should ideally be able to capture the scenario1 with 0 lag and scenario2/3 as a continuously increasing lag. A controller periodic task should be able to figure out if any of the segment is supposed to be in consuming state, I see `missingConsumingSegmentNewPartitionCount` (#8877) is present and should have worked. If these metrics are not helpful or emitted properly in scenario of OFFLINE/ERROR segments then we can improve them as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
