jadami10 opened a new pull request, #11421: URL: https://github.com/apache/pinot/pull/11421
This is a small `fix` in realtime servers to avoid excessive logging. This will now correctly log at most once per minute or 100k events. We should have been logging consume rate + other metadata every minute or every 100k events. But for some reason the code uses `lastConsumeCount` to check if we should use `consumeStartTime` or `lastLogTime` as previous time. Since we have partitions with low to no event volume (QA and such), `lastConsumeCount` is often 0, so this causes emits a log on every consume loop. Now we always use `lastLogTime` as `prevTime` when it's not 0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
