richardstartin commented on issue #9091: URL: https://github.com/apache/pinot/issues/9091#issuecomment-1192511680
To fix this without regressing on batches which consist entirely of tombstones, the "unfiltered count" isn't discriminative enough. Partition level consumers which discard messages for reasons other than time filtering, should record a dropped count or invalid message count, which `LLRealtimeSegmentDataManager` can use to ensure progress. The unfiltered count isn't used for any other purpose so should be replaced in the bug fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
