navina commented on PR #10418: URL: https://github.com/apache/pinot/pull/10418#issuecomment-1476831216
> Internally, we have multiple kafka clusters per topic for better availability. We use our own stream ingestion plugin to make it look like 1 topic to Pinot. But it means across most tables/topics, some partitions get very few events. That's definitely not a pattern one would expect :) @jugomezv and I discussed this on friday and I believe he is going to come up with some proposal on API changes that can provide metadata on the filtered messages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
