dang-stripe commented on issue #12318: URL: https://github.com/apache/pinot/issues/12318#issuecomment-1922264881
Thanks @snleee. I think increasing the fetch timeout or pausing + resume is a reasonable workaround. I don't see anything in the Kafka consumer library that'd allow us to get the offset from a `poll` call that returns no messages, so this seems like an ask for Kafka to support an API like that. Otherwise Pinot can't actually tell the different between an actual empty batch or an empty batch with only aborted messages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org