sylph-eu opened a new pull request, #11565:
URL: https://github.com/apache/pinot/pull/11565
Our deployment of Pinot has plenty of "slow" REALTIME table for which no new
data are produced for several minutes in a row. As the result, stream consumers
are regularly recreated with the following WARN message
```
Recreating stream consumer for topic partition <kafka-topic>-<partition>,
reason: Total idle time: 183623 ms exceeded idle timeout: 180000 ms
```
I'd like to reduce the level of this message to drop plenty of noisy WARN+
messages that pollutes our logging system.
Speaking of the actual usage, this message inside `recreateStreamConsumer`
being called from two places:
1. From `handleTransientStreamErrors`, when max consecutive error count
exceeds the threshold. In this case there's another warning message
`_segmentLogger
.warn("Stream transient exception when fetching messages, retrying
(count={})", _consecutiveErrorCount, e);`
2. From `consumeLoop`, upon hitting idle timeout. This is the primary source
of noisy log messages.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
