jadami10 opened a new pull request, #11345: URL: https://github.com/apache/pinot/pull/11345
This is a small feature addition to allow servers to become healthy via `realtimeFreshnessIdleTimeoutMs` if the stream is not making any progress. There's also an addition to the freshness checker to mark itself healthy if the current stream offset is now out of retention. This has been an issue for us in low volume QA environments because we have servers wait 45 minutes to catch up before marking themselves as healthy. But there are occasions where servers have been down for too long and offsets are retentioned. Or kafka just never gives us back the requested offsets (we believe these are control messages from transactional publishes). We're running this on all QA clusters with no issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
