noob-se7en opened a new pull request, #16572: URL: https://github.com/apache/pinot/pull/16572
**Problem Statement** Currently throttling only supports message count, i.e., Throttling config only takes the max limit for number of messages per sec a consumer can consume. However message/s might not be the best option considering that the server load (CPU and heap) caused by consumer is dependent on the messageBatchSize instead of message count. For example: The same machine might support max 100K messages/s for 1 tenant and 200K message/s for a different tenant. This leads to users sometimes do manual work to translate bytes/s to messages/s just for adding throttling configs. **PR:** This PR adds support for bytes based throttling. This will help in future to just add a default core level throttling to avoid OOM caused by realtime ingestion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
