mcvsubbu commented on issue #8618: URL: https://github.com/apache/pinot/issues/8618#issuecomment-1126598001
Some thoughts. The broker could keep track of a "health score" for serves and rank them. The score could include a variety of dimensions like: - How much thread cpu the server has used up in the last N time units? - What has been the response time of the server for the last M queries (perhaps normalized to the thread cpu used?) - maybe others as well The servers could also send a score of their own along with each response to the brokers after monitoring their current health. The brokers could include that information in deciding the "weight" of the server for inclusion in a query. We will need to ensure that the thing does not oscillate wildly, with all brokers backing off for the same server, and then all of them subjecting the server to an onslaught thinking that it is lightly loaded. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
