Jackie-Jiang commented on issue #4338: Only allow the first CONSUMING segment for the real-time table routing URL: https://github.com/apache/incubator-pinot/pull/4338#issuecomment-503379408 > Not sure if I follow the description. If for a given partition, there are 'n' replicas that are all in consuming state, will the first instance get all the QPS? If yes, that will cause a huge spike for one instance (I am sure I am missing something here). If not, what does 'allow' mean? When a segment finishes consumption and the next segment starts consuming, there could be a short period of time where the ideal state looks like the follows: ``` -------- Server1 Server2 Server3 Segment1 ONLINE CONSUMING CONSUMING Segment2 CONSUMING CONSUMING CONSUMING ``` The current algorithm will allow only the segment2 (last one) in consuming state, which means Segment1 will only have one replica (Server1) up as Server2 and Server3 are in CONSUMING state. This is causing Server1 becoming the hotspot. The new algorithm will allow only the segment1 in consuming state, which means Segment2 won't be queried.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
