Jackie-Jiang commented on issue #10185: URL: https://github.com/apache/pinot/issues/10185#issuecomment-1405795170
I think I know the reason why it is also impacting regular tables. For partial upsert table, we need to first load all sealed segments to restore the history before starting the consumption. Currently it blocks the state transition from OFFLINE -> CONSUMING. On each server, we allow limited state transitions to happen in parallel (40 by default). When multiple threads are blocked (worst case all 40 threads are blocked), other messages won't get processed. We need to let the state transition pass, and block the consumption within the `LLRealtimeSegmentDataManager` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
