Jackie-Jiang commented on issue #9137: URL: https://github.com/apache/pinot/issues/9137#issuecomment-1224968273
@tanmesh Thanks for volunteering. We can focus on `SingleConnectionBrokerRequestHandler` for now. Currently broker gathers all the responses from all the servers before sending them to the reducer (See `SingleConnectionBrokerRequestHandler.processBrokerRequest()` line 113 `asyncQueryResponse.getFinalResponses()`). Instead, we want to reduce the results whenever a server responds, and early terminate the reduce (we may leverage the new introduced cancel query feature #9171). No extra limit needs to be passed as it should already exist in the pinot query. The challenge here is to make the reducer directly work on the `AsyncQueryResponse` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
