atris commented on issue #7060: URL: https://github.com/apache/incubator-pinot/issues/7060#issuecomment-871304433
So I investigated this and noted that in case there is no ORDER BY present, there is a possibility that we will early terminate during a DISTINCT operation. However, in case of ORDER BY being present, DistinctCombineOperator will not allow early termination, thus forcing all segments to be processed. I do not see how we can avoid this, since ORDER BY will have to ensure that the results are ordered globally, irrespective of the limit. I think a better way would be to support DISTINCT operation to work on top of dictionary, in case the conditions are matched. I will work on the PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
