vvivekiyer opened a new pull request, #10248: URL: https://github.com/apache/pinot/pull/10248
Currently, when we build a StagePlan for GroupBy aggregations, we create a Leaf Level Aggregation and an Intermediate Level Aggregation. For high cardinality columns, doing partial aggregation at leaf level might not be useful to collapse data by a considerable degree. If the optimizer can recognize this fact (based on SQL Hint or cardinality information), we can omit the aggregation at leaf stage and just do it at the intermediate stage. Creating this PoC PR to discuss the pros and cons of this and see if it makes sense to proceed forward with this thought. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
