zhouxiz9 opened a new pull request, #10979: URL: https://github.com/apache/pinot/pull/10979
This PR adds a filtering step during the minion task generation process to skip generating rollup task with all merged segments. * For non rollup task, the task generation process stays the same. * For rollup task, if some of the input segments are not merged, the process stays the same. * For rollup task, if all input segments are all merged but the target merge level is higher, the process stays the same. E.g. input segments are merged at 5mins but the target merge level is 1 day then we still generate the rollup tasks. * For rollup task, if all input segments are all merged at the target merge level, skip generating the task. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
