Dandandan commented on issue #21381: URL: https://github.com/apache/datafusion/issues/21381#issuecomment-4191094936
My comment was about the final `SortPreservingMergeExec` stage indeed, not the internal merging of batches within `SortExec`. I think both cases (full sort and merge-only) might benefit from more parallelism in the final stage, but in cases SPM is the only stage there might be substantial more benefit, probably less buffering will be necessary to introduce enough parallelism in the inner streams. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
