stuhood commented on issue #21992: URL: https://github.com/apache/datafusion/issues/21992#issuecomment-4434586668
I think that partitioning is likely to become relevant for us in the next few weeks, and our schedule should finally be clearing up to try and get some of our team involved with helping. We're very likely to be doing either Range or N-dimensional partitioning. AFAICT though, Range is sufficient to represent N-dimensional partitioning (with a physical optimizer rule running before EnforceDistribution), because you can declare each table to be partitioned on the relevant join key...? So, in practice, it doesn't seem like it would be worth actually introducing knowledge of multi-dimensional ranges here: a Range type would be enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
