alamb commented on issue #21207: URL: https://github.com/apache/datafusion/issues/21207#issuecomment-4319951004
> I had proposed something similar here (https://github.com/apache/datafusion/pull/18919) a while ago which introduced an idea of Value-based partitioning. Even if the solution we need now is not the exact same, we can continue discussion starting with some ideas from there. I will open a new issue and PR to discuss this separately. One thing that I found is interesting is that the Logical version of Partitioning actually has a `DistributeBy` variant (though the docs are not very clear on what it is for) https://docs.rs/datafusion/latest/datafusion/logical_expr/enum.Partitioning.html Maybe we need to bring that notion into the physical plan 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
