gene-bordegaray commented on issue #21992: URL: https://github.com/apache/datafusion/issues/21992#issuecomment-4455852315
To keep everyone else in this thread up-to-date, we had some discussions this week regarding this topic and have come up with a concrete plan. We are going to start with adding a enum variant for `ExprPartitioning` (name up for debate) rather than introducing a general trait immediately. @alamb described the concept and representation of this well, so I won't reexplain that here. For implementation, the first PR will be purely mechanical. This will add a `Expr` (or similar) variant to the existing physical `Partitioning` enum, along with the supporting types, but just throw "not implemented" at callsites. This will introduce the concept and give a good idea of the API methods we will need to represent partitioning well. This will then be followed up with implementing the partitioning features based on the callsites in follow-up PRs, with one of these beeing the dynamic filter routing. The goal is still to model this in a way that can evolve into a general partitioning abstraction if needed. I will make the mechanical PR soon and ping here 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
