toutane commented on PR #2298: URL: https://github.com/apache/iceberg-rust/pull/2298#issuecomment-4296313816
Hey Tim, I think you're absolutely right about consolidating everything into a single `TableProvider` long term. The only reason I kept separate paths was to avoid introducing breaking changes. I am going to explore a design where partitioned file scan becomes the default behavior, with the current provider's logic as a fallback as you suggested. On a related note, it could be worth thinking about the next step: exposing `Partitioning::Hash` as output-partitioned when the Iceberg data uses bucket partitioning. Do you think that fits naturally in the same path, or would a separate provider be a better fit? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
