wirybeaver commented on issue #1241: URL: https://github.com/apache/datafusion-ballista/issues/1241#issuecomment-5441294423
I put together the proposed two-step version of this work: 1. #2388 adds a small, format-neutral codec seam for external table providers and physical plans. Ballista core keeps no format dependency, and existing Ballista nodes retain their current serialization path. 2. #2389 is a stacked Hudi proof using that seam. It keeps Hudi in an independent `integrations/hudi` crate and executes a projected/filtered Parquet COW read through a two-worker standalone cluster. The Hudi proof currently pins apache/hudi-rs#698, which aligns its DataFusion adapter with DataFusion 55 / Arrow 59.2. The first slice intentionally excludes MOR custom execution, writes, dynamic loading, and broad fallback machinery so the interface remains small enough to review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
