RussellSpitzer opened a new issue, #18232: URL: https://github.com/apache/iceberg/issues/18232
Follow-up to the `file` type work tracked in #17919. Because visitors fall back to struct behavior by default, the engine modules keep compiling and a file column behaves like a struct of its nested fields. These are runtime gaps rather than compile breaks, which is why engine support was left out of the initial PR series. What is needed per engine is a schema conversion that maps `file` to the engine's struct type, wrappers and readers that handle it, and tests covering read, write, and projection of a file column. Suggested order, each as its own PR: - [ ] Spark 4.1 - [ ] Flink 2.1 - [ ] Backport to Spark 4.0 and 3.5 - [ ] Backport to Flink 2.0 and 1.20 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
