RussellSpitzer opened a new pull request, #18252: URL: https://github.com/apache/iceberg/pull/18252
Initial Implementation of #17918 - Part of #17919 - Built from work on #17821 after review and iteration. This is one of a series of PRs for full File Support. This PR covers just the API module changes and initial visitor changes. Add a `file` type for referencing a range of bytes stored inline or in an external file, as defined by the Parquet FILE logical type. The type is its own NestedType with its own TypeID rather than a struct subclass, so visitors cannot silently treat it as a struct where that would be wrong, while the default visitor behavior still falls back to struct handling for the majority of visitors that need no special casing. A file's six nested fields are derived from the ID of the field that holds the type rather than stored in the schema, which keeps the structure immutable. ID assignment reserves the derived block so that a later column cannot be given an ID that the file already owns. The type is gated to format version 4. Generated-by: Cursor -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
