sreejasahithi opened a new pull request, #18987: URL: https://github.com/apache/iceberg/pull/18987
This PR introduces `CanonicalUriFileIO`, a wrapper around Iceberg's `FileIO` abstraction that decouples the URI stored in Iceberg table metadata from the physical URI used to access files. It allows different compute engines to access the same Iceberg table using different storage protocols while retaining a consistent canonical URI representation in table metadata. ## What does this change? - **Canonical URI resolution:** Resolves canonical URIs stored in Iceberg metadata into protocol-specific physical URIs at runtime using configurable URI mappings. - **FileIO delegation:** Delegates actual filesystem operations to a configured underlying `FileIO` implementation. - **Consistent URI handling:** Applies URI resolution across metadata files, manifest lists, manifests, data files, and delete files. - **Relative path support:** Handles relative and absolute file paths while preserving Iceberg's path representation semantics across table format versions. - **Configurable mappings:** Allows storage-specific URI mappings to be configured without introducing dependencies on any particular storage system or filesystem implementation. ## Compatibility - Existing Iceberg tables can be accessed without rewriting their metadata. - Existing fully-qualified file locations continue to work. - When canonical URI resolution is not configured, existing `FileIO` behavior remains unchanged. - No changes to the Iceberg table format specification or catalog interfaces are required. Refernce : https://github.com/apache/iceberg/issues/18921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
