geruh opened a new pull request, #2251: URL: https://github.com/apache/iceberg-python/pull/2251
closes #2247 # Rationale for this change Add support for PyArrow filesystem specific properties allowing users to pass properties directly to the underlying PyArrow filesystem implementations (e.g. `S3FileSystem`, `GcsFileSystem`, `AzureFileSystem`, etc.) without requiring mapping support in PyIceberg. Since Pyarrow is a compiled implementation, it won't soft ignore extra parameters making this functionality pretty tedious. BUt now depending on the file systems the properties can be passed through to Pyarrow and interpreted there directly. # Are these changes tested? Added tests and tested locally with S3 # Are there any user-facing changes? Yes new capabilities, updated docs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
