xanderbailey opened a new pull request, #4328: URL: https://github.com/apache/iceberg-python/pull/4328
<!-- Thanks for opening a pull request! --> Working towards https://github.com/apache/iceberg-python/issues/3222 <!-- In the case this PR will resolve an issue, please replace ${GITHUB_ISSUE_ID} below with the actual Github issue id. --> <!-- Closes #${GITHUB_ISSUE_ID} --> # Rationale for this change First write-side PR: data files of an encrypted table are written with Parquet Modular Encryption. - Each data file gets its own key and AAD prefix, recorded as the `DataFile`'s `key_metadata`. - Like Java, the AAD prefix isn't stored in the file. - Needs pyarrow >= 25, and raises on older versions rather than writing plaintext. Commits to v3 tables still fail at the manifest writer, so encrypted manifests come next once #3624 lands. ## Are these changes tested? Yes, `write_file` on an encrypted table writes encrypted files that read back through a scan. I also checked iceberg-rust can read one. ## Are there any user-facing changes? No. <!-- In the case of user-facing changes, please add the changelog label. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
