Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-02-06 Thread via GitHub
Fokko commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2640733293 Thanks for the additional context @yigal-rozenberg. I find this very interesting. Also, I know certain companies that use this pattern for GDPR, where they erase the decryption

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-02-03 Thread via GitHub
yigal-rozenberg commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2631602334 related technical publication: https://www.etsi.org/deliver/etsi_ts/103500_103599/103532/01.01.01_60/ts_103532v010101p.pdf -- This is an automated message from the

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-02-03 Thread via GitHub
yigal-rozenberg commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2631515059 Hi @Fokko, File encryption is an essential functionality that adds an immortal security layer to data integrity and security on a file level. Data Centric securi

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-02-03 Thread via GitHub
Fokko commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2630481183 As @kevinjqliu already pointed out, this is a bigger thing than just implementing it on PyIceberg. There is also a proposal out for file-level encryption: https://github.com/ap

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-01-31 Thread via GitHub
yigal-rozenberg commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2627821210 added code change here: https://github.com/apache/iceberg-python/pull/1594 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-01-28 Thread via GitHub
yigal-rozenberg commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2620105176 Before posting this as a proper improvement request, I would like to come up with a POC that demonstrate the desired functionality/ The thread you provided talks abou

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-01-28 Thread via GitHub
kevinjqliu commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2619864409 Hey there! Thanks for creating this issue. Typically for something like this we would want to create a [Improvement Proposals](https://iceberg.apache.org/contribute/?h=pro

Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

2025-01-27 Thread via GitHub
yigal-rozenberg commented on issue #1582: URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2616475076 Sample program to read and write using ProtectedType data. [app.txt](https://github.com/user-attachments/files/18562332/app.txt) -- This is an automated messa