caushie-akamai opened a new issue, #14403:
URL: https://github.com/apache/iceberg/issues/14403

   ### Apache Iceberg version
   
   1.10.0 (latest release)
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   When testing encryption locally on V3 tables, i also gave it a try for V2 
tables. @amogh-jahagirdar  [suggested that this should only work with 
V3](https://apache-iceberg.slack.com/archives/C02HPMR83A6/p1760653515237979?thread_ts=1760628412.925919&cid=C02HPMR83A6).
  
   
   I cherry-picked https://github.com/apache/iceberg/pull/13066 and 
https://github.com/apache/iceberg/pull/7770 on 1.10 and created a table by 
`CREATE TABLE test_encryption_v2 (id bigint, data string) USING iceberg  
TBLPROPERTIES ('encryption.key-id'='keyA')` using 
`org.apache.iceberg.encryption.UnitestKMS`
   
   ```
   spark-sql (test)> show create table test_encryption_v2;
   CREATE TABLE test_encryption_v2 (
     id BIGINT,
     data STRING)
   USING iceberg
   LOCATION 's3a://test_bucket//test_encryption_v2'
   TBLPROPERTIES (
     'current-snapshot-id' = 'none',
     'encryption.key-id' = 'keyA',
     'format' = 'iceberg/parquet',
     'format-version' = '2',
     'write.parquet.compression-codec' = 'zstd')
   ```
   
   After grabbing the data file: 
   ```
   $ parquet-tools inspect 
00002-2-abb73261-3beb-4965-aa57-3e8a6a42ecc7-0-00001.parquet
   Traceback (most recent call last):
     File "/home/ecaushi/.local/bin/parquet-tools", line 8, in <module>
       sys.exit(main())
     File 
"/home/ecaushi/.local/lib/python3.10/site-packages/parquet_tools/cli.py", line 
26, in main
       args.handler(args)
     File 
"/home/ecaushi/.local/lib/python3.10/site-packages/parquet_tools/commands/inspect.py",
 line 55, in _cli
       _execute_simple(
     File 
"/home/ecaushi/.local/lib/python3.10/site-packages/parquet_tools/commands/inspect.py",
 line 63, in _execute_simple
       pq_file: pq.ParquetFile = pq.ParquetFile(filename)
     File 
"/home/ecaushi/.local/lib/python3.10/site-packages/pyarrow/parquet/core.py", 
line 317, in __init__
       self.reader.open(
     File "pyarrow/_parquet.pyx", line 1501, in 
pyarrow._parquet.ParquetReader.open
     File "pyarrow/error.pxi", line 92, in pyarrow.lib.check_status
   OSError: Could not read encrypted metadata, no decryption found in reader's 
properties
   ```
   
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [x] I would be willing to contribute a fix for this bug with guidance from 
the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to