jatorre opened a new issue, #4295:
URL: https://github.com/apache/iceberg-python/issues/4295
### Apache Iceberg version
0.12.0 (and main)
### Please describe the bug 🐞
`AvroFileHeader.compression_codec()` reads a missing `avro.codec` entry as
`TableProperties.WRITE_AVRO_COMPRESSION_DEFAULT` ("gzip"). That is an Iceberg
property value, not an Avro codec name, so it is not in `KNOWN_CODECS` and the
read raises `ValueError: Unsupported codec: gzip`. The Avro specification makes
`null` (uncompressed) the default for a file without the entry.
iceberg-rust writes manifests without the entry (apache/iceberg-rust#3639 is
about using its commits from Python), so a table with one snapshot from
iceberg-rust cannot be scanned from PyIceberg:
```
File "pyiceberg/avro/file.py", line 94, in compression_codec
raise ValueError(f"Unsupported codec: {codec_name}")
ValueError: Unsupported codec: gzip
```
### Willingness to contribute
- [x] I can contribute a fix for this bug independently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
