fcfangcc opened a new issue, #2529:
URL: https://github.com/apache/iceberg-python/issues/2529

   ### Feature Request / Improvement
   
   
   When use fsspec io-impl, put object to File Storage Provider(FSP) not 
support [Signature calculations for trailing 
headers](https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming-trailers.html)
   
   Put file like snapxxx.avro will not handle by FSP after upload(put object is 
success), the file some data signature related things are reserved.
   
   When get snapxxx.avro  to read and decoder, raise Error, Because the file 
contains signature information
   ```python
     File "pyiceberg/avro/decoder_fast.pyx", line 150, in 
pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_utf8
       cpdef str read_utf8(self):
     File "pyiceberg/avro/decoder_fast.pyx", line 156, in 
pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_utf8
       return self.read_bytes().decode("utf-8")
     File "pyiceberg/avro/decoder_fast.pyx", line 130, in 
pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_bytes
       return r[0:length]
   SystemError: Negative size passed to PyBytes_FromStringAndSize
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to