[GitHub] [iceberg] Fokko commented on issue #6435: PyIceberg: Avro decode EOF error

[GitBox]

Fokko commented on issue #6435:
URL: https://github.com/apache/iceberg/issues/6435#issuecomment-1373416695

   Able to reproduce this locally:
   ```
   >>> from pyiceberg.manifest import read_manifest_entry
   >>> 
list(read_manifest_entry(io.new_input('/Users/fokkodriesprong/Desktop/iceberg_6435_metadata/c8562c72-8cf0-4474-b75d-399938b6e335-m0.avro')))
   
   Traceback (most recent call last):
     File "<stdin>", line 1, in <module>
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/manifest.py", line 
139, in read_manifest_entry
       for record in reader:
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/file.py", line 
194, in __next__
       return self.__next__()
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/file.py", line 
186, in __next__
       return next(self.block)
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/file.py", line 
113, in __next__
       return self.reader.read(self.block_decoder)
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/reader.py", line 
260, in read
       struct.set(pos, field.read(decoder))  # later: pass reuse in here
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/reader.py", line 
260, in read
       struct.set(pos, field.read(decoder))  # later: pass reuse in here
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/reader.py", line 
233, in read
       return self.option.read(decoder)
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/reader.py", line 
313, in read
       read_items[key] = self.value.read(decoder)
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/reader.py", line 
200, in read
       return decoder.read_bytes()
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/decoder.py", line 
118, in read_bytes
       return self.read(self.read_int())
     File 
"/Users/fokkodriesprong/Desktop/iceberg/python/pyiceberg/avro/decoder.py", line 
54, in read
       raise EOFError
   EOFError
   ```
   Thanks for sharing the Avro files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org