bigluck commented on issue #669:
URL: https://github.com/apache/iceberg-python/issues/669#issuecomment-2084469240
For reference, this is the full stack trace:
```
Traceback (most recent call last):
File "/Users/bigluck/Desktop/pyiceberg-vlad-bug/test.py", line 31, in
<module>
new_table.append(arrow_table)
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/table/__init__.py",
line 1000, in append
for data_file in data_files:
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/table/__init__.py",
line 2345, in _dataframe_to_data_files
yield from write_file(table, iter([WriteTask(write_uuid, next(counter),
df)]))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1758, in write_file
fill_parquet_file_metadata(
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1695, in fill_parquet_file_metadata
_min = agg.min_as_bytes()
^^^^^^^^^^^^^^^^^^
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1355, in min_as_bytes
return self.serialize(
^^^^^^^^^^^^^^^
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/io/pyarrow.py",
line 1337, in serialize
return to_bytes(self.primitive_type, value)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/nix/store/03q8gn91mj95y5bqbcl90hyvmpqpz738-python3-3.11.7/lib/python3.11/functools.py",
line 909, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/conversions.py",
line 267, in _
return decimal_to_bytes(value)
^^^^^^^^^^^^^^^^^^^^^^^
File
"/Users/bigluck/Desktop/pyiceberg-vlad-bug/venv/lib/python3.11/site-packages/pyiceberg/utils/decimal.py",
line 81, in decimal_to_bytes
return unscaled_value.to_bytes(byte_length, byteorder="big", signed=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OverflowError: int too big to convert
(venv)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
