Fokko commented on issue #1946:
URL:
https://github.com/apache/iceberg-python/issues/1946#issuecomment-2846738918
Hey @dor-bernstein Thanks for raising this. Do you have the full stack trace
by any chance?
I see in the code that you probably commit twice:
```python
with table.transaction() as tx:
for offset in range(0, data.num_rows, MAX_APPEND_CHUNK_SIZE):
data_slice = data.slice(offset, MAX_APPEND_CHUNK_SIZE)
logger.info(f'Writing batch of {data_slice.num_rows} with offset
{offset} to table {table.name()}')
tx.append(data_slice)
tx.commit_transaction() <-- this will commit
<-- Leaving the context manager will also trigger a commit
```
Please let me know, it would be great to get this fixed 🚀
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
