frankliee commented on issue #1488:
URL:
https://github.com/apache/iceberg-python/issues/1488#issuecomment-2581774240
I use strace on the worker process, there are `FUTEX_WAIT_BITSET_PRIVATE`,
and I not sure it was dead locking caused by process forking in pyarrow.
Then I find that
frankliee commented on issue #1488:
URL:
https://github.com/apache/iceberg-python/issues/1488#issuecomment-2579879173
> One thing we can test is to force create a new FileIO in the worker.
Something like this
>
> ```
> from multiprocessing import Process
> from pyiceberg.io.pya
kevinjqliu commented on issue #1488:
URL:
https://github.com/apache/iceberg-python/issues/1488#issuecomment-2575734864
One thing we can test is to force create a new FileIO in the worker.
Something like this
```
from multiprocessing import Process
from pyiceberg.io.pyarrow im
frankliee commented on issue #1488:
URL:
https://github.com/apache/iceberg-python/issues/1488#issuecomment-2574263503
@kevinjqliu
I use pystack to get stack of child process, it shows that
`pyarrow.FileSystem` causes the hanging.
By the way, our env is not easy to upgrade pyiceberg t
kevinjqliu commented on issue #1488:
URL:
https://github.com/apache/iceberg-python/issues/1488#issuecomment-2573279503
Hi @frankliee thanks for reporting this issue. I noticed you're using
version 0.7.1, the latest version is 0.8.1. Could you retry with the latest
version?
The issue
