gitzwz commented on issue #1229: URL: https://github.com/apache/iceberg-python/issues/1229#issuecomment-2601733467
> Here's what I did in my particular case to give the general idea: Thanks to [DieHertz](https://github.com/DieHertz), I tried the demo code with CPython 3.12 & Debian GNU/Linux 9.13 and get also ~3 times speedup in CPU-bound scenarios. For anyone meets problem running this code on Linux, you may need to change like this: ```Python with ProcessPoolExecutor(mp_context=multiprocessing.get_context('spawn')) as pool: ``` The default process-start mode is **fork** on Linux, which seems to run into dead-lock. I think it may be faster if this problem can be figured out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org