gitzwz commented on issue #1479: URL: https://github.com/apache/iceberg-python/issues/1479#issuecomment-2568858562
> Could you print out `ExecutorFactory.max_workers()` to double check the value? I hacked the pyIceberg code to print executing thread name, so I can see the thread difference. > Theres already some discussions around this in https://github.com/apache/iceberg-python/issues/1229. The issue might be with I/O bound tasks and the python GIL. Can you give ProcessPoolExecutor a try? Thank you so much for pointing this out. That's same issue. I will try out and reply in https://github.com/apache/iceberg-python/issues/1229. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
