findepi commented on PR #7844: URL: https://github.com/apache/iceberg/pull/7844#issuecomment-1866905125
> The problem is that planning uses a shared threadpool. Using a blocking queue would cause tasks to stall, which would then tie up the threads in the shared pool and cause all planning to halt. good point > 3\. Use an isolated threadpool in `BlockingParallelIterable` that is not shared with other planning tasks from Trino perspective it would be most convenient to be able to provide an `Executor`. (Trino uses shared thread pool. + a "`BoundedExecutor`" which limits number of threads available to a given task, while still being able to reuse threads.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
