dekimir commented on PR #10691: URL: https://github.com/apache/iceberg/pull/10691#issuecomment-2225641596
> My thinking here is that we bound the queue. The `ParallelIterable` is often used at places where it is IO intensive. This will limit the parallelism of calls to the object stores and that might harm the overall throughput. If the consumer of `ParallelIterable` is fast enough, then this limit should have no impact, right? And if the consumer isn't consuming fast enough, then the producer's throughput doesn't determine the overall throughput. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
