tbaeg commented on issue #11768: URL: https://github.com/apache/iceberg/issues/11768#issuecomment-2555714182
@sopel39 I **think** the issue is resolved with this patch. Previously, we made an incorrect assumption the read timeout was due to slowness in processing the avro files, not a deadlock (we introduced separate executor for scan planning with fewer threads). We increased our read time out in our http connections in hopes to mitigate the issue and was likely masking the deadlock. I reverted the read time out to the default (in our case 30 seconds) and have not seen the issue when running with the patch. I was only able to test in an isolated setting, but it looks promising. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
