steveloughran commented on issue #10340: URL: https://github.com/apache/iceberg/issues/10340#issuecomment-2286940103
one of those stack traces is from deltaio, so nothing to do with iceberg both of them are caused by the AWS sdk itself not retrying, or retrying but not enough times for the problem to recover. There's also http connection pooling at play here too: there's no point the library trying to repeat the request if it keeps returning the failed stream to the pool for it to be picked up again. Some suggestions * look up the sdk docs on system properties `aws.retryMode` and `aws.maxAttempts` and see if setting things there help * if possible, switch to the Hadoop s3a connector which does a lot of work recovering from connectivity and other network errors -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
