ryzhyk opened a new pull request, #788: URL: https://github.com/apache/iceberg-rust/pull/788
I noticed that, when reading many parquet files from S3, one of the reads fails occasionally with a temporary error such as "connection closed before message completed". I think such transient failures are normal for S3, and the client is expected to retry the read in this case. However, opendal was not configured to perform a retry. This commit adds a retry layer to opendal config for S3 and GCS object stores with the default configuration (exponential backoff with up to 3 retries). This solves the issue for me. It might be useful to make this behavior configurable in the future, but default settings should work most of the time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
