danielcweeks commented on code in PR #11383: URL: https://github.com/apache/iceberg/pull/11383#discussion_r1823593819
########## docs/docs/aws.md: ########## @@ -669,6 +669,13 @@ Users can use catalog properties to override the defaults. For example, to confi --conf spark.sql.catalog.my_catalog.http-client.apache.max-connections=5 ``` +**Note that for workloads with exceptionally high throughput against tables that S3 where you will likely to increase Retries, you will also like to increase the number of connections for the HTTP client** + +```shell +spark.sql.catalog.my_catalog.http-client.apache.max-connections=200 Review Comment: This doesn't look like an Iceberg setting from what I can tell. If this is EMR specific, it should not be included here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
