SanjayMarreddi commented on PR #12299: URL: https://github.com/apache/iceberg/pull/12299#issuecomment-2839660314
> Hi, One question that I have here, are we supporting the configs of the underlying client? For S3 tables this was useful: > > `--conf spark.sql.catalog.my_catalog.http-client.apache.max-connections=5` > > Looking at this... > > https://github.com/awslabs/analytics-accelerator-s3/blob/main/doc/CONFIGURATION.md > > Thanks Hey, thanks for reaching out. As of now, when we create the async client that's used with `analytics-accelerator-s3`, we are not applying the [HttpClientProperties](https://github.com/apache/iceberg/blob/main/aws/src/main/java/org/apache/iceberg/aws/HttpClientProperties.java#L161). So the http related configs of the underlying client won't be picked up. We plan to work on it. Meanwhile, would you mind creating an opensource issue here on the codebase - so I can discuss with team. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
