gruuya opened a new issue, #2069: URL: https://github.com/apache/iceberg-python/issues/2069
### Feature Request / Improvement I've noticed that `boto3` opens a new connection on each client call with `rest.sigv4-enabled` set to `true`, which is wasteful. This happens because a `boto3` session is instantiated inside the adapter's `add_headers` hook (which in turn is called for each HTTP call) https://github.com/apache/iceberg-python/blob/a67c5592f3243d255519581fedfcc5d93274b9c8/pyiceberg/catalog/rest/__init__.py#L394-L398 The `boto3` session should be re-used throughout the lifetime of the catalog, like the `requests` session, module any creds expiration/invalidation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
