kevinjqliu commented on issue #1546: URL: https://github.com/apache/iceberg-python/issues/1546#issuecomment-2628249397
> The issue on botocore was closed because there are apparently params you can pass to turn off the new signing stuff. But I'm not sure how we can apply those flags here given botocore is so many layers deep. we pass [configs down to s3fs](https://github.com/apache/iceberg-python/blob/37916c46f795588b4df7ca4546b7039f1b5c36a4/pyiceberg/io/fsspec.py#L124-L133), i think it would be useful to allow passing arbitrary configs to s3fa so that we dont need to explicit define all of [s3fs S3FileSystem args](https://s3fs.readthedocs.io/en/latest/api.html#s3fs.core.S3FileSystem) @ryanovas do you know if that option is available in s3fs yet? i couldnt find a match -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
