Re: [I] PyArrow S3FileSystem doesn't honor the AWS profile config [iceberg-python]

2024-07-19 Thread via GitHub
kevinjqliu commented on issue #570: URL: https://github.com/apache/iceberg-python/issues/570#issuecomment-2240062099 Fixed in #922 Glue and S3 can have separate configs as well as using the same unified config -- This is an automated message from the Apache Git Service. To respond to t

Re: [I] PyArrow S3FileSystem doesn't honor the AWS profile config [iceberg-python]

2024-07-19 Thread via GitHub
kevinjqliu closed issue #570: PyArrow S3FileSystem doesn't honor the AWS profile config URL: https://github.com/apache/iceberg-python/issues/570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] PyArrow S3FileSystem doesn't honor the AWS profile config [iceberg-python]

2024-04-03 Thread via GitHub
kevinjqliu commented on issue #570: URL: https://github.com/apache/iceberg-python/issues/570#issuecomment-2035130535 I think it makes sense to have both a "catalog level" configuration and a "file level" configuration. A catalog might have a different set of permissions from when reading sp

Re: [I] PyArrow S3FileSystem doesn't honor the AWS profile config [iceberg-python]

2024-04-02 Thread via GitHub
HonahX commented on issue #570: URL: https://github.com/apache/iceberg-python/issues/570#issuecomment-2033588669 @geruh, thanks for highlighting this issue. The confusion largely stems from the naming convention used when the `profile_name`, `region_name`, `aws_access_key_id`, etc., were in

[I] PyArrow S3FileSystem doesn't honor the AWS profile config [iceberg-python]

2024-04-02 Thread via GitHub
geruh opened a new issue, #570: URL: https://github.com/apache/iceberg-python/issues/570 ### Apache Iceberg version main (development) ### Please describe the bug 🐞 When initializing the GlueCatalog with a specific AWS profile, everything works as it should with catalog