jayceslesar opened a new issue, #38013:
URL: https://github.com/apache/arrow/issues/38013
### Describe the bug, including details regarding any error messages,
version, and platform.
My org recently switched to using aws sso to configure all of our access and
when making the swap, we noticed that we are no longer able to write to S3 when
using these types of credentials. When explicitly setting the
`AWS_SECRET_ACCESS_KEY` and `AWS_ACCESS_KEY_ID` with previous IAM User
accounts, the problem does not exist. For reference, once authenticating with
`aws sso login` and attempting to write some data, I am thrown the following
error:
```
File "pyarrow/_dataset.pyx", line 3844, in
pyarrow._dataset._filesystemdataset_write
File "pyarrow/error.pxi", line 115, in pyarrow.lib.check_status
OSError: When testing for existence of bucket 'my-s3-bucket': AWS Error
ACCESS_DENIED during HeadBucket operation: No response body.
```
### Component(s)
Parquet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
