andygrove opened a new issue, #1583:
URL: https://github.com/apache/datafusion-ballista/issues/1583
**Describe the bug**
The CustomObjectStoreRegistry in ballista/core/src/object_store.rs calls
AmazonS3Builder::from_env() to initialize the S3 builder, which supports the
full AWS credential chain (environment variables, IRSA
web identity tokens, instance profiles, etc.). However, lines 187-201 then
require s3.access_key_id and s3.secret_access_key to be explicitly configured
via SQL SET commands, returning an error if they are
not present:
```
Exception: DataFusion error: ArrowError(ExternalError(Execution("Job sT6fyu9
failed: Error planning job sT6fyu9:
DataFusionError(Configuration(\"'s3.access_key_id' & 's3.secret_access_key'
must be
``` │
**To Reproduce**
**Expected behavior**
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
