AwasthiSomesh commented on issue #10078: URL: https://github.com/apache/iceberg/issues/10078#issuecomment-2035029132
@nastra Even I see we are getting error for region unable to load. Error:- Exception in thread "main" software.amazon.awssdk.core.exception.SdkClientException: Unable to load region from any of the providers in the chain software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@610fbe1c: [software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@53cb0bcb: Unable to load region from system settings. Region must be specified either via environment variable (AWS_REGION) or system property (aws.region)., software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@41f964f9: No region provided in profile: default, software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@11399548: Unable to contact EC2 metadata service.] **After adding region via - System.setProperty("aws.region", "us-west-2");** we are getting error for credentials load like below Unable to load credentials from any of the providers in the chain AwsCredentialsProviderChain(credentialsProviders=[SystemPropertyCredentialsProvider(), EnvironmentVariableCredentialsProvider(), WebIdentityTokenCredentialsProvider(), After adding all properties via System.setProperty() like below everything is working fine. System.setProperty("aws.region", "us-west-2"); System.setProperty("aws.accessKeyId", "xxxxxxxxxxxxxxxxxxxxxxx") System.setProperty("aws.secretAccessKey", "XXXXXXXXXXXXXXXXXXXXXXXXx") **But we need to honor it via spark config property only because System.setProperty() is not in my use case.** Could you please help here . Thanks, Somesh -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org