adnanhemani opened a new pull request, #9385: URL: https://github.com/apache/iceberg/pull/9385
This PR allows us to add support for S3 Access Grants (S3AG) to S3FileIO through adding a new SDK Plugin (https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/services/kafkaconnect/model/Plugin.html) for S3 Access Grants (https://github.com/aws/aws-s3-accessgrants-plugin-java-v2). We are only adding the S3 Access Grants Plugin (which is available publicly on Maven) to the S3 Client Factory if the users enable S3AG on the catalog. The additional options added in this CR mirror EMR's options for enabling S3AG support on EMR: https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-access-grants.html#emr-access-grants-launch-ec2. The only difference in experience between Iceberg and EMR (in general) is the fact that S3AG must be enabled individually per Iceberg catalog. This is as a result of a lack of infrastructure in Iceberg to allow user configurations across catalogs for AWS Client level configurations. We are not aiming to re-architect Iceberg for this change - we only want to add support through whatever existing mechanisms already exist. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
