[
https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024316#comment-18024316
]
ASF GitHub Bot commented on HADOOP-19282:
-----------------------------------------
LDVSOFT opened a new pull request, #8008:
URL: https://github.com/apache/hadoop/pull/8008
> This is a cherry-pick from _trunk_ MR #7966 to _branch-3.4_
### Description of PR
`URIBuilder` was used from the AWS SDK for Java v2, to be precise from the
shaded Apache HTTP Client. It is a problem if a user would like not to use the
AWS SDK bundle, since more or less only 3 modules are needed (s3, s3-transfer &
sts), but that may cause problems on unshaded dependency versions. Since a URI
constructor can achieve the same here I switched it as a preferred option.
### How was this patch tested?
I've run [the test
suite](https://hadoop.apache.org/docs/r3.4.2/hadoop-aws/tools/hadoop-aws/testing.html)
against a _eu-west-1_ bucket, without scaling/load since the change shouldn't
affect that. To be exact, with something like this:
<details>
<summary><code class="notranslate">auth-keys.xml</code></summary>
<configuration>
<property>
<name>test.fs.s3a.name</name>
<value>s3a://hadoop-test-bucket-20250321181757964400000002/</value>
</property>
<property>
<name>fs.contract.test.fs.s3a</name>
<value>${test.fs.s3a.name}</value>
</property>
<property>
<name>fs.s3a.access.key</name>
<description>AWS access key ID. Omit for IAM role-based
authentication.</description>
<value>AKIA27OSP7CBZF3MKEMA</value>
</property>
<property>
<name>fs.s3a.secret.key</name>
<description>AWS secret key. Omit for IAM role-based
authentication.</description>
<value>I5ZsoLfzSjXrSTFzrJ73eqWRamZzlIVqXEUUrqgW</value>
</property>
<property>
<name>fs.s3a.assumed.role.sts.endpoint.region</name>
<value>eu-west-1</value>
</property>
<property>
<name>fs.s3a.assumed.role.sts.endpoint</name>
<value>${test.sts.endpoint}</value>
</property>
<property>
<name>test.sts.endpoint</name>
<description>Specific endpoint to use for STS requests.</description>
<value>sts.eu-west-1.amazonaws.com</value>
</property>
<property>
<name>fs.s3a.endpoint.region</name>
<value>eu-west-1</value>
</property>
<!
> S3A: STSClientFactory has hard-coded dependency on shaded HttpClient
> --------------------------------------------------------------------
>
> Key: HADOOP-19282
> URL: https://issues.apache.org/jira/browse/HADOOP-19282
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.2
> Reporter: melin
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.0
>
>
> hadoop-aws directly depends on aws-java-sdk-bundle, and the size of
> aws-java-sdk-bundle is too large.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
