[
https://issues.apache.org/jira/browse/HADOOP-19696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18020922#comment-18020922
]
ASF GitHub Bot commented on HADOOP-19696:
-----------------------------------------
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303139199
by contrast: 3.4.2
```
total 98048
-rw-r--r--@ 1 stevel staff 3448 Aug 7 12:16
animal-sniffer-annotations-1.17.jar
-rw-r--r--@ 1 stevel staff 20891 Aug 7 12:16
audience-annotations-0.12.0.jar
-rw-r--r--@ 1 stevel staff 651391 Aug 7 12:16 avro-1.11.4.jar
-rw-r--r--@ 1 stevel staff 8324412 Aug 7 12:15 bcprov-jdk18on-1.78.1.jar
-rw-r--r--@ 1 stevel staff 193322 Aug 7 12:16 checker-qual-2.5.2.jar
-rw-r--r--@ 1 stevel staff 75479 Aug 7 12:16 commons-cli-1.9.0.jar
-rw-r--r--@ 1 stevel staff 353793 Aug 7 12:16 commons-codec-1.15.jar
-rw-r--r--@ 1 stevel staff 751914 Aug 7 12:16
commons-collections4-4.4.jar
-rw-r--r--@ 1 stevel staff 1079377 Aug 7 12:16 commons-compress-1.26.1.jar
-rw-r--r--@ 1 stevel staff 657516 Aug 7 12:16
commons-configuration2-2.10.1.jar
-rw-r--r--@ 1 stevel staff 24239 Aug 7 12:16 commons-daemon-1.0.13.jar
-rw-r--r--@ 1 stevel staff 508826 Aug 7 12:16 commons-io-2.16.1.jar
-rw-r--r--@ 1 stevel staff 673587 Aug 7 12:16 commons-lang3-3.17.0.jar
-rw-r--r--@ 1 stevel staff 70816 Aug 7 12:16 commons-logging-1.3.0.jar
-rw-r--r--@ 1 stevel staff 2213560 Aug 7 12:16 commons-math3-3.6.1.jar
-rw-r--r--@ 1 stevel staff 316431 Aug 7 12:16 commons-net-3.9.0.jar
-rw-r--r--@ 1 stevel staff 238400 Aug 7 12:16 commons-text-1.10.0.jar
-rw-r--r--@ 1 stevel staff 2983237 Aug 7 12:16 curator-client-5.2.0.jar
-rw-r--r--@ 1 stevel staff 336384 Aug 7 12:16 curator-framework-5.2.0.jar
-rw-r--r--@ 1 stevel staff 315569 Aug 7 12:16 curator-recipes-5.2.0.jar
-rw-r--r--@ 1 stevel staff 583996 Aug 7 12:16 dnsjava-3.6.1.jar
-rw-r--r--@ 1 stevel staff 3727 Aug 7 12:16 failureaccess-1.0.jar
-rw-r--r--@ 1 stevel staff 249277 Aug 7 12:16 gson-2.9.0.jar
-rw-r--r--@ 1 stevel staff 2747878 Aug 7 12:16 guava-27.0-jre.jar
-rw-r--r--@ 1 stevel staff 25517 Aug 7 12:16
hadoop-annotations-3.4.2.jar
-rw-r--r--@ 1 stevel staff 110106 Aug 7 12:16 hadoop-auth-3.4.2.jar
-rw-r--r--@ 1 stevel staff 810477 Aug 7 12:39 hadoop-azure-3.4.2.jar
-rw-r--r--@ 1 stevel staff 3519516 Aug 7 12:16
hadoop-shaded-guava-1.4.0.jar
-rw-r--r--@ 1 stevel staff 1952967 Aug 7 12:16
hadoop-shaded-protobuf_3_25-1.4.0.jar
-rw-r--r--@ 1 stevel staff 780321 Aug 7 12:16 httpclient-4.5.13.jar
-rw-r--r--@ 1 stevel staff 328593 Aug 7 12:16 httpcore-4.4.13.jar
-rw-r--r--@ 1 stevel staff 8782 Aug 7 12:16 j2objc-annotations-1.1.jar
-rw-r--r--@ 1 stevel staff 75705 Aug 7 12:16
jackson-annotations-2.12.7.jar
-rw-r--r--@ 1 stevel staff 365538 Aug 7 12:16 jackson-core-2.12.7.jar
-rw-r--r--@ 1 stevel staff 1512418 Aug 7 12:16
jackson-databind-2.12.7.1.jar
-rw-r--r--@ 1 stevel staff 44399 Aug 7 12:16
jakarta.activation-api-1.2.1.jar
-rw-r--r--@ 1 stevel staff 95806 Aug 7 12:16 javax.servlet-api-3.1.0.jar
-rw-r--r--@ 1 stevel staff 102244 Aug 7 12:16 jaxb-api-2.2.11.jar
-rw-r--r--@ 1 stevel staff 890168 Aug 7 12:16 jaxb-impl-2.2.3-1.jar
-rw-r--r--@ 1 stevel staff 4722 Aug 7 12:16 jcip-annotations-1.0-1.jar
-rw-r--r--@ 1 stevel staff 436731 Aug 7 12:16 jersey-core-1.19.4.jar
-rw-r--r--@ 1 stevel staff 158890 Aug 7 12:16 jersey-json-1.22.0.jar
-rw-r--r--@ 1 stevel staff 705276 Aug 7 12:16 jersey-server-1.19.4.jar
-rw-r--r--@ 1 stevel staff 128990 Aug 7 12:16 jersey-servlet-1.19.4.jar
-rw-r--r--@ 1 stevel staff 90184 Aug 7 12:16 jettison-1.5.4.jar
-rw-r--r--@ 1 stevel staff 249911 Aug 7 12:16
jetty-http-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 183011 Aug 7 12:16
jetty-io-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 118496 Aug 7 12:16
jetty-security-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 739348 Aug 7 12:16
jetty-server-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 146064 Aug 7 12:16
jetty-servlet-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 588962 Aug 7 12:16
jetty-util-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 66643 Aug 7 12:16
jetty-util-ajax-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 140308 Aug 7 12:16
jetty-webapp-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 68894 Aug 7 12:16
jetty-xml-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 282591 Aug 7 12:16 jsch-0.1.55.jar
-rw-r--r--@ 1 stevel staff 100636 Aug 7 12:15 jsp-api-2.1.jar
-rw-r--r--@ 1 stevel staff 19936 Aug 7 12:16 jsr305-3.0.2.jar
-rw-r--r--@ 1 stevel staff 46367 Aug 7 12:16 jsr311-api-1.1.1.jar
-rw-r--r--@ 1 stevel staff 4519 Aug 7 12:16 jul-to-slf4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 223129 Aug 7 12:16 kerb-core-2.0.3.jar
-rw-r--r--@ 1 stevel staff 115065 Aug 7 12:16 kerb-crypto-2.0.3.jar
-rw-r--r--@ 1 stevel staff 36361 Aug 7 12:16 kerb-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 100095 Aug 7 12:16 kerby-asn1-2.0.3.jar
-rw-r--r--@ 1 stevel staff 30190 Aug 7 12:16 kerby-config-2.0.3.jar
-rw-r--r--@ 1 stevel staff 200581 Aug 7 12:16 kerby-pkix-2.0.3.jar
-rw-r--r--@ 1 stevel staff 40787 Aug 7 12:16 kerby-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 2199 Aug 7 12:16
listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r--@ 1 stevel staff 136314 Aug 7 12:16 metrics-core-3.2.4.jar
-rw-r--r--@ 1 stevel staff 4554 Aug 7 12:15 netty-all-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 339045 Aug 7 12:16
netty-buffer-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 355199 Aug 7 12:16
netty-codec-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 67192 Aug 7 12:15
netty-codec-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37789 Aug 7 12:15
netty-codec-haproxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 674362 Aug 7 12:15
netty-codec-http-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 490985 Aug 7 12:15
netty-codec-http2-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 44736 Aug 7 12:15
netty-codec-memcache-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 113699 Aug 7 12:15
netty-codec-mqtt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 46015 Aug 7 12:15
netty-codec-redis-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 21344 Aug 7 12:15
netty-codec-smtp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 121032 Aug 7 12:15
netty-codec-socks-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 34636 Aug 7 12:15
netty-codec-stomp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19823 Aug 7 12:15
netty-codec-xml-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 719225 Aug 7 12:16
netty-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 580162 Aug 7 12:16
netty-handler-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25650 Aug 7 12:15
netty-handler-proxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 26833 Aug 7 12:15
netty-handler-ssl-ocsp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37842 Aug 7 12:16
netty-resolver-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 188360 Aug 7 12:15
netty-resolver-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 9145 Aug 7 12:15
netty-resolver-dns-classes-macos-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19825 Aug 7 12:15
netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 19629 Aug 7 12:15
netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 521428 Aug 7 12:16
netty-transport-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 147621 Aug 7 12:16
netty-transport-classes-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 108558 Aug 7 12:15
netty-transport-classes-kqueue-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 42321 Aug 7 12:15
netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
-rw-r--r--@ 1 stevel staff 36594 Aug 7 12:15
netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
-rw-r--r--@ 1 stevel staff 40644 Aug 7 12:15
netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
-rw-r--r--@ 1 stevel staff 6193 Aug 7 12:16
netty-transport-native-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25741 Aug 7 12:15
netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 25170 Aug 7 12:15
netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 44157 Aug 7 12:16
netty-transport-native-unix-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 18241 Aug 7 12:15
netty-transport-rxtx-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 50814 Aug 7 12:15
netty-transport-sctp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 32189 Aug 7 12:15
netty-transport-udt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 779369 Aug 7 12:16 nimbus-jose-jwt-9.37.2.jar
-rw-r--r--@ 1 stevel staff 128414 Aug 7 12:16 re2j-1.1.jar
-rw-r--r--@ 1 stevel staff 332398 Aug 7 12:16 reload4j-1.2.22.jar
-rw-r--r--@ 1 stevel staff 41125 Aug 7 12:15 slf4j-api-1.7.36.jar
-rw-r--r--@ 1 stevel staff 9824 Aug 7 12:15 slf4j-reload4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 2112099 Aug 7 12:16 snappy-java-1.1.10.4.jar
-rw-r--r--@ 1 stevel staff 195909 Aug 7 12:16 stax2-api-4.2.1.jar
-rw-r--r--@ 1 stevel staff 522679 Aug 7 12:16 woodstox-core-5.4.0.jar
-rw-r--r--@ 1 stevel staff 1323991 Aug 7 12:16 zookeeper-3.8.4.jar
-rw-r--r--@ 1 stevel staff 254932 Aug 7 12:16 zookeeper-jute-3.8.4.jar
```
> hadoop binary distribution to move cloud connectors to hadoop common/lib
> ------------------------------------------------------------------------
>
> Key: HADOOP-19696
> URL: https://issues.apache.org/jira/browse/HADOOP-19696
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure, fs/gcs, fs/huawei, fs/s3
> Affects Versions: 3.4.2
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> Place all the cloud connector hadoop-* artifacts and dependencies into
> hadoop/common/lib so that the stores can be directly accessed.
> * filesystem operations against abfs, s3a, gcs, etc don't need any effort
> setting things up.
> * Releases without the aws bundle.jar can be trivially updated by adding any
> version of the sdk libraries to the common/lib dir.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
