[ 
https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016675#comment-18016675
 ] 

ASF GitHub Bot commented on HADOOP-19343:
-----------------------------------------

slfan1989 commented on PR #7904:
URL: https://github.com/apache/hadoop/pull/7904#issuecomment-3231622019

   > Hi @slfan1989 . @pan3793 is correct. All of the hadoop-gcp code itself is 
using the hadoop-thirdparty shaded Guava:
   > 
   > 
https://github.com/apache/hadoop/blob/HADOOP-19343/hadoop-tools/hadoop-gcp/src/main/java/org/apache/hadoop/fs/gs/GoogleCloudStorageFileSystem.java#L21
   > 
   > The specific issue here is about the Guava used by the GCS SDK. We don't 
have a way to rewire its imports to point at our third-party. Also, we've seen 
historically that the GCS SDK can be particular about the version of Guava it 
uses. Historically, the original codebase from the [Google 
repo](https://github.com/GoogleCloudDataproc/hadoop-connectors/) has shaded 
this to guarantee a matching version and also isolate Hadoop clients from 
unexpected changes in the Guava version.
   
   @cnauroth Thank you for the clarification! I have no further questions about 
this PR. I'm curious why the Hadoop main project hasn't upgraded the Guava 
version. It seems 27.0-jre is from 2018.




> Add native support for GCS connector
> ------------------------------------
>
>                 Key: HADOOP-19343
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19343
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 3.5.0
>            Reporter: Abhishek Modi
>            Assignee: Arunkumar Chacko
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: GCS connector for Hadoop.pdf, Google Cloud Storage 
> connector for Hadoop-1.pdf, Google Cloud Storage connector for Hadoop.pdf, 
> Google Cloud Storage connector for Hadoop.v1.pdf, Google Cloud Storage 
> connector for Hadoop_v1.pdf
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to