[
https://issues.apache.org/jira/browse/HADOOP-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17951494#comment-17951494
]
Chris Nauroth commented on HADOOP-19343:
----------------------------------------
Talking offline with Arun, we've found that the GCS client is often upgrading
some dependencies (notably gRPC) at a much more rapid pace than
[hadoop-thirdparty|https://github.com/apache/hadoop-thirdparty]. I don't think
we can safely make those rapid upgrades for the whole of Hadoop (and downstream
projects). The existing code solves this by shading its own copy of gRPC:
https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v3.1.2/gcs/pom.xml#L241-L323
We're thinking of carrying forward that same shading strategy here.
> Add native support for GCS connector
> ------------------------------------
>
> Key: HADOOP-19343
> URL: https://issues.apache.org/jira/browse/HADOOP-19343
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Affects Versions: 3.5.0
> Reporter: Abhishek Modi
> Assignee: Arunkumar Chacko
> Priority: Major
> Labels: pull-request-available
> Attachments: GCS connector for Hadoop.pdf, Google Cloud Storage
> connector for Hadoop-1.pdf, Google Cloud Storage connector for Hadoop.pdf,
> Google Cloud Storage connector for Hadoop.v1.pdf, Google Cloud Storage
> connector for Hadoop_v1.pdf
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]