[
https://issues.apache.org/jira/browse/HADOOP-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16044995#comment-16044995
]
Karthik Kambatla commented on HADOOP-14284:
-------------------------------------------
I agree with [~vinodkv] on shading only the YARN/MR client modules.
For YARN, that is yarn-common, yarn-client, and yarn-api modules. For MR, that
should be mapreduce-client-* modules. We probably don't need to shade
hadoop-mapreduce-client-hs and hadoop-mapreduce-client-hs-plugins jars though,
as they are for the HistoryServer and have no @Stable APIs.
In cases where devs extend YARN classes like the SchedulingPolicy in
FairScheduler or implement their own scheduler, the dev will be responsible for
ensuring they don't use guava or use it with a version that is consistent with
what Hadoop uses. I expect these devs to be sophisticated enough to figure this
out. That said, we should probably still call out cases like these in the
compatibility guide. /cc [~templedf]
> Shade Guava everywhere
> ----------------------
>
> Key: HADOOP-14284
> URL: https://issues.apache.org/jira/browse/HADOOP-14284
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
> Affects Versions: 3.0.0-alpha4
> Reporter: Andrew Wang
> Assignee: Tsuyoshi Ozawa
> Priority: Blocker
> Attachments: HADOOP-14238.pre001.patch, HADOOP-14284.002.patch,
> HADOOP-14284.004.patch, HADOOP-14284.007.patch, HADOOP-14284.010.patch,
> HADOOP-14284.012.patch
>
>
> HADOOP-10101 upgraded the guava version for 3.x to 21.
> Guava is broadly used by Java projects that consume our artifacts.
> Unfortunately, these projects also consume our private artifacts like
> {{hadoop-hdfs}}. They also are unlikely on the new shaded client introduced
> by HADOOP-11804, currently only available in 3.0.0-alpha2.
> We should shade Guava everywhere to proactively avoid breaking downstreams.
> This isn't a requirement for all dependency upgrades, but it's necessary for
> known-bad dependencies like Guava.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
