[
https://issues.apache.org/jira/browse/HADOOP-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15936407#comment-15936407
]
Allen Wittenauer commented on HADOOP-10738:
-------------------------------------------
bq. we need to provide a way to set parameters for distcp
I agree that there needs to be a way to set parameters for distcp, which is why
this is considered fixed in trunk. It was short-sighted for someone to
hard-code that params in 2.x, but what's done is done.
Pushing that aside, I'm still waiting for answers to:
* How do end users override the distcp-site.xml file with this patch? Aren't we
right back where we started, especially since this is getting added as a
Resource?
* Why does distcp get special treatment when we only offer command line ways
for other tools?
* Instead of setting mapreduce.\*.memory.mb, etc, why doesn't distcp provide
*different* config knobs which set those parameters if we want to hide the fact
that distcp is nothing more than a MR job?
> Dynamically adjust distcp configuration by adding distcp-site.xml into code
> base
> --------------------------------------------------------------------------------
>
> Key: HADOOP-10738
> URL: https://issues.apache.org/jira/browse/HADOOP-10738
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: Siqi Li
> Labels: BB2015-05-TBR
> Attachments: HADOOP-10738-branch-2.001.patch, HADOOP-10738.v1.patch,
> HADOOP-10738.v2.patch
>
>
> For now, the configuration of distcp resides in hadoop-distcp.jar. This makes
> it difficult to adjust the configuration dynamically.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
