[
https://issues.apache.org/jira/browse/HADOOP-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385256#comment-17385256
]
Vijay Singh commented on HADOOP-17042:
--------------------------------------
Hi *[~tanakahda]*
Getting the same error message:
*ERROR:* Tools helper /usr/hdp/4.1.4.8/hadoop/libexec/tools/hadoop-distcp.sh
was not found.
Using the below configuration:
Azure HDInsight 4.0
Apache Hive (version 3.1.4.4.1.4.8)
Driver: Hive JDBC (version 3.1.4.4.1.4.8)
Beeline version 3.1.4.4.1.4.8
Any resolution for the issue in the existing versions?
> Hadoop distcp throws "ERROR: Tools helper
> ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found"
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-17042
> URL: https://issues.apache.org/jira/browse/HADOOP-17042
> Project: Hadoop Common
> Issue Type: Improvement
> Components: tools/distcp
> Affects Versions: 3.2.1, 3.1.3
> Reporter: Aki Tanaka
> Assignee: Aki Tanaka
> Priority: Minor
> Fix For: 3.2.2, 3.3.1, 3.4.0
>
> Attachments: HADOOP-17042.patch
>
>
> On Hadoop 3.x, we see following "ERROR: Tools helper
> ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found." message on
> the first line of the command output when running Hadoop DistCp.
> {code:java}
> $ hadoop distcp /path/to/src /user/hadoop/
> ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not
> found.
> 2020-05-14 17:11:53,173 INFO tools.DistCp: Input Options:
> DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false,
> ignoreFailures=false, overwrite=false, append=false, useDiff=false,
> useRdiff=false, fromSnapshot=null, toSnapshot=null, skipCRC=false,
> blocking=true
> ..
> {code}
> This message was added by HADOOP-12857 and it would be an expected behavior.
> DistCp calls 'hadoop_add_to_classpath_tools hadoop-distcp' when [it
> starts|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-distcp/src/main/shellprofile.d/hadoop-distcp.sh],
> and the error is returned because the hadoop-distcp.sh does not exist in the
> tools directory.
> However, that error message confuses us. Since this is not an user end
> configuration issue, I would think it's better to change the log level to
> debug (hadoop_debug).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
