[
https://issues.apache.org/jira/browse/HADOOP-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114178#comment-17114178
]
Stephen O'Donnell commented on HADOOP-14698:
--------------------------------------------
I am +1 to commit this after a clean Yetus run. In the last run mvnsite is
failing for some reason. It may be a transient issue, so I have triggered it
again to see.
I also tested uploading about 2000 tiny files in a local docker environment -
running with "-t 4" was about twice as fast as no option. The -t option works
fine with put and copyFromLocal as expected with the patch.
{code}
[root@260fc8ca984c /]# time hadoop fs -put -t 1 small_files /data/small_files20
2020-05-22 15:07:18,672 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
real 1m13.513s
user 0m22.876s
sys 0m18.762s
[root@260fc8ca984c /]# time hadoop fs -put -t 4 small_files /data/small_files21
real 0m37.405s
user 0m27.802s
sys 0m20.987s
[root@260fc8ca984c /]# time hadoop fs -copyFromLocal -t 4 small_files
/data/small_files24
real 0m36.222s
user 0m29.134s
sys 0m21.026s
{code}
> Make copyFromLocal's -t option available for put as well
> --------------------------------------------------------
>
> Key: HADOOP-14698
> URL: https://issues.apache.org/jira/browse/HADOOP-14698
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Andras Bokor
> Assignee: Andras Bokor
> Priority: Major
> Attachments: HADOOP-14698.01.patch, HADOOP-14698.02.patch,
> HADOOP-14698.03.patch, HADOOP-14698.04.patch, HADOOP-14698.05.patch,
> HADOOP-14698.06.patch, HADOOP-14698.07.patch, HADOOP-14698.08.patch,
> HADOOP-14698.09.patch
>
>
> After HDFS-11786 copyFromLocal and put are no longer identical.
> I do not see any reason why not to add the new feature to put as well.
> Being non-identical makes the understanding/usage of command more complicated
> from user point of view.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
