[
https://issues.apache.org/jira/browse/HADOOP-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899564#comment-13899564
]
Sandy Ryza commented on HADOOP-10339:
-------------------------------------
Have you experienced issues with this? My understanding is that the map sort
buffer isn't allocated at all for map-only jobs.
> Set io.sort.mb to 10 for distcp jobs
> ------------------------------------
>
> Key: HADOOP-10339
> URL: https://issues.apache.org/jira/browse/HADOOP-10339
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Siqi Li
> Attachments: HADOOP-10339.v1.patch
>
>
> For distcp we don't emit anything, it's a map-only job with no output (just
> side-effects).
> In that case we can set io.sort.mb to 10.
> This way we don't waste the default memory in a buffer that is not needed.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
