[
https://issues.apache.org/jira/browse/MAPREDUCE-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yan updated MAPREDUCE-7276:
--------------------------------
Description:
When running a hive job with HFDS disk quota specified, and enable the fast
fail feature to fast fail a job when hdfs disk quota limitation is exceeded
(mapreduce.job.dfs.storage.capacity.kill-limit-exceed=true), the job does not
fail fast when one task attempt fails due to the quota limitation. This seems
to be a bug : TaskAttemptImpl does not handle fast fail at all in the
FAILED_FINISHING_TRANSITION event.
was:
When running a hive job with HFDS disk quota specified, and enable the fast
fail feature to fast fail a job when hdfs disk quota limitation is exceeded
(mapreduce.job.dfs.storage.capacity.kill-limit-exceed=true), the job is
expected to fail fast when one task attempt fails due to the quota limitation.
But I confirmed that the fast fail feature is not working. This seems to be a
bug : TaskAttemptImpl does not handle fast fail at all in the
FAILED_FINISHING_TRANSITION event.
> hadoop job fast fail is not working properly
> ---------------------------------------------
>
> Key: MAPREDUCE-7276
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7276
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster
> Affects Versions: 3.2.0, 2.9.2
> Environment: hadoop 2.9.2, hive 2.3.2 and hive 0.13
> Reporter: Wang Yan
> Priority: Minor
> Attachments: MAPREDUCE-7276.001.patch
>
>
> When running a hive job with HFDS disk quota specified, and enable the fast
> fail feature to fast fail a job when hdfs disk quota limitation is exceeded
> (mapreduce.job.dfs.storage.capacity.kill-limit-exceed=true), the job does not
> fail fast when one task attempt fails due to the quota limitation. This seems
> to be a bug : TaskAttemptImpl does not handle fast fail at all in the
> FAILED_FINISHING_TRANSITION event.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
