Repository: spark Updated Branches: refs/heads/master ecad9d434 -> c0b7df68f
[SPARK-9366] use task's stageAttemptId in TaskEnd event Author: Ryan Williams <[email protected]> Closes #7681 from ryan-williams/task-stage-attempt and squashes the following commits: d6d5f0f [Ryan Williams] use task's stageAttemptId in TaskEnd event Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c0b7df68 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c0b7df68 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c0b7df68 Branch: refs/heads/master Commit: c0b7df68f81c2a2a9c1065009fe75c278fa30499 Parents: ecad9d4 Author: Ryan Williams <[email protected]> Authored: Mon Jul 27 12:54:08 2015 -0500 Committer: Imran Rashid <[email protected]> Committed: Mon Jul 27 12:54:08 2015 -0500 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/c0b7df68/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala index 552dabc..b6a833b 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala @@ -927,7 +927,7 @@ class DAGScheduler( // The success case is dealt with separately below, since we need to compute accumulator // updates before posting. if (event.reason != Success) { - val attemptId = stageIdToStage.get(task.stageId).map(_.latestInfo.attemptId).getOrElse(-1) + val attemptId = task.stageAttemptId listenerBus.post(SparkListenerTaskEnd(stageId, attemptId, taskType, event.reason, event.taskInfo, event.taskMetrics)) } --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
