Repository: spark Updated Branches: refs/heads/master b86db517b -> f6e7302cb
Improve scheduler delay tooltip. As a result of shivaram's experience debugging long scheduler delay, I think we should improve the tooltip to point people in the right direction if scheduler delay is large. Author: Kay Ousterhout <[email protected]> Closes #1488 from kayousterhout/better_tooltips and squashes the following commits: 22176fd [Kay Ousterhout] Improve scheduler delay tooltip. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f6e7302c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f6e7302c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f6e7302c Branch: refs/heads/master Commit: f6e7302cb49ee227aed537026d19f68528051dfd Parents: b86db51 Author: Kay Ousterhout <[email protected]> Authored: Sun Jul 20 20:18:18 2014 -0700 Committer: Kay Ousterhout <[email protected]> Committed: Sun Jul 20 20:18:18 2014 -0700 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/ui/ToolTips.scala | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/f6e7302c/core/src/main/scala/org/apache/spark/ui/ToolTips.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/ui/ToolTips.scala b/core/src/main/scala/org/apache/spark/ui/ToolTips.scala index 37708d7..9ced9b8 100644 --- a/core/src/main/scala/org/apache/spark/ui/ToolTips.scala +++ b/core/src/main/scala/org/apache/spark/ui/ToolTips.scala @@ -20,9 +20,9 @@ package org.apache.spark.ui private[spark] object ToolTips { val SCHEDULER_DELAY = """Scheduler delay includes time to ship the task from the scheduler to - the executor, and time the time to send a message from the executor to the scheduler stating - that the task has completed. When the scheduler becomes overloaded, task completion messages - become queued up, and scheduler delay increases.""" + the executor, and time to send the task result from the executor to the scheduler. If + scheduler delay is large, consider decreasing the size of tasks or decreasing the size + of task results.""" val INPUT = "Bytes read from Hadoop or from Spark storage."
