Repository: spark Updated Branches: refs/heads/branch-2.0 5024c4cb8 -> 50d7002b6
[SPARK-11857][MESOS] Deprecate fine grained ## What changes were proposed in this pull request? Documentation changes to indicate that fine-grained mode is now deprecated. No code changes were made, and all fine-grained mode instructions were left in place. We can remove all of that once the deprecation cycle completes (Does Spark have a standard deprecation cycle? One major version?) Blocked on https://github.com/apache/spark/pull/14059 ## How was this patch tested? Viewed in Github Author: Michael Gummelt <[email protected]> Closes #14078 from mgummelt/deprecate-fine-grained. (cherry picked from commit b1db26acc51003e68e4e8d7d324cf74e3aa03cfd) Signed-off-by: Reynold Xin <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/50d7002b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/50d7002b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/50d7002b Branch: refs/heads/branch-2.0 Commit: 50d7002b6aa95bad2a89f771f02e629ca7fc524f Parents: 5024c4c Author: Michael Gummelt <[email protected]> Authored: Fri Jul 8 20:20:26 2016 -0700 Committer: Reynold Xin <[email protected]> Committed: Fri Jul 8 20:20:48 2016 -0700 ---------------------------------------------------------------------- docs/running-on-mesos.md | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/50d7002b/docs/running-on-mesos.md ---------------------------------------------------------------------- diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 8ab5f30..5219e99 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -181,7 +181,7 @@ Note that jars or python files that are passed to spark-submit should be URIs re # Mesos Run Modes Spark can run over Mesos in two modes: "coarse-grained" (default) and -"fine-grained". +"fine-grained" (deprecated). ## Coarse-Grained @@ -213,7 +213,12 @@ the application. To configure your job to dynamically adjust to its resource requirements, look into [Dynamic Allocation](#dynamic-resource-allocation-with-mesos). -## Fine-Grained +## Fine-Grained (deprecated) + +**NOTE:** Fine-grained mode is deprecated as of Spark 2.0.0. Consider + using [Dynamic Allocation](#dynamic-resource-allocation-with-mesos) + for some of the benefits. For a full explanation see + [SPARK-11857](https://issues.apache.org/jira/browse/SPARK-11857) In "fine-grained" mode, each Spark task inside the Spark executor runs as a separate Mesos task. This allows multiple instances of Spark (and --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
