This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 3886442 [SPARK-27963][DOCS][FOLLOWUP] Update requirements for
spark.dynamicAllocation.enabled
3886442 is described below
commit 388644233285bc71e43f7d063da57d22ed35ae23
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon Apr 6 11:04:21 2020 +0900
[SPARK-27963][DOCS][FOLLOWUP] Update requirements for
spark.dynamicAllocation.enabled
### What changes were proposed in this pull request?
This PR fixes the outdated requirement for
`spark.dynamicAllocation.enabled=true`.
### Why are the changes needed?
This is found during 3.0.0 RC1 document review and testing. As described at
`spark.dynamicAllocation.shuffleTracking.enabled` in the same table, we can
enabled Dynamic Allocation without external shuffle service.
### Does this PR introduce any user-facing change?
Yes. (Doc.)
### How was this patch tested?
Manually generate the doc by `SKIP_API=1 jekyll build`
**BEFORE**
**AFTER**
Closes #28132 from dongjoon-hyun/SPARK-DA-DOC.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
---
docs/configuration.md | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/docs/configuration.md b/docs/configuration.md
index 5081d79..b8f2649 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -2456,7 +2456,8 @@ Apart from these, the following properties are also
available, and may be useful
For more detail, see the description
<a href="job-scheduling.html#dynamic-resource-allocation">here</a>.
<br><br>
- This requires <code>spark.shuffle.service.enabled</code> to be set.
+ This requires <code>spark.shuffle.service.enabled</code> or
+ <code>spark.dynamicAllocation.shuffleTracking.enabled</code> to be set.
The following configurations are also relevant:
<code>spark.dynamicAllocation.minExecutors</code>,
<code>spark.dynamicAllocation.maxExecutors</code>, and
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
