This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new bef7c0f [SPARK-29790][DOC] Note required port for Kube API
bef7c0f is described below
commit bef7c0fddbddf1cc9d22b3ea60153b7e1bf8809d
Author: Emil Sandstø <emilale...@hotmail.com>
AuthorDate: Fri Nov 8 09:32:29 2019 -0800
[SPARK-29790][DOC] Note required port for Kube API
It adds a note about the required port of a master url in Kubernetes.
Currently a port needs to be specified for the Kubernetes API. Also in case
the API is hosted on the HTTPS port. Else the driver might fail with
https://medium.com/kidane.weldemariam_75349/thanks-james-on-issuing-spark-submit-i-run-into-this-error-cc507d4f8f0d
Yes, a change to the "Running on Kubernetes" guide.
None - Documentation change
Closes #26426 from Tapped/patch-1.
Authored-by: Emil Sandstø <emilale...@hotmail.com>
Signed-off-by: Marcelo Vanzin <van...@cloudera.com>
(cherry picked from commit 0bdadba5e3810f8e3f5da13e2a598071cbadab94)
Signed-off-by: Marcelo Vanzin <van...@cloudera.com>
---
docs/running-on-kubernetes.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index 0277043..037e1d5 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -103,7 +103,7 @@ $ bin/spark-submit \
```
The Spark master, specified either via passing the `--master` command line
argument to `spark-submit` or by setting
-`spark.master` in the application's configuration, must be a URL with the
format `k8s://<api_server_url>`. Prefixing the
+`spark.master` in the application's configuration, must be a URL with the
format `k8s://<api_server_host>:<k8s-apiserver-port>`. The port must always be
specified, even if it's the HTTPS port 443. Prefixing the
master string with `k8s://` will cause the Spark application to launch on the
Kubernetes cluster, with the API server
being contacted at `api_server_url`. If no HTTP protocol is specified in the
URL, it defaults to `https`. For example,
setting the master to `k8s://example.com:443` is equivalent to setting it to
`k8s://https://example.com:443`, but to
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
