This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 99c96f2 [SPARK-53740] Update `(pi|spark-history-server)-preview.yaml`
to use `4.1.0-preview2`
99c96f2 is described below
commit 99c96f29851970be89f37518deeb8c1974d8b98f
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon Sep 29 12:37:25 2025 -0700
[SPARK-53740] Update `(pi|spark-history-server)-preview.yaml` to use
`4.1.0-preview2`
### What changes were proposed in this pull request?
This PR aims to update two examples to use `4.1.0-preview2`.
- `pi-preview.yaml`
- `spark-history-server-preview.yaml`
### Why are the changes needed?
To help the users access the latest preview version features more easily.
### Does this PR introduce _any_ user-facing change?
No behavior change because this is an example update.
### How was this patch tested?
Manually.
Since 4.1.0-preview2 image is not published yet, I built the image locally
and used it.
```
$ ./bin/docker-image-tool.sh -r docker.io/apache -t
4.1.0-preview2-java21-scala build
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #354 from dongjoon-hyun/SPARK-53740.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
examples/pi-preview.yaml | 4 ++--
examples/spark-history-server-preview.yaml | 6 +++---
2 files changed, 5 insertions(+), 5 deletions(-)
diff --git a/examples/pi-preview.yaml b/examples/pi-preview.yaml
index 16a2f8e..24fcded 100644
--- a/examples/pi-preview.yaml
+++ b/examples/pi-preview.yaml
@@ -24,8 +24,8 @@ spec:
spark.dynamicAllocation.shuffleTracking.enabled: "true"
spark.dynamicAllocation.maxExecutors: "3"
spark.kubernetes.authenticate.driver.serviceAccountName: "spark"
- spark.kubernetes.container.image:
"apache/spark:4.1.0-preview1-java21-scala"
+ spark.kubernetes.container.image:
"apache/spark:4.1.0-preview2-java21-scala"
applicationTolerations:
resourceRetainPolicy: OnFailure
runtimeVersions:
- sparkVersion: "4.1.0-preview1"
+ sparkVersion: "4.1.0-preview2"
diff --git a/examples/spark-history-server-preview.yaml
b/examples/spark-history-server-preview.yaml
index 73892b6..08f6503 100644
--- a/examples/spark-history-server-preview.yaml
+++ b/examples/spark-history-server-preview.yaml
@@ -19,11 +19,11 @@ metadata:
spec:
mainClass: "org.apache.spark.deploy.history.HistoryServer"
sparkConf:
- spark.jars.packages: "org.apache.hadoop:hadoop-aws:3.4.1"
+ spark.jars.packages: "org.apache.hadoop:hadoop-aws:3.4.2"
spark.jars.ivy: "/tmp/.ivy2.5.2"
spark.driver.memory: "2g"
spark.kubernetes.authenticate.driver.serviceAccountName: "spark"
- spark.kubernetes.container.image:
"apache/spark:4.1.0-preview1-java21-scala"
+ spark.kubernetes.container.image:
"apache/spark:4.1.0-preview2-java21-scala"
spark.ui.port: "18080"
spark.history.fs.logDirectory: "s3a://spark-events"
spark.history.fs.cleaner.enabled: "true"
@@ -36,7 +36,7 @@ spec:
spark.hadoop.fs.s3a.access.key: "test"
spark.hadoop.fs.s3a.secret.key: "test"
runtimeVersions:
- sparkVersion: "4.1.0-preview1"
+ sparkVersion: "4.1.0-preview2"
applicationTolerations:
restartConfig:
restartPolicy: Always
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
