This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new bb3d580 [SPARK-54756] Use `4.1.0` instead of `preview` in GitHub
Action CIs
bb3d580 is described below
commit bb3d580affb8c6005f243e9f1d1945fcc2201f54
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Thu Dec 18 08:58:23 2025 -0800
[SPARK-54756] Use `4.1.0` instead of `preview` in GitHub Action CIs
### What changes were proposed in this pull request?
This PR aims to use Apache Spark 4.1.0 instead of `preview` versions in
GitHub Action CIs.
### Why are the changes needed?
Apache Spark 4.1.0 is released officially.
- https://github.com/apache/spark/releases/tag/v4.1.0
- https://spark.apache.org/docs/4.1.0/
- https://dist.apache.org/repos/dist/release/spark/spark-4.1.0/
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #266 from dongjoon-hyun/SPARK-54756.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/build_and_test.yml | 14 +++++++-------
Tests/SparkConnectTests/SQLTests.swift | 6 +++---
2 files changed, 10 insertions(+), 10 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index f567869..9f4c241 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -93,7 +93,7 @@ jobs:
SPARK_REMOTE: "sc://localhost:15003"
services:
spark:
- image: apache/spark:4.1.0-preview4-java21
+ image: apache/spark:4.1.0-scala
env:
SPARK_NO_DAEMONIZE: 1
ports:
@@ -117,9 +117,9 @@ jobs:
run: swift test --filter NOTHING -c release
- name: Test
run: |
- curl -LO
https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0-preview4/spark-4.1.0-preview4-bin-hadoop3.tgz?action=download
- tar xvfz spark-4.1.0-preview4-bin-hadoop3.tgz && rm
spark-4.1.0-preview4-bin-hadoop3.tgz
- mv spark-4.1.0-preview4-bin-hadoop3 /tmp/spark
+ curl -LO
https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0/spark-4.1.0-bin-hadoop3.tgz?action=download
+ tar xvfz spark-4.1.0-bin-hadoop3.tgz && rm spark-4.1.0-bin-hadoop3.tgz
+ mv spark-4.1.0-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh
cd -
@@ -156,9 +156,9 @@ jobs:
run: swift test --filter NOTHING -c release
- name: Test
run: |
- curl -LO
https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0-preview4/spark-4.1.0-preview4-bin-hadoop3.tgz?action=download
- tar xvfz spark-4.1.0-preview4-bin-hadoop3.tgz && rm
spark-4.1.0-preview4-bin-hadoop3.tgz
- mv spark-4.1.0-preview4-bin-hadoop3 /tmp/spark
+ curl -LO
https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0/spark-4.1.0-bin-hadoop3.tgz?action=download
+ tar xvfz spark-4.1.0-bin-hadoop3.tgz && rm spark-4.1.0-bin-hadoop3.tgz
+ mv spark-4.1.0-bin-hadoop3 /tmp/spark
cd /tmp/spark/sbin
./start-connect-server.sh
cd -
diff --git a/Tests/SparkConnectTests/SQLTests.swift
b/Tests/SparkConnectTests/SQLTests.swift
index 45dc07b..ffccd9a 100644
--- a/Tests/SparkConnectTests/SQLTests.swift
+++ b/Tests/SparkConnectTests/SQLTests.swift
@@ -99,7 +99,7 @@ struct SQLTests {
"variant.sql",
]
- let queriesForSpark41Only: [String] = [
+ let queriesForSpark42Only: [String] = [
"time.sql"
]
@@ -114,8 +114,8 @@ struct SQLTests {
print("Skip query \(name) due to the difference between Spark 3 and
4.")
continue
}
- if await !spark.version.starts(with: "4.1") &&
queriesForSpark41Only.contains(name) {
- print("Skip query \(name) due to the difference between Spark 4.0 and
4.1")
+ if await !spark.version.starts(with: "4.2") &&
queriesForSpark42Only.contains(name) {
+ print("Skip query \(name) due to the difference between Spark 4.1 and
4.2")
continue
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
