This is an automated email from the ASF dual-hosted git repository.
HyukjinKwon pushed a commit to branch branch-4.x
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.x by this push:
new 8c2931d33e70 [SPARK-58068][PYTHON][TEST] Move `test_import_spark` to
`pyspark_install` module
8c2931d33e70 is described below
commit 8c2931d33e701b0617af063713f0f1468c497126
Author: Tian Gao <[email protected]>
AuthorDate: Fri Jul 10 07:47:12 2026 +0900
[SPARK-58068][PYTHON][TEST] Move `test_import_spark` to `pyspark_install`
module
### What changes were proposed in this pull request?
Move `test_import_spark` to `pyspark_install` module from `pyspark_core`.
### Why are the changes needed?
1. `test_import_spark` should be triggered for any changes in pyspark,
including streaming/ml etc. `test_install` currently does that.
2. `test_install` is cheap because it is not executed in post-merge. It
would be executed in scheduled CI only.
We failed to catch the import issue from
https://github.com/apache/spark/pull/56786 because the test did not run.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #57164 from gaogaotiantian/move-import-check.
Authored-by: Tian Gao <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
(cherry picked from commit 1935ee0e2953551fb770ca70611ba6bf6005a59b)
Signed-off-by: Hyukjin Kwon <[email protected]>
---
dev/sparktestsupport/modules.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dev/sparktestsupport/modules.py b/dev/sparktestsupport/modules.py
index 1e1cd1e3af73..33049885102c 100644
--- a/dev/sparktestsupport/modules.py
+++ b/dev/sparktestsupport/modules.py
@@ -503,7 +503,6 @@ pyspark_core = Module(
"pyspark.tests.test_conf",
"pyspark.tests.test_context",
"pyspark.tests.test_daemon",
- "pyspark.tests.test_import_spark",
"pyspark.tests.test_join",
"pyspark.tests.test_memory_profiler",
"pyspark.tests.test_pin_thread",
@@ -829,6 +828,7 @@ pyspark_install = Module(
"python/pyspark/tests/test_install_spark.py",
],
python_test_goals=[
+ "pyspark.tests.test_import_spark",
"pyspark.tests.test_install_spark",
],
)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
