This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d14c3558405f [SPARK-54069][PYTHON][TESTS] Skip `test_to_feather` in
Python 3.14
d14c3558405f is described below
commit d14c3558405f9632eaae4f33ad7638c2ed59368d
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue Oct 28 20:15:17 2025 -0700
[SPARK-54069][PYTHON][TESTS] Skip `test_to_feather` in Python 3.14
### What changes were proposed in this pull request?
This PR aims to skip `test_to_feather` in Python 3.14 test until
SPARK-54068 fixes it in the `Connect` mode.
### Why are the changes needed?
We have `test_to_feather` test coverage for both `classic` and `connect`
mode, but only `connect` mode fails currently in `Python 3.14`.
- https://github.com/apache/spark/actions/workflows/build_python_3.14.yml
- https://github.com/apache/spark/actions/runs/18864049006/job/53876343283
We had better focus on `classic` first by skipping this now. SPARK-54068 is
created to track it for `connect` mode.
### Does this PR introduce _any_ user-facing change?
No, this is a test only change.
### How was this patch tested?
Pass the CIs and manually test.
```
$ python/run-tests --parallelism 1 --testnames
pyspark.pandas.tests.connect.io.test_parity_feather --python-executables python3
Running PySpark tests. Output is in
/Users/dongjoon/APACHE/spark-merge/python/unit-tests.log
Will test against the following Python executables: ['python3']
Will test the following Python tests:
['pyspark.pandas.tests.connect.io.test_parity_feather']
python3 python_implementation is CPython
python3 version is: Python 3.14.0
Starting test(python3): pyspark.pandas.tests.connect.io.test_parity_feather
(temp output:
/Users/dongjoon/APACHE/spark-merge/python/target/4d8b6c19-57bf-49af-a582-43bc4c056c78/python3__pyspark.pandas.tests.connect.io.test_parity_feather__h5rneuu6.log)
Finished test(python3): pyspark.pandas.tests.connect.io.test_parity_feather
(4s) ... 1 tests were skipped
Tests passed in 4 seconds
Skipped tests in pyspark.pandas.tests.connect.io.test_parity_feather with
python3:
test_to_feather
(pyspark.pandas.tests.connect.io.test_parity_feather.FeatherParityTests.test_to_feather)
... skip (0.000s)
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #52771 from dongjoon-hyun/SPARK-54069.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
python/pyspark/pandas/tests/io/test_feather.py | 2 ++
1 file changed, 2 insertions(+)
diff --git a/python/pyspark/pandas/tests/io/test_feather.py
b/python/pyspark/pandas/tests/io/test_feather.py
index 74fa6bc7d7b6..3ddf0a2aad92 100644
--- a/python/pyspark/pandas/tests/io/test_feather.py
+++ b/python/pyspark/pandas/tests/io/test_feather.py
@@ -17,6 +17,7 @@
import unittest
import pandas as pd
+import sys
from pyspark import pandas as ps
from pyspark.testing.pandasutils import PandasOnSparkTestCase, TestUtils
@@ -34,6 +35,7 @@ class FeatherMixin:
def psdf(self):
return ps.from_pandas(self.pdf)
+ @unittest.skipIf(sys.version_info > (3, 13), "SPARK-54068")
def test_to_feather(self):
with self.temp_dir() as dirpath:
path1 = f"{dirpath}/file1.feather"
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
