This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 717789149f23 [SPARK-50890][PYTHON][TESTS][CONNECT] Skip test_take in
Spark Connect only build
717789149f23 is described below
commit 717789149f2363ea6f2be716ef35b6825ef922dd
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Mon Jan 20 09:49:03 2025 +0900
[SPARK-50890][PYTHON][TESTS][CONNECT] Skip test_take in Spark Connect only
build
This PR proposes to skip test_take in Spark Connect only build.
This particular test is flaky
(https://github.com/apache/spark/actions/runs/12857135589/job/35844649654) and
fails with OOM, which results in stopping all following tests. We should at
least fix this build, and run other tests.
No, test-only.
Will monitor the build.
No.
Closes #49565 from HyukjinKwon/skip-test-take.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
(cherry picked from commit 1e378b34676b4b2322937c5e76a914276ae1f9c1)
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/pandas/tests/connect/frame/test_parity_take.py | 2 ++
1 file changed, 2 insertions(+)
diff --git a/python/pyspark/pandas/tests/connect/frame/test_parity_take.py
b/python/pyspark/pandas/tests/connect/frame/test_parity_take.py
index 4fc8b2452a76..6e8e38efe166 100644
--- a/python/pyspark/pandas/tests/connect/frame/test_parity_take.py
+++ b/python/pyspark/pandas/tests/connect/frame/test_parity_take.py
@@ -17,11 +17,13 @@
import unittest
from pyspark import pandas as ps
+from pyspark import is_remote_only
from pyspark.pandas.tests.frame.test_take import FrameTakeMixin
from pyspark.testing.connectutils import ReusedConnectTestCase
from pyspark.testing.pandasutils import PandasOnSparkTestUtils
[email protected](is_remote_only(), "Flaky with OOM")
class FrameParityTakeTests(FrameTakeMixin, PandasOnSparkTestUtils,
ReusedConnectTestCase):
@property
def psdf(self):
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
