This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 551087bbb94 [SPARK-41964][CONNECT][PYTHON][FOLLOW-UP] Fix the jdbc
writer not implemented Test
551087bbb94 is described below
commit 551087bbb946741f63d4d5966714e6b80ee67dab
Author: Sandeep Singh <[email protected]>
AuthorDate: Sat Jan 14 15:44:20 2023 +0900
[SPARK-41964][CONNECT][PYTHON][FOLLOW-UP] Fix the jdbc writer not
implemented Test
### What changes were proposed in this pull request?
Fix the `jdbc` Writer function not implemented test
### Why are the changes needed?
Fixing a test
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing Test
Closes #39562 from techaddict/SPARK-41964-followup.
Authored-by: Sandeep Singh <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/sql/tests/connect/test_connect_basic.py | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/python/pyspark/sql/tests/connect/test_connect_basic.py
b/python/pyspark/sql/tests/connect/test_connect_basic.py
index 971355ec32c..3aca5830481 100644
--- a/python/pyspark/sql/tests/connect/test_connect_basic.py
+++ b/python/pyspark/sql/tests/connect/test_connect_basic.py
@@ -2496,6 +2496,7 @@ class SparkConnectBasicTests(SparkConnectSQLTestCase):
def test_unsupported_io_functions(self):
# SPARK-41964: Disable unsupported functions.
# DataFrameWriterV2 is also not implemented yet
+ df = self.connect.createDataFrame([(x, f"{x}") for x in range(100)],
["id", "name"])
for f in ("csv", "orc", "jdbc"):
with self.assertRaises(NotImplementedError):
@@ -2503,7 +2504,7 @@ class SparkConnectBasicTests(SparkConnectSQLTestCase):
for f in ("jdbc",):
with self.assertRaises(NotImplementedError):
- getattr(self.connect.read, f)()
+ getattr(df.write, f)()
@unittest.skipIf(not should_test_connect, connect_requirement_message)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
