This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 908218ee149 [SPARK-41767][CONNECT][TESTS][FOLLOW-UP] Disable the
doctests for dropFields and withField
908218ee149 is described below
commit 908218ee149b9faf1738a3389781e7a2c825b8a8
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Thu Dec 29 21:41:07 2022 +0900
[SPARK-41767][CONNECT][TESTS][FOLLOW-UP] Disable the doctests for
dropFields and withField
### What changes were proposed in this pull request?
There is a logical conflict between
https://github.com/apache/spark/pull/39249 and
https://github.com/apache/spark/pull/39283. This PR fixes it with filing a
related JIRA.
### Why are the changes needed?
To recover the build.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Manually tested via:
```bash
./python/run-tests --testnames 'pyspark.sql.connect.column'
```
Closes #39288 from HyukjinKwon/SPARK-41767.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/sql/connect/column.py | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/python/pyspark/sql/connect/column.py
b/python/pyspark/sql/connect/column.py
index 2667e795974..39de3cdd126 100644
--- a/python/pyspark/sql/connect/column.py
+++ b/python/pyspark/sql/connect/column.py
@@ -443,6 +443,10 @@ def _test() -> None:
os.environ["SPARK_REMOTE"] = "sc://localhost"
globs["spark"] =
PySparkSession.builder.remote("sc://localhost").getOrCreate()
+ # TODO(SPARK-41746): SparkSession.createDataFrame does not support
nested datatypes
+ del pyspark.sql.connect.column.Column.dropFields.__doc__
+ # TODO(SPARK-41772): Enable
pyspark.sql.connect.column.Column.withField doctest
+ del pyspark.sql.connect.column.Column.withField.__doc__
# TODO(SPARK-41751): Support
Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,
# isNull,isin
del pyspark.sql.connect.column.Column.bitwiseAND.__doc__
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
