This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 205ed98513ca [SPARK-53259][PYTHON] Correct the message for
INVALID_UDF_EVAL_TYPE
205ed98513ca is described below
commit 205ed98513ca8d49c7ad2f8cc99479e4b22ca316
Author: Ruifeng Zheng <ruife...@apache.org>
AuthorDate: Tue Aug 12 06:48:52 2025 -0700
[SPARK-53259][PYTHON] Correct the message for INVALID_UDF_EVAL_TYPE
### What changes were proposed in this pull request?
Correct the message for INVALID_UDF_EVAL_TYPE
### Why are the changes needed?
the error message should include the newly added eval types
### Does this PR introduce _any_ user-facing change?
yes, changes in error message
### How was this patch tested?
updated tests
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #51989 from zhengruifeng/error_eval_type.
Authored-by: Ruifeng Zheng <ruife...@apache.org>
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
---
python/pyspark/sql/connect/udf.py | 3 ++-
python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py | 7 ++++---
python/pyspark/sql/udf.py | 3 ++-
3 files changed, 8 insertions(+), 5 deletions(-)
diff --git a/python/pyspark/sql/connect/udf.py
b/python/pyspark/sql/connect/udf.py
index a405781b416d..0f45690a9db3 100644
--- a/python/pyspark/sql/connect/udf.py
+++ b/python/pyspark/sql/connect/udf.py
@@ -285,7 +285,8 @@ class UDFRegistration:
errorClass="INVALID_UDF_EVAL_TYPE",
messageParameters={
"eval_type": "SQL_BATCHED_UDF, SQL_ARROW_BATCHED_UDF, "
- "SQL_SCALAR_PANDAS_UDF, SQL_SCALAR_PANDAS_ITER_UDF, "
+ "SQL_SCALAR_PANDAS_UDF, SQL_SCALAR_ARROW_UDF, "
+ "SQL_SCALAR_PANDAS_ITER_UDF,
SQL_SCALAR_ARROW_ITER_UDF, "
"SQL_GROUPED_AGG_PANDAS_UDF or
SQL_GROUPED_AGG_ARROW_UDF"
},
)
diff --git a/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
b/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
index a7516bdd22b0..b8f1afc5130f 100644
--- a/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
+++ b/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
@@ -221,9 +221,10 @@ class GroupedApplyInPandasTestsMixin:
exception=pe.exception,
errorClass="INVALID_UDF_EVAL_TYPE",
messageParameters={
- "eval_type": "SQL_BATCHED_UDF, SQL_ARROW_BATCHED_UDF,
SQL_SCALAR_PANDAS_UDF, "
- "SQL_SCALAR_PANDAS_ITER_UDF, SQL_GROUPED_AGG_PANDAS_UDF or "
- "SQL_GROUPED_AGG_ARROW_UDF"
+ "eval_type": "SQL_BATCHED_UDF, SQL_ARROW_BATCHED_UDF, "
+ "SQL_SCALAR_PANDAS_UDF, SQL_SCALAR_ARROW_UDF, "
+ "SQL_SCALAR_PANDAS_ITER_UDF, SQL_SCALAR_ARROW_ITER_UDF, "
+ "SQL_GROUPED_AGG_PANDAS_UDF or SQL_GROUPED_AGG_ARROW_UDF"
},
)
diff --git a/python/pyspark/sql/udf.py b/python/pyspark/sql/udf.py
index 5c749ccc73bc..4bb06d37b2d4 100644
--- a/python/pyspark/sql/udf.py
+++ b/python/pyspark/sql/udf.py
@@ -661,7 +661,8 @@ class UDFRegistration:
errorClass="INVALID_UDF_EVAL_TYPE",
messageParameters={
"eval_type": "SQL_BATCHED_UDF, SQL_ARROW_BATCHED_UDF, "
- "SQL_SCALAR_PANDAS_UDF, SQL_SCALAR_PANDAS_ITER_UDF, "
+ "SQL_SCALAR_PANDAS_UDF, SQL_SCALAR_ARROW_UDF, "
+ "SQL_SCALAR_PANDAS_ITER_UDF,
SQL_SCALAR_ARROW_ITER_UDF, "
"SQL_GROUPED_AGG_PANDAS_UDF or
SQL_GROUPED_AGG_ARROW_UDF"
},
)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
