This is an automated email from the ASF dual-hosted git repository.
ueshin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from df534c355d9 [SPARK-44952][SQL][PYTHON] Support named arguments in
aggregate Pandas UDFs
add e4ebb372fa1 [SPARK-44901][SQL] Add API in Python UDTF 'analyze' method
to return partitioning/ordering expressions
No new revisions were added by this update.
Summary of changes:
.../src/main/resources/error/error-classes.json | 12 +
docs/sql-error-conditions.md | 12 +
python/pyspark/sql/functions.py | 1 +
python/pyspark/sql/tests/test_udtf.py | 142 ++++++-
python/pyspark/sql/udtf.py | 44 +-
python/pyspark/sql/worker/analyze_udtf.py | 18 +
.../spark/sql/catalyst/analysis/Analyzer.scala | 53 ++-
.../spark/sql/catalyst/expressions/PythonUDF.scala | 100 ++++-
.../sql/catalyst/expressions/generators.scala | 2 +-
.../spark/sql/errors/QueryCompilationErrors.scala | 22 +
.../python/UserDefinedPythonFunction.scala | 49 ++-
.../sql-tests/analyzer-results/udtf/udtf.sql.out | 397 ++++++++++++++++++
.../test/resources/sql-tests/inputs/udtf/udtf.sql | 91 +++++
.../resources/sql-tests/results/udtf/udtf.sql.out | 448 +++++++++++++++++++++
.../apache/spark/sql/IntegratedUDFTestUtils.scala | 272 ++++++++++++-
.../org/apache/spark/sql/SQLQueryTestSuite.scala | 40 +-
.../sql/execution/python/PythonUDTFSuite.scala | 68 +++-
17 files changed, 1716 insertions(+), 55 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
