This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from f34563442a7c [SPARK-52919][SQL] Fix DSv2 Join pushdown to use
previously aliased column
add 23a19e6b5b03 [SPARK-52905][PYTHON] Arrow UDF for window
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/api/python/PythonRunner.scala | 2 +
dev/sparktestsupport/modules.py | 1 +
python/pyspark/sql/pandas/_typing/__init__.pyi | 1 +
.../test_arrow_udf_window.py} | 266 ++++++++++-----------
python/pyspark/util.py | 2 +
python/pyspark/worker.py | 77 ++++++
.../spark/sql/catalyst/expressions/PythonUDF.scala | 3 +-
.../catalyst/expressions/windowExpressions.scala | 11 +
.../spark/sql/execution/SparkStrategies.scala | 2 +-
...ala => ArrowWindowPythonEvaluatorFactory.scala} | 7 +-
...andasExec.scala => ArrowWindowPythonExec.scala} | 23 +-
11 files changed, 246 insertions(+), 149 deletions(-)
copy python/pyspark/sql/tests/{pandas/test_pandas_udf_window.py =>
arrow/test_arrow_udf_window.py} (66%)
rename
sql/core/src/main/scala/org/apache/spark/sql/execution/python/{WindowInPandasEvaluatorFactory.scala
=> ArrowWindowPythonEvaluatorFactory.scala} (98%)
rename
sql/core/src/main/scala/org/apache/spark/sql/execution/python/{WindowInPandasExec.scala
=> ArrowWindowPythonExec.scala} (86%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
