This is an automated email from the ASF dual-hosted git repository.
allisonwang pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 1f4f5401d072 [SPARK-53117][CORE][SQL] Support `moveDirectory` in
`SparkFileUtils` and `JavaUtils`
add 93fc2ed9fb1b [SPARK-52980][PYTHON] Support Arrow Python UDTFs
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/api/python/PythonRunner.scala | 2 +
dev/sparktestsupport/modules.py | 1 +
python/pyspark/errors/error-conditions.json | 5 +
python/pyspark/sql/_typing.pyi | 1 +
python/pyspark/sql/functions/__init__.py | 1 +
python/pyspark/sql/functions/builtin.py | 70 +++-
python/pyspark/sql/pandas/serializers.py | 9 +
python/pyspark/sql/tests/arrow/test_arrow_udtf.py | 393 +++++++++++++++++++++
.../sql/tests/connect/test_connect_function.py | 3 +-
.../sql/tests/test_connect_compatibility.py | 3 +-
python/pyspark/sql/udtf.py | 52 ++-
python/pyspark/util.py | 2 +
python/pyspark/worker.py | 185 +++++++++-
.../execution/python/ArrowPythonUDTFRunner.scala | 7 +-
.../sql/execution/python/ExtractPythonUDFs.scala | 4 +
15 files changed, 730 insertions(+), 8 deletions(-)
create mode 100644 python/pyspark/sql/tests/arrow/test_arrow_udtf.py
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
