This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 37564db05c03 [SPARK-51426][PYTHON][SQL] Fix 'Setting metadata to empty
dict does not work'
add 85c9fd18f200 [SPARK-53867][PYTHON] Limit Arrow batch sizes in
SQL_GROUPED_AGG_ARROW_UDF
No new revisions were added by this update.
Summary of changes:
python/pyspark/sql/pandas/serializers.py | 43 ++++++++++++++++++++++
.../sql/tests/arrow/test_arrow_grouped_map.py | 4 +-
.../sql/tests/arrow/test_arrow_udf_grouped_agg.py | 28 ++++++++++++++
.../sql/tests/pandas/test_pandas_grouped_map.py | 4 +-
.../tests/pandas/test_pandas_udf_grouped_agg.py | 1 +
python/pyspark/worker.py | 4 +-
.../python/ArrowAggregatePythonExec.scala | 36 ++++++------------
7 files changed, 90 insertions(+), 30 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
