This is an automated email from the ASF dual-hosted git repository.
viirya pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 9bc8cd51b671 [SPARK-51358][SS] Introduce snapshot upload lag detection
through StateStoreCoordinator
add 01c16af41518 [SPARK-51769][SQL] Add maxRecordsPerOutputBatch to limit
the number of record of Arrow output batch
No new revisions were added by this update.
Summary of changes:
python/pyspark/sql/tests/arrow/test_arrow_map.py | 8 ++
.../org/apache/spark/sql/internal/SQLConf.scala | 15 +++
.../sql/execution/python/PythonArrowOutput.scala | 138 +++++++++++++++++++--
3 files changed, 149 insertions(+), 12 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
