This is an automated email from the ASF dual-hosted git repository.
sandy pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 05a1ffb31f42 [SPARK-51169][PYTHON] Add Python 3.14 support in Spark
Classic
add efcc8f69a01f [SPARK-53850][SDP] Define proto for Sinks and Rename
DefineDataset to DefineOutput
No new revisions were added by this update.
Summary of changes:
python/pyspark/pipelines/api.py | 10 +-
python/pyspark/pipelines/graph_element_registry.py | 4 +-
python/pyspark/pipelines/{dataset.py => output.py} | 14 +-
.../spark_connect_graph_element_registry.py | 54 +++---
.../tests/local_graph_element_registry.py | 12 +-
python/pyspark/pipelines/tests/test_cli.py | 4 +-
.../pipelines/tests/test_graph_element_registry.py | 8 +-
python/pyspark/pipelines/tests/test_init_cli.py | 4 +-
python/pyspark/sql/connect/proto/pipelines_pb2.py | 112 +++++------
python/pyspark/sql/connect/proto/pipelines_pb2.pyi | 207 ++++++++++++++-------
.../main/protobuf/spark/connect/pipelines.proto | 52 ++++--
.../sql/connect/pipelines/PipelinesHandler.scala | 58 +++---
.../pipelines/PipelineEventStreamSuite.scala | 18 +-
.../pipelines/PipelineRefreshFunctionalSuite.scala | 20 +-
.../SparkDeclarativePipelinesServerSuite.scala | 182 +++++++++---------
.../SparkDeclarativePipelinesServerTest.scala | 4 +-
.../connect/pipelines/TestPipelineDefinition.scala | 24 +--
17 files changed, 435 insertions(+), 352 deletions(-)
rename python/pyspark/pipelines/{dataset.py => output.py} (90%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
