(spark) branch branch-4.0 updated (b0d6b17b2998 -> 93fb1f33e46a)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git from b0d6b17b2998 [SPARK-53326][BUILD] Upgrade ORC Format to 1.1.1 add 93fb1f33e46a [SPARK-51920][SS][PYTHON][4.0

(spark) branch master updated (59556b1a69f6 -> 9e06a506a947)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 59556b1a69f6 [SPARK-53302][PYTHON][TESTS] Make doctest of df.unpivot deterministic add 9e06a506a947 [SPARK

(spark) branch branch-4.0 updated: [SPARK-52989][SS][4.0] Add explicit close() API to State Store iterators

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 03c8d5016580 [SPARK-52989][SS][4.0] Add

(spark) branch master updated: [SPARK-52989][SS] Add explicit close() API to State Store iterators

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d53de53fff55 [SPARK-52989][SS] Add explicit

(spark) branch master updated: [SPARK-52630][SS] Reorganize streaming operator and state mgmt code and dirs

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2bd93dafb9fd [SPARK-52630][SS] Reorganize

(spark) branch master updated: [SPARK-52553][SS] Fix NumberFormatException when reading v1 changelog

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be08d581b202 [SPARK-52553][SS] Fix

(spark) branch branch-4.0 updated: [SPARK-52553][SS] Fix NumberFormatException when reading v1 changelog

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new fdcc62efa260 [SPARK-52553][SS] Fix

(spark) branch master updated: [SPARK-50752][SQL][PYSPARK][FOLLOWUP] Respect PYTHON_UDF_MAX_RECORDS_PER_BATCH in Python worker

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b969ffe5d816 [SPARK-50752][SQL][PYSPARK

(spark) branch master updated: [SPARK-52391][SS] Refactor TransformWithStateExec to extract shared functions and variables into an abstract base class for Scala and Python

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a9bfacb084e6 [SPARK-52391][SS] Refactor

(spark) branch branch-4.0 updated: [SPARK-52350][SS] Fix link for SS programming guide in 4.0

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 5a450e48b5ab [SPARK-52350][SS] Fix link

(spark) branch master updated: [SPARK-52350][SS] Fix link for SS programming guide in 4.0

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a4bdb37efcf7 [SPARK-52350][SS] Fix link for SS

(spark) branch master updated (98552a6b6424 -> 3159416c1ed1)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 98552a6b6424 [SPARK-52338][SQL] Support for inheriting default collation from schema to View add 3159416c1ed1

(spark) branch master updated (7e48ba7bf10e -> 3d84039292b7)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7e48ba7bf10e [SPARK-52272][SQL] V2SessionCatalog does not alter schema on Hive Catalog add 3d84039292b7 [SPARK

(spark) branch branch-4.0 updated: [SPARK-52329][SS] Remove private sql scoping tags for new transformWithState API

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new a92c9430ede7 [SPARK-52329][SS] Remove

(spark) branch master updated: [SPARK-52329][SS] Remove private sql scoping tags for new transformWithState API

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 62eac3ec8f93 [SPARK-52329][SS] Remove private

(spark) branch master updated: [SPARK-52195][PYTHON][SS] Fix initial state column dropping issue for Python TWS

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dad1369df70d [SPARK-52195][PYTHON][SS] Fix

(spark) branch branch-4.0 updated: [SPARK-52188] Fix for StateDataSource where StreamExecution.RUN_ID_KEY is not set

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new fe1818698811 [SPARK-52188] Fix for

(spark) branch master updated: [SPARK-52188] Fix for StateDataSource where StreamExecution.RUN_ID_KEY is not set

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c09ac2373e1c [SPARK-52188] Fix for

(spark) branch master updated: [SPARK-52096][SQL][SS] Reclassify kafka source offset assertion error

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2b5cd7dc59e8 [SPARK-52096][SQL][SS] Reclassify

(spark) branch master updated: [SPARK-52127][SS][PYTHON] Squeeze the protocol of MapState KEYS / VALUES / ITERATOR for transformWithState in PySpark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cea3ae4e8bf9 [SPARK-52127][SS][PYTHON] Squeeze

(spark) branch master updated: [SPARK-52126][SS][PYTHON] Revert rename for TWS utility classes for forward compatibility in Spark Connect

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 092223365928 [SPARK-52126][SS][PYTHON] Revert

(spark) branch master updated (688281ae13ec -> a0a9ff0f388c)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 688281ae13ec [SPARK-52040][PYTHON][SQL][CONNECT] ResolveLateralColumnAliasReference should retain the plan id

(spark) branch master updated: [SPARK-51940][SS] Add interface for managing streaming checkpoint metadata

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 896b62d3780a [SPARK-51940][SS] Add interface

(spark) branch branch-4.0 updated (2a6864faabe7 -> 7f265a257c55)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git from 2a6864faabe7 [SPARK-51802][PYTHON][DOCS] OSS PySpark User Guide Docs add 7f265a257c55 [SPARK-51921][SS

(spark) branch master updated (48322c7ac541 -> 7fcae8cab68b)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 48322c7ac541 [SPARK-51933][SS][DOCS] Document the new API `transformWithState` in PySpark add 7fcae8cab68b

(spark) branch master updated: [SPARK-51933][SS][DOCS] Document the new API `transformWithState` in PySpark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48322c7ac541 [SPARK-51933][SS][DOCS] Document

(spark) branch master updated: [SPARK-51869][SS] Create classification for user errors within UDFs for Scala TransformWithState

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b83a819b50ad [SPARK-51869][SS] Create

(spark) branch master updated: [SPARK-51814][SS][PYTHON][FOLLOWUP][MINOR] Add missing type handling for PythonEvalType.toString

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e32fb5efd337 [SPARK-51814][SS][PYTHON][FOLLOWUP

(spark) branch master updated: [SPARK-51827][SS][CONNECT] Support Spark Connect on transformWithState in PySpark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6f47783d3512 [SPARK-51827][SS][CONNECT] Support

(spark) branch master updated (7832e917d0d5 -> 7292ff1ec763)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7832e917d0d5 [SPARK-51928][BUILD] Upgrade Apache `common-text` to 1.13.1 add 7292ff1ec763 [SPARK-51823][SS] Add

(spark) branch master updated: [SPARK-51827][SS][CONNECT] Support Spark Connect on transformWithState in PySpark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 81ede347e3e2 [SPARK-51827][SS][CONNECT] Support

(spark) branch branch-4.0 updated: [SPARK-51922][SS] Fix UTFDataFormatException thrown from StateStoreChangelogReaderFactory for v1

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 525e134efc77 [SPARK-51922][SS] Fix

(spark) branch master updated: [SPARK-51922][SS] Fix UTFDataFormatException thrown from StateStoreChangelogReaderFactory for v1

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b63497893649 [SPARK-51922][SS] Fix

(spark) branch branch-4.0 updated: [SPARK-51904][SS] Removing async metadata purging for StateSchemaV3 and ignoring non-batch files when listing OperatorMetadata files

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 0b4a10c8009b [SPARK-51904][SS] Removing

(spark) branch master updated: [SPARK-51904][SS] Removing async metadata purging for StateSchemaV3 and ignoring non-batch files when listing OperatorMetadata files

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 23785d33acab [SPARK-51904][SS] Removing async

(spark) branch master updated: [SPARK-51891][SS] Squeeze the protocol of ListState GET / PUT / APPENDLIST for transformWithState in PySpark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2c0fc708b88f [SPARK-51891][SS] Squeeze the

(spark) branch branch-4.0 updated: [SPARK-51889][PYTHON][SS] Fix a bug for MapState clear() in Python TWS

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 7305cef149cb [SPARK-51889][PYTHON][SS

(spark) branch master updated: [SPARK-51889][PYTHON][SS] Fix a bug for MapState clear() in Python TWS

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6eb966812b32 [SPARK-51889][PYTHON][SS] Fix a

(spark) branch master updated (58adb0174af3 -> 772c4cbd9f65)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 58adb0174af3 [SPARK-51814][SS][PYTHON][FOLLLOW-UP] Uses `list(self)` instead of `StructType.fields` for old version

(spark) branch master updated (e616b8404ff2 -> ec430279b43d)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e616b8404ff2 [SPARK-51836][PYTHON][CONNECT][TESTS][FOLLOW-UP] update `test_connect_classification` add

(spark) branch master updated (0d3d3a47d3a5 -> 23c77b7e701b)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0d3d3a47d3a5 [SPARK-51829][PYTHON][ML] Client side should update `client.thread_local.ml_caches` after deletion

(spark) branch branch-4.0 updated: [SPARK-51411][SS][DOCS] Add documentation for the transformWithState operator

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 000f8973c231 [SPARK-51411][SS][DOCS

(spark) branch branch-4.0 updated: [SPARK-50967][SS][MINOR][FOLLOW-UP] Update `flatMapGroupsWithState` test conf

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new b23a6a58e1ec [SPARK-50967][SS][MINOR

(spark) branch master updated: [SPARK-50967][SS][MINOR][FOLLOW-UP] Update `flatMapGroupsWithState` test conf

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8b33a832b2ba [SPARK-50967][SS][MINOR][FOLLOW-UP

(spark) branch master updated: [SPARK-51758][SS] Fix test case related to extra batch causing empty df due to watermark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 335063fc8f88 [SPARK-51758][SS] Fix test case

(spark) branch branch-4.0 updated: [SPARK-51758][SS] Fix test case related to extra batch causing empty df due to watermark

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 5fba0b476ade [SPARK-51758][SS] Fix test

(spark) branch branch-4.0 updated: [SPARK-51758][SS][FOLLOWUP][TESTS] Fix flaky test around watermark due to additional batch causing empty df

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 25bee87585fe [SPARK-51758][SS][FOLLOWUP

(spark) branch master updated: [SPARK-51758][SS][FOLLOWUP][TESTS] Fix flaky test around watermark due to additional batch causing empty df

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2b78cec410ca [SPARK-51758][SS][FOLLOWUP][TESTS

(spark) branch master updated (6e8b4b5a6116 -> a5510808b30a)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6e8b4b5a6116 [SPARK-51638][CORE] Fix fetching the remote disk stored RDD blocks via the external shuffle service

(spark) branch master updated (7087677cf185 -> bb1a63a8c361)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7087677cf185 [SPARK-51775][SQL] Normalize LogicalRelation and HiveTableRelation by NormalizePlan add

(spark) branch branch-4.0 updated: [SPARK-51758][SS] Apply late record filtering based on watermark only if timeMode is passed as EventTime to the transformWithState operator

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 002a9bf3e617 [SPARK-51758][SS] Apply

(spark) branch master updated: [SPARK-51358][SS] Introduce snapshot upload lag detection through StateStoreCoordinator

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9bc8cd51b671 [SPARK-51358][SS] Introduce

(spark) branch HeartSaVioR/SPARK-XXXXX-python-transform-with-state deleted (was 5a709080dd01)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch HeartSaVioR/SPARK-X-python-transform-with-state in repository https://gitbox.apache.org/repos/asf/spark.git was 5a709080dd01 fix conflict This change permanently discards the

(spark) branch master updated (92f5d38ac397 -> 187adb83fae9)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 92f5d38ac397 [SPARK-51711][ML][CONNECT] Memory based MLCache eviction policy add 187adb83fae9 [SPARK-51724][SS

(spark) branch master updated: [SPARK-51714][SS] Add Failure Ingestion test to test state store checkpoint format V2

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c7024d35c45a [SPARK-51714][SS] Add Failure

(spark) branch master updated: [SPARK-51717][SS][ROCKSDB] Fix SST mismatch corruption that can happen for second snapshot created for a new query

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3f16577c2199 [SPARK-51717][SS][ROCKSDB] Fix SST

(spark) branch branch-4.0 updated: [SPARK-51717][SS][ROCKSDB] Fix SST mismatch corruption that can happen for second snapshot created for a new query

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new ffbb1c12f47f [SPARK-51717][SS][ROCKSDB

(spark) branch branch-4.0 updated: [SPARK-51724][SS] RocksDB StateStore's lineage manager should be synchronized

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 1e4dc0d8cbd5 [SPARK-51724][SS] RocksDB

(spark) 02/02: fix conflict

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch HeartSaVioR/SPARK-X-python-transform-with-state in repository https://gitbox.apache.org/repos/asf/spark.git commit 5a709080dd01163451ee9f75b5eca1c2a5e83249 Author: Jungtaek Lim AuthorDate

(spark) branch HeartSaVioR/SPARK-XXXXX-python-transform-with-state created (now 5a709080dd01)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch HeartSaVioR/SPARK-X-python-transform-with-state in repository https://gitbox.apache.org/repos/asf/spark.git at 5a709080dd01 fix conflict This branch includes the following new

(spark) branch master updated: [SPARK-51690][SS] Change the protocol of ListState.put()/get()/appendList() from Arrow to simple custom protocol

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 418cfd1f7801 [SPARK-51690][SS] Change the

(spark) branch branch-4.0 updated: [SPARK-51700][SS] Fix incorrect logging when no files are eligible for deletion in RocksDBFileManager

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 56bca499e47f [SPARK-51700][SS] Fix

(spark) branch master updated: [SPARK-51675][SS] Fix col family creation after opening local DB to avoid snapshot creation, if not necessary

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c0fbc6ba7d2d [SPARK-51675][SS] Fix col family

(spark) branch branch-4.0 updated: [SPARK-51682][SS] State Store Checkpoint V2 should handle offset log ahead of commit log correctly

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new eadecfb42065 [SPARK-51682][SS] State

(spark) branch master updated: [SPARK-51252][SS][TESTS] Make tests more consistent for StateStoreInstanceMetricSuite

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d642b6bd174a [SPARK-51252][SS][TESTS] Make

(spark) branch HeartSaVioR/SPARK-51187-4.0 deleted (was cc87e5689bfb)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch HeartSaVioR/SPARK-51187-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git was cc87e5689bfb [empty] this is a empty commit The revisions that were on this branch are still

(spark) branch master updated: [SPARK-51667][SS][PYTHON] Disable Nagle's algorithm (via TCP_NODELAY = true) in TWS + PySpark for python <-> state server

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a760df7b8434 [SPARK-51667][SS][PYTHON] Disable

(spark) branch master updated: [SPARK-51675][SS][FOLLOW-UP] Clear internal maps on close to remove DB open dep in other places

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3ab0f2de54af [SPARK-51675][SS][FOLLOW-UP] Clear

(spark) branch branch-4.0 updated: [SPARK-51675][SS][FOLLOW-UP] Clear internal maps on close to remove DB open dep in other places

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 8e1840bedf38 [SPARK-51675][SS][FOLLOW

(spark) branch master updated: [SPARK-51685][SS] Excessive Info logging from RocksDb operations causing too big executor stderr files

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b0a7e2e01ccc [SPARK-51685][SS] Excessive Info

(spark) branch master updated: [SPARK-51700][SS] Fix incorrect logging when no files are eligible for deletion in RocksDBFileManager

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a222f78cc2ba [SPARK-51700][SS] Fix incorrect

(spark) branch master updated: [SPARK-51682][SS] State Store Checkpoint V2 should handle offset log ahead of commit log correctly

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5d71afc7ea0f [SPARK-51682][SS] State Store

(spark) branch branch-4.0 updated: [SPARK-51675][SS] Fix col family creation after opening local DB to avoid snapshot creation, if not necessary

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 5550bf0fe9a0 [SPARK-51675][SS] Fix col

(spark) branch branch-4.0 updated: [SPARK-51667][SS][PYTHON] Disable Nagle's algorithm (via TCP_NODELAY = true) in TWS + PySpark for python <-> state server

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 136afb17fe89 [SPARK-51667][SS][PYTHON

(spark) branch master updated: [SPARK-51573][SS] Fix Streaming State Checkpoint v2 checkpointInfo race condition

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4765c15a442e [SPARK-51573][SS] Fix Streaming

(spark) branch branch-4.0 updated: [SPARK-51573][SS] Fix Streaming State Checkpoint v2 checkpointInfo race condition

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new ac168abb7c3b [SPARK-51573][SS] Fix

(spark) branch branch-4.0 updated: [SPARK-51587][PYTHON][SS] Fix an issue where timestamp cannot be used in ListState when multiple state data is involved

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new dd96a3da1a98 [SPARK-51587][PYTHON][SS

(spark) branch master updated: [SPARK-51471][SS] RatePerMicroBatchStream - classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3155c4b8e0c0 [SPARK-51471][SS

(spark) branch master updated: [SPARK-51252][SS] Add instance metrics for last uploaded snapshot version in HDFS State Stores

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b2dd85ef57b [SPARK-51252][SS] Add instance

(spark) branch master updated (b2290444e9c1 -> 11d1409fc828)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b2290444e9c1 [SPARK-51420][SQL][TESTS][FOLLOWUP] Re-generate `sql-expression-schema.md` add 11d1409fc828 [SPARK

(spark) branch branch-4.0 updated: [SPARK-51586][SS] initialize input partitions independent of columnar support in continuous mode

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new e0c364e9c5e2 [SPARK-51586][SS

(spark) branch HeartSaVioR/SPARK-51187-4.0 created (now cc87e5689bfb)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch HeartSaVioR/SPARK-51187-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git at cc87e5689bfb [empty] this is a empty commit This branch includes the following new commits

(spark) 01/01: [empty] this is a empty commit

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch HeartSaVioR/SPARK-51187-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git commit cc87e5689bfb488b8778d2c6b07df82ce4282e21 Author: Jungtaek Lim AuthorDate: Wed Mar 19 10:48:57 2025

(spark) branch master updated: [SPARK-51097][SS] Re-introduce RocksDB state store's last uploaded snapshot version instance metrics

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 84b9848f9a69 [SPARK-51097][SS] Re-introduce

(spark) branch master updated: [SPARK-51397][SS] Fix maintenance pool shutdown handling issue causing long test times

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7b1346b401d6 [SPARK-51397][SS] Fix maintenance

(spark) branch master updated (894814ea31d2 -> a8e92e4b1b06)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 894814ea31d2 [SPARK-51497][SQL] Add the default time formatter add a8e92e4b1b06 [SPARK-51506][PYTHON][SS] Do not

(spark) branch branch-4.0 updated: [SPARK-51506][PYTHON][SS] Do not enforce users to implement close() in TransformWithStateInPandas

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 115d3a956287 [SPARK-51506][PYTHON][SS

(spark) branch master updated: [SPARK-51440][SS] classify the NPE when null topic field value is in kafka message data and there is no topic option

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a7b864fcdc7e [SPARK-51440][SS] classify the NPE

(spark) branch master updated: [SPARK-51409][SS] Add error classification in the changelog writer creation path

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0deb4cb09ff7 [SPARK-51409][SS] Add error

(spark) branch branch-4.0 updated (66ed4e3f3163 -> f629491879bc)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git from 66ed4e3f3163 [SPARK-51393][PYTHON] Fallback to regular Python UDF when Arrow is not found but Arrow-optimized

(spark) branch master updated (e17df6e452a2 -> 792eef666588)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e17df6e452a2 [SPARK-51290][SQL] Enable filling default values in DSv2 writes add 792eef666588 [SPARK-51097][SS

(spark) branch branch-4.0 updated: [SPARK-51373][SS] Removing extra copy for column family prefix from 'ReplyChangelog'

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new c04dc0486076 [SPARK-51373][SS] Removing

(spark) branch master updated: [SPARK-51373][SS] Removing extra copy for column family prefix from 'ReplyChangelog'

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c2f2be68dd09 [SPARK-51373][SS] Removing extra

(spark) branch master updated: [SPARK-50855][SS][CONNECT] Spark Connect Support for TransformWithState In Scala

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3820ae0f86b9 [SPARK-50855][SS][CONNECT] Spark

(spark) branch master updated (86c2140b62e4 -> cf1c3bf54580)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 86c2140b62e4 [SPARK-51363][SQL] Desc As JSON` clustering column names add cf1c3bf54580 [SPARK-51362][SQL] Change

(spark) branch master updated: [SPARK-51351][SS] Do not materialize the output in Python worker for TWS

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 496fe7a50919 [SPARK-51351][SS] Do not

(spark) branch branch-4.0 updated: [SPARK-51351][SS] Do not materialize the output in Python worker for TWS

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new 13d9c914f09d [SPARK-51351][SS] Do not

(spark) branch master updated: [SPARK-50856][SS][PYTHON][CONNECT] Spark Connect Support for TransformWithStateInPandas In Python

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 93d10c25d5b8 [SPARK-50856][SS][PYTHON][CONNECT

(spark) branch master updated (d6ca11e93535 -> 42ab97a3e6e7)

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d6ca11e93535 [SPARK-51092][SS] Skip the v1 FlatMapGroupsWithState tests with timeout on big endian platforms

(spark) branch branch-4.0 updated: [SPARK-51249][SS] Fixing the NoPrefixKeyStateEncoder and Avro encoding to use the correct number of version bytes

This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-4.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-4.0 by this push: new e6dbc9e537ae [SPARK-51249][SS] Fixing

  1   2   3   4   5   6   7   8   9   >