This is an automated email from the ASF dual-hosted git repository.
ashrigondekar pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from e308660e8d83 [SPARK-54736][TEST][INFRA] Change the default executable
to sys.executable
add 0faa10e7d128 [SPARK-54419][SS] Offline Repartition State Reader
Supports Multi-Column Families
No new revisions were added by this update.
Summary of changes:
.../datasources/v2/state/StateDataSource.scala | 89 ++-
.../v2/state/StatePartitionReader.scala | 130 +++-
.../datasources/v2/state/StateScanBuilder.scala | 10 +-
.../datasources/v2/state/StateTable.scala | 5 +-
.../StateStoreColumnFamilySchemaUtils.scala | 15 +
.../state/HDFSBackedStateStoreProvider.scala | 6 +
.../sql/execution/streaming/state/RocksDB.scala | 8 +
.../state/RocksDBStateStoreProvider.scala | 4 +
.../sql/execution/streaming/state/StateStore.scala | 9 +
...tatePartitionAllColumnFamiliesReaderSuite.scala | 801 ++++++++++++++++++---
.../streaming/state/MemoryStateStore.scala | 3 +
.../RocksDBStateStoreCheckpointFormatV2Suite.scala | 2 +
.../execution/streaming/state/RocksDBSuite.scala | 1 +
.../streaming/state/StateStoreSuite.scala | 3 +
14 files changed, 934 insertions(+), 152 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
