This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-fs-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
discard ce112240a8b [fix](fe) Fix wrong snapshot name extraction in
listSnapshots for object stores
discard bdb3bb6f159 [fix](fe) Fix Azure auth failure due to missing
AZURE_ACCOUNT_KEY in SPI property mapping
omit d4d0f7bd02e [fix](fe) Fix @Ignored tests broken by FS SPI refactoring
(P1-12)
omit 074f6595390 [fix](fe) Fix P1 issues in filesystem SPI module
omit 28116c16b2b [fix](fe) Fix P0 issues in filesystem SPI module
omit b5acd4278be [test](fe) Add presigned URL env tests and fix
run-fs-env-test.sh
omit bb3daa332ad fix format
omit 190e5c49c54 fix test
omit da414e9be17 [test](fe) Add comprehensive unit and environment tests
for fe-filesystem module
omit 7fcde587062 [fix](fe) Fix remaining P0/External/Vault regression
failures in FS SPI
omit 1c7a8ce71bd [fix](build) Restore default JuiceFS packaging in build.sh
omit 0cceeeed926 [fix](fe) Fix P0 regression failures in FileSystem SPI
refactoring
omit e518e7c47d3 [fix](fe) Fix Hadoop ClassLoader conflict in filesystem
plugin
omit 23c70f9ffc7 [fix](fe) Fix 5 FS SPI regression bugs found in CI build
921471
omit 9e7e0bfc0f3 [fix](fe) Fix DFSFileSystem silently ignoring HDFS rename
failure in Hive write path
omit 63bf8081b89 [fix](fe) Restore hive.ignore_absent_partitions after
filesystem SPI refactoring
omit eb9e921bd45 [fix](fe) Fix glob listing in Repository backup/restore
for S3 and HDFS
omit 0a5cfc11fe3 [fix](fe) Fix FileSystemTransferUtil non-recursive listing
dropping directories
omit 973a0b93f4a [fix](fe) Fix multi-authority HDFS wrong-FS error and
regression test failures
omit 5231a756a62 [fix](fe) Fix 3 FE UT failures in filesystem SPI
refactoring (PR #62023)
omit 6ac3d8415ab delete doc
omit d2f70da57be [fix](fe) Fix AWS SDK ClassLoader conflict in filesystem
plugin
omit 30824125644 fix fe ut
omit 6c5cf5da099 [fix](fe) Fix 26 FE UT failures after filesystem SPI
refactoring
omit 630cd264ccb [refactor](fe) Move FileSystemProvider from
fe-filesystem-api to fe-filesystem-spi
omit c339ecbd8aa [fix](build) Fix intermittent parallel Maven build race in
fe-filesystem-s3
omit 91c26fbd7d7 [fix](fe) Fix checkstyle violations in filesystem SPI unit
tests
omit b95f1f8448f [fix](fe) Fix CI regression failures in filesystem SPI
refactoring
omit 6e9dc21822f [fix](fe) Fix P2/P3 issues in filesystem SPI refactoring
omit 01255cbf9fd [test](fe) Add unit tests for P1 fixes in filesystem SPI
omit ab923c73435 [fix](fe) Fix P1 issues in filesystem SPI refactoring
omit c9820bac8ac [test](fe) Add unit tests for 3 P0 fixes in filesystem SPI
refactoring (PR #62023)
omit 311cd3a950b [fix](fe) Fix 3 P0 issues in filesystem SPI refactoring
(PR #62023)
omit f7c606c2c81 [fix](fe) Fix S3 ExecutionInterceptor classloader
split-brain
omit 740a15e521b [fix](be) Fix S3 classloader split-brain in
S3ObjStorage.buildClient
omit d4e41ef6e1e [chore](fe) Fix import order and unused import checkstyle
errors
omit 8e89139461a [fix](build) Fix plugin assembly to place only project jar
at root
omit 1aafb64f5e9 [fix](build) Exclude intra-doris deps from plugin zip root
to prevent duplicate FileSystemProvider discovery
omit dd604e37427 [fix](fe) Fix multiple FileSystemProvider found when
plugin bundles dependent plugins
omit bdf09037449 [fix](be) Fix No FileSystem for scheme hdfs in HDFS
filesystem plugin
omit 2887138582c [refactor](fe) Simplify
ExternalFileTableValuedFunction.parseFile() storage-type dispatch
omit e6f9dc326f1 [refactor](fe) Decouple BrokerUtil from filesystem SPI and
reorganize utilities
omit 65068ed9e40 [fix](fe) Fix ClassCastException in HDFS/S3 TVF parseFile
after broker SPI migration
omit 4cdb377335a [improvement](build) Disable JuiceFS packaging by default
omit 86975686917 [fix](build) Make jindofs-helpers.sh POSIX sh compatible
omit 4f1cf25fabf [improvement](fe) Use maven-assembly-plugin to package
filesystem plugins
omit cfbacb7c94c [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI (#61862)
omit f9db8901099 delete plan doc
omit 5c0652b002b [chore](fe) Fix hadoop cloud connector dep scope in fe-core
omit 251ba3e7334 [chore](fe) Remove stranded cloud vendor SDK deps from
fe-core
omit d2cc30f3eec [test](fe) Add unit tests for AzureObjStorage cloud
extension methods
omit 9ade08f5f66 [test](fe) Add unit tests for OssObjStorage,
CosObjStorage, ObsObjStorage
omit 87d80fc3e67 [feature](fe) Add native presignedUrl and STS extensions
for OSS/COS/OBS/Azure ObjStorage
omit 60d5fc38320 [build](fe) Move filesystem plugin dep-copy into Maven
lifecycle
omit b25dc0b686b [refactor](fe) Split fe-filesystem-spi into api and spi
modules
omit c1dee055213 [fix](fe) Fix multiple bugs and improve SPI design in
fe-filesystem module
omit 28c58e0b3b6 [refactor](fs-spi) phase 5 remove fs in fe-core (#62021)
omit f781f521363 [improvement](build) Flatten filesystem plugin output
layout
omit ed31c745639 [fix](build) Fix fe-filesystem plugin build and deployment
omit f9693ab92b9 [doc](fs-spi) P4.8: update progress doc to reflect all
phases complete
omit b64533b21aa [refactor](fs-spi) P4.8-G4G5G6H1H2: delete legacy
filesystem hierarchy
omit 51fc68cef97 [refactor](fs-spi) P4.8-G3: delete DFSFileSystem and its
phantom reference infrastructure
omit edb5238a933 [refactor](fs-spi) P4.8-G1G2: delete dead DFSFileSystem
subclasses and legacy ObjFileSystem
omit 8004b4b4f1c [refactor](fs-spi) P4.8-F: delete legacy BrokerFileSystem,
S3FileSystem, AzureFileSystem and StorageTypeMapper
omit cc9a8f2d89b [refactor](fs-spi) P4.8-E: delete SwitchingFileSystem and
dead legacy provider infrastructure
omit 04f2180f1f0 [refactor](fs-spi) P4.8-D: migrate HdfsStorageVault to
SPI, delete legacy HDFS IO wrappers
omit ca9bb7cb3fc [refactor](fs-spi) P4.8-C: delete MultipartUploadCapable
interface
omit 7b8ba65b66d [refactor](fs-spi) P4.8-B: migrate DirectoryLister from
RemoteFile to SPI FileEntry
omit 6afd17f3817 [refactor](fs-spi) P4.8-A: delete LegacyToNewFsAdapter and
LegacyFileSystemAdapter
omit b64c3464052 [fix](build) Handle Maven Build Cache hit missing
target/lib in FE output copy
omit 2bd471ef801 [fix](build) Fix dependency:copy-dependencies path for
fe-filesystem plugins
omit e6b7b93a949 [fix](fe) Fix fe-filesystem plugin module build errors and
wire into build.sh
omit 81c0750c53b [fix](fe) Add missing ASF license headers to SPI service
provider files
omit de252dee858 [fix](fe) Fix FE build: update tests to use new
StorageProperties/SPI FileSystem API
omit fe363e207d3 [refactor](fe) Remove PersistentFileSystem from Repository
metadata path (P4.6-meta)
omit d48bbc7aa9e [feature](fe) Migrate Repository.java I/O path to SPI
FileSystem
omit 8f36cb1f949 [feature](fe) Implement fe-filesystem-broker SPI module
and migrate BrokerUtil
omit c9c05e2a391 [refactor](fe) Migrate HMSTransaction from
LegacyFileSystemApi to spi.FileSystem (P4.7)
omit ebd14d49c28 [refactor](fe) P4.5c: S3SourceOffsetProvider SPI migration
(globListWithLimit)
omit 59a1415513a [refactor](fe) Phase4 P4.6a-d: migrate backup domain to
FileSystemDescriptor
omit 900755044ee [feature](fe) Migrate Iceberg DelegateFileIO to filesystem
SPI (P4.4)
omit 07fd1215afa [feature](cloud) Migrate cloud ObjFS callers to new
filesystem SPI (P4.3)
omit 210210c8f7d [refactor](fe) Phase4 P4.6e: replace instanceof checks
with FsStorageType in RepositoryMgr
omit cbea7f425ca [refactor](fe) Phase4 P4.5b: migrate InsertIntoTVFCommand
to spi.FileSystem
omit 9098383171d [refactor](fe) Phase4 P4.2: migrate FileSystemCache and
callers to spi.FileSystem
omit 50e67add0f7 [refactor](fe) Phase4 P4.1: add FileSystemPluginManager
and plugin loading infrastructure
omit a9966db70b6 [refactor](fe) Phase4 P4.0: add FileSystemTransferUtil and
unit tests
omit 64e1b23eebb [refactor](fe) Phase3: split filesystem implementations
into independent SPI modules (#61919)
omit 725366331c9 [refactor](fs-spi) Migrate cloud.storage Remote* hierarchy
to fs.obj module (#61911)
omit bf22db2966b [refactor](fs-spi) phase1 Add unit tests for
MemoryFileSystem (#61909)
omit ae14075e708 [refactor](fe) Implement Phase 1 FS interface refactoring:
new FileSystem API and value objects (#61908)
omit 3b6ebf9c829 [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI (#61862)
omit 86c3feee080 [fix](fe) Fix checkstyle violations introduced by Phase 0
refactoring
omit 1edeb3ea1ff [build](fe) Fix Maven build cache incorrectly skipping
checkstyle
omit ebd52ad4c60 [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI
add e61837c24eb [fix](backup) Fix UnsupportedOperationException in
RestoreCommand by copying properties before modification (#61890)
add e4ed81fdb1b [fix](spill) Fix revocable_mem_size to return 0 when
partition reaches max repartition depth (#61973)
add 20b05a9a6d8 [chore](ci) Remove author association check from
opencode-review workflow (#62074)
add 0adc79074b1 [fix](variant) preserve subcolumns after row-store partial
update (#62067)
add 1ce2e40dc4f [fix](scan) Fix missing predicate filter when Native and
JNI readers are mixed in FileScanner (#61929)
add d5e95188554 [Bug](scan) Preserve IN_LIST runtime filter predicates
when key range is a scope range (#62027)
add 632f79197c2 [Exec](be) Support offset prue column and null column in
BE (#61888)
add 6fb376a094c [opt](memory) Remove unused indexId field from
CloudReplica (#62080)
add 84c1c36575e [fix](compaction) Remove upper limit for
vertical_compaction_num_columns_per_group (#61992)
add 977c1f1134c [Bug](pipeline) do not treat BLOCKED->FINISHED as error
when wake_up_early is true (#61989)
add ac27e4b7690 [env](compiler) Reduce compile time of
aggregate_function_reader_replace.cpp (#62047)
add 9689b8288df [fix](fe) Enable fuzzy for enable_query_cache (#62087)
add 3160231a3e1 [Bug](pipeline) do not set shared hash table signaled when
task terminated (#62056)
add 186a53ebe7d [opt](memory) Remove unused dbId field from CloudReplica
(#62079)
add d1e09c408eb [feat](fe) Add ClusterGuard SPI interface for
cluster-level policy enforcement (#62031)
add a8c890545ec [fix](jdbc) Preserve query tvf column aliases across JDBC
catalogs (#61939)
add 157a35e2580 [opt](explode) Optimize explode_outer and posexplode
(#62069)
add 0a3bea51271 [refactor](fe) Decouple SlotRef dependencies:
GlobalVariable, Column serialization, Expr visitor (#61918)
add 405541b2de5 [fix](tvf) fix wrong backend assignment for insert into
local tvf (#62143)
add c0b33f8b51e [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI
add 90c908307a6 [build](fe) Fix Maven build cache incorrectly skipping
checkstyle
add d4cf3f7bff6 [fix](fe) Fix checkstyle violations introduced by Phase 0
refactoring
add 3b690d7f8e7 [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI (#61862)
add 8165d6c2244 [refactor](fe) Implement Phase 1 FS interface refactoring:
new FileSystem API and value objects (#61908)
add 0fa02c88ac8 [refactor](fs-spi) phase1 Add unit tests for
MemoryFileSystem (#61909)
add aeedc8e84b8 [refactor](fs-spi) Migrate cloud.storage Remote* hierarchy
to fs.obj module (#61911)
add 597436ef20a [refactor](fe) Phase3: split filesystem implementations
into independent SPI modules (#61919)
add 0222df274a7 [refactor](fe) Phase4 P4.0: add FileSystemTransferUtil and
unit tests
add e089b0f0d27 [refactor](fe) Phase4 P4.1: add FileSystemPluginManager
and plugin loading infrastructure
add 26bb248d731 [refactor](fe) Phase4 P4.2: migrate FileSystemCache and
callers to spi.FileSystem
add f27b3d8ba2f [refactor](fe) Phase4 P4.5b: migrate InsertIntoTVFCommand
to spi.FileSystem
add 34d31402e6e [refactor](fe) Phase4 P4.6e: replace instanceof checks
with FsStorageType in RepositoryMgr
add cea7881b778 [feature](cloud) Migrate cloud ObjFS callers to new
filesystem SPI (P4.3)
add 7ad0ef535bc [feature](fe) Migrate Iceberg DelegateFileIO to filesystem
SPI (P4.4)
add 557b77e99d4 [refactor](fe) Phase4 P4.6a-d: migrate backup domain to
FileSystemDescriptor
add 81e82370aa0 [refactor](fe) P4.5c: S3SourceOffsetProvider SPI migration
(globListWithLimit)
add 9f0e92c0d4c [refactor](fe) Migrate HMSTransaction from
LegacyFileSystemApi to spi.FileSystem (P4.7)
add 55d8666d330 [feature](fe) Implement fe-filesystem-broker SPI module
and migrate BrokerUtil
add 88f17ee7a8d [feature](fe) Migrate Repository.java I/O path to SPI
FileSystem
add a0d3eea6a84 [refactor](fe) Remove PersistentFileSystem from Repository
metadata path (P4.6-meta)
add c7a0116855b [fix](fe) Fix FE build: update tests to use new
StorageProperties/SPI FileSystem API
add a94ff8f104f [fix](fe) Add missing ASF license headers to SPI service
provider files
add fa311ccbe83 [fix](fe) Fix fe-filesystem plugin module build errors and
wire into build.sh
add 7cebd5ef9bb [fix](build) Fix dependency:copy-dependencies path for
fe-filesystem plugins
add 2ede269d680 [fix](build) Handle Maven Build Cache hit missing
target/lib in FE output copy
add d32db620df5 [refactor](fs-spi) P4.8-A: delete LegacyToNewFsAdapter and
LegacyFileSystemAdapter
add 2807de4e7f9 [refactor](fs-spi) P4.8-B: migrate DirectoryLister from
RemoteFile to SPI FileEntry
add 263fa7e2760 [refactor](fs-spi) P4.8-C: delete MultipartUploadCapable
interface
add 13e7b4fcdc6 [refactor](fs-spi) P4.8-D: migrate HdfsStorageVault to
SPI, delete legacy HDFS IO wrappers
add b85e544c2b6 [refactor](fs-spi) P4.8-E: delete SwitchingFileSystem and
dead legacy provider infrastructure
add 7ed6f76c1d1 [refactor](fs-spi) P4.8-F: delete legacy BrokerFileSystem,
S3FileSystem, AzureFileSystem and StorageTypeMapper
add 1ea6074ba35 [refactor](fs-spi) P4.8-G1G2: delete dead DFSFileSystem
subclasses and legacy ObjFileSystem
add 3e180781750 [refactor](fs-spi) P4.8-G3: delete DFSFileSystem and its
phantom reference infrastructure
add 1db3a535423 [refactor](fs-spi) P4.8-G4G5G6H1H2: delete legacy
filesystem hierarchy
add d1de123c587 [doc](fs-spi) P4.8: update progress doc to reflect all
phases complete
add 5dbe4bfc56b [fix](build) Fix fe-filesystem plugin build and deployment
add c59392e7934 [improvement](build) Flatten filesystem plugin output
layout
add 1f068b2b79e [refactor](fs-spi) phase 5 remove fs in fe-core (#62021)
add bae4bd6d6a9 [fix](fe) Fix multiple bugs and improve SPI design in
fe-filesystem module
add 38a8ae18322 [refactor](fe) Split fe-filesystem-spi into api and spi
modules
add 6c1e26faa58 [build](fe) Move filesystem plugin dep-copy into Maven
lifecycle
add 7f39d0e3165 [feature](fe) Add native presignedUrl and STS extensions
for OSS/COS/OBS/Azure ObjStorage
add 1d7ae6700e4 [test](fe) Add unit tests for OssObjStorage,
CosObjStorage, ObsObjStorage
add 5bc5f07f61b [test](fe) Add unit tests for AzureObjStorage cloud
extension methods
add cc230c07e7c [chore](fe) Remove stranded cloud vendor SDK deps from
fe-core
add 51503093cad [chore](fe) Fix hadoop cloud connector dep scope in fe-core
add bf7f4362a59 delete plan doc
add cae576ac284 [refactor](fe) Phase 0: Prerequisite decoupling for
filesystem SPI (#61862)
add 1bf666481dd [improvement](fe) Use maven-assembly-plugin to package
filesystem plugins
add bfe26e64e9a [fix](build) Make jindofs-helpers.sh POSIX sh compatible
add 1974f50a81a [improvement](build) Disable JuiceFS packaging by default
add 0886197c055 [fix](fe) Fix ClassCastException in HDFS/S3 TVF parseFile
after broker SPI migration
add 76bbcb39171 [refactor](fe) Decouple BrokerUtil from filesystem SPI and
reorganize utilities
add 24a2340dc13 [refactor](fe) Simplify
ExternalFileTableValuedFunction.parseFile() storage-type dispatch
add 0c95a84f275 [fix](be) Fix No FileSystem for scheme hdfs in HDFS
filesystem plugin
add a7bf186914c [fix](fe) Fix multiple FileSystemProvider found when
plugin bundles dependent plugins
add 4704bb0bb09 [fix](build) Exclude intra-doris deps from plugin zip root
to prevent duplicate FileSystemProvider discovery
add 63f40d0edbb [fix](build) Fix plugin assembly to place only project jar
at root
add 42e0c33bcab [chore](fe) Fix import order and unused import checkstyle
errors
add e660405ed5f [fix](be) Fix S3 classloader split-brain in
S3ObjStorage.buildClient
add 52f1d17ab8b [fix](fe) Fix S3 ExecutionInterceptor classloader
split-brain
add 2eeb85e9b51 [fix](fe) Fix 3 P0 issues in filesystem SPI refactoring
(PR #62023)
add fc5e166362e [test](fe) Add unit tests for 3 P0 fixes in filesystem SPI
refactoring (PR #62023)
add bc233772a31 [fix](fe) Fix P1 issues in filesystem SPI refactoring
add 4cc8072293b [test](fe) Add unit tests for P1 fixes in filesystem SPI
add ff0002b2b13 [fix](fe) Fix P2/P3 issues in filesystem SPI refactoring
add 97ef08eb90b [fix](fe) Fix CI regression failures in filesystem SPI
refactoring
add 37c67c526b9 [fix](fe) Fix checkstyle violations in filesystem SPI unit
tests
add 114e87bb116 [fix](build) Fix intermittent parallel Maven build race in
fe-filesystem-s3
add 98d931a3f07 [refactor](fe) Move FileSystemProvider from
fe-filesystem-api to fe-filesystem-spi
add 81d9e557f92 [fix](fe) Fix 26 FE UT failures after filesystem SPI
refactoring
add ad208493a95 fix fe ut
add 03e4cbcb955 [fix](fe) Fix AWS SDK ClassLoader conflict in filesystem
plugin
add 76f67814a12 delete doc
add 13982cfa0d6 [fix](fe) Fix 3 FE UT failures in filesystem SPI
refactoring (PR #62023)
add 8a1c3a6d32b [fix](fe) Fix multi-authority HDFS wrong-FS error and
regression test failures
add a790f3395d0 [fix](fe) Fix FileSystemTransferUtil non-recursive listing
dropping directories
add 171284026c5 [fix](fe) Fix glob listing in Repository backup/restore
for S3 and HDFS
add aaf1301dc95 [fix](fe) Restore hive.ignore_absent_partitions after
filesystem SPI refactoring
add b071f58ab01 [fix](fe) Fix DFSFileSystem silently ignoring HDFS rename
failure in Hive write path
add aa2bc364c3d [fix](fe) Fix 5 FS SPI regression bugs found in CI build
921471
add 8b85ac44d7a [fix](fe) Fix Hadoop ClassLoader conflict in filesystem
plugin
add 5b1b8bc2752 [fix](fe) Fix P0 regression failures in FileSystem SPI
refactoring
add 63209e00128 [fix](build) Restore default JuiceFS packaging in build.sh
add 6f5efb6711e [fix](fe) Fix remaining P0/External/Vault regression
failures in FS SPI
add c6cda61d64e [test](fe) Add comprehensive unit and environment tests
for fe-filesystem module
add b6a16878b81 fix test
add 272d55f5c56 fix format
add 1d6b1d9d194 [test](fe) Add presigned URL env tests and fix
run-fs-env-test.sh
add a6e5191df41 [fix](fe) Fix P0 issues in filesystem SPI module
add f6780078f7b [fix](fe) Fix P1 issues in filesystem SPI module
add 53f4221e19b [fix](fe) Fix @Ignored tests broken by FS SPI refactoring
(P1-12)
add ea4498ff632 [fix](fe) Fix Azure auth failure due to missing
AZURE_ACCOUNT_KEY in SPI property mapping
add 69fb8196db8 [fix](fe) Fix wrong snapshot name extraction in
listSnapshots for object stores
add 4872bc0659e [fix](fe) Fix BrokerReader Thrift client connection pool
leak
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ce112240a8b)
\
N -- N -- N refs/heads/branch-fs-spi (4872bc0659e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/opencode-review.yml | 7 +-
be/src/core/column/column.h | 9 +
be/src/core/column/column_nullable.h | 8 +
be/src/core/column/column_string.h | 23 +
be/src/exec/operator/hashjoin_build_sink.cpp | 33 +-
be/src/exec/operator/olap_scan_operator.cpp | 44 +-
be/src/exec/operator/operator.h | 1 -
.../partitioned_aggregation_source_operator.cpp | 5 +
.../partitioned_hash_join_probe_operator.cpp | 5 +
be/src/exec/operator/scan_operator.cpp | 41 +-
be/src/exec/operator/table_function_operator.cpp | 210 +++--
be/src/exec/pipeline/pipeline_task.cpp | 12 +-
be/src/exec/pipeline/pipeline_task.h | 17 +
be/src/exec/scan/file_scanner.cpp | 5 +-
.../aggregate_function_reader_first_last.h | 304 +------
.../aggregate_function_reader_replace.cpp | 262 +++++-
be/src/exprs/table_function/table_function.h | 1 +
be/src/exprs/table_function/vexplode.cpp | 2 +-
be/src/exprs/table_function/vexplode_v2.cpp | 3 +-
be/src/storage/predicate/column_predicate.h | 3 +-
be/src/storage/predicate/comparison_predicate.h | 6 -
be/src/storage/predicate/in_list_predicate.h | 7 -
be/src/storage/predicate/null_predicate.h | 1 -
be/src/storage/segment/binary_dict_page.cpp | 52 +-
be/src/storage/segment/binary_plain_page.h | 39 +-
be/src/storage/segment/column_reader.cpp | 429 +++++++++-
be/src/storage/segment/column_reader.h | 65 +-
be/src/storage/segment/options.h | 1 +
be/src/storage/segment/segment_writer.cpp | 5 +
be/src/storage/segment/vertical_segment_writer.cpp | 5 +
.../exec/operator/analytic_sink_operator_test.cpp | 2 +-
...istinct_streaming_aggregation_operator_test.cpp | 2 +-
.../operator/exchange_source_operator_test.cpp | 2 +-
be/test/exec/operator/hashjoin_build_sink_test.cpp | 262 ++++++
.../operator/partition_sort_sink_operator_test.cpp | 2 +-
...artitioned_aggregation_source_operator_test.cpp | 38 +
.../partitioned_hash_join_probe_operator_test.cpp | 45 +
.../exec/operator/query_cache_operator_test.cpp | 2 +-
be/test/exec/operator/repeat_operator_test.cpp | 2 +-
be/test/exec/operator/set_operator_test.cpp | 4 +-
be/test/exec/operator/sort_operator_test.cpp | 2 +-
.../exec/operator/table_function_operator_test.cpp | 639 +++++++++++++-
be/test/exec/operator/union_operator_test.cpp | 6 +-
be/test/exec/pipeline/pipeline_task_test.cpp | 58 +-
be/test/exec/scan/vfile_scanner_exception_test.cpp | 41 +
.../exec/sink/arrow_result_block_buffer_test.cpp | 8 +-
be/test/exec/sink/result_block_buffer_test.cpp | 6 +-
be/test/storage/segment/column_reader_test.cpp | 40 +-
be/test/testutil/mock/mock_runtime_state.h | 4 +-
.../apache/doris/catalog/NameSpaceContext.java} | 36 +-
fe/fe-common/pom.xml | 48 ++
.../java/org/apache/doris/qe/GlobalVariable.java | 107 ++-
.../main/java/org/apache/doris/qe/VarAttrDef.java | 87 ++
fe/fe-core/pom.xml | 30 -
.../src/main/java/org/apache/doris/DorisFE.java | 7 +
.../main/java/org/apache/doris/alter/Alter.java | 5 +-
.../apache/doris/alter/SchemaChangeHandler.java | 15 +-
.../org/apache/doris/analysis/ColumnRefExpr.java | 12 -
.../main/java/org/apache/doris/analysis/Expr.java | 14 -
.../doris/analysis/ExprToColumnLabelVisitor.java | 51 --
.../doris/analysis/ExprToExprNameVisitor.java | 65 ++
.../apache/doris/analysis/FunctionCallExpr.java | 11 -
.../org/apache/doris/analysis/LiteralExpr.java | 8 -
.../java/org/apache/doris/analysis/SlotRef.java | 9 -
.../org/apache/doris/analysis/VirtualSlotRef.java | 4 -
.../java/org/apache/doris/backup/RestoreJob.java | 7 +-
.../apache/doris/catalog/CatalogRecycleBin.java | 3 +-
.../main/java/org/apache/doris/catalog/Column.java | 310 +------
.../org/apache/doris/catalog/ColumnToProtobuf.java | 201 +++++
.../org/apache/doris/catalog/ColumnToThrift.java | 173 ++++
.../java/org/apache/doris/catalog/Database.java | 17 +-
.../main/java/org/apache/doris/catalog/Env.java | 27 +-
.../java/org/apache/doris/catalog/OlapTable.java | 13 +-
.../catalog/constraint/ForeignKeyConstraint.java | 5 +-
.../apache/doris/cloud/catalog/CloudReplica.java | 14 -
.../cloud/datasource/CloudInternalCatalog.java | 3 +-
.../org/apache/doris/cluster/ClusterGuard.java | 65 ++
.../doris/cluster/ClusterGuardException.java} | 11 +-
.../apache/doris/cluster/ClusterGuardFactory.java | 88 ++
.../NoOpClusterGuard.java} | 40 +-
.../org/apache/doris/common/util/BrokerReader.java | 19 +-
.../org/apache/doris/common/util/BrokerUtil.java | 16 -
.../apache/doris/common/util/PropertyAnalyzer.java | 4 +-
.../apache/doris/datasource/InternalCatalog.java | 9 +-
.../doris/datasource/iceberg/IcebergUtils.java | 19 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 7 +-
.../datasource/jdbc/util/JdbcFieldSchema.java | 5 +-
.../maxcompute/source/MaxComputeScanNode.java | 10 +-
.../paimon/source/PaimonPredicateConverter.java | 3 +-
.../doris/httpv2/rest/manager/HttpUtils.java | 8 +-
.../doris/httpv2/restv2/ClusterGuardAction.java | 161 ++++
.../java/org/apache/doris/info/TableNameInfo.java | 75 +-
.../org/apache/doris/info/TableNameInfoUtils.java | 104 +++
.../java/org/apache/doris/info/TableRefInfo.java | 4 +-
.../main/java/org/apache/doris/load/DeleteJob.java | 3 +-
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 9 +-
.../java/org/apache/doris/mtmv/MTMVService.java | 12 +-
.../doris/mysql/privilege/TablePrivEntry.java | 4 +-
.../doris/nereids/minidump/MinidumpUtils.java | 4 +-
.../nereids/rules/rewrite/ForeignKeyContext.java | 5 +-
.../trees/plans/commands/AddConstraintCommand.java | 9 +-
.../commands/AdminCancelRepairTableCommand.java | 2 +-
.../plans/commands/AdminCompactTableCommand.java | 2 +-
.../plans/commands/AdminRepairTableCommand.java | 2 +-
.../commands/AdminSetPartitionVersionCommand.java | 2 +-
.../plans/commands/AdminSetTableStatusCommand.java | 2 +-
.../plans/commands/AlterColumnStatsCommand.java | 2 +-
.../trees/plans/commands/AlterTableCommand.java | 2 +-
.../plans/commands/AlterTableStatsCommand.java | 2 +-
.../trees/plans/commands/AnalyzeTableCommand.java | 2 +-
.../plans/commands/CancelAlterTableCommand.java | 2 +-
.../plans/commands/CancelBuildIndexCommand.java | 2 +-
.../plans/commands/CleanQueryStatsCommand.java | 2 +-
.../trees/plans/commands/CreatePolicyCommand.java | 2 +-
.../trees/plans/commands/DescribeCommand.java | 2 +-
.../plans/commands/DropCachedStatsCommand.java | 2 +-
.../plans/commands/DropConstraintCommand.java | 4 +-
.../commands/DropMaterializedViewCommand.java | 2 +-
.../trees/plans/commands/DropRowPolicyCommand.java | 2 +-
.../trees/plans/commands/DropStatsCommand.java | 2 +-
.../trees/plans/commands/DropStreamCommand.java | 2 +-
.../trees/plans/commands/DropTableCommand.java | 2 +-
.../trees/plans/commands/DropViewCommand.java | 2 +-
.../trees/plans/commands/ExecuteActionCommand.java | 2 +-
.../trees/plans/commands/LockTablesCommand.java | 2 +-
.../plans/commands/RecoverPartitionCommand.java | 2 +-
.../trees/plans/commands/RecoverTableCommand.java | 2 +-
.../trees/plans/commands/RestoreCommand.java | 12 +-
.../trees/plans/commands/ShowAnalyzeCommand.java | 2 +-
.../commands/ShowColumnHistogramStatsCommand.java | 2 +-
.../plans/commands/ShowColumnStatsCommand.java | 2 +-
.../trees/plans/commands/ShowColumnsCommand.java | 2 +-
.../plans/commands/ShowConstraintsCommand.java | 4 +-
.../ShowCreateMaterializedViewCommand.java | 2 +-
.../plans/commands/ShowCreateStreamCommand.java | 2 +-
.../plans/commands/ShowCreateTableCommand.java | 2 +-
.../plans/commands/ShowCreateViewCommand.java | 2 +-
.../trees/plans/commands/ShowDataCommand.java | 2 +-
.../trees/plans/commands/ShowDataSkewCommand.java | 4 +-
.../plans/commands/ShowIndexStatsCommand.java | 2 +-
.../plans/commands/ShowPartitionsCommand.java | 2 +-
.../plans/commands/ShowQueryStatsCommand.java | 2 +-
.../commands/ShowQueuedAnalyzeJobsCommand.java | 2 +-
.../commands/ShowReplicaDistributionCommand.java | 2 +-
.../plans/commands/ShowReplicaStatusCommand.java | 2 +-
.../plans/commands/ShowTableStatsCommand.java | 2 +-
.../commands/ShowTabletsFromTableCommand.java | 2 +-
.../trees/plans/commands/ShowViewCommand.java | 4 +-
.../trees/plans/commands/TruncateTableCommand.java | 2 +-
.../trees/plans/commands/UnsetVariableCommand.java | 3 +-
.../trees/plans/commands/WarmUpClusterCommand.java | 2 +-
.../trees/plans/commands/info/AlterMTMVInfo.java | 2 +-
.../trees/plans/commands/info/AlterViewInfo.java | 2 +-
.../trees/plans/commands/info/BuildIndexOp.java | 2 +-
.../plans/commands/info/CancelMTMVTaskInfo.java | 2 +-
.../trees/plans/commands/info/CreateIndexOp.java | 2 +-
.../trees/plans/commands/info/CreateMTMVInfo.java | 2 +-
.../plans/commands/info/CreateStreamInfo.java | 4 +-
.../plans/commands/info/CreateTableLikeInfo.java | 4 +-
.../trees/plans/commands/info/CreateViewInfo.java | 2 +-
.../trees/plans/commands/info/DropIndexOp.java | 2 +-
.../trees/plans/commands/info/DropMTMVInfo.java | 2 +-
.../trees/plans/commands/info/LabelNameInfo.java | 4 +-
.../commands/info/ModifyTablePropertiesOp.java | 4 +-
.../trees/plans/commands/info/PauseMTMVInfo.java | 2 +-
.../trees/plans/commands/info/RefreshMTMVInfo.java | 2 +-
.../trees/plans/commands/info/ResumeMTMVInfo.java | 2 +-
.../plans/commands/info/ShowCreateMTMVInfo.java | 2 +-
.../commands/refresh/RefreshTableCommand.java | 2 +-
.../worker/job/UnassignedJobBuilder.java | 16 +-
...mmitJob.java => UnassignedLocalTVFSinkJob.java} | 40 +-
.../plans/logical/LogicalCatalogRelation.java | 3 +-
.../plans/physical/PhysicalCatalogRelation.java | 3 +-
.../apache/doris/nereids/types/VariantField.java | 20 +-
.../apache/doris/persist/GlobalVarPersistInfo.java | 8 +-
.../apache/doris/planner/MaterializationNode.java | 3 +-
.../org/apache/doris/planner/OlapScanNode.java | 5 +-
.../org/apache/doris/planner/OlapTableSink.java | 5 +-
.../org/apache/doris/planner/TVFTableSink.java | 3 +-
.../java/org/apache/doris/qe/ConnectContext.java | 5 +
.../java/org/apache/doris/qe/SessionVariable.java | 936 ++++++++++-----------
.../main/java/org/apache/doris/qe/VariableMgr.java | 96 +--
.../apache/doris/statistics/AnalysisManager.java | 5 +-
.../doris/statistics/StatisticsJobAppender.java | 9 +-
.../org/apache/doris/system/SystemInfoService.java | 20 +
.../apache/doris/task/AlterInvertedIndexTask.java | 3 +-
.../org/apache/doris/task/AlterReplicaTask.java | 3 +-
.../org/apache/doris/task/CreateReplicaTask.java | 3 +-
.../doris/cluster/ClusterGuardExceptionTest.java | 48 ++
.../doris/cluster/ClusterGuardFactoryTest.java | 392 +++++++++
.../apache/doris/cluster/NoOpClusterGuardTest.java | 55 ++
.../datasource/jdbc/util/JdbcFieldSchemaTest.java | 74 ++
.../apache/doris/info/TableNameInfoUtilsTest.java | 181 ++++
.../doris/nereids/trees/plans/ConstraintTest.java | 37 +-
.../trees/plans/CreateTableCommandTest.java | 21 +-
.../trees/plans/commands/RestoreCommandTest.java | 16 +
.../org/apache/doris/qe/SessionVariablesTest.java | 2 +-
.../org/apache/doris/catalog/PatternType.java} | 11 +-
.../org/apache/doris/catalog/VariantField.java | 11 +-
gensrc/script/Makefile | 2 +-
gensrc/script/gen_build_version.sh | 4 +-
.../test_rf_in_list_not_erased_by_scope_range.out} | 8 +-
.../external_table_p0/jdbc/test_jdbc_query_tvf.out | 6 +
...est_rf_in_list_not_erased_by_scope_range.groovy | 91 ++
.../jdbc/test_jdbc_query_tvf.groovy | 5 +-
.../suites/variant_p0/delete_update.groovy | 40 +
206 files changed, 5182 insertions(+), 1917 deletions(-)
copy fe/{fe-type/src/main/java/org/apache/doris/catalog/AnyType.java =>
fe-catalog/src/main/java/org/apache/doris/catalog/NameSpaceContext.java} (53%)
rename fe/{fe-core =>
fe-common}/src/main/java/org/apache/doris/qe/GlobalVariable.java (77%)
create mode 100644
fe/fe-common/src/main/java/org/apache/doris/qe/VarAttrDef.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/ExprToColumnLabelVisitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/ExprToExprNameVisitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/ColumnToProtobuf.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/ColumnToThrift.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cluster/ClusterGuard.java
copy
fe/{fe-extension-spi/src/main/java/org/apache/doris/extension/spi/PluginException.java
=> fe-core/src/main/java/org/apache/doris/cluster/ClusterGuardException.java}
(76%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cluster/ClusterGuardFactory.java
copy
fe/fe-core/src/main/java/org/apache/doris/{nereids/types/UnsupportedType.java
=> cluster/NoOpClusterGuard.java} (53%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/httpv2/restv2/ClusterGuardAction.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/info/TableNameInfoUtils.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/distribute/worker/job/{UnassignedGroupCommitJob.java
=> UnassignedLocalTVFSinkJob.java} (54%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cluster/ClusterGuardExceptionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cluster/ClusterGuardFactoryTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cluster/NoOpClusterGuardTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/jdbc/util/JdbcFieldSchemaTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/info/TableNameInfoUtilsTest.java
copy
fe/{fe-core/src/main/java/org/apache/doris/catalog/SinglePartitionInfo.java =>
fe-type/src/main/java/org/apache/doris/catalog/PatternType.java} (81%)
copy
regression-test/data/{cloud_p0/read_cluster_cache/warmup/test_warmup_delay_compaction_query_tolerance.out
=> correctness_p0/test_rf_in_list_not_erased_by_scope_range.out} (79%)
create mode 100644
regression-test/suites/correctness_p0/test_rf_in_list_not_erased_by_scope_range.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
