This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from f9461a1bc62 [opt](nereids) keep equal predicate as join conjunct even
if it can be fold to null literal (#35811)
new 6300c5ddec3 [fix](mtmv) mtmv disable dynamic partition (#35686)
new 1ea62910430 [refactor](pipeline) Delete non-pipeline exec nodes
(#35803)
new c54b1e470be [Bug](udtf) fix udtf core dump use as normal function
(#35235)
new f59c45c6378 [opt](nereids) transform grouping sets to trivial
aggregation as far as possible (#35813)
new 891e6bdb326 [Fix](Tablet) Fix the issue of redundant loading of stale
rowset meta (#35768)
new 292ee7a94c1 [fix](stream_load) fix stream load may failed caused by
column name with keyword (#35822)
new 3ec25068406 [fix](export) fix that export table retry with same label
should succeed when first export job failed (#35676)
new c4f5b768d1a [refactor](pipeline) Delete non-pipeline data sink (#35858)
new b82679b039e [feature](statistics)Remove not exist partition stats
while analyzing. (#35814)
new 9a2af49268f [improve](fe) Support to config max msg/frame size of the
thrift server (#35845)
new 8f53322983c [regression](backup-restore) Add a `huge tables`
backup-restore test case (#35862)
new 1ebcf0adb7b [Bugfix] Fix nullptr cache object because init file cache
concurrently (#35722)
new 7550bbd2f63 [improve](cloud) Add profile for sync_rowsets while
quering (#35869)
new 119f0772ff5 [fix](broker) fix no error url when broker data quality
error (#35643)
new e26ef2e90fa [improve](cache) optimize the cache log (#35603)
new 63591b0fd0e [Fix](MS) Fix get tablet stats value api (#35880)
new 06aebff80ed [fix](fe) Set is electable for checking compatibility mode
(#35853)
new a6a30f0a70f [fix](clone) Fix clone and alter tablet use same tablet
path (#34889)
new e0001bc6e0a [streamload](redirect) Support redirect-policy for
streamload which is used by audit plugin (#35840)
new fbb32e76357 [fix](regression test) test_alter_colocate_group due to
force_olap_table_replication_num (#35835)
new eb68dd619d8 [fix](move-memtable) fix move memtable core when use multi
table load (#35458)
new 38b31a28ab6 [enhancement](delete-pred) enable delete sub predicate v2
for compaction (#35859)
new e878512cc69 (chore)[profile] remove non-pipeline logical from profile
(#35877)
new 1cfae20b310 [chore](FE) Fix issues with the activation of profile
protoc_rosetta (#35598)
new f500dd33497 [Chore](log) do not print stacktrace on
ABORTED/NOT_IMPLEMENTED_ERROR (#35867)
new d264bcd9003 [enhancement](fe-meta) Support skip specified journal to
avoid FE can't be start due to a damaged journal (#35783)
new 0d969e91784 [fix](case)fix regress case for test_ip_in_inverted_index
(#35881)
new ee79ffe6896 [fix](build) fix include for macOS compile (#35865)
new fa9d7f99099 [fix](RecycleBin) fix race condition issue when do execute
ShowCatalogRecycleBinStmt (#35759)
new ed3567d8b68 [improvement](JdbcScan) Change the mysql function that
does not support pushdown in JdbcScan to Config (#35196)
new 913ed2c2aa3 [fix](mtmv)Mtmv support row column (#35860)
new f8274a61147 [fix](arrow-flight-sql) Fix pipelineX Unknown result sink
type (#35804)
new 96a7a0a7b48 [fix](memory) Add cache manager check for exist (#35590)
new 19a44bcf7a9 [feature-wip](Cloud) Add azure obj client into recycler
(#35849)
new a5321eb19bc [improve](routine-load) add retry when get Kafka meta info
(#35376)
new 9e84affb7a4 [fix](multicast) should not ignore Status of block::merge
(#35886)
new 033f758083c [improve](txn insert) Txn load support cloud mode (#34721)
new 63d3e254b9f [fix](datetime) Fix date floor functions overflow (#35477)
new ba3b85bec65 [refactor](coordinator) remove non pipeline code from
coordinator (#35888)
new fcce175c6b3 [enhance](recycler) Don't do delete request when
encountering empty objs and log more error msg (#35916)
new 4f5774c22a9 [enhancement](regression-test) modify a value type tests
(#35847)
new 0c0eb9ddad0 [fix](cloud) ignore black list in cloud mode (#35905)
new 76cab88b962 [feature](test)Add column date type boundary of auto
partition (#34351)
new effa3287fb6 [Bug](function) Fix function for cast string as
date/datetime (#35637)
new 34e26b57d39 [opt](tools) update tools schema (#35873)
new 4d67c29ec5d [opt](mtmv) Materialized view partition track supports
date_trunc and optimize the fail reason (#35562)
new 10d4795aa23 [enhance](BE) Avoid memcpy in `OlapMeta::iterate` (#35850)
new e32bfc8f0b2 [refactor](pipeline) Refactor non-pipeline code structure
(#35900)
new e0457df8432 [feature](pipeline)add local merge sort exchanger (#35682)
new aab04aab934 [enhancement](export)export job for olap table will only
hit the base index, so skip other tablets of rollup index when do splitTablets
(#35556)
new d47c94c063b [opt](Nereids) use date signature for date arithmetic as
far as possible (#35863)
new a13aafa2a0e [fix](statistics)Fix partition table health rate
evaluation bug. (#35924)
new e9d7fc28446 [minor](log) Add debug log in Coordinator (#35936)
new 85cc7ad718a [improve](cloud) Add more cost time log for sync_rowset
while calculaing delete bitmap (#35866)
new 8091e844c0d [chore](ci) add required check for branch-2.1 (#35910)
new 3fc552f776c [fix](keyword) let some keyword be non-reserved between
old parser and new parser (#35938)
new aa335be4cfa [opt](Nereids) Optimize Join Penalty Calculation Based on
Build Side Data Volume (#35773)
new 624f21a6075 [fix](functions) fix be crash for function random_bytes
and mark_first/last_n (#35884)
new d74cb6ae5b7 [Enhancement](Nereids) Nereids supports group_commit with
insert (#32523)
new b6f56703759 [opt](variable) add a new variable tag REMOVED (#35902)
new e09da7822a7 [Update](inverted index) set default inverted index
storage format to v2 (#35303)
new 2766556f967 [Feature](information-schema) add SCHEMA_VERSION into
information_schema.rowsets (#35861)
new aef1c8591e0 [enhancement](Nereids) support 4 phases distinct aggregate
with full distribution (#35871)
new cf621c8fd26 [feature](tvf) support max_filter_ratio (#35431)
new 17a3a847cb1 [feature](Nereids) support select ALL (#35935)
new 1b4b2941026 [bugfix](hive)fix the error message when creating hive
table (#35833)
new e37e0cbca34 [Feature](agg-state) OLAP_FIELD_TYPE_AGG_STATE support
more serialized_type (#35628)
new a65693af52a [fix](scan) In-predicate should not be pushed down for
non-key column (#35913)
new ad0d76366b0 [Update](regression) refine case for inverted index show
data (#35939)
new 0ad30afe056 [build](docker) add repo for new version of git (#35892)
new 4d644eb2a41 [fix](proc) fix keyword case sensitive issue for stmt
show_frontends_disks (#35921)
new c4a643fcdbd [refactor](pipeline) Delete pipeline option (#35943)
new ceb23365102 [fix](routine-load) dealing with the high watermark of
Kafka may fallback (#35901)
new 04f9d43f424 [Chore](scan) normalize push down logic for tablet reader
predicates (#35960)
new 4c12b09322a [fix](Nereids) not do distinct when aggregate with
distinct project (#35899)
new bfc36076f89 [feature](Nereids) support cast to unsigned / signed
(#35937)
new ae9514b5487 [fix](DDL) not set table type as default comment when
create table (#35855)
new 18c2a3059a5 [opt](log) refine the BE logger (#35942)
new d904a6d23bb [Chore](type) remove duplicate uint128/int128/uint256
defines (#35841)
new 1e44a5ab2f1 [fix](fe) avoid setting the value of batch_size
excessively high (#35941)
new 988e419dbbc [Chore](log) do not get stacktrace when error_code's
stacktrace is false (#35974)
new 4067cedf725 [fix](nereids)should not push down constant output expr in
window expression (#35948)
new 63cd0909fe5 [fix](mtmv)fix mtmv show partition error when base table
dropped (#35729)
new b8d5cf28821 [fix](Nereids): add be test number in some tests (#35500)
new 44822e73d70 [minor](log) Refactor some warning logs (#35973)
new c9e53c97552 [fix](cloud) Fix compatibility issues with old cloud code
(#35958)
new b88e2e48638 [feature](cloud) Support path format v1 for Storage Vault
(#35953)
new 93ea640e454 [enhancement](regression-test) modify a value type tests
(#35959)
new 436f8c6361b [improve](group commit) Modify group commit case and
modify cancel status (#35995)
new 0a0d03162be [opt](ddl) Do not check number replicas when create table
in cloud mode (#36002)
new 1118a23aeef [enhance](boot) Limit the concurrency of load data dirs
(#35852)
new 710e06afb32 [fix](pipeline) Do not push data in local exchange if eos
(#35972)
new 88545bf54e8 [fix](inverted index)Delete tmp dirs when BE starts to
avoid tmp file… (#35951)
new 9e1adb15938 [chore](be-ut) Fix the issues with BE UT when starting on
macOS (#35946)
new bd9f0963d9f [fix](memory) Allocator check failed log stacktrace if not
catch exception (#35965)
The 95 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.asf.yaml | 28 +
.github/workflows/be-ut-mac.yml | 4 +-
.github/workflows/comment-to-trigger-teamcity.yml | 22 +-
be/CMakeLists.txt | 3 +
be/src/agent/task_worker_pool.cpp | 6 +-
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 17 +-
be/src/cloud/cloud_meta_mgr.cpp | 16 +-
be/src/cloud/cloud_meta_mgr.h | 3 +-
be/src/cloud/cloud_storage_engine.cpp | 28 +-
be/src/cloud/cloud_storage_engine.h | 2 +-
be/src/common/config.cpp | 9 +
be/src/common/config.h | 16 +-
be/src/common/exception.cpp | 8 +-
be/src/common/exception.h | 2 +-
be/src/common/logconfig.cpp | 39 +-
be/src/common/status.h | 4 +-
be/src/common/utils.h | 3 +-
be/src/exec/data_sink.cpp | 382 -----
be/src/exec/data_sink.h | 127 --
be/src/exec/exec_node.cpp | 637 -------
be/src/exec/exec_node.h | 366 ----
be/src/exec/scan_node.cpp | 57 -
be/src/exec/scan_node.h | 109 --
.../exec/schema_scanner/schema_rowsets_scanner.cpp | 13 +-
be/src/exprs/runtime_filter.cpp | 59 +-
be/src/exprs/runtime_filter.h | 26 +-
be/src/gutil/CMakeLists.txt | 2 -
be/src/gutil/endian.h | 50 -
be/src/gutil/hash/city.cc | 119 +-
be/src/gutil/hash/city.h | 10 +-
be/src/gutil/hash/hash.cc | 188 --
be/src/gutil/hash/hash.h | 276 ---
be/src/gutil/hash/hash128to64.h | 21 -
be/src/gutil/hash/legacy_hash.h | 80 -
be/src/gutil/hash/string_hash.h | 77 -
be/src/gutil/int128.cc | 17 -
be/src/gutil/int128.h | 328 ----
be/src/gutil/strings/numbers.cc | 10 -
be/src/gutil/strings/numbers.h | 4 -
be/src/gutil/strings/stringpiece.cc | 5 -
be/src/gutil/strings/stringpiece.h | 34 +-
be/src/http/action/http_stream.cpp | 1 -
be/src/http/action/restore_tablet_action.cpp | 2 +-
be/src/http/utils.cpp | 35 +-
be/src/io/cache/block_file_cache.cpp | 13 +-
be/src/io/cache/block_file_cache_factory.cpp | 10 +-
be/src/io/cache/block_file_cache_factory.h | 1 +
be/src/io/cache/file_cache_common.h | 7 +-
be/src/io/file_factory.cpp | 20 -
be/src/io/fs/hdfs_file_system.cpp | 1 -
be/src/io/fs/multi_table_pipe.cpp | 219 ++-
be/src/io/fs/multi_table_pipe.h | 11 +-
be/src/io/fs/s3_obj_storage_client.cpp | 4 +-
be/src/io/hdfs_util.cpp | 26 +-
be/src/olap/base_tablet.cpp | 23 +-
be/src/olap/compaction.cpp | 3 +-
be/src/olap/data_dir.cpp | 48 +-
be/src/olap/data_dir.h | 4 +-
be/src/olap/delete_handler.cpp | 85 +-
be/src/olap/delete_handler.h | 14 +-
be/src/olap/field.h | 2 -
be/src/olap/olap_meta.cpp | 23 +-
be/src/olap/olap_meta.h | 13 +-
be/src/olap/parallel_scanner_builder.cpp | 16 +-
be/src/olap/parallel_scanner_builder.h | 10 +-
be/src/olap/rowset/rowset_meta.cpp | 15 +-
be/src/olap/rowset/rowset_meta.h | 4 +-
be/src/olap/rowset/rowset_meta_manager.cpp | 48 +-
be/src/olap/rowset/rowset_meta_manager.h | 4 +-
be/src/olap/rowset/segment_v2/binary_dict_page.h | 6 +-
be/src/olap/rowset/segment_v2/binary_plain_page.h | 2 +-
.../segment_v2/bloom_filter_index_writer.cpp | 6 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 353 ++--
be/src/olap/rowset/segment_v2/column_reader.h | 21 +-
be/src/olap/rowset/segment_v2/column_writer.cpp | 479 +++---
be/src/olap/rowset/segment_v2/column_writer.h | 12 +
.../olap/rowset/segment_v2/inverted_index_desc.cpp | 8 +-
.../olap/rowset/segment_v2/inverted_index_desc.h | 5 +-
.../segment_v2/inverted_index_file_reader.cpp | 2 +-
.../segment_v2/inverted_index_file_writer.cpp | 39 +-
.../olap/rowset/segment_v2/inverted_index_writer.h | 8 +-
be/src/olap/rowset/segment_v2/page_io.h | 2 +-
be/src/olap/rowset/segment_v2/page_pointer.h | 2 +-
be/src/olap/rowset/segment_v2/segment.cpp | 2 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 5 +-
.../rowset/segment_v2/vertical_segment_writer.cpp | 4 +-
be/src/olap/schema_change.cpp | 1 -
be/src/olap/single_replica_compaction.cpp | 4 +-
be/src/olap/storage_engine.cpp | 74 +-
be/src/olap/storage_policy.cpp | 33 +-
be/src/olap/storage_policy.h | 9 +-
be/src/olap/tablet.cpp | 5 +-
be/src/olap/tablet_manager.cpp | 124 +-
be/src/olap/tablet_manager.h | 19 +-
be/src/olap/tablet_meta.cpp | 13 +-
be/src/olap/tablet_meta.h | 2 +-
be/src/olap/tablet_meta_manager.cpp | 30 +-
be/src/olap/tablet_meta_manager.h | 25 +-
be/src/olap/tablet_reader.cpp | 83 +-
be/src/olap/tablet_schema.h | 23 +-
be/src/olap/task/engine_clone_task.cpp | 32 +-
be/src/olap/task/engine_storage_migration_task.cpp | 8 +
be/src/olap/types.cpp | 2 +-
be/src/olap/utils.h | 8 +-
be/src/olap/wal/wal_manager.cpp | 1 -
be/src/olap/wal/wal_table.cpp | 1 -
be/src/pipeline/common/agg_utils.h | 340 ++++
.../data_gen_functions/vdata_gen_function_inf.h | 4 +-
.../common}/data_gen_functions/vnumbers_tvf.cpp | 14 +-
.../common}/data_gen_functions/vnumbers_tvf.h | 6 +-
be/src/pipeline/common/join_utils.h | 68 +
.../common}/runtime_filter_consumer.cpp | 16 +-
.../common}/runtime_filter_consumer.h | 10 +-
be/src/pipeline/dependency.cpp | 28 +-
be/src/pipeline/dependency.h | 112 +-
be/src/pipeline/exec/aggregation_sink_operator.cpp | 41 +-
be/src/pipeline/exec/aggregation_sink_operator.h | 4 +-
.../pipeline/exec/aggregation_source_operator.cpp | 1 +
be/src/pipeline/exec/analytic_sink_operator.cpp | 14 +-
be/src/pipeline/exec/analytic_sink_operator.h | 9 +-
be/src/pipeline/exec/analytic_source_operator.cpp | 29 +-
be/src/pipeline/exec/analytic_source_operator.h | 21 +-
be/src/pipeline/exec/datagen_operator.cpp | 7 +-
be/src/pipeline/exec/datagen_operator.h | 4 +-
.../distinct_streaming_aggregation_operator.cpp | 3 +-
.../exec/distinct_streaming_aggregation_operator.h | 2 +-
be/src/pipeline/exec/es_scan_operator.cpp | 14 +-
be/src/pipeline/exec/exchange_sink_buffer.h | 1 -
be/src/pipeline/exec/exchange_sink_operator.cpp | 22 +-
be/src/pipeline/exec/exchange_sink_operator.h | 3 +-
be/src/pipeline/exec/exchange_source_operator.cpp | 1 -
.../exec/group_commit_block_sink_operator.cpp | 1 +
.../exec/group_commit_block_sink_operator.h | 7 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 30 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 60 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 13 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 32 +-
be/src/pipeline/exec/hive_table_sink_operator.h | 2 +-
be/src/pipeline/exec/iceberg_table_sink_operator.h | 2 +-
be/src/pipeline/exec/jdbc_table_sink_operator.cpp | 4 -
be/src/pipeline/exec/jdbc_table_sink_operator.h | 9 +-
.../exec/join/cross_join_impl.cpp | 2 +-
.../exec/join/full_outer_join_impl.cpp | 2 +-
.../exec/join/inner_join_impl.cpp | 2 +-
be/src/{vec => pipeline}/exec/join/join_op.h | 14 +-
.../exec/join/left_anti_join_impl.cpp | 2 +-
.../exec/join/left_outer_join_impl.cpp | 2 +-
.../exec/join/left_semi_join_impl.cpp | 2 +-
.../exec/join/null_aware_left_anti_join_impl.cpp | 2 +-
.../exec/join/null_aware_left_semi_join_impl.cpp | 2 +-
.../exec/join/process_hash_table_probe.h | 57 +-
.../exec/join/process_hash_table_probe_impl.h | 240 +--
.../exec/join/right_anti_join_impl.cpp | 2 +-
.../exec/join/right_outer_join_impl.cpp | 2 +-
.../exec/join/right_semi_join_impl.cpp | 2 +-
be/src/pipeline/exec/join_build_sink_operator.h | 2 +-
.../pipeline/exec/multi_cast_data_stream_sink.cpp | 30 +
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 27 +-
.../exec/multi_cast_data_stream_source.cpp | 12 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 5 +-
be/src/pipeline/exec/multi_cast_data_streamer.cpp | 5 +-
be/src/pipeline/exec/multi_cast_data_streamer.h | 2 +-
.../exec/nested_loop_join_build_operator.cpp | 33 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 30 +-
be/src/pipeline/exec/olap_scan_operator.h | 15 +-
be/src/pipeline/exec/olap_table_sink_operator.h | 2 +-
be/src/pipeline/exec/olap_table_sink_v2_operator.h | 2 +-
be/src/pipeline/exec/operator.cpp | 1 -
be/src/pipeline/exec/operator.h | 3 +-
.../pipeline/exec/partition_sort_sink_operator.cpp | 94 +-
.../pipeline/exec/partition_sort_sink_operator.h | 188 +-
.../exec/partitioned_aggregation_sink_operator.h | 1 +
.../exec/partitioned_hash_join_probe_operator.cpp | 20 +
.../exec/partitioned_hash_join_probe_operator.h | 2 +
be/src/pipeline/exec/result_file_sink_operator.cpp | 37 +-
be/src/pipeline/exec/result_file_sink_operator.h | 15 +-
be/src/pipeline/exec/result_sink_operator.cpp | 18 +-
be/src/pipeline/exec/result_sink_operator.h | 86 +-
be/src/pipeline/exec/scan_operator.cpp | 182 +-
be/src/pipeline/exec/scan_operator.h | 86 +-
be/src/pipeline/exec/schema_scan_operator.h | 2 +-
be/src/pipeline/exec/set_sink_operator.cpp | 2 +-
be/src/pipeline/exec/set_source_operator.cpp | 2 +-
be/src/pipeline/exec/set_source_operator.h | 2 +-
be/src/pipeline/exec/sort_source_operator.cpp | 43 +-
be/src/pipeline/exec/sort_source_operator.h | 17 +
.../exec/streaming_aggregation_operator.cpp | 19 +-
.../pipeline/exec/streaming_aggregation_operator.h | 4 +-
be/src/pipeline/exec/table_function_operator.h | 2 +-
.../local_exchange_sink_operator.cpp | 54 +
.../local_exchange/local_exchange_sink_operator.h | 67 +-
.../local_exchange_source_operator.cpp | 6 +-
.../local_exchange_source_operator.h | 8 +-
be/src/pipeline/local_exchange/local_exchanger.cpp | 146 +-
be/src/pipeline/local_exchange/local_exchanger.h | 155 +-
be/src/pipeline/pipeline_fragment_context.cpp | 27 +-
be/src/pipeline/pipeline_task.h | 1 -
be/src/runtime/buffer_control_block.cpp | 245 ++-
be/src/runtime/buffer_control_block.h | 51 +-
be/src/runtime/fragment_mgr.cpp | 296 +---
be/src/runtime/fragment_mgr.h | 8 -
be/src/runtime/group_commit_mgr.cpp | 3 +-
be/src/runtime/memory/cache_manager.h | 5 +-
be/src/runtime/plan_fragment_executor.cpp | 664 --------
be/src/runtime/plan_fragment_executor.h | 280 ---
be/src/runtime/query_context.cpp | 112 +-
be/src/runtime/query_context.h | 35 +-
be/src/runtime/result_buffer_mgr.cpp | 8 +-
be/src/runtime/result_buffer_mgr.h | 3 +-
be/src/runtime/result_writer.h | 2 -
be/src/runtime/runtime_filter_mgr.cpp | 2 -
be/src/runtime/runtime_filter_mgr.h | 1 -
be/src/runtime/runtime_query_statistics_mgr.cpp | 155 +-
be/src/runtime/runtime_query_statistics_mgr.h | 42 +-
be/src/runtime/runtime_state.h | 11 +-
be/src/service/point_query_executor.h | 1 -
be/src/util/hash_util.hpp | 21 +-
be/src/util/lru_multi_cache.h | 1 -
be/src/util/lru_multi_cache.inline.h | 1 +
be/src/util/path_util.cpp | 26 -
be/src/util/path_util.h | 9 -
be/src/util/s3_util.h | 20 +-
be/src/util/trace.h | 1 -
be/src/vec/common/allocator.cpp | 5 +-
be/src/vec/common/hash_table/hash.h | 11 +-
be/src/vec/common/hash_table/hash_map_context.h | 12 +-
.../vec/common/hash_table/hash_table_set_build.h | 2 +-
.../vec/common/hash_table/hash_table_set_probe.h | 1 -
be/src/vec/common/hash_table/string_hash_map.h | 6 +-
be/src/vec/common/hash_table/string_hash_table.h | 8 +-
be/src/vec/common/string_ref.h | 63 +-
be/src/vec/common/uint128.h | 123 +-
be/src/vec/core/sort_cursor.h | 3 +
be/src/vec/core/wide_integer.h | 22 +
be/src/vec/data_types/convert_field_to_type.cpp | 7 -
be/src/vec/data_types/data_type_factory.cpp | 28 +-
be/src/vec/data_types/data_type_number.h | 3 -
be/src/vec/data_types/data_type_time_v2.cpp | 14 +-
be/src/vec/exec/format/column_type_convert.h | 6 +-
be/src/vec/exec/join/vacquire_list.hpp | 54 -
be/src/vec/exec/join/vhash_join_node.cpp | 1041 ------------
be/src/vec/exec/join/vhash_join_node.h | 394 -----
be/src/vec/exec/join/vjoin_node_base.cpp | 350 ----
be/src/vec/exec/join/vjoin_node_base.h | 168 --
be/src/vec/exec/join/vnested_loop_join_node.cpp | 723 --------
be/src/vec/exec/join/vnested_loop_join_node.h | 268 ---
be/src/vec/exec/scan/group_commit_scan_node.cpp | 73 -
be/src/vec/exec/scan/group_commit_scan_node.h | 49 -
be/src/vec/exec/scan/new_es_scan_node.cpp | 177 --
be/src/vec/exec/scan/new_es_scan_node.h | 91 -
be/src/vec/exec/scan/new_es_scanner.cpp | 34 +-
be/src/vec/exec/scan/new_es_scanner.h | 5 -
be/src/vec/exec/scan/new_file_scan_node.cpp | 134 --
be/src/vec/exec/scan/new_file_scan_node.h | 73 -
be/src/vec/exec/scan/new_jdbc_scan_node.cpp | 75 -
be/src/vec/exec/scan/new_jdbc_scan_node.h | 56 -
be/src/vec/exec/scan/new_jdbc_scanner.cpp | 30 +-
be/src/vec/exec/scan/new_jdbc_scanner.h | 3 -
be/src/vec/exec/scan/new_odbc_scan_node.cpp | 74 -
be/src/vec/exec/scan/new_odbc_scan_node.h | 60 -
be/src/vec/exec/scan/new_odbc_scanner.cpp | 241 ---
be/src/vec/exec/scan/new_odbc_scanner.h | 85 -
be/src/vec/exec/scan/new_olap_scan_node.cpp | 681 --------
be/src/vec/exec/scan/new_olap_scan_node.h | 222 ---
be/src/vec/exec/scan/new_olap_scanner.cpp | 94 +-
be/src/vec/exec/scan/new_olap_scanner.h | 10 +-
be/src/vec/exec/scan/pip_scanner_context.h | 73 -
be/src/vec/exec/scan/scanner_context.cpp | 93 +-
be/src/vec/exec/scan/scanner_context.h | 32 +-
be/src/vec/exec/scan/vfile_scanner.cpp | 78 +-
be/src/vec/exec/scan/vfile_scanner.h | 20 +-
be/src/vec/exec/scan/vmeta_scan_node.cpp | 84 -
be/src/vec/exec/scan/vmeta_scan_node.h | 65 -
be/src/vec/exec/scan/vmeta_scanner.cpp | 10 -
be/src/vec/exec/scan/vmeta_scanner.h | 4 -
be/src/vec/exec/scan/vscan_node.cpp | 1306 --------------
be/src/vec/exec/scan/vscan_node.h | 420 -----
be/src/vec/exec/scan/vscanner.cpp | 53 +-
be/src/vec/exec/scan/vscanner.h | 6 -
be/src/vec/exec/vaggregation_node.cpp | 1787 --------------------
be/src/vec/exec/vaggregation_node.h | 786 ---------
be/src/vec/exec/vanalytic_eval_node.cpp | 812 ---------
be/src/vec/exec/vanalytic_eval_node.h | 192 ---
be/src/vec/exec/vassert_num_rows_node.cpp | 155 --
be/src/vec/exec/vassert_num_rows_node.h | 51 -
be/src/vec/exec/vdata_gen_scan_node.cpp | 137 --
be/src/vec/exec/vdata_gen_scan_node.h | 71 -
be/src/vec/exec/vempty_set_node.cpp | 38 -
be/src/vec/exec/vempty_set_node.h | 40 -
be/src/vec/exec/vexchange_node.cpp | 145 --
be/src/vec/exec/vexchange_node.h | 76 -
be/src/vec/exec/vmysql_scan_node.cpp | 234 ---
be/src/vec/exec/vmysql_scan_node.h | 83 -
be/src/vec/exec/vpartition_sort_node.cpp | 436 -----
be/src/vec/exec/vpartition_sort_node.h | 285 ----
be/src/vec/exec/vrepeat_node.cpp | 301 ----
be/src/vec/exec/vrepeat_node.h | 90 -
be/src/vec/exec/vschema_scan_node.cpp | 308 ----
be/src/vec/exec/vschema_scan_node.h | 81 -
be/src/vec/exec/vselect_node.cpp | 90 -
be/src/vec/exec/vselect_node.h | 46 -
be/src/vec/exec/vset_operation_node.cpp | 604 -------
be/src/vec/exec/vset_operation_node.h | 143 --
be/src/vec/exec/vsort_node.cpp | 205 ---
be/src/vec/exec/vsort_node.h | 106 --
be/src/vec/exec/vtable_function_node.cpp | 303 ----
be/src/vec/exec/vtable_function_node.h | 174 --
be/src/vec/exec/vunion_node.cpp | 343 ----
be/src/vec/exec/vunion_node.h | 135 --
be/src/vec/exprs/vectorized_fn_call.cpp | 4 +-
be/src/vec/functions/function.h | 5 +
.../vec/functions/function_datetime_floor_ceil.cpp | 248 +--
be/src/vec/functions/function_fake.h | 26 +-
be/src/vec/functions/function_string.h | 28 +-
be/src/vec/functions/function_timestamp.cpp | 35 +-
be/src/vec/json/path_in_data.cpp | 2 +-
be/src/vec/olap/olap_data_convertor.cpp | 80 +-
be/src/vec/olap/olap_data_convertor.h | 20 +-
be/src/vec/runtime/vdata_stream_mgr.cpp | 4 +-
be/src/vec/runtime/vdata_stream_recvr.cpp | 24 +-
be/src/vec/runtime/vdata_stream_recvr.h | 1 -
be/src/vec/runtime/vdatetime_value.cpp | 72 +-
be/src/vec/runtime/vdatetime_value.h | 86 +-
be/src/vec/runtime/vsorted_run_merger.cpp | 27 +-
be/src/vec/runtime/vsorted_run_merger.h | 4 -
be/src/vec/sink/async_writer_sink.h | 133 --
be/src/vec/sink/group_commit_block_sink.cpp | 332 ----
be/src/vec/sink/group_commit_block_sink.h | 86 -
be/src/vec/sink/load_stream_map_pool.h | 1 -
be/src/vec/sink/load_stream_stub.h | 1 -
be/src/vec/sink/multi_cast_data_stream_sink.h | 56 -
be/src/vec/sink/varrow_flight_result_writer.cpp | 4 -
be/src/vec/sink/varrow_flight_result_writer.h | 2 -
be/src/vec/sink/vdata_stream_sender.cpp | 495 +-----
be/src/vec/sink/vdata_stream_sender.h | 183 +-
be/src/vec/sink/vhive_table_sink.cpp | 48 -
be/src/vec/sink/vhive_table_sink.h | 52 -
be/src/vec/sink/viceberg_table_sink.cpp | 49 -
be/src/vec/sink/viceberg_table_sink.h | 52 -
be/src/vec/sink/vmemory_scratch_sink.cpp | 113 --
be/src/vec/sink/vmemory_scratch_sink.h | 75 -
be/src/vec/sink/vmysql_result_writer.cpp | 5 -
be/src/vec/sink/vmysql_result_writer.h | 2 -
be/src/vec/sink/volap_table_sink.cpp | 136 --
be/src/vec/sink/volap_table_sink.h | 96 --
be/src/vec/sink/volap_table_sink_v2.cpp | 56 -
be/src/vec/sink/volap_table_sink_v2.h | 66 -
be/src/vec/sink/vresult_file_sink.cpp | 149 --
be/src/vec/sink/vresult_file_sink.h | 83 -
be/src/vec/sink/vresult_sink.cpp | 187 --
be/src/vec/sink/vresult_sink.h | 163 --
be/src/vec/sink/writer/vfile_result_writer.cpp | 4 +-
be/src/vec/sink/writer/vfile_result_writer.h | 8 +-
be/src/vec/sink/writer/vtablet_writer.h | 1 -
be/test/olap/delta_writer_test.cpp | 2 +-
be/test/olap/olap_meta_test.cpp | 2 +-
be/test/olap/rowset/beta_rowset_test.cpp | 2 +-
be/test/olap/segment_cache_test.cpp | 2 +-
be/test/olap/storage_resource_test.cpp | 68 +
be/test/olap/tablet_cooldown_test.cpp | 2 +-
be/test/olap/tablet_meta_manager_test.cpp | 4 +-
be/test/util/path_util_test.cpp | 11 -
.../vec_sequence_match_test.cpp | 12 +-
.../aggregate_functions/vec_window_funnel_test.cpp | 10 +-
be/test/vec/exec/vtablet_sink_test.cpp | 858 ----------
be/test/vec/exec/vwal_scanner_test.cpp | 27 +-
be/test/vec/exprs/vexpr_test.cpp | 2 +-
be/test/vec/runtime/vdata_stream_test.cpp | 221 ---
be/test/vec/runtime/vdatetime_value_test.cpp | 16 +-
bin/start_be.sh | 56 +-
cloud/cmake/thirdparty.cmake | 6 +
cloud/src/common/bvars.cpp | 2 +
cloud/src/common/bvars.h | 2 +
cloud/src/meta-service/http_encode_key.cpp | 59 +-
cloud/src/meta-service/meta_service.h | 24 +
.../src/meta-service/meta_service_tablet_stats.cpp | 98 +-
cloud/src/meta-service/meta_service_tablet_stats.h | 5 +
cloud/src/meta-service/meta_service_txn.cpp | 965 ++++++++++-
cloud/src/recycler/azure_obj_client.cpp | 222 +++
.../{s3_obj_client.h => azure_obj_client.h} | 19 +-
cloud/src/recycler/obj_store_accessor.h | 10 +-
cloud/src/recycler/recycler.cpp | 9 +
cloud/src/recycler/s3_accessor.cpp | 17 +-
cloud/src/recycler/s3_accessor.h | 2 +-
cloud/src/recycler/s3_obj_client.cpp | 11 +-
cloud/src/recycler/s3_obj_client.h | 2 +-
cloud/test/http_encode_key_test.cpp | 36 +-
cloud/test/meta_service_test.cpp | 320 ++++
cloud/test/recycler_test.cpp | 145 ++
docker/compilation/Dockerfile | 2 +-
.../main/java/org/apache/doris/common/Config.java | 22 +-
.../apache/doris/common/VariableAnnotation.java | 6 +-
fe/fe-core/pom.xml | 2 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 11 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 27 +-
fe/fe-core/src/main/cup/sql_parser.cup | 24 +
.../analysis/ModifyTablePropertiesClause.java | 17 +
.../apache/doris/analysis/ShowFrontendsStmt.java | 4 +-
.../apache/doris/analysis/ShowTableStatsStmt.java | 2 +-
.../apache/doris/catalog/CatalogRecycleBin.java | 3 +-
.../java/org/apache/doris/catalog/Database.java | 24 +
.../main/java/org/apache/doris/catalog/Env.java | 22 +-
.../org/apache/doris/catalog/InternalSchema.java | 4 +-
.../doris/catalog/InternalSchemaInitializer.java | 2 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 1 +
.../main/java/org/apache/doris/catalog/Table.java | 2 +-
.../doris/clone/DynamicPartitionScheduler.java | 2 +
.../doris/cloud/CacheHotspotManagerUtils.java | 1 +
.../apache/doris/cloud/rpc/MetaServiceClient.java | 18 +
.../apache/doris/cloud/rpc/MetaServiceProxy.java | 20 +
.../transaction/CloudGlobalTransactionMgr.java | 144 +-
.../java/org/apache/doris/common/ThriftServer.java | 61 +-
.../doris/common/proc/FrontendsProcNode.java | 2 +-
.../doris/common/proc/PartitionsProcDir.java | 23 +-
.../doris/common/profile/ExecutionProfile.java | 250 +--
.../org/apache/doris/common/profile/Profile.java | 3 -
.../apache/doris/datasource/InternalCatalog.java | 17 +-
.../jdbc/source/JdbcFunctionPushDownRule.java | 4 +
.../apache/doris/datasource/kafka/KafkaUtil.java | 171 +-
.../org/apache/doris/httpv2/rest/LoadAction.java | 45 +-
.../doris/journal/bdbje/BDBJournalCursor.java | 4 +
.../main/java/org/apache/doris/load/ExportJob.java | 10 +-
.../main/java/org/apache/doris/load/ExportMgr.java | 6 +-
.../org/apache/doris/load/StreamLoadHandler.java | 7 +
.../apache/doris/load/loadv2/BrokerLoadJob.java | 3 +-
.../load/loadv2/BrokerLoadingTaskAttachment.java | 9 +-
.../apache/doris/load/loadv2/LoadLoadingTask.java | 6 +-
.../load/routineload/KafkaRoutineLoadJob.java | 9 +-
.../org/apache/doris/mtmv/MTMVPartitionInfo.java | 6 -
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 4 +-
.../org/apache/doris/nereids/cost/CostModelV1.java | 7 +
.../glue/translator/PhysicalPlanTranslator.java | 6 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 39 +-
.../doris/nereids/parser/PartitionTableInfo.java | 6 +-
.../properties/ChildrenPropertiesRegulator.java | 10 -
.../org/apache/doris/nereids/rules/RuleType.java | 3 +
.../nereids/rules/analysis/BindExpression.java | 13 +-
.../nereids/rules/analysis/FillUpMissingSlots.java | 64 +-
.../nereids/rules/analysis/NormalizeRepeat.java | 10 +-
.../exploration/join/OuterJoinLAsscomProject.java | 2 +-
.../mv/AsyncMaterializationContext.java | 6 +-
.../exploration/mv/MaterializedViewUtils.java | 221 ++-
.../mv/rollup/AggFunctionRollUpHandler.java | 5 +-
.../rules/expression/ExpressionNormalization.java | 2 +
.../rules/expression/QueryColumnCollector.java | 15 +-
.../rules/expression/rules/MergeDateTrunc.java | 78 +
.../rules/implementation/AggregateStrategies.java | 119 +-
.../nereids/rules/rewrite/AdjustPreAggStatus.java | 2 +-
.../ExtractAndNormalizeWindowExpression.java | 3 +-
.../nereids/rules/rewrite/MergeAggregate.java | 2 +-
.../mv/SelectMaterializedIndexWithAggregate.java | 2 +-
.../org/apache/doris/nereids/trees/TreeNode.java | 8 +-
.../ComputeSignatureForDateArithmetic.java | 59 +
.../functions/ComputeSignatureHelper.java | 1 -
.../expressions/functions/scalar/DaysAdd.java | 4 +-
.../expressions/functions/scalar/DaysSub.java | 4 +-
.../expressions/functions/scalar/MaskFirstN.java | 8 +
.../expressions/functions/scalar/MaskLastN.java | 8 +
.../expressions/functions/scalar/MonthsAdd.java | 15 +-
.../expressions/functions/scalar/MonthsSub.java | 15 +-
.../expressions/functions/scalar/WeeksAdd.java | 4 +-
.../expressions/functions/scalar/WeeksSub.java | 4 +-
.../expressions/functions/scalar/YearsAdd.java | 15 +-
.../expressions/functions/scalar/YearsSub.java | 15 +-
.../expressions/functions/udf/AliasUdfBuilder.java | 5 +-
.../trees/expressions/literal/DateLiteral.java | 18 +
.../trees/expressions/literal/Interval.java | 37 +-
.../nereids/trees/plans/algebra/Aggregate.java | 22 +
.../doris/nereids/trees/plans/algebra/Repeat.java | 32 +
.../trees/plans/commands/DeleteFromCommand.java | 8 +-
.../trees/plans/commands/info/CreateMTMVInfo.java | 17 +
.../commands/info/MTMVPartitionDefinition.java | 107 +-
.../commands/insert/AbstractInsertExecutor.java | 10 +-
.../insert/BatchInsertIntoTableCommand.java | 7 +-
.../commands/insert/GroupCommitInsertExecutor.java | 251 +++
.../plans/commands/insert/GroupCommitInserter.java | 144 --
.../commands/insert/InsertIntoTableCommand.java | 13 +-
.../insert/InsertOverwriteTableCommand.java | 3 +-
.../trees/plans/commands/insert/InsertUtils.java | 5 +-
.../plans/commands/insert/OlapInsertExecutor.java | 2 +-
.../trees/plans/physical/PhysicalRepeat.java | 7 +
.../org/apache/doris/nereids/types/BigIntType.java | 10 +-
.../org/apache/doris/nereids/types/DataType.java | 8 +-
.../apache/doris/nereids/types/LargeIntType.java | 11 +-
.../apache/doris/nereids/util/ExpressionUtils.java | 5 +-
.../org/apache/doris/nereids/util/PlanUtils.java | 6 +-
.../org/apache/doris/persist/gson/GsonUtils.java | 94 +-
.../persist/gson/RuntimeTypeAdapterFactory.java | 24 +-
.../apache/doris/planner/GroupCommitPlanner.java | 42 +-
.../doris/plugin/audit/AuditStreamLoader.java | 6 +-
.../java/org/apache/doris/qe/ConnectContext.java | 10 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 920 ++--------
.../java/org/apache/doris/qe/SessionVariable.java | 30 +-
.../java/org/apache/doris/qe/SimpleScheduler.java | 6 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 24 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 5 +
.../org/apache/doris/statistics/AnalysisInfo.java | 4 +-
.../apache/doris/statistics/AnalysisManager.java | 25 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 30 +-
.../doris/statistics/ExternalAnalysisTask.java | 5 +
.../apache/doris/statistics/HMSAnalysisTask.java | 21 +
.../org/apache/doris/statistics/HistogramTask.java | 5 +
.../apache/doris/statistics/OlapAnalysisTask.java | 42 +
.../org/apache/doris/statistics/Statistics.java | 2 +-
.../doris/statistics/StatisticsAutoCollector.java | 2 +-
.../doris/statistics/StatisticsRepository.java | 27 +-
.../apache/doris/statistics/TableStatsMeta.java | 16 +-
.../doris/statistics/util/StatisticsUtil.java | 21 +-
.../apache/doris/transaction/TransactionEntry.java | 83 +-
.../apache/doris/transaction/TransactionState.java | 6 +-
.../java/org/apache/doris/alter/AlterTest.java | 2 +-
.../analysis/CreateTableAsSelectStmtTest.java | 62 +-
.../apache/doris/nereids/cost/CostModelV1Test.java | 42 +
.../rules/analysis/NormalizeRepeatTest.java | 39 +-
.../exploration/mv/MaterializedViewUtilsTest.java | 172 +-
.../expression/ExpressionRewriteTestHelper.java | 6 +
.../rules/expression/MergeDateTruncTest.java | 57 +
.../rules/rewrite/mv/SelectMvIndexTest.java | 4 +-
.../trees/plans/CreateTableCommandTest.java | 14 +
.../apache/doris/nereids/types/DataTypeTest.java | 2 +
.../apache/doris/planner/ConstantExpressTest.java | 4 +-
.../doris/statistics/util/StatisticsUtilTest.java | 14 +-
gensrc/proto/cloud.proto | 55 +
gensrc/proto/segment_v2.proto | 3 +
gensrc/thrift/PaloInternalService.thrift | 2 +
.../data/correctness_p0/test_cast_date_decimal.out | 14 +-
...decimal.out => test_in_predicate_push_down.out} | 5 +-
.../datatype_p0/ip/test_ip_in_inverted_index.out | 104 +-
.../get_assignment_compatible_type.out | 6 +-
regression-test/data/ddl_p0/test_create_view.out | 2 +-
.../data/ddl_p0/test_create_view_nereids.out | 20 +-
.../test_export_table_with_label_retry.out | 205 +++
.../test_export_table_with_materialized_view.out | 205 +++
.../data/external_table_p0/tvf/test_hdfs_tvf.out | 1 -
.../insert_group_commit_into_max_filter_ratio.out | 2 +
regression-test/data/insert_p0/txn_insert.out | 131 +-
.../data/insert_p0/txn_insert_inject_case.out | 9 +
.../data/load_p0/stream_load/test_keyword.csv | 10 +
.../stream_load/test_stream_load_keyword.out | 13 +
.../data/mtmv_p0/test_rollup_partition_mtmv.out | 22 +
.../test_row_column_mtmv.out} | 13 +-
.../diffrent_serialize/diffrent_serialize.out | 22 +
.../nereids_function_p0/scalar_function/Array.out | 259 +--
.../aggregate/agg_with_distinct_project.out | 30 +
.../data/nereids_p0/aggregate/aggregate.out | 4 +
.../fold_constant/fold_constant_by_fe.out | 200 +--
.../nereids_rules_p0/eager_aggregate/basic.out | 10 +-
.../push_down_count_through_join.out | 4 +-
.../push_down_count_through_join_one_side.out | 15 +-
.../eager_aggregate/push_down_max_through_join.out | 2 +-
.../eager_aggregate/push_down_min_through_join.out | 2 +-
.../eager_aggregate/push_down_sum_through_join.out | 8 +-
.../push_down_sum_through_join_one_side.out | 2 +-
.../eliminate_outer_join/eliminate_outer_join.out | 29 +-
.../push_down_top_n_distinct_through_join.out | 15 +-
.../data/nereids_syntax_p0/test_date_add.out | 28 +-
.../data/nereids_syntax_p0/test_date_sub.out | 24 +-
.../nereids_tpcds_shape_sf1000_p0/shape/query4.out | 4 +-
.../shape/query74.out | 4 +-
.../noStatsRfPrune/query95.out | 22 +-
.../no_stats_shape/query95.out | 24 +-
.../rf_prune/query4.out | 4 +-
.../rf_prune/query74.out | 4 +-
.../nereids_tpcds_shape_sf100_p0/shape/query4.out | 4 +-
.../nereids_tpcds_shape_sf100_p0/shape/query74.out | 4 +-
.../datetime_functions/test_date_floor_ceil.out | 36 +
.../query_p0/system/test_query_sys_rowsets.out | 1 +
.../data/query_p0/system/test_table_options.out | 12 +-
.../test_unique_model_schema_value_change.out | 80 +
.../test_unique_model_schema_value_change2.out | 11 +
.../show_p0/test_show_create_table_and_views.out | 10 +-
.../test_show_create_table_and_views_nereids.out | 10 +-
.../create_view_star_except_and_cast_to_sql.out | 2 +-
regression-test/framework/pom.xml | 2 +-
.../org/apache/doris/regression/suite/Suite.groovy | 2 +-
.../alter_p2/test_alter_colocate_group.groovy | 42 +-
.../test_backup_restore_with_many_tables.groovy | 95 ++
.../test_drop_clone_tablet_path_race.groovy | 85 +
.../correctness/test_removed_session_var.groovy | 12 +-
.../correctness_p0/test_cast_date_decimal.groovy | 18 +-
.../test_in_predicate_push_down.groovy | 88 +
.../correctness_p0/test_mask_function.groovy | 17 +
.../ip/test_ip_in_inverted_index.groovy | 4 +-
.../test_export_table_with_label_retry.groovy | 249 +++
...test_export_table_with_materialized_view.groovy | 127 ++
.../jdbc/test_mysql_jdbc_catalog.groovy | 5 +
.../external_table_p0/tvf/test_hdfs_tvf.groovy | 43 +-
.../test_calc_crc_fault_injection.groovy | 10 +-
.../insert_p0/insert_group_commit_into.groovy | 14 +-
...nsert_group_commit_into_max_filter_ratio.groovy | 40 +-
.../insert_group_commit_into_unique.groovy | 6 +-
...nsert_group_commit_into_unique_sync_mode.groovy | 6 +-
.../insert_group_commit_with_exception.groovy | 39 +-
.../insert_group_commit_with_large_data.groovy | 2 +-
.../suites/insert_p0/insert_with_null.groovy | 2 +-
.../test_group_commit_data_bytes_property.groovy | 2 +-
.../test_group_commit_interval_ms_property.groovy | 2 +-
regression-test/suites/insert_p0/txn_insert.groovy | 468 ++---
.../insert_p0/txn_insert_concurrent_insert.groovy | 26 +-
.../suites/insert_p0/txn_insert_inject_case.groovy | 69 +-
.../insert_p0/txn_insert_with_schema_change.groovy | 88 +-
...mit_insert_into_lineitem_multiple_client.groovy | 2 -
...mmit_insert_into_lineitem_multiple_table.groovy | 2 -
...group_commit_insert_into_lineitem_normal.groovy | 2 -
...ommit_insert_into_lineitem_scheme_change.groovy | 2 -
.../suites/inverted_index_p0/test_show_data.groovy | 153 +-
.../javaudf_p0/test_javaudtf_all_types.groovy | 19 +-
.../suites/javaudf_p0/test_javaudtf_int.groovy | 5 +-
.../load_p0/broker_load/test_etl_failed.groovy | 2 +-
.../stream_load/test_stream_load_keyword.groovy | 75 +
.../suites/mtmv_p0/test_build_mtmv.groovy | 6 +
.../suites/mtmv_p0/test_limit_op_mtmv.groovy | 18 +
.../mtmv_p0/test_rollup_partition_mtmv.groovy | 325 ++++
.../suites/mtmv_p0/test_row_column_mtmv.groovy | 72 +
.../mtmv_p0/test_show_partitions_mtmv.groovy | 72 +
.../diffrent_serialize/diffrent_serialize.groovy | 93 +
.../scalar_function/Array.groovy | 124 +-
.../nereids_function_p0/scalar_function/R.groovy | 4 +
.../nereids_p0/aggregate/agg_window_project.groovy | 14 +
.../aggregate/agg_with_distinct_project.groovy | 80 +
.../suites/nereids_p0/aggregate/aggregate.groovy | 22 +
.../suites/nereids_p0/hint/test_distribute.groovy | 3 +-
.../push_down_count_through_join_one_side.groovy | 1 +
.../eliminate_gby_key/eliminate_gby_key.groovy | 12 +-
.../eliminate_outer_join.groovy | 2 +-
.../push_down_alias_through_join.groovy | 1 +
.../grouping_sets/grouping_normalize_test.groovy | 15 +
.../push_down_top_n_distinct_through_join.groovy | 1 +
.../suites/nereids_syntax_p0/agg_4_phase.groovy | 4 +-
.../suites/nereids_syntax_p0/cast.groovy | 5 +
.../suites/nereids_syntax_p0/select_const.groovy | 2 +
.../suites/node_p0/test_frontend.groovy | 8 +-
.../test_col_data_type_boundary.groovy | 380 +++++
.../performance_p0/redundant_conjuncts.groovy | 1 +
.../suites/query_p0/join/test_join.groovy | 2 +-
.../datetime_functions/test_date_floor_ceil.groovy | 17 +-
.../test_unique_model_schema_value_change.groovy | 819 +++++++++
.../test_unique_model_schema_value_change2.groovy | 951 +++++++++++
.../suites/statistics/test_partition_stats.groovy | 72 +
.../test_unsigned_int_compatibility.groovy | 55 -
run-be-ut.sh | 5 +
tools/tpcds-tools/ddl/create-tpcds-tables-sf1.sql | 2 +-
.../tpcds-tools/ddl/create-tpcds-tables-sf100.sql | 2 +-
.../tpcds-tools/ddl/create-tpcds-tables-sf1000.sql | 2 +-
.../ddl/create-tpcds-tables-sf10000.sql | 2 +-
645 files changed, 14430 insertions(+), 29348 deletions(-)
delete mode 100644 be/src/exec/data_sink.cpp
delete mode 100644 be/src/exec/data_sink.h
delete mode 100644 be/src/exec/exec_node.cpp
delete mode 100644 be/src/exec/exec_node.h
delete mode 100644 be/src/exec/scan_node.cpp
delete mode 100644 be/src/exec/scan_node.h
delete mode 100644 be/src/gutil/hash/hash.cc
delete mode 100644 be/src/gutil/hash/hash.h
delete mode 100644 be/src/gutil/hash/hash128to64.h
delete mode 100644 be/src/gutil/hash/legacy_hash.h
delete mode 100644 be/src/gutil/hash/string_hash.h
delete mode 100644 be/src/gutil/int128.cc
delete mode 100644 be/src/gutil/int128.h
create mode 100644 be/src/pipeline/common/agg_utils.h
rename be/src/{vec/exec =>
pipeline/common}/data_gen_functions/vdata_gen_function_inf.h (97%)
rename be/src/{vec/exec =>
pipeline/common}/data_gen_functions/vnumbers_tvf.cpp (87%)
rename be/src/{vec/exec => pipeline/common}/data_gen_functions/vnumbers_tvf.h
(93%)
create mode 100644 be/src/pipeline/common/join_utils.h
rename be/src/{vec/exec => pipeline/common}/runtime_filter_consumer.cpp (94%)
rename be/src/{vec/exec => pipeline/common}/runtime_filter_consumer.h (92%)
copy be/src/{vec => pipeline}/exec/join/cross_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/full_outer_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/inner_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/join_op.h (92%)
rename be/src/{vec => pipeline}/exec/join/left_anti_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/left_outer_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/left_semi_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/null_aware_left_anti_join_impl.cpp
(96%)
rename be/src/{vec => pipeline}/exec/join/null_aware_left_semi_join_impl.cpp
(96%)
rename be/src/{vec => pipeline}/exec/join/process_hash_table_probe.h (71%)
rename be/src/{vec => pipeline}/exec/join/process_hash_table_probe_impl.h (75%)
rename be/src/{vec => pipeline}/exec/join/right_anti_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/right_outer_join_impl.cpp (96%)
rename be/src/{vec => pipeline}/exec/join/right_semi_join_impl.cpp (96%)
delete mode 100644 be/src/runtime/plan_fragment_executor.cpp
delete mode 100644 be/src/runtime/plan_fragment_executor.h
delete mode 100644 be/src/vec/exec/join/vacquire_list.hpp
delete mode 100644 be/src/vec/exec/join/vhash_join_node.cpp
delete mode 100644 be/src/vec/exec/join/vhash_join_node.h
delete mode 100644 be/src/vec/exec/join/vjoin_node_base.cpp
delete mode 100644 be/src/vec/exec/join/vjoin_node_base.h
delete mode 100644 be/src/vec/exec/join/vnested_loop_join_node.cpp
delete mode 100644 be/src/vec/exec/join/vnested_loop_join_node.h
delete mode 100644 be/src/vec/exec/scan/group_commit_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/group_commit_scan_node.h
delete mode 100644 be/src/vec/exec/scan/new_es_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/new_es_scan_node.h
delete mode 100644 be/src/vec/exec/scan/new_file_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/new_file_scan_node.h
delete mode 100644 be/src/vec/exec/scan/new_jdbc_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/new_jdbc_scan_node.h
delete mode 100644 be/src/vec/exec/scan/new_odbc_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/new_odbc_scan_node.h
delete mode 100644 be/src/vec/exec/scan/new_odbc_scanner.cpp
delete mode 100644 be/src/vec/exec/scan/new_odbc_scanner.h
delete mode 100644 be/src/vec/exec/scan/new_olap_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/new_olap_scan_node.h
delete mode 100644 be/src/vec/exec/scan/pip_scanner_context.h
delete mode 100644 be/src/vec/exec/scan/vmeta_scan_node.cpp
delete mode 100644 be/src/vec/exec/scan/vmeta_scan_node.h
delete mode 100644 be/src/vec/exec/scan/vscan_node.cpp
delete mode 100644 be/src/vec/exec/vaggregation_node.cpp
delete mode 100644 be/src/vec/exec/vaggregation_node.h
delete mode 100644 be/src/vec/exec/vanalytic_eval_node.cpp
delete mode 100644 be/src/vec/exec/vanalytic_eval_node.h
delete mode 100644 be/src/vec/exec/vassert_num_rows_node.cpp
delete mode 100644 be/src/vec/exec/vassert_num_rows_node.h
delete mode 100644 be/src/vec/exec/vdata_gen_scan_node.cpp
delete mode 100644 be/src/vec/exec/vdata_gen_scan_node.h
delete mode 100644 be/src/vec/exec/vempty_set_node.cpp
delete mode 100644 be/src/vec/exec/vempty_set_node.h
delete mode 100644 be/src/vec/exec/vexchange_node.cpp
delete mode 100644 be/src/vec/exec/vexchange_node.h
delete mode 100644 be/src/vec/exec/vmysql_scan_node.cpp
delete mode 100644 be/src/vec/exec/vmysql_scan_node.h
delete mode 100644 be/src/vec/exec/vpartition_sort_node.cpp
delete mode 100644 be/src/vec/exec/vpartition_sort_node.h
delete mode 100644 be/src/vec/exec/vrepeat_node.cpp
delete mode 100644 be/src/vec/exec/vrepeat_node.h
delete mode 100644 be/src/vec/exec/vschema_scan_node.cpp
delete mode 100644 be/src/vec/exec/vschema_scan_node.h
delete mode 100644 be/src/vec/exec/vselect_node.cpp
delete mode 100644 be/src/vec/exec/vselect_node.h
delete mode 100644 be/src/vec/exec/vset_operation_node.cpp
delete mode 100644 be/src/vec/exec/vset_operation_node.h
delete mode 100644 be/src/vec/exec/vsort_node.cpp
delete mode 100644 be/src/vec/exec/vsort_node.h
delete mode 100644 be/src/vec/exec/vtable_function_node.cpp
delete mode 100644 be/src/vec/exec/vtable_function_node.h
delete mode 100644 be/src/vec/exec/vunion_node.cpp
delete mode 100644 be/src/vec/exec/vunion_node.h
delete mode 100644 be/src/vec/sink/async_writer_sink.h
delete mode 100644 be/src/vec/sink/group_commit_block_sink.cpp
delete mode 100644 be/src/vec/sink/group_commit_block_sink.h
delete mode 100644 be/src/vec/sink/multi_cast_data_stream_sink.h
delete mode 100644 be/src/vec/sink/vhive_table_sink.cpp
delete mode 100644 be/src/vec/sink/vhive_table_sink.h
delete mode 100644 be/src/vec/sink/viceberg_table_sink.cpp
delete mode 100644 be/src/vec/sink/viceberg_table_sink.h
delete mode 100644 be/src/vec/sink/vmemory_scratch_sink.cpp
delete mode 100644 be/src/vec/sink/vmemory_scratch_sink.h
delete mode 100644 be/src/vec/sink/volap_table_sink.cpp
delete mode 100644 be/src/vec/sink/volap_table_sink.h
delete mode 100644 be/src/vec/sink/volap_table_sink_v2.cpp
delete mode 100644 be/src/vec/sink/volap_table_sink_v2.h
delete mode 100644 be/src/vec/sink/vresult_file_sink.cpp
delete mode 100644 be/src/vec/sink/vresult_file_sink.h
delete mode 100644 be/src/vec/sink/vresult_sink.cpp
delete mode 100644 be/src/vec/sink/vresult_sink.h
create mode 100644 be/test/olap/storage_resource_test.cpp
delete mode 100644 be/test/vec/exec/vtablet_sink_test.cpp
delete mode 100644 be/test/vec/runtime/vdata_stream_test.cpp
create mode 100644 cloud/src/recycler/azure_obj_client.cpp
copy cloud/src/recycler/{s3_obj_client.h => azure_obj_client.h} (80%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rules/MergeDateTrunc.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/ComputeSignatureForDateArithmetic.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/GroupCommitInsertExecutor.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/GroupCommitInserter.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/cost/CostModelV1Test.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/expression/MergeDateTruncTest.java
copy regression-test/data/correctness_p0/{test_cast_date_decimal.out =>
test_in_predicate_push_down.out} (76%)
create mode 100644
regression-test/data/export_p0/test_export_table_with_label_retry.out
create mode 100644
regression-test/data/export_p0/test_export_table_with_materialized_view.out
create mode 100644 regression-test/data/insert_p0/txn_insert_inject_case.out
create mode 100644 regression-test/data/load_p0/stream_load/test_keyword.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_stream_load_keyword.out
copy regression-test/data/{correctness_p0/test_cast_date_decimal.out =>
mtmv_p0/test_row_column_mtmv.out} (59%)
create mode 100644
regression-test/data/mv_p0/agg_state/diffrent_serialize/diffrent_serialize.out
create mode 100644
regression-test/data/nereids_p0/aggregate/agg_with_distinct_project.out
create mode 100644
regression-test/data/schema_change_p0/test_unique_model_schema_value_change2.out
create mode 100644
regression-test/suites/backup_restore_p2/test_backup_restore_with_many_tables.groovy
create mode 100644
regression-test/suites/clone_p0/test_drop_clone_tablet_path_race.groovy
rename be/src/vec/exec/join/cross_join_impl.cpp =>
regression-test/suites/correctness/test_removed_session_var.groovy (80%)
create mode 100644
regression-test/suites/correctness_p0/test_in_predicate_push_down.groovy
create mode 100644
regression-test/suites/export_p0/test_export_table_with_label_retry.groovy
create mode 100644
regression-test/suites/export_p0/test_export_table_with_materialized_view.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_stream_load_keyword.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_row_column_mtmv.groovy
create mode 100644
regression-test/suites/mtmv_p0/test_show_partitions_mtmv.groovy
create mode 100644
regression-test/suites/mv_p0/agg_state/diffrent_serialize/diffrent_serialize.groovy
create mode 100644
regression-test/suites/nereids_p0/aggregate/agg_with_distinct_project.groovy
create mode 100644
regression-test/suites/partition_p0/auto_partition/test_col_data_type_boundary.groovy
create mode 100644
regression-test/suites/schema_change_p0/test_unique_model_schema_value_change2.groovy
delete mode 100644
regression-test/suites/types_p0/unsigned/test_unsigned_int_compatibility.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
