This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch rf-thrift-poc in repository https://gitbox.apache.org/repos/asf/doris.git
discard dcc240db083 move rf info from instance level to be level (#49474) add e3d62f9632c [Feature](parallel-result-sink) support async fetch from multiple backends concurrently (#47915) add 1ff635cad8b [fix](arrow-flight-sql) Modify the default value of `arrow_flight_sql_port` configuration (#49236) add dc207c6dcab [fix](cases) fix case for test_struct_functions without order by (#49247) add c505e473585 [fix](kerberos) Back to use principal and keytab to login kerberos instead of using kerberos ticket cache. (#48655) add 36d86cf6a01 Revert "[refactor](pipeline) Refine scheduling logics (#49180)" (#49279) add e885e46cc3a [chore](ci) support comment to trigger tc pipelines for PRs base dev … (#49271) add 5e7dc1ec737 [fix](case) Rename load_from_big_lateral_view.out to string_over_flow… (#48243) add 8fcdde1b143 [fix](Index)Make column unique ids in index dynamically computed (#48988) add 947463ddd7f [opt](Nereids) support more pattern in DeferMaterializeTopNResult (#48747) add 9a2ace74748 [fix](ci) adjust thirdparth download url (#48551) add 6d97b849c59 [chore](ci) rm unused file (#48326) add 606943828fa [improvement](statistics)Remove read lock when doing db analyze. (#49250) add 7af13a46d51 [fix](core) fix subreplace when inputting a large number of empty strings (#49241) add 6746c63a328 [Chore](test) remove unused code of zipf_distribution (#49248) add 9470a9538cf [feature](vault) Support database level storage vault (#45325) add 7a9809b620c [feat](deps) add jindofs jars (#49259) add c525ec568bb [fix](nereids)avoid generate Runtime filter whose target is not a base table column (#48804) add 1462d5f1315 [Refactor](runtime-filter) Refactor code about runtime filter (#48225) add 24e641b1f85 [fix](mow) remove rowset cache version (#49295) add 9dc034abeb4 [bugfix](be) split the usage of thread pool in internal service (#49292) add 20a925d77d2 [feature](function) upper lower support utf8 input (#49231) add bc0b0cdf75b [Bug](partition) fix partition sort lock scope cause error (#49243) add 1f00a6c8781 [fix](nereids) proper planning of shadow columns for load and schema change concurrent execution (#49332) add abea0e5ba72 [fix](test) Force enable light schema change for check before quit (#49301) add 095a2aed994 [fix](Nereids) fold constant for string function process emoji character by mistake (#49087) add c455f366b76 [enhancement](hudi)support native read hudi top level schema change table. (#49051) add 73ab13be580 [chore](thrift) remove some unused query options (#49254) add bfab8a31bc0 [improve](function) memory reuse in array_map fucntion (#49212) add 625c9d5e34d [enhance](auth)Change the syntax related to role from identifier to identifierOrText (#49215) add 67d54a23024 [fix](statistics)Fix replace table doesn't remove table stat meta memory leak bug. (#49345) add 04d83f4c274 [opt](meta-service) Implement set_value API for meta-servce (#49052) add cd0e5a78120 [opt](filecache) Do not remove parent directory when clear file cache (#49199) add ee789fefbe7 [opt](cloud) Add config enable_meta_service_endpoint_consistency_check (#49264) add 93084017974 [opt](s3client) Set ClientConfiguration.requestTimeoutMs default value from 3000ms to 30000ms (#49315) add f7b77e50ade [Fix](cloud-mow) Fix dup key problem due to calculating delete bitmaps for incremental rowsets based on wrong historical rowsets during SC (#49350) add 199580f15c1 [Enhancement](compaction) Add tablet info when cloud compaction crash (#49296) add b27a7dd062c [Bug](fix) fix the percentile func result do not equal the percentile array rewrite result (#49351) add 0210cade6ab [fix](deps) miss build_jindofs in build-thirdparty.sh (#49371) add bedec814816 [fix](nereids)TableQueryPlanAction can't work when having empty relation (#49178) add 1252261f65e [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids (#49308) add 0ba33494596 [Fix]fix query statistics leak in BE (#49325) add 97e7789feb0 [refactor](pipeline) Refactor state transition in pipeline task (#49281) add 4bd8b9d6302 [opt](iceberg)Optimize count* in batch mode (#49025) add 118ec7c0456 [feat](build) add jindofs jars by default for linux x64 & arm (#49374) add 6ab1e3a33a7 [case](restore) Rename repo name of backup-restore regression cases with suite name (#49237) add 52171352132 [fix](Nereids) fix cancel task jobs failed (#44755) add 6ce45c43e36 [Test][Fix](parquet-reader) Add parquet decoder unit tests and fix bugs by these tests. (#49182) add c8783bd7a18 [Enhancement] (nereids) implement showTableStatsCommand in nereids (#48827) add 0b0d2184890 [fix](tracker) Missing attaching task in fold constant executor (#49405) add a078defffbd [Enhancement](nereids)support show snapshot (#49274) add 69d12768fd5 [Test](cbq) Record err and print at the end of check_before_quit test (#49406) add e063ba6de96 [refactor](test) refactor compression test to verify compatibility of ARM and X86 (#49396) add 0f63dfed763 [Fix](log) correct tablet diff log in `TabletInvertedIndex.tabletReport` (#49390) add 80ee746a5b4 [Fix](compaction) Fix full compaction error when compaction size is too large (#48958) add 20f81637007 [enhance](third-party) Add pugixml library (#49238) add c4e61fb52c1 [Enhancement](ctas) Support create auto range partition table with CTAS command (#48931) add ece728136c1 [test](ut) Add cases for spill sort operator (#49207) add 65a32f76b05 [Feature](join) Support lazy materialization of columns that are not used in join other conjunct (#49073) add 2ad8108e3bb [fix](Nereids) use StringLikeLiteral as parameter type in constant folding (#49413) add f70aee99146 [Fix](Compaction) atomic should not be implicitly converted to int64_t (#49427) add 22390d1fc85 [fix](restore) correct the storage_medium of atomic restore (#49330) add d3a6ba57829 [test](beut) add pipeline Union/Intersect/Except Operator beut (#49293) add a65e0806ce5 [opt](metrics) optimize performance of metrics endpoint (#49380) add e3142fe5b55 [fix](docker) fix docker entrypoint script adminUser grep rule (#49343) add 5abb4c6d6e6 [fix](nereids) project child output to union output in correct order after eliminate empty relation (#49257) add 6d42a93ef62 [improve](function) support lead/lag function input column as third params (#49381) add dffbd5108db [Enhancement] Support some math functions (#48476) add bd157e6a62e [fix](jdbc catalog) ensure initialization before fetching row count (#49442) add 6d75dbc87b6 [fix](multi-catalog) Fix bug: "Can not create a Path from an empty string" (#49382) add 8f46bf97b21 [fix](spill) Fix `WorkloadGroupManager` in spill (#49373) add 386dad71893 [Fix](testcase) Change big txn load of auto partition test to not-primary table (#49435) add ed87894e525 [chore](ci) pr for dev branch can run cloud_p0 and performance (#49466) add 77a2b22ba6e [opt](nereids) remove redundant hash join condition (#48363) add 7b6d2e21226 [fix](nereids)canInferNotNullForMarkSlot method get wrong result if fold constant rule is disabled (#49428) add 5834faebe73 [Opt](cloud-sc) Clear stop token when `commit_tablet_job` fails (#49275) add 3708b43c564 [fix](inverted index) Fix for NullPointerException in Ordered Sloppy Phrase Query (#49487) add 3668945816a [fix](cloud) fix misuse of file_cache_evict_in_advance_batch_bytes (#49336) add b3b00eb67da [Bug] Fix accidental table deletion during restore job (#48820) add d9afcecc4ca [follow-up](nereids) speedup huge InPredicate for tablet pruning (#49386) add a61d7c44695 [chore](metrics) Add agent batch task metrics (#49480) add 44133312747 [chore](task) log the thrift message size if the broken pipe is occurred (#49492) add c602ed5f146 [fix](nereids) EliminateGroupByConstant should replace agg's group by after removing constant group by keys (#49473) add 79a6dd1ff49 [fix](catalog)when checkpoint,use cacheThreadPool (#49097) new 327915737a7 move rf info from instance level to be level (#49474) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (dcc240db083) \ N -- N -- N refs/heads/rf-thrift-poc (327915737a7) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/build-extension.yml | 2 +- .github/workflows/comment-to-trigger-teamcity.yml | 177 +- be/CMakeLists.txt | 2 + be/src/agent/heartbeat_server.cpp | 9 +- be/src/cloud/cloud_schema_change_job.cpp | 24 +- be/src/cloud/cloud_storage_engine.cpp | 20 +- be/src/cloud/cloud_storage_engine.h | 2 +- be/src/cloud/config.cpp | 1 + be/src/cloud/config.h | 3 + be/src/common/config.cpp | 14 +- be/src/common/config.h | 5 + be/src/common/daemon.cpp | 20 +- be/src/common/kerberos/kerberos_ticket_cache.cpp | 6 +- be/src/common/kerberos/kerberos_ticket_cache.h | 6 +- be/src/exec/olap_common.h | 26 +- be/src/exprs/bitmapfilter_predicate.h | 6 +- be/src/exprs/bloom_filter_func.h | 464 +----- be/src/exprs/bloom_filter_func_adaptor.h | 266 +++ be/src/exprs/bloom_filter_func_impl.h | 127 ++ be/src/exprs/create_predicate_function.h | 132 +- .../src/exprs/filter_base.h | 32 +- be/src/exprs/hybrid_map.h | 57 - be/src/exprs/hybrid_set.h | 59 +- be/src/exprs/minmax_predicate.h | 125 +- be/src/exprs/runtime_filter.cpp | 1737 -------------------- be/src/exprs/runtime_filter.h | 557 ------- be/src/exprs/runtime_filter_slots.h | 186 --- be/src/exprs/runtime_filter_slots_cross.h | 89 - be/src/io/cache/block_file_cache.cpp | 8 +- be/src/io/cache/fs_file_cache_storage.cpp | 42 +- be/src/io/fs/file_handle_cache.cpp | 4 + be/src/io/fs/hdfs/hdfs_mgr.cpp | 17 +- be/src/io/fs/hdfs_file_reader.cpp | 2 +- be/src/io/hdfs_builder.cpp | 37 +- be/src/io/hdfs_builder.h | 9 - be/src/io/hdfs_util.h | 14 +- be/src/olap/bitmap_filter_predicate.h | 5 - be/src/olap/bloom_filter_predicate.h | 17 +- be/src/olap/column_predicate.h | 35 +- be/src/olap/compaction_permit_limiter.h | 2 +- .../src/olap/filter_olap_param.h | 40 +- be/src/olap/in_list_predicate.h | 13 +- be/src/olap/memtable_flush_executor.cpp | 2 +- .../inverted_index/query/phrase_query.cpp | 4 +- be/src/olap/rowset/segment_v2/segment_iterator.cpp | 9 +- be/src/olap/tablet.cpp | 10 +- be/src/olap/tablet_meta.cpp | 70 +- be/src/olap/tablet_meta.h | 7 +- be/src/olap/tablet_reader.cpp | 45 +- be/src/olap/tablet_reader.h | 9 +- be/src/pipeline/common/runtime_filter_consumer.cpp | 182 -- be/src/pipeline/dependency.cpp | 28 +- be/src/pipeline/dependency.h | 14 +- be/src/pipeline/exec/datagen_operator.cpp | 9 +- be/src/pipeline/exec/es_scan_operator.cpp | 13 +- .../exec/group_commit_block_sink_operator.h | 1 + be/src/pipeline/exec/hashjoin_build_sink.cpp | 93 +- be/src/pipeline/exec/hashjoin_build_sink.h | 8 +- be/src/pipeline/exec/hashjoin_probe_operator.cpp | 40 +- be/src/pipeline/exec/hashjoin_probe_operator.h | 16 +- .../pipeline/exec/join/process_hash_table_probe.h | 41 +- .../exec/join/process_hash_table_probe_impl.h | 250 +-- be/src/pipeline/exec/join_build_sink_operator.cpp | 5 - be/src/pipeline/exec/join_build_sink_operator.h | 8 - .../exec/multi_cast_data_stream_source.cpp | 14 +- .../pipeline/exec/multi_cast_data_stream_source.h | 8 +- be/src/pipeline/exec/multi_cast_data_streamer.cpp | 2 +- .../exec/nested_loop_join_build_operator.cpp | 57 +- .../exec/nested_loop_join_build_operator.h | 12 +- be/src/pipeline/exec/olap_scan_operator.cpp | 18 +- be/src/pipeline/exec/olap_scan_operator.h | 2 +- .../pipeline/exec/partition_sort_sink_operator.cpp | 3 +- .../exec/partition_sort_source_operator.cpp | 3 +- .../exec/partitioned_hash_join_probe_operator.cpp | 14 +- .../exec/partitioned_hash_join_sink_operator.cpp | 9 +- be/src/pipeline/exec/scan_operator.cpp | 61 +- be/src/pipeline/exec/scan_operator.h | 24 +- be/src/pipeline/exec/schema_scan_operator.cpp | 2 +- be/src/pipeline/exec/set_probe_sink_operator.cpp | 6 +- be/src/pipeline/exec/set_probe_sink_operator.h | 5 + be/src/pipeline/exec/set_sink_operator.h | 8 + be/src/pipeline/exec/set_source_operator.cpp | 2 +- be/src/pipeline/exec/set_source_operator.h | 6 +- be/src/pipeline/exec/sort_source_operator.h | 2 +- be/src/pipeline/exec/spill_sort_sink_operator.cpp | 28 +- be/src/pipeline/exec/union_sink_operator.cpp | 2 +- be/src/pipeline/exec/union_sink_operator.h | 12 +- be/src/pipeline/exec/union_source_operator.cpp | 4 +- be/src/pipeline/exec/union_source_operator.h | 7 +- be/src/pipeline/pipeline_fragment_context.cpp | 2 +- be/src/pipeline/pipeline_task.cpp | 316 ++-- be/src/pipeline/pipeline_task.h | 101 +- be/src/pipeline/task_scheduler.cpp | 5 +- be/src/runtime/descriptor_helper.h | 55 + be/src/runtime/fold_constant_executor.cpp | 2 +- be/src/runtime/fragment_mgr.cpp | 157 +- be/src/runtime/fragment_mgr.h | 5 +- be/src/runtime/load_stream_mgr.h | 3 - be/src/runtime/memory/global_memory_arbitrator.cpp | 11 +- be/src/runtime/memory/global_memory_arbitrator.h | 21 +- be/src/runtime/memory/mem_tracker_limiter.cpp | 4 + be/src/runtime/memory/mem_tracker_limiter.h | 5 + be/src/runtime/memory/memory_profile.cpp | 3 +- be/src/runtime/memory/thread_mem_tracker_mgr.h | 3 +- be/src/runtime/query_context.cpp | 6 +- be/src/runtime/query_context.h | 6 +- be/src/runtime/runtime_filter_mgr.h | 296 ---- be/src/runtime/runtime_query_statistics_mgr.cpp | 44 +- be/src/runtime/runtime_state.cpp | 25 +- be/src/runtime/runtime_state.h | 39 +- be/src/runtime/thread_context.h | 44 +- be/src/runtime/workload_group/workload_group.cpp | 10 + .../workload_group/workload_group_manager.cpp | 169 +- .../workload_group/workload_group_manager.h | 2 +- be/src/runtime_filter/CMakeLists.txt | 27 + be/src/runtime_filter/runtime_filter.cpp | 132 ++ be/src/runtime_filter/runtime_filter.h | 133 ++ be/src/runtime_filter/runtime_filter_consumer.cpp | 229 +++ be/src/runtime_filter/runtime_filter_consumer.h | 141 ++ .../runtime_filter_consumer_helper.cpp | 151 ++ .../runtime_filter_consumer_helper.h} | 88 +- be/src/runtime_filter/runtime_filter_definitions.h | 100 ++ be/src/runtime_filter/runtime_filter_merger.h | 127 ++ .../runtime_filter_mgr.cpp | 297 ++-- be/src/runtime_filter/runtime_filter_mgr.h | 177 ++ be/src/runtime_filter/runtime_filter_producer.cpp | 244 +++ be/src/runtime_filter/runtime_filter_producer.h | 173 ++ .../runtime_filter_producer_helper.cpp | 138 ++ .../runtime_filter_producer_helper.h | 88 + .../runtime_filter_producer_helper_cross.h | 70 + be/src/runtime_filter/runtime_filter_wrapper.cpp | 688 ++++++++ be/src/runtime_filter/runtime_filter_wrapper.h | 144 ++ be/src/runtime_filter/utils.cpp | 196 +++ .../utils.h} | 44 +- be/src/service/internal_service.cpp | 49 +- be/src/util/doris_metrics.cpp | 11 + be/src/util/doris_metrics.h | 5 + be/src/util/lru_multi_cache.inline.h | 2 + be/src/util/s3_util.cpp | 2 + .../aggregate_function_group_array_intersect.h | 43 +- .../aggregate_function_percentile.cpp | 1 + .../aggregate_function_percentile.h | 2 +- .../aggregate_function_window.h | 66 +- be/src/vec/common/allocator.cpp | 4 +- be/src/vec/common/hash_table/join_hash_table.h | 4 +- be/src/vec/common/sort/partition_sorter.cpp | 1 - be/src/vec/common/sort/partition_sorter.h | 3 +- be/src/vec/exec/format/orc/vorc_reader.cpp | 25 +- be/src/vec/exec/format/orc/vorc_reader.h | 8 +- .../vec/exec/format/parquet/bool_plain_decoder.h | 3 +- .../vec/exec/format/parquet/bool_rle_decoder.cpp | 25 +- be/src/vec/exec/format/parquet/bool_rle_decoder.h | 5 +- be/src/vec/exec/format/parquet/decoder.h | 6 +- .../exec/format/parquet/delta_bit_pack_decoder.cpp | 136 ++ .../exec/format/parquet/delta_bit_pack_decoder.h | 180 +- .../format/parquet/fix_length_dict_decoder.hpp | 6 +- .../format/parquet/fix_length_plain_decoder.cpp | 44 + .../exec/format/parquet/fix_length_plain_decoder.h | 97 +- be/src/vec/exec/format/parquet/level_decoder.cpp | 10 +- be/src/vec/exec/format/parquet/schema_desc.cpp | 2 +- be/src/vec/exec/format/parquet/schema_desc.h | 6 +- .../parquet/vparquet_column_chunk_reader.cpp | 2 +- .../exec/format/parquet/vparquet_group_reader.cpp | 3 +- be/src/vec/exec/format/parquet/vparquet_reader.cpp | 1 + be/src/vec/exec/format/table/equality_delete.cpp | 2 +- be/src/vec/exec/format/table/hudi_reader.cpp | 92 ++ be/src/vec/exec/format/table/hudi_reader.h | 83 + be/src/vec/exec/format/table/iceberg_reader.cpp | 200 +-- be/src/vec/exec/format/table/iceberg_reader.h | 38 +- be/src/vec/exec/format/table/paimon_reader.cpp | 82 +- be/src/vec/exec/format/table/paimon_reader.h | 40 +- .../vec/exec/format/table/table_format_reader.cpp | 133 ++ be/src/vec/exec/format/table/table_format_reader.h | 46 +- .../format/table/transactional_hive_reader.cpp | 16 +- .../exec/format/table/transactional_hive_reader.h | 3 - be/src/vec/exec/scan/file_scanner.cpp | 24 +- be/src/vec/exec/scan/file_scanner.h | 2 +- be/src/vec/exec/scan/olap_scanner.cpp | 3 +- be/src/vec/exec/scan/olap_scanner.h | 2 +- be/src/vec/exec/scan/scanner.cpp | 4 +- be/src/vec/exec/scan/scanner_scheduler.cpp | 8 +- .../exprs/lambda_function/varray_map_function.cpp | 173 +- be/src/vec/exprs/vbitmap_predicate.cpp | 2 +- be/src/vec/exprs/vbitmap_predicate.h | 2 +- be/src/vec/exprs/vbloom_predicate.cpp | 4 +- be/src/vec/exprs/vbloom_predicate.h | 3 +- be/src/vec/exprs/vexpr.h | 6 + be/src/vec/exprs/vliteral.h | 4 + be/src/vec/exprs/vruntimefilter_wrapper.cpp | 10 +- be/src/vec/exprs/vruntimefilter_wrapper.h | 5 +- be/src/vec/exprs/vslot_ref.h | 4 + be/src/vec/functions/function_string.cpp | 62 +- be/src/vec/functions/function_string.h | 3 +- be/src/vec/functions/in.h | 9 +- be/src/vec/functions/math.cpp | 28 + be/src/vec/olap/vertical_merge_iterator.cpp | 2 + be/src/vec/runtime/shared_hash_table_controller.h | 17 +- be/test/CMakeLists.txt | 1 - be/test/exprs/bloom_filter_func_test.cpp | 680 ++++++++ be/test/exprs/hybrid_set_test.cpp | 413 ++++- be/test/exprs/minmax_predicate_test.cpp | 163 ++ be/test/exprs/runtime_filter_test.cpp | 111 -- be/test/exprs/zipf_distribution.h | 100 -- be/test/io/cache/block_file_cache_test.cpp | 106 +- be/test/io/fs/hdfs/hdfs_mgr_test.cpp | 259 ++- be/test/olap/compaction_permit_limiter_test.cpp | 78 + be/test/olap/date_bloom_filter_test.cpp | 8 +- .../inverted_index/query/phrase_query_test.cpp | 35 + be/test/pipeline/operator/operator_helper.h | 18 + .../partitioned_aggregation_sink_operator_test.cpp | 26 +- ...artitioned_aggregation_source_operator_test.cpp | 12 +- .../operator/partitioned_hash_join_test_helper.h | 15 + be/test/pipeline/operator/set_operator_test.cpp | 554 +++++++ .../operator/spill_sort_sink_operator_test.cpp | 386 +++++ .../operator/spill_sort_source_operator_test.cpp | 576 +++++++ .../pipeline/operator/spill_sort_test_helper.cpp | 170 ++ be/test/pipeline/operator/spill_sort_test_helper.h | 85 + .../operator/spillable_operator_test_helper.cpp | 4 +- be/test/pipeline/operator/union_operator_test.cpp | 297 ++++ be/test/pipeline/pipeline_test.cpp | 76 +- be/test/pipeline/thrift_builder.h | 267 ++- be/test/runtime/load_stream_test.cpp | 1 - .../runtime/memory/thread_mem_tracker_mgr_test.cpp | 16 +- .../workload_group/dummy_workload_group_test.cpp | 2 +- .../runtime_filter_consumer_helper_test.cpp | 108 ++ .../runtime_filter_consumer_test.cpp | 240 +++ .../runtime_filter_definitions_test.cpp | 70 + .../runtime_filter/runtime_filter_merger_test.cpp | 212 +++ be/test/runtime_filter/runtime_filter_mgr_test.cpp | 185 +++ .../runtime_filter_producer_helper_cross_test.cpp | 84 + .../runtime_filter_producer_helper_test.cpp | 171 ++ .../runtime_filter_producer_test.cpp | 207 +++ be/test/runtime_filter/runtime_filter_test_utils.h | 74 + .../runtime_filter/runtime_filter_wrapper_test.cpp | 1400 ++++++++++++++++ be/test/runtime_filter/utils_test.cpp | 119 ++ be/test/testutil/column_helper.h | 38 + be/test/testutil/creators.h | 8 + be/test/testutil/mock/mock_descriptors.h | 1 + be/test/testutil/mock/mock_literal_expr.cpp | 72 + be/test/testutil/mock/mock_literal_expr.h | 109 ++ .../format/paimon/paimon_schema_change_test.cpp | 31 +- .../format/parquet/bool_plain_decoder_test.cpp | 245 +++ .../exec/format/parquet/bool_rle_decoder_test.cpp | 245 +++ .../parquet/byte_array_dict_decoder_test.cpp | 513 ++++++ .../parquet/byte_array_plain_decoder_test.cpp | 247 +++ .../parquet/byte_stream_split_decoder_test.cpp | 405 +++++ .../format/parquet/delta_bit_pack_decoder_test.cpp | 272 +++ .../parquet/delta_byte_array_decoder_test.cpp | 598 +++++++ .../delta_length_byte_array_decoder_test.cpp | 281 ++++ .../parquet/fix_length_dict_decoder_test.cpp | 551 +++++++ .../parquet/fix_length_plain_decoder_test.cpp | 208 +++ .../vec/exec/format/parquet/level_decoder_test.cpp | 225 +++ .../{ => format}/parquet/parquet_common_test.cpp | 0 .../parquet/parquet_corrupt_statistics_test.cpp | 0 .../parquet_nested_type_cross_page_test.cpp | 0 .../{ => format}/parquet/parquet_reader_test.cpp | 0 .../parquet/parquet_statistics_test.cpp | 0 .../{ => format}/parquet/parquet_thrift_test.cpp | 0 .../{ => format}/parquet/parquet_version_test.cpp | 0 .../table/table_schema_change_helper_test.cpp | 471 ++++++ be/test/vec/exec/orc_reader_test.cpp | 4 +- be/test/vec/function/function_math_test.cpp | 60 + be/test/vec/function/function_string_test.cpp | 15 +- be/test/vec/function/function_sub_replace_test.cpp | 51 + build.sh | 37 +- cloud/src/common/util.cpp | 24 + cloud/src/common/util.h | 6 + cloud/src/meta-service/http_encode_key.cpp | 208 ++- cloud/src/meta-service/meta_service_http.cpp | 16 +- cloud/src/meta-service/meta_service_http.h | 3 + cloud/test/meta_service_http_test.cpp | 73 + conf/be.conf | 2 +- conf/fe.conf | 2 +- dist/LICENSE-dist.txt | 1 + dist/licenses/LICENSE-pugixml.txt | 24 + .../be/resource/be_disaggregated_entrypoint.sh | 2 +- docker/runtime/be/resource/be_entrypoint.sh | 2 +- .../fe/resource/fe_disaggregated_entrypoint.sh | 2 +- docker/runtime/fe/resource/fe_entrypoint.sh | 4 +- .../scripts/create_preinstalled_scripts/run74.hql | 9 + .../partition_col=,/000000_0 | Bin 0 -> 408 bytes .../partition_col=a, b, c/000000_0 | Bin 0 -> 408 bytes .../partition_col=a, b/000000_0 | Bin 0 -> 408 bytes .../create_preinstalled_scripts/iceberg/run10.sql | 48 + .../main/java/org/apache/doris/common/Config.java | 2 +- fe/fe-core/pom.xml | 4 + .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 46 +- .../main/java/org/apache/doris/alter/Alter.java | 1 + .../apache/doris/alter/SchemaChangeHandler.java | 2 - .../apache/doris/analysis/AlterRepositoryStmt.java | 2 +- .../apache/doris/analysis/BuildIndexClause.java | 2 +- .../apache/doris/analysis/CreateIndexClause.java | 2 +- .../doris/analysis/CreateRepositoryStmt.java | 2 +- .../org/apache/doris/analysis/CreateTableStmt.java | 3 +- .../java/org/apache/doris/analysis/IndexDef.java | 5 - .../java/org/apache/doris/backup/RestoreJob.java | 26 +- .../doris/catalog/BuiltinAggregateFunctions.java | 2 +- .../doris/catalog/BuiltinScalarFunctions.java | 16 +- .../java/org/apache/doris/catalog/Database.java | 24 + .../main/java/org/apache/doris/catalog/Env.java | 2 +- .../java/org/apache/doris/catalog/FunctionSet.java | 9 + .../main/java/org/apache/doris/catalog/Index.java | 40 +- .../doris/catalog/MaterializedIndexMeta.java | 7 - .../apache/doris/catalog/TabletInvertedIndex.java | 20 +- .../cloud/datasource/CloudInternalCatalog.java | 5 +- .../java/org/apache/doris/common/FeNameFormat.java | 17 + .../apache/doris/common/util/PropertyAnalyzer.java | 53 +- .../doris/datasource/ExternalMetaCacheMgr.java | 25 +- .../apache/doris/datasource/InternalCatalog.java | 3 +- .../doris/datasource/hive/HMSExternalTable.java | 24 +- .../doris/datasource/hive/HiveMetaStoreCache.java | 3 +- .../datasource/hive/HiveMetaStoreClientHelper.java | 28 +- .../datasource/hudi/HudiSchemaCacheValue.java | 17 +- .../apache/doris/datasource/hudi/HudiUtils.java | 24 + .../hudi/source/COWIncrementalRelation.java | 26 +- .../doris/datasource/hudi/source/HudiScanNode.java | 54 +- .../datasource/iceberg/source/IcebergScanNode.java | 50 +- .../doris/datasource/jdbc/JdbcExternalTable.java | 1 + .../datasource/paimon/source/PaimonScanNode.java | 11 +- .../doris/httpv2/rest/TableQueryPlanAction.java | 8 +- .../org/apache/doris/master/ReportHandler.java | 8 +- .../java/org/apache/doris/metric/MetricRepo.java | 13 + .../org/apache/doris/monitor/jvm/JvmService.java | 6 +- .../org/apache/doris/monitor/jvm/JvmStats.java | 42 +- .../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 1 + .../glue/translator/PhysicalPlanTranslator.java | 2 +- .../doris/nereids/jobs/executor/Rewriter.java | 8 +- .../doris/nereids/parser/LogicalPlanBuilder.java | 89 +- .../post/RuntimeFilterPushDownVisitor.java | 21 +- .../org/apache/doris/nereids/rules/RuleType.java | 1 + .../doris/nereids/rules/analysis/BindSink.java | 13 + .../rules/analysis/EliminateGroupByConstant.java | 5 +- .../exploration/mv/MaterializedViewUtils.java | 3 +- .../rules/rewrite/DeferMaterializeTopNResult.java | 101 +- .../rewrite/EliminateConstHashJoinCondition.java | 91 + .../rules/rewrite/EliminateEmptyRelation.java | 22 +- .../functions/executable/NumericArithmetic.java | 50 + .../functions/executable/StringArithmetic.java | 131 +- .../functions/scalar/{StrLeft.java => Acosh.java} | 34 +- .../functions/scalar/{StrRight.java => Asinh.java} | 31 +- .../functions/scalar/{StrLeft.java => Atanh.java} | 34 +- .../functions/scalar/{StrLeft.java => Sinh.java} | 30 +- .../trees/expressions/functions/window/Lag.java | 5 +- .../trees/expressions/functions/window/Lead.java | 5 +- .../functions/window/WindowFunction.java | 6 +- .../expressions/visitor/ScalarFunctionVisitor.java | 30 +- .../apache/doris/nereids/trees/plans/PlanType.java | 2 + .../plans/commands/AlterJobStatusCommand.java | 27 +- .../trees/plans/commands/CancelJobTaskCommand.java | 43 +- .../trees/plans/commands/CreateTableCommand.java | 25 +- .../plans/commands/DropCachedStatsCommand.java | 16 +- .../plans/commands/DropExpiredStatsCommand.java | 12 + .../trees/plans/commands/DropJobCommand.java | 12 +- .../trees/plans/commands/DropStatsCommand.java | 36 +- .../trees/plans/commands/PauseJobCommand.java | 12 +- .../trees/plans/commands/ResumeJobCommand.java | 12 +- .../trees/plans/commands/ShowSnapshotCommand.java | 225 +++ .../plans/commands/ShowTableStatsCommand.java | 364 ++++ .../trees/plans/commands/info/IndexDefinition.java | 2 +- .../plans/commands/info/PartitionTableInfo.java | 5 + .../nereids/trees/plans/logical/LogicalJoin.java | 7 + .../trees/plans/visitor/CommandVisitor.java | 10 + .../apache/doris/nereids/types/AggStateType.java | 1 + .../apache/doris/nereids/util/ExpressionUtils.java | 11 +- .../org/apache/doris/planner/OlapScanNode.java | 2 +- .../org/apache/doris/planner/OlapTableSink.java | 4 +- .../org/apache/doris/planner/RuntimeFilter.java | 4 +- .../main/java/org/apache/doris/qe/Coordinator.java | 27 +- .../org/apache/doris/qe/CoordinatorContext.java | 3 - .../java/org/apache/doris/qe/ResultReceiver.java | 29 +- .../apache/doris/qe/ResultReceiverConsumer.java | 129 ++ .../java/org/apache/doris/qe/SessionVariable.java | 47 - .../apache/doris/qe/runtime/QueryProcessor.java | 46 +- .../org/apache/doris/rpc/BackendServiceClient.java | 3 +- .../org/apache/doris/rpc/BackendServiceProxy.java | 19 + .../apache/doris/statistics/AnalysisManager.java | 111 +- .../apache/doris/statistics/StatisticsCleaner.java | 19 +- .../java/org/apache/doris/task/AgentBatchTask.java | 22 +- .../apache/doris/task/AlterInvertedIndexTask.java | 4 +- .../org/apache/doris/task/CreateReplicaTask.java | 2 +- .../java/org/apache/doris/catalog/IndexTest.java | 164 ++ .../org/apache/doris/catalog/OlapTableTest.java | 2 +- .../doris/common/proc/IndexesProcNodeTest.java | 8 +- .../doris/datasource/hudi/HudiUtilsTest.java | 4 +- .../doris/http/TableQueryPlanActionTest.java | 33 + .../joinorder/hypergraph/PullupExpressionTest.java | 10 +- .../nereids/postprocess/RuntimeFilterTest.java | 76 + .../nereids/rules/analysis/GenerateFunction.java | 1 + .../exploration/mv/MaterializedViewUtilsTest.java | 2 +- .../nereids/rules/expression/FoldConstantTest.java | 126 ++ .../EliminateConstHashJoinConditionTest.java | 58 + .../rules/rewrite/EliminateEmptyRelationTest.java | 92 ++ .../rules/rewrite/EliminateOrderByKeyTest.java | 2 +- .../plans/commands/DropCachedStatsCommandTest.java | 162 ++ .../commands/DropExpiredStatsCommandTest.java | 66 + .../trees/plans/commands/DropStatsCommandTest.java | 203 +++ .../plans/commands/ShowSnapshotCommandTest.java | 126 ++ .../plans/commands/ShowTableStatsCommandTest.java | 175 ++ .../util/CanInferNotNullForMarkSlotTest.java | 100 ++ .../persist/TableAddOrDropColumnsInfoTest.java | 2 +- .../doris/qe/ResultReceiverConsumerTest.java | 172 ++ .../java/org/apache/doris/task/AgentTaskTest.java | 2 + .../apache/doris/utframe/MockedBackendFactory.java | 2 +- .../org/apache/doris/utframe/MockedFrontend.java | 2 +- fe/pom.xml | 7 + gensrc/proto/internal_service.proto | 24 +- gensrc/thrift/PaloInternalService.thrift | 52 +- gensrc/thrift/PlanNodes.thrift | 7 +- .../data/compression_p0/{load.out => query.out} | Bin 2093 -> 2425 bytes .../data/correctness_p0/test_lag_lead_window.out | Bin 1402 -> 1797 bytes .../hive/test_hive_partitions.out | Bin 3171 -> 3333 bytes .../iceberg/iceberg_schema_change2.out | Bin 0 -> 675 bytes .../hudi/test_hudi_schema_change.out | Bin 0 -> 10726 bytes .../cloud/test_cloud_mow_new_tablet_compaction.out | Bin 206 -> 206 bytes ...> test_cloud_sc_self_retry_with_stop_token.out} | Bin 206 -> 167 bytes .../nereids_p0/runtime_filter/runtime_filter.out | Bin 868 -> 742 bytes .../test_aggregate_percentile_no_cast.out | Bin 1410 -> 1426 bytes .../test_aggregate_window_functions.out | Bin 21104 -> 21134 bytes .../extend_infer_equal_predicate.out | Bin 30317 -> 30195 bytes .../infer_predicate/pull_up_predicate_literal.out | Bin 82024 -> 78088 bytes .../infer_predicate/pull_up_predicate_set_op.out | Bin 19703 -> 19652 bytes .../data/nereids_rules_p0/pkfk/eliminate_inner.out | Bin 7333 -> 6965 bytes .../data/query_p0/aggregate/aggregate.out | Bin 9762 -> 9841 bytes .../test_inject_send_filter_size_fail.out | Bin 0 -> 197 bytes .../test_math_unary_always_nullable.out | Bin 1032 -> 1769 bytes .../string_functions/test_string_function.out | Bin 4892 -> 4890 bytes .../struct_functions/test_struct_functions.out | Bin 1856 -> 1856 bytes ...m_big_lateral_view.out => string_over_flow.out} | Bin .../cloud_p0/conf/regression-conf-custom.groovy | 1 + regression-test/pipeline/cloud_p0/prepare.sh | 10 +- .../pipeline/common/check-pr-if-need-run-build.sh | 200 --- regression-test/pipeline/common/teamcity-utils.sh | 36 +- regression-test/pipeline/performance/prepare.sh | 20 +- regression-test/suites/account_p0/test_role.groovy | 10 + .../backup_restore/test_backup_cancelled.groovy | 2 +- .../backup_restore/test_backup_restore.groovy | 2 +- .../test_backup_restore_alias.groovy | 3 +- .../test_backup_restore_atomic.groovy | 2 +- .../test_backup_restore_atomic_cancel.groovy | 2 +- ...st_backup_restore_atomic_reserve_replica.groovy | 2 +- .../test_backup_restore_atomic_with_alter.groovy | 2 +- .../test_backup_restore_atomic_with_view.groovy | 2 +- ...est_backup_restore_backup_temp_partition.groovy | 2 +- .../test_backup_restore_bloom_filter.groovy | 3 +- .../test_backup_restore_clean_restore.groovy | 2 +- .../test_backup_restore_colocate.groovy | 5 +- .../backup_restore/test_backup_restore_db.groovy | 2 +- ...t_backup_restore_diff_repo_same_snapshot.groovy | 23 +- ..._backup_restore_dup_without_default_keys.groovy | 3 +- .../test_backup_restore_exclude.groovy | 2 +- ...backup_restore_force_replace_diff_column.groovy | 2 +- ...kup_restore_force_replace_diff_part_type.groovy | 2 +- ...ckup_restore_force_replace_diff_part_val.groovy | 2 +- .../test_backup_restore_inverted_idx.groovy | 2 +- .../test_backup_restore_inverted_index.groovy | 3 +- .../backup_restore/test_backup_restore_mtmv.groovy | 2 +- .../test_backup_restore_multi_tables.groovy | 2 +- ...st_backup_restore_multi_tables_overwrite.groovy | 2 +- .../backup_restore/test_backup_restore_mv.groovy | 2 +- .../test_backup_restore_ngram_bloom_filter.groovy | 2 +- .../test_backup_restore_overwrite_indexes.groovy | 2 +- .../test_backup_restore_partition.groovy | 2 +- ..._restore_reserve_dynamic_partition_false.groovy | 3 +- ...p_restore_reserve_dynamic_partition_true.groovy | 3 +- .../test_backup_restore_storage_policy.groovy | 2 +- .../test_backup_restore_table_auto_bucket.groovy | 3 +- .../test_backup_restore_version_revert.groovy | 2 +- .../test_backup_restore_with_hdfs.groovy | 2 +- ..._backup_restore_with_two_phase_fetch_opt.groovy | 2 +- .../test_backup_restore_with_view.groovy | 2 +- .../test_backup_store_with_db_properties.groovy | 2 +- .../test_backup_store_with_db_properties_kv.groovy | 2 +- .../test_duplicate_backup_restore.groovy | 5 +- .../test_restore_mix_exists_and_new_table.groovy | 2 +- .../test_restore_to_new_table.groovy | 3 +- .../test_unique_backup_restore.groovy | 5 +- .../test_backup_restore_with_many_tables.groovy | 2 +- .../check_before_quit/check_before_quit.groovy | 100 +- regression-test/suites/compression_p0/load.groovy | 38 +- .../suites/compression_p0/query.groovy | 37 +- .../correctness_p0/test_lag_lead_window.groovy | 39 + .../query/test_nested_type_with_resize.groovy | 8 +- .../suites/empty_relation/eliminate_empty.groovy | 173 ++ .../hive/test_hive_partitions.groovy | 6 +- .../iceberg/iceberg_schema_change2.groovy | 66 + .../iceberg/test_iceberg_optimize_count.groovy | 56 + .../kerberos/test_single_hive_kerberos.groovy | 14 +- .../kerberos/test_two_hive_kerberos.groovy | 26 +- .../hudi/test_hudi_schema_change.groovy | 156 ++ .../test_cloud_mow_new_tablet_compaction.groovy | 4 +- ...test_cloud_sc_self_retry_with_stop_token.groovy | 76 + .../aggregate/aggregate_groupby_constant.groovy | 26 + .../create_table/test_ctas_auto_partition.groovy | 94 ++ .../nereids_p0/cte/test_cte_filter_pushdown.groovy | 2 + .../fold_constant_numeric_arithmatic.groovy | 48 +- .../fold_constant_string_arithmatic.groovy | 200 ++- .../show/test_nereids_show_snapshot.groovy} | 33 +- .../cte/test_cte_filter_pushdown.groovy | 2 +- .../lazy_materialize_topn.groovy | 73 + .../filter_push_down/push_filter_through.groovy | 2 +- .../pull_up_predicate_literal.groovy | 2 +- .../agg_optimize_when_uniform.groovy | 10 +- .../agg_with_roll_up/aggregate_with_roll_up.groovy | 1 + .../aggregate_without_roll_up.groovy | 3 +- .../mv/dimension/dimension_1.groovy | 1 + .../mv/dimension/dimension_2_full_join.groovy | 1 + .../mv/dimension/dimension_2_inner_join.groovy | 1 + .../mv/dimension/dimension_2_left_join.groovy | 1 + .../mv/dimension/dimension_2_right_join.groovy | 1 + .../mv/join/dphyp_inner/inner_join_dphyp.groovy | 1 + .../mv/join/dphyp_outer/outer_join_dphyp.groovy | 2 + .../mv/join/inner/inner_join.groovy | 1 + .../mv/join/left_outer/outer_join.groovy | 1 + .../inner_join_infer_and_derive.groovy | 1 + .../mv/nested/nested_materialized_view.groovy | 1 + .../nereids_rules_p0/mv/variant/variant_mv.groovy | 2 +- .../predicate_infer/infer_predicate.groovy | 2 +- .../ddl/create_list_part_data_table.sql | 2 +- .../ddl/create_range_part_data_table.sql | 2 +- .../ddl/stream_load_list_test_table.sql | 2 +- .../ddl/stream_load_range_test_table.sql | 2 +- .../suites/query_p0/aggregate/aggregate.groovy | 40 + .../join/test_hash_join_probe_early_eos.groovy | 4 - .../test_inject_send_filter_size_fail.groovy | 120 ++ .../join/test_low_bucket/test_low_bucket.groovy | 1 + .../join/test_slow_close/test_slow_close.groovy | 2 + .../test_array_map_function_with_column.groovy | 2 +- .../test_math_unary_always_nullable.groovy | 30 +- .../struct_functions/test_struct_functions.groovy | 4 +- ...lace_table.grovvy => test_replace_table.groovy} | 17 +- regression-test/suites/variant_p0/load.groovy | 2 +- regression-test/suites/variant_p0/nested.groovy | 4 +- .../suites/variant_p0/test_sub_path_pruning.groovy | 2 +- .../vault_p0/database/test_database_vault.groovy | 246 +++ thirdparty/CHANGELOG.md | 8 + thirdparty/build-thirdparty.sh | 28 + thirdparty/vars.sh | 14 + 537 files changed, 23405 insertions(+), 7761 deletions(-) create mode 100644 be/src/exprs/bloom_filter_func_adaptor.h create mode 100644 be/src/exprs/bloom_filter_func_impl.h copy fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/HudiSchemaCacheValue.java => be/src/exprs/filter_base.h (58%) delete mode 100644 be/src/exprs/hybrid_map.h delete mode 100644 be/src/exprs/runtime_filter.cpp delete mode 100644 be/src/exprs/runtime_filter.h delete mode 100644 be/src/exprs/runtime_filter_slots.h delete mode 100644 be/src/exprs/runtime_filter_slots_cross.h copy fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/HudiSchemaCacheValue.java => be/src/olap/filter_olap_param.h (58%) delete mode 100644 be/src/pipeline/common/runtime_filter_consumer.cpp delete mode 100644 be/src/runtime/runtime_filter_mgr.h create mode 100644 be/src/runtime_filter/CMakeLists.txt create mode 100644 be/src/runtime_filter/runtime_filter.cpp create mode 100644 be/src/runtime_filter/runtime_filter.h create mode 100644 be/src/runtime_filter/runtime_filter_consumer.cpp create mode 100644 be/src/runtime_filter/runtime_filter_consumer.h create mode 100644 be/src/runtime_filter/runtime_filter_consumer_helper.cpp rename be/src/{pipeline/common/runtime_filter_consumer.h => runtime_filter/runtime_filter_consumer_helper.h} (50%) create mode 100644 be/src/runtime_filter/runtime_filter_definitions.h create mode 100644 be/src/runtime_filter/runtime_filter_merger.h rename be/src/{runtime => runtime_filter}/runtime_filter_mgr.cpp (60%) create mode 100644 be/src/runtime_filter/runtime_filter_mgr.h create mode 100644 be/src/runtime_filter/runtime_filter_producer.cpp create mode 100644 be/src/runtime_filter/runtime_filter_producer.h create mode 100644 be/src/runtime_filter/runtime_filter_producer_helper.cpp create mode 100644 be/src/runtime_filter/runtime_filter_producer_helper.h create mode 100644 be/src/runtime_filter/runtime_filter_producer_helper_cross.h create mode 100644 be/src/runtime_filter/runtime_filter_wrapper.cpp create mode 100644 be/src/runtime_filter/runtime_filter_wrapper.h create mode 100644 be/src/runtime_filter/utils.cpp rename be/src/{exprs/runtime_filter_convertor.h => runtime_filter/utils.h} (71%) create mode 100644 be/src/vec/exec/format/parquet/delta_bit_pack_decoder.cpp create mode 100644 be/src/vec/exec/format/parquet/fix_length_plain_decoder.cpp create mode 100644 be/src/vec/exec/format/table/hudi_reader.cpp create mode 100644 be/src/vec/exec/format/table/hudi_reader.h create mode 100644 be/src/vec/exec/format/table/table_format_reader.cpp create mode 100644 be/test/exprs/bloom_filter_func_test.cpp create mode 100644 be/test/exprs/minmax_predicate_test.cpp delete mode 100644 be/test/exprs/runtime_filter_test.cpp delete mode 100644 be/test/exprs/zipf_distribution.h create mode 100644 be/test/olap/compaction_permit_limiter_test.cpp create mode 100644 be/test/pipeline/operator/set_operator_test.cpp create mode 100644 be/test/pipeline/operator/spill_sort_sink_operator_test.cpp create mode 100644 be/test/pipeline/operator/spill_sort_source_operator_test.cpp create mode 100644 be/test/pipeline/operator/spill_sort_test_helper.cpp create mode 100644 be/test/pipeline/operator/spill_sort_test_helper.h create mode 100644 be/test/pipeline/operator/union_operator_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_consumer_helper_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_consumer_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_definitions_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_merger_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_mgr_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_producer_helper_cross_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_producer_helper_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_producer_test.cpp create mode 100644 be/test/runtime_filter/runtime_filter_test_utils.h create mode 100644 be/test/runtime_filter/runtime_filter_wrapper_test.cpp create mode 100644 be/test/runtime_filter/utils_test.cpp create mode 100644 be/test/testutil/mock/mock_literal_expr.cpp create mode 100644 be/test/testutil/mock/mock_literal_expr.h create mode 100644 be/test/vec/exec/format/parquet/bool_plain_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/bool_rle_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/byte_array_dict_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/byte_array_plain_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/byte_stream_split_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/delta_bit_pack_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/delta_byte_array_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/delta_length_byte_array_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/fix_length_dict_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/fix_length_plain_decoder_test.cpp create mode 100644 be/test/vec/exec/format/parquet/level_decoder_test.cpp rename be/test/vec/exec/{ => format}/parquet/parquet_common_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_corrupt_statistics_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_nested_type_cross_page_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_reader_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_statistics_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_thrift_test.cpp (100%) rename be/test/vec/exec/{ => format}/parquet/parquet_version_test.cpp (100%) create mode 100644 be/test/vec/exec/format/table/table_schema_change_helper_test.cpp create mode 100644 be/test/vec/function/function_sub_replace_test.cpp create mode 100644 dist/licenses/LICENSE-pugixml.txt create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=,/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=a, b, c/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=a, b/000000_0 create mode 100644 docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run10.sql create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/EliminateConstHashJoinCondition.java copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{StrLeft.java => Acosh.java} (62%) rename fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{StrRight.java => Asinh.java} (62%) copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{StrLeft.java => Atanh.java} (62%) rename fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{StrLeft.java => Sinh.java} (62%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowSnapshotCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowTableStatsCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/qe/ResultReceiverConsumer.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/catalog/IndexTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/EliminateConstHashJoinConditionTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/EliminateEmptyRelationTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/DropCachedStatsCommandTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/DropExpiredStatsCommandTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/DropStatsCommandTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowSnapshotCommandTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowTableStatsCommandTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/util/CanInferNotNullForMarkSlotTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/qe/ResultReceiverConsumerTest.java rename regression-test/data/compression_p0/{load.out => query.out} (86%) create mode 100644 regression-test/data/external_table_p0/iceberg/iceberg_schema_change2.out create mode 100644 regression-test/data/external_table_p2/hudi/test_hudi_schema_change.out copy regression-test/data/fault_injection_p0/cloud/{test_cloud_mow_new_tablet_compaction.out => test_cloud_sc_self_retry_with_stop_token.out} (73%) create mode 100644 regression-test/data/query_p0/join/test_inject_send_filter_size_fail/test_inject_send_filter_size_fail.out rename regression-test/data/query_p2/string_over_flow/{load_from_big_lateral_view.out => string_over_flow.out} (100%) delete mode 100755 regression-test/pipeline/common/check-pr-if-need-run-build.sh copy fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/HudiSchemaCacheValue.java => regression-test/suites/compression_p0/query.groovy (58%) create mode 100644 regression-test/suites/external_table_p0/iceberg/iceberg_schema_change2.groovy create mode 100644 regression-test/suites/external_table_p2/hudi/test_hudi_schema_change.groovy create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_sc_self_retry_with_stop_token.groovy create mode 100644 regression-test/suites/nereids_p0/create_table/test_ctas_auto_partition.groovy copy regression-test/suites/{backup_restore/test_restore_to_new_table.groovy => nereids_p0/show/test_nereids_show_snapshot.groovy} (74%) create mode 100644 regression-test/suites/nereids_rules_p0/defer_materialize_topn/lazy_materialize_topn.groovy create mode 100644 regression-test/suites/query_p0/join/test_inject_send_filter_size_fail/test_inject_send_filter_size_fail.groovy rename regression-test/suites/statistics/{test_replace_table.grovvy => test_replace_table.groovy} (82%) create mode 100644 regression-test/suites/vault_p0/database/test_database_vault.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org