This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git
from 9ef4e49307e [bugfix](scannerdeadloop) there is a dead loop in scanner ctx (#29794) new 53f15213087 [feature](inverted index)Support failover when index compaction failed (#29553) new 9791a63212f [opt](match_phrase) Optimizing match_phrase with a new algorithm (#29444) new ddaa645a4fe [improvement](statistics) Force to use zonemap for collecting string type min max. (#29631) new 847898bf268 [fix](Nereids) delete using should support sql without where (#29518) new 971bc804ac5 [fix](Nereids) update and delete may produce exprs with same exprid (#29656) new 0126b09c114 [fix](Nereids): fix shape of eliminate_inner regression test (#29613) new b59a8c93651 [feature](Nereids): refresh view hypergraph after inferring join (#29469) new 97ed06a92cf [regression-test](Variant) fix unstable case (#29648) new c9e2f1934a4 [opt](file cache) make the cache queue percentage configurable (#29537) new eea657a6106 [rf](nereids)prune rf for external db according to jump count (#29634) new c10bcb666d9 [Fix](Nereids) change log level of warning of converting error to debug (#29660) new 3cd1c7745ab [fix](jdbc catalog) Fix the precision of decimal type mapping to 0 (#29407) new 78fc38f53eb [typo](docs) fix the unit of default value of thrift_connect_timeout_seconds (#29626) new 30e46ee5adb [Fix](Job)Fixed the problem of not deleting JOB during DROP JOB metadata playback (#29543) new 8fc9c18c850 [improvement](jdbc catalog) Put the jdbc connection pool parameters into catalog properties (#29195) new a2da434e3b7 [refactor](Nereids): refactor PredicatePropagation & support to infer Equal Condition (#29644) new 54d2528c69d [Fix](Nereids) fix fe ut failed cause of getting statement context (#29683) new 40badbf5c5b Fix analyze empty external NPE bug. (#29675) new 28dca66c062 Fix BE UT macOS compile (#29663) new 2ca90b2bf10 [Refactor](dialect) Add sql dialect converter plugins (#28890) new aa4de6f39af (feature)[pipelineX]Make operator_id negative in pipelineX (#29649) new 9f73f77d125 [fix](pipeline) incorrect result caused by missing output block of union operator (#29677) new 0b51532dfc5 [doc](release) update release process related to maven (#29467) new 75631c89fa6 [Fix](thirdparty) fix that BE can not start when use JDK17 (#29570) new 1ca4d8bf10b [improve](docs) add Flink write metrics doc (#29578) new 87023d3b7ac [Fix](inverted index) fix memory leak in inverted index when encountering fault (#29676) new 1d834571ab5 [doc](fix) K8s doc modify catalog and add helm doc (#29604) new 161134913da [fix](regression-test) fix non stable case test_unique_table_like (#29643) new 0a55376a488 [fix](regression-test) fix non stable case test_bitmap_index (#29592) new d50c8b6d3ac [Improvement](nereids) Query rewrite by mv support bitmap_union and bitmap_union_count roll up (#29418) new 28695249eaf [Fix](nereids) Fix partition check failure (#29642) new 0c7c9485b6a [Fix](nereids) Fix get ralated partition table when nodata (#29453) new 028e59efab0 [refactor](Nereids): unify all `replaceNamedExpressions` (#28228) new 87a6def8621 [Fix](index tool) fix inverted index tool memory leak (#29701) new 78aabc34925 [session](shared) disable shared scan in default (#29703) new 2959219b4d8 [Enhancement](wal) Add fault injection case for wal back pressure (#29689) new bff7f3f9801 [fix](regression) change reference of s3 in p1 via getS3url #29693 new 374c6387880 [improvement](executor) improve readability and efficiency of the checks (#29696) new 7357ca62af7 [improvement](statistics)Only write editlog for manual analyze task, don't need to do so for auto tasks. #29685 new be56bf06cf8 [feature](function) support ip function named is_ip_address_in_range(addr, cidr) (#29681) new 34fe5ee38b6 [feat](Nereids) support show constraint command (#29667) new fda001b6d35 [Improvement](nereids) Support join derivation when mv rewrite (#29609) new abb7640d37b [debug](timeout) add more log in scanner ctx to find timeout problem #29704 new e4707154fa5 [opt](statistics) create or update table stats after alter column stats. new da182a8b6f5 [feature](nereids)print nereids node id in explain (#29238) new aec373e2a06 [fix](regression) remove a buggy fault-injection case which make BE crash (#29673) new 67986a8a6f8 [fix](case) external case, specify networks (#29699) new 9cbb55d49bb [fix](Nereids) create double literal when create decimal literal failed (#28959) new 7738eca6daf [Bug](stream-load) fix stream load failed on table with rollup (#29665) new b7a819bd245 [Fix](typo) Fix analyzeGroupCommitDataBytes typo #29640 new 0a853be3d12 [fix](storage medium) show create table don't print empty storage medium #29650 new 7a75cde77db [fix](schemachange) Fixed the issue of incorrect log information when distribution columns are compared inconsistently (#27013) new a5a63856be7 [chore](case) update regression-test README #29031 new 2d04b72b5df [opt](case) Update test_hive_query_cache.groovy (#29694) new aa22698fe7d [fix](case) fix unstable case by add def before variable define (#29082) new f8aba3faaec [Enhancement](index tool) refine inverted index tool code (#29717) new c16a5315136 [FIX](regresstest)delete replicate create table numbers #29722 new 48f58510a8c [refactor](tabletwriter) make tablet writer's rpc callback safe, could exit any time (#29684) new 463a7ab2128 [Performance](exec) opt the exchange performance (#29579) new 94ebf9d7f67 [test](regression-test) forbid test_load_stream_stub_failure_injection #29728 new 2c449515439 [fix](planner)only allow null safe equal when both children are nullable (#29470) new d5311119228 [test](regression-test) forbid test_index_failure_injection (#29741) new 71b017efeee [typo](docs) fix invalid url (#29471) new fe5b0e98801 [FIX](struct)fix struct literal in fe const fold with field name #29735 new 7287c0ca15b [Opt](exec)(multi-catalog) Opt date type reading. (#29571) new ff7f09fe1f8 [fix](executor) Fe publish topic info tcp leak (#29739) new fc4ca712ed6 [bugfix](core) using weak ptr in data stream receiver to avoid runtime state is deconstructed (#29410) new ca75c9b8aba add more logs to debug timeout new a94f2564e31 [fix] (schema change) ignore the error of repeatedly writing rowset during schema change (#29733) new 883d6dfc733 [fix](planner)strip trailing zeros for decimal literal if the precision larger than max decimal precision in doris (#29737) new e17809a684d [fix](nereids)logicalhaving is in wrong place after logicalagg and logicalwindow (#29463) new 38c225f76c7 [fix](nereids) generate correct order for runtime filter when contains NullSafeEquals hash condition (#29726) new 542cfb37b04 [ci](perf) adjust performance pipeline (#29622) new 7db65f3f6c2 [tools] update tpcds tools query (#29745) new bd4ef638f13 [fix](invert index) fix match_phrase_prefix memory leak (#29774) new 3e9cd3a8b96 [minor](jdbc) fix wrong log and add more info (#29557) new ddf2e8d3dd2 [feature](Nereids): merge topNs (#28246) new 5d0732fcf42 [typo](docker thirdparties) Modify script prompt information error (#29770) new 697a6a4ba25 [Refactor](admin-stmt) rename some `admin-show` statestmt (#29492) new f8d3b209115 [improve](fmt) use format_to and FMT_COMPILE to speed up write data #29682 new a244f11da2b [fix](statistics)Fix alter column stats not forward to master bug (#29786) new 99c8e47518b [fix](nereids) fix regression case "nereids_p0/runtimefilter" (#29776) new 8fd1ce4a2e2 [Enhancement](inverted index) refact some inverted index writer code to make more effieciency (#29602) new 2e90c457b6f [fix](move-memtable) don't fail if success tablets to one BE is less than quorum (#29754) new 81d6775b7bc [Cleanup](Nereids): delete useless `ddlSql` to avoid wrong usage (#29788) new 7c7dbf15bcc [feature](merge-cloud) Decouple Tablet/TabletManager/TxnManager from global StorageEngine instance (#29736) new 0d16ec73457 [improvement](cooldown) do not cooldown tablet without cold data (#29690) new 81680383e6e [UT](wal) Add wal dirs info be ut (#29759) new c7968480ac9 [fix](move-memtable) fix use-after-free in LoadStreamReplyHandler (#29791) new f0eb23a4967 [fix](insert-into) fix insert into lose data (#29802) new 4a98db2d473 [fix](Nereids): add def in test (#29796) new a94343c5f9c [fix](planner) Fix table sample not take effect if exist conjunct #29814 new 17a2b89945b [runtimeFilter](nereids) expand runtime filter by join condition by default (#29633) new 0d691c638b3 [Feature](profile)Support report runtime workload statistics #29591 new ba1ecf43903 [pipelineX](profile) refine scan profile (#29801) new 58f8994f5d5 [Fix](core) Fix initializing the WalManager could prevent the BE from starting (#29688) new 33b8311d5f0 [Improvement](runtime-filter) build runtime filter before build hash table on join build probe (#29727) new 542a8010418 [typo](doc) optimization show processlist (#28342) new 771c66c034d [docs](typo)Update flink-doris-connector.md (#29834) new e93a16ac6ec [fix](Nereids) support complex literal cast in fe (#29599) new 3cf95d0fdfb [Improvement](execute) optimize for ColumnNullable's serialize_vec/deserialize_vec (#28788) new 068367063fa [Improvement](function) optimization for substr with ascii string (#29799) new 8c0b046ad41 [case](wal)Add wal backpressure case (#29725) new c9a949130b6 [Case](wal) Add wal group commit sink case with low disk space fault injection (#29731) new 18f850c94f3 [enhance](auto-partition) forbid null column for auto partition (#29749) new f02fb5d49e8 [fix](vec) wrong implementation of operator <=> of Field (#29743) new 885d8b28ba7 [fix](Nerids): fix function deps when check unique and not null #29797 new 22c134fa0ab [fix](rowset-reader) direct mode shouldn't use merge iterator (#29678) new eed72a101ef [fix](Nereids) decimalv3 cast in fe produce wrong data (#29808) new 4d97f8ea750 [enhance](function) support two special format for str_to_date (#29823) new 8ba1eb0b028 [feature](mtmv) task tvf add queryId (#29671) new 90c98a3c59a [feature](merge-cloud) Add meta service client and proxy (#29832) new adc11f174a0 [fix](auth)remove the key when priv is empty (#29522) new e5c23995eb2 [opt](nereids) prune runtime redundant filters (#29828) new e29de284748 [Session](rf) Change the default min size of bf runtime filter (#29837) new a92e4132a87 [opt](information_schema) support information_schema in external catalog (#28919) new ed3d53e2158 [ci](perf) adjust threshold (#29856) new bd91e2c51a1 [improve](load) reduce logs from memtable memory limiter (#29840) new 367045c050a [pipelineX](fix) Fix incorrect runtime filter (#29860) new 7ea9f346180 [bug](group_commit) fix relay wal problem on materialized-view (#29848) new fc592176752 [config](move-memtable) set default load_stream_per_node to 20 (#29822) new 2f91f4f7c00 [regression](conf) enable test_stream_stub_fault_injection (#29830) new 2fb85616885 [Fix] (schema change) fix the bug that non light schema change tables can rename column (#29850) new 2901aaf544b [regression](conf) enable load_stream_fault_injection (#29829) new db0f68eac6f [chore](regression test) check disk is good (#29740) new 5cd107297fe [improve] Use lru cache to count the number of column in tablet schema to control memory (#29668) new b322cb9c96d [Fix](executor)Fix Grayscale upgrade be code dump when report statistics #29843 new 194108745b5 [opt](parquet-reader) Opt parquet decimal type reading. (#29825) new 22277fe59a4 [Optimize](kill-query)Support the scanners exits as soon as possible when kill query #29803 new 5663d2b7e61 [fix](dynamic partition) fix dynamic partition storage medium not working (#29490) new 9b7bbb5b567 [docs](query-accel) refine several statements in docs (#29716) new 6a558f66638 [feature](profile )merge of profiles can be disabled by profile level. #29861 new f34305d88db [pipelineX](fix) Fix correctness problem due to local hash shuffle (#29881) new 4f024cad902 [Refactor](executor)refactor workload group log fron WARNING to INFO #29878 new 59b7f8287a3 [Fix](inverted index) fix array inverted index builder error (#29869) new f5b5a749724 [fix](move-memtable) check all streams for failed reason (#29877) new c0de6cd20f0 [bug](rf) fix invalid type for runtime filters when result column is const (#29851) new 2828ac9d7db [fix](move-memtable) check eos for already closed streams (#29734) new bae8fd4b537 [test](ut) added UT cases for show create load stmt (#29564) The 139 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/comment-to-trigger-teamcity.yml | 28 +- be/cmake/thirdparty.cmake | 1 + be/src/agent/be_exec_version_manager.h | 4 +- be/src/agent/cgroup_cpu_ctl.cpp | 2 +- be/src/agent/workload_group_listener.cpp | 4 +- be/src/clucene | 2 +- be/src/common/config.cpp | 5 + be/src/common/config.h | 6 + be/src/common/daemon.cpp | 13 + be/src/common/daemon.h | 1 + be/src/common/status.h | 1 + be/src/exec/data_sink.cpp | 32 +- be/src/exec/data_sink.h | 8 - be/src/exec/exec_node.cpp | 21 +- be/src/exec/exec_node.h | 11 +- be/src/exec/schema_scanner.cpp | 9 + be/src/exec/schema_scanner.h | 4 + be/src/exprs/bloom_filter_func.h | 47 +- be/src/exprs/runtime_filter.cpp | 2 +- be/src/exprs/runtime_filter_slots.h | 16 +- be/src/gutil/strings/numbers.cc | 13 +- be/src/index-tools/index_tool.cpp | 88 +- be/src/io/cache/block/block_file_cache_settings.h | 3 - be/src/olap/base_tablet.cpp | 1 - be/src/olap/cold_data_compaction.cpp | 2 +- be/src/olap/compaction.cpp | 93 +- be/src/olap/memtable_memory_limiter.cpp | 33 +- be/src/olap/memtable_memory_limiter.h | 7 +- be/src/olap/olap_server.cpp | 167 +- be/src/olap/options.cpp | 44 +- be/src/olap/options.h | 14 +- be/src/olap/rowset/beta_rowset_writer.cpp | 2 +- be/src/olap/rowset/rowset.h | 11 + be/src/olap/rowset/rowset_meta.cpp | 38 +- be/src/olap/rowset/rowset_meta.h | 10 + .../inverted_index/query/conjunction_query.cpp | 3 +- .../inverted_index/query/phrase_query.cpp | 201 ++ .../segment_v2/inverted_index/query/phrase_query.h | 77 + .../rowset/segment_v2/inverted_index_cache.cpp | 29 +- .../segment_v2/inverted_index_compaction.cpp | 16 +- .../inverted_index_compound_directory.cpp | 29 +- .../segment_v2/inverted_index_compound_directory.h | 8 +- .../rowset/segment_v2/inverted_index_reader.cpp | 34 +- .../olap/rowset/segment_v2/inverted_index_reader.h | 6 + .../rowset/segment_v2/inverted_index_writer.cpp | 141 +- .../olap/rowset/segment_v2/inverted_index_writer.h | 2 + be/src/olap/schema_change.cpp | 2 +- be/src/olap/snapshot_manager.cpp | 5 +- be/src/olap/storage_engine.cpp | 5 +- be/src/olap/storage_engine.h | 1 + be/src/olap/tablet.cpp | 300 +-- be/src/olap/tablet.h | 29 +- be/src/olap/tablet_manager.cpp | 33 +- be/src/olap/tablet_manager.h | 4 +- be/src/olap/tablet_reader.cpp | 6 + be/src/olap/tablet_schema_cache.cpp | 81 +- be/src/olap/tablet_schema_cache.h | 39 +- be/src/olap/task/engine_clone_task.cpp | 2 +- be/src/olap/task/index_builder.cpp | 65 +- be/src/olap/txn_manager.cpp | 14 +- be/src/olap/txn_manager.h | 4 +- be/src/olap/wal/wal_dirs_info.cpp | 40 +- be/src/olap/wal/wal_dirs_info.h | 11 +- be/src/olap/wal/wal_manager.cpp | 6 +- be/src/olap/wal/wal_table.cpp | 1 + be/src/pipeline/exec/exchange_sink_buffer.cpp | 10 +- be/src/pipeline/exec/exchange_sink_buffer.h | 1 - be/src/pipeline/exec/exchange_sink_operator.cpp | 9 +- be/src/pipeline/exec/exchange_sink_operator.h | 4 +- be/src/pipeline/exec/exchange_source_operator.cpp | 3 +- be/src/pipeline/exec/exchange_source_operator.h | 5 - be/src/pipeline/exec/hashjoin_build_sink.cpp | 24 +- be/src/pipeline/exec/hashjoin_build_sink.h | 6 +- be/src/pipeline/exec/operator.h | 21 - be/src/pipeline/exec/result_file_sink_operator.cpp | 13 +- be/src/pipeline/exec/result_file_sink_operator.h | 2 - be/src/pipeline/exec/result_sink_operator.cpp | 3 +- be/src/pipeline/exec/scan_operator.cpp | 10 +- be/src/pipeline/exec/scan_operator.h | 4 - be/src/pipeline/exec/union_source_operator.cpp | 16 +- be/src/pipeline/pipeline.h | 7 - be/src/pipeline/pipeline_fragment_context.cpp | 5 +- be/src/pipeline/pipeline_fragment_context.h | 12 - be/src/pipeline/pipeline_task.cpp | 26 - be/src/pipeline/pipeline_task.h | 3 - .../local_exchange/local_exchange_sink_operator.h | 7 +- .../pipeline_x/local_exchange/local_exchanger.cpp | 8 +- be/src/pipeline/pipeline_x/operator.cpp | 4 +- be/src/pipeline/pipeline_x/operator.h | 7 +- .../pipeline_x/pipeline_x_fragment_context.cpp | 69 +- .../pipeline_x/pipeline_x_fragment_context.h | 12 +- be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 5 +- be/src/pipeline/pipeline_x/pipeline_x_task.h | 6 +- be/src/runtime/buffer_control_block.cpp | 4 +- be/src/runtime/buffer_control_block.h | 19 +- be/src/runtime/descriptors.cpp | 14 +- be/src/runtime/descriptors.h | 10 + be/src/runtime/exec_env.h | 6 + be/src/runtime/exec_env_init.cpp | 15 +- be/src/runtime/fold_constant_executor.cpp | 14 +- be/src/runtime/fragment_mgr.cpp | 1 - be/src/runtime/group_commit_mgr.cpp | 14 +- be/src/runtime/large_int_value.h | 6 +- be/src/runtime/load_stream_writer.cpp | 1 - be/src/runtime/memory/cache_policy.h | 5 +- be/src/runtime/plan_fragment_executor.cpp | 59 +- be/src/runtime/plan_fragment_executor.h | 18 +- be/src/runtime/query_context.cpp | 13 + be/src/runtime/query_context.h | 4 + be/src/runtime/query_statistics.cpp | 10 +- be/src/runtime/query_statistics.h | 23 +- be/src/runtime/runtime_query_statistics_mgr.cpp | 170 ++ be/src/runtime/runtime_query_statistics_mgr.h | 59 + be/src/runtime/runtime_state.cpp | 7 +- be/src/runtime/runtime_state.h | 9 +- be/src/runtime/task_group/task_group_manager.cpp | 20 +- be/src/util/date_func.cpp | 9 +- be/src/util/mysql_row_buffer.cpp | 14 +- be/src/util/simd/vstring_function.h | 57 +- .../aggregate_functions/aggregate_function_null.h | 30 +- .../aggregate_functions/aggregate_function_sort.h | 2 +- be/src/vec/columns/column.h | 5 +- be/src/vec/columns/column_array.cpp | 15 +- be/src/vec/columns/column_const.h | 4 +- be/src/vec/columns/column_decimal.cpp | 4 +- be/src/vec/columns/column_dummy.h | 2 - be/src/vec/columns/column_map.cpp | 6 + be/src/vec/columns/column_map.h | 2 + be/src/vec/columns/column_nullable.cpp | 29 +- be/src/vec/columns/column_nullable.h | 3 +- be/src/vec/columns/column_object.cpp | 2 +- be/src/vec/columns/column_string.cpp | 4 +- be/src/vec/common/hash_table/hash_map_context.h | 11 +- be/src/vec/common/memcpy_small.h | 9 +- be/src/vec/common/pod_array.h | 8 + be/src/vec/common/schema_util.cpp | 43 +- be/src/vec/common/sort/partition_sorter.cpp | 2 +- be/src/vec/common/sort/sorter.cpp | 6 +- be/src/vec/common/sort/sorter.h | 2 +- be/src/vec/common/typeid_cast.h | 9 +- be/src/vec/core/block.cpp | 49 +- be/src/vec/core/block.h | 5 +- be/src/vec/core/block_spill_writer.cpp | 2 +- be/src/vec/core/column_with_type_and_name.cpp | 25 + be/src/vec/core/column_with_type_and_name.h | 13 +- be/src/vec/core/field.h | 3 +- be/src/vec/core/sort_cursor.h | 10 +- be/src/vec/data_types/data_type.h | 8 +- be/src/vec/data_types/data_type_decimal.cpp | 92 +- be/src/vec/data_types/data_type_nullable.cpp | 121 +- be/src/vec/data_types/data_type_nullable.h | 1 - be/src/vec/data_types/data_type_number_base.cpp | 95 +- be/src/vec/data_types/data_type_string.cpp | 189 +- be/src/vec/data_types/get_least_supertype.cpp | 4 +- .../exec/format/parquet/fix_length_plain_decoder.h | 29 +- .../exec/format/parquet/parquet_column_convert.h | 175 +- .../exec/format/parquet/vparquet_column_reader.cpp | 12 +- .../exec/format/parquet/vparquet_column_reader.h | 4 +- be/src/vec/exec/join/vhash_join_node.cpp | 22 +- be/src/vec/exec/join/vhash_join_node.h | 52 +- be/src/vec/exec/scan/new_jdbc_scanner.cpp | 5 + be/src/vec/exec/scan/new_olap_scan_node.cpp | 15 - be/src/vec/exec/scan/new_olap_scan_node.h | 2 - be/src/vec/exec/scan/pip_scanner_context.h | 4 + be/src/vec/exec/scan/scanner_context.cpp | 2 + be/src/vec/exec/scan/scanner_scheduler.cpp | 11 +- be/src/vec/exec/scan/vfile_scanner.cpp | 2 + be/src/vec/exec/scan/vscan_node.cpp | 10 +- be/src/vec/exec/scan/vscanner.cpp | 7 + be/src/vec/exec/scan/vscanner.h | 7 + be/src/vec/exec/vexchange_node.cpp | 17 +- be/src/vec/exec/vexchange_node.h | 4 - be/src/vec/exec/vjdbc_connector.cpp | 23 +- be/src/vec/exec/vjdbc_connector.h | 5 + be/src/vec/exec/vsort_node.cpp | 2 +- be/src/vec/exprs/vcast_expr.cpp | 7 +- be/src/vec/exprs/vruntimefilter_wrapper.cpp | 16 +- be/src/vec/functions/function.cpp | 132 +- be/src/vec/functions/function.h | 28 +- be/src/vec/functions/function_bitmap.cpp | 7 +- be/src/vec/functions/function_cast.h | 129 +- be/src/vec/functions/function_ip.cpp | 8 +- be/src/vec/functions/function_ip.h | 107 +- be/src/vec/functions/function_rpc.cpp | 2 +- be/src/vec/functions/function_rpc.h | 2 +- be/src/vec/functions/function_string.h | 226 +- be/src/vec/functions/functions_geo.cpp | 32 +- be/src/vec/functions/functions_geo.h | 1 - be/src/vec/functions/functions_logical.cpp | 5 +- be/src/vec/functions/least_greast.cpp | 3 +- be/src/vec/functions/nullif.cpp | 28 +- be/src/vec/io/io_helper.h | 5 +- be/src/vec/runtime/ip_address_cidr.h | 141 ++ be/src/vec/runtime/vdata_stream_mgr.cpp | 22 +- be/src/vec/runtime/vdata_stream_mgr.h | 11 +- be/src/vec/runtime/vdata_stream_recvr.cpp | 24 +- be/src/vec/runtime/vdata_stream_recvr.h | 18 +- be/src/vec/runtime/vdatetime_value.cpp | 53 +- be/src/vec/runtime/vdatetime_value.h | 39 +- be/src/vec/sink/load_stream_stub.cpp | 136 +- be/src/vec/sink/load_stream_stub.h | 139 +- be/src/vec/sink/load_stream_stub_pool.cpp | 18 - be/src/vec/sink/vdata_stream_sender.cpp | 39 +- be/src/vec/sink/vdata_stream_sender.h | 22 +- be/src/vec/sink/vresult_file_sink.cpp | 15 +- be/src/vec/sink/vresult_file_sink.h | 4 - be/src/vec/sink/vresult_sink.cpp | 8 +- be/src/vec/sink/vresult_sink.h | 3 - be/src/vec/sink/writer/vjdbc_table_writer.cpp | 5 + be/src/vec/sink/writer/vtablet_writer.cpp | 14 +- be/src/vec/sink/writer/vtablet_writer.h | 3 + be/src/vec/sink/writer/vtablet_writer_v2.cpp | 42 +- be/src/vec/sink/writer/vtablet_writer_v2.h | 2 - be/src/vec/sink/writer/vwal_writer.cpp | 7 +- be/test/io/cache/file_block_cache_test.cpp | 76 + be/test/io/fs/local_file_system_test.cpp | 4 +- .../compaction_delete_bitmap_calculator_test.cpp | 5 +- be/test/olap/cumulative_compaction_policy_test.cpp | 67 +- ...mulative_compaction_time_series_policy_test.cpp | 58 +- be/test/olap/ordered_data_compaction_test.cpp | 2 +- be/test/olap/path_gc_test.cpp | 2 +- be/test/olap/rowid_conversion_test.cpp | 2 +- be/test/olap/rowset/rowset_meta_test.cpp | 2 +- be/test/olap/segcompaction_test.cpp | 2 +- be/test/olap/tablet_cooldown_test.cpp | 1 + be/test/olap/tablet_test.cpp | 6 +- be/test/olap/txn_manager_test.cpp | 6 +- be/test/olap/wal/wal_dirs_info_test.cpp | 132 + be/test/olap/{ => wal}/wal_manager_test.cpp | 0 be/test/olap/{ => wal}/wal_reader_writer_test.cpp | 0 be/test/testutil/run_all_tests.cpp | 7 +- be/test/vec/exec/parquet/parquet_thrift_test.cpp | 4 +- be/test/vec/exec/vtablet_sink_test.cpp | 9 + be/test/vec/olap/vertical_compaction_test.cpp | 2 +- be/test/vec/runtime/vdata_stream_test.cpp | 9 +- bin/start_be.sh | 5 +- conf/be.conf | 4 +- .../docker-compose/kafka/kafka.yaml.tpl | 12 +- .../postgresql/init/02-create-table.sql | 7 +- .../docker-compose/postgresql/init/04-insert.sql | 4 + .../thirdparties/docker-compose/spark/spark.yaml | 11 + docker/thirdparties/run-thirdparties-docker.sh | 2 +- docs/dev.json | 4 + .../release-and-verify/release-complete.md | 9 +- .../docs/admin-manual/cluster-management/fqdn.md | 2 +- docs/en/docs/admin-manual/config/be-config.md | 2 +- .../docs/admin-manual/config/fe-config-template.md | 14 +- docs/en/docs/admin-manual/config/fe-config.md | 14 +- .../docs/admin-manual/data-admin/delete-recover.md | 2 +- .../maint-monitor/tablet-repair-and-balance.md | 8 +- docs/en/docs/advanced/alter-table/schema-change.md | 2 +- docs/en/docs/advanced/partition/auto-partition.md | 9 +- docs/en/docs/advanced/variables.md | 2 +- docs/en/docs/data-table/data-partition.md | 1 + docs/en/docs/ecosystem/flink-doris-connector.md | 24 +- .../docs/install/k8s-deploy/helm-chart-deploy.md | 108 + .../operator-deploy.md} | 0 docs/en/docs/lakehouse/filecache.md | 2 +- .../join-optimization/colocation-join.md | 2 +- docs/en/docs/query-acceleration/nereids.md | 4 +- docs/en/docs/query-acceleration/statistics.md | 10 +- .../date-time-functions/str-to-date.md | 10 +- .../ADMIN-REPAIR-TABLE.md | 2 +- .../ADMIN-SET-CONFIG.md | 2 +- .../{ADMIN-SHOW-CONFIG.md => SHOW-CONFIG.md} | 14 +- ...ISTRIBUTION.md => SHOW-REPLICA-DISTRIBUTION.md} | 14 +- ...OW-REPLICA-STATUS.md => SHOW-REPLICA-STATUS.md} | 16 +- ...DIAGNOSE-TABLET.md => SHOW-TABLET-DIAGNOSIS.md} | 11 +- ...AGE-FORMAT.md => SHOW-TABLET-STORAGE-FORMAT.md} | 16 +- .../Show-Statements/SHOW-PROCESSLIST.md | 2 +- .../Utility-Statements/REFRESH-LDAP.md | 2 +- docs/sidebars.json | 19 +- .../release-and-verify/release-complete.md | 9 +- .../docs/admin-manual/cluster-management/fqdn.md | 2 +- docs/zh-CN/docs/admin-manual/config/be-config.md | 2 +- .../docs/admin-manual/config/fe-config-template.md | 14 +- docs/zh-CN/docs/admin-manual/config/fe-config.md | 16 +- .../docs/admin-manual/data-admin/delete-recover.md | 2 +- .../maint-monitor/tablet-repair-and-balance.md | 8 +- .../docs/advanced/alter-table/schema-change.md | 2 +- .../docs/advanced/partition/auto-partition.md | 9 +- docs/zh-CN/docs/advanced/variables.md | 4 +- docs/zh-CN/docs/data-table/data-partition.md | 1 + docs/zh-CN/docs/ecosystem/audit-plugin.md | 4 +- docs/zh-CN/docs/ecosystem/flink-doris-connector.md | 20 + .../docs/install/k8s-deploy/helm-chart-deploy.md | 105 + .../operator-deploy.md} | 0 docs/zh-CN/docs/lakehouse/filecache.md | 2 +- .../join-optimization/colocation-join.md | 2 +- docs/zh-CN/docs/query-acceleration/nereids.md | 4 +- .../pipeline-execution-engine.md | 4 +- docs/zh-CN/docs/query-acceleration/statistics.md | 8 +- docs/zh-CN/docs/releasenotes/release-2.0-Beta.md | 6 +- docs/zh-CN/docs/releasenotes/release-2.0.0.md | 10 +- .../date-time-functions/str-to-date.md | 10 +- .../ADMIN-REPAIR-TABLE.md | 2 +- .../ADMIN-SET-CONFIG.md | 2 +- .../{ADMIN-SHOW-CONFIG.md => SHOW-CONFIG.md} | 14 +- ...ISTRIBUTION.md => SHOW-REPLICA-DISTRIBUTION.md} | 14 +- ...OW-REPLICA-STATUS.md => SHOW-REPLICA-STATUS.md} | 16 +- ...DIAGNOSE-TABLET.md => SHOW-TABLET-DIAGNOSIS.md} | 11 +- ...AGE-FORMAT.md => SHOW-TABLET-STORAGE-FORMAT.md} | 17 +- .../Show-Statements/SHOW-PROCESSLIST.md | 2 +- .../Utility-Statements/REFRESH-LDAP.md | 2 +- .../java/org/apache/doris/jdbc/JdbcDataSource.java | 5 - .../apache/doris/jdbc/JdbcDataSourceConfig.java | 169 ++ .../java/org/apache/doris/jdbc/JdbcExecutor.java | 93 +- .../java/org/apache/doris/catalog/StructField.java | 2 +- .../main/java/org/apache/doris/common/Config.java | 56 +- fe/fe-core/pom.xml | 10 +- .../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 + .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 3 +- fe/fe-core/src/main/cup/sql_parser.cup | 81 +- .../org/apache/doris/alter/SchemaChangeJobV2.java | 2 +- .../doris/analysis/AlterColumnStatsStmt.java | 5 - .../apache/doris/analysis/AlterJobStatusStmt.java | 12 + .../java/org/apache/doris/analysis/Analyzer.java | 13 +- .../doris/analysis/CreateMaterializedViewStmt.java | 13 +- .../org/apache/doris/analysis/DateLiteral.java | 8 + .../org/apache/doris/analysis/DecimalLiteral.java | 14 + ...noseTabletStmt.java => DiagnoseTabletStmt.java} | 8 +- .../apache/doris/analysis/ExprSubstitutionMap.java | 6 + .../org/apache/doris/analysis/InlineViewRef.java | 11 +- .../org/apache/doris/analysis/PartitionDesc.java | 7 +- .../org/apache/doris/analysis/SchemaTableType.java | 1 - .../org/apache/doris/analysis/ShowColumnStmt.java | 52 +- ...dminShowConfigStmt.java => ShowConfigStmt.java} | 6 +- .../java/org/apache/doris/analysis/ShowDbStmt.java | 17 +- .../org/apache/doris/analysis/ShowIndexStmt.java | 11 +- ...nStmt.java => ShowReplicaDistributionStmt.java} | 6 +- ...aStatusStmt.java => ShowReplicaStatusStmt.java} | 4 +- .../apache/doris/analysis/ShowTableStatsStmt.java | 2 + .../apache/doris/analysis/ShowTableStatusStmt.java | 46 +- .../org/apache/doris/analysis/ShowTableStmt.java | 15 +- ...tStmt.java => ShowTabletStorageFormatStmt.java} | 6 +- .../apache/doris/analysis/ShowVariablesStmt.java | 2 +- .../org/apache/doris/analysis/StructLiteral.java | 24 +- .../doris/catalog/BuiltinScalarFunctions.java | 6 +- .../doris/catalog/DynamicPartitionProperty.java | 11 +- .../main/java/org/apache/doris/catalog/Env.java | 22 +- .../org/apache/doris/catalog/JdbcResource.java | 17 +- .../java/org/apache/doris/catalog/JdbcTable.java | 31 + .../java/org/apache/doris/catalog/MetaObject.java | 4 +- .../org/apache/doris/catalog/MetadataViewer.java | 8 +- .../java/org/apache/doris/catalog/OlapTable.java | 12 +- .../main/java/org/apache/doris/catalog/Table.java | 13 +- .../java/org/apache/doris/catalog/TableIf.java | 40 +- .../main/java/org/apache/doris/catalog/View.java | 5 - .../doris/catalog/constraint/Constraint.java | 20 +- .../catalog/constraint/ForeignKeyConstraint.java | 11 + .../catalog/constraint/PrimaryKeyConstraint.java | 5 + .../doris/catalog/constraint/TableIdentifier.java | 6 + .../doris/catalog/constraint/UniqueConstraint.java | 5 + .../doris/catalog/external/EsExternalTable.java | 5 - .../doris/catalog/external/ExternalDatabase.java | 27 +- .../doris/catalog/external/HMSExternalTable.java | 5 - .../doris/catalog/external/JdbcExternalTable.java | 10 +- .../catalog/external/MaxComputeExternalTable.java | 5 - .../doris/catalog/external/TestExternalTable.java | 5 - .../doris/clone/DynamicPartitionScheduler.java | 30 +- .../apache/doris/cloud/rpc/MetaServiceClient.java | 318 +++ .../apache/doris/cloud/rpc/MetaServiceProxy.java | 584 +++++ .../org/apache/doris/common/profile/Profile.java | 20 +- .../doris/common/publish/TopicPublisherThread.java | 17 +- .../apache/doris/common/util/PropertyAnalyzer.java | 2 +- .../org/apache/doris/datasource/CatalogMgr.java | 1 + .../apache/doris/datasource/ExternalCatalog.java | 40 +- .../apache/doris/datasource/InitDatabaseLog.java | 1 + .../apache/doris/datasource/InternalCatalog.java | 10 +- .../infoschema/ExternalInfoSchemaDatabase.java | 55 + .../infoschema/ExternalInfoSchemaTable.java} | 47 +- .../doris/datasource/jdbc/JdbcExternalCatalog.java | 28 +- .../doris/datasource/jdbc/client/JdbcClient.java | 39 +- .../datasource/jdbc/client/JdbcClientConfig.java | 61 + .../datasource/jdbc/client/JdbcMySQLClient.java | 4 +- .../org/apache/doris/httpv2/rest/LoadAction.java | 7 +- .../org/apache/doris/job/base/AbstractJob.java | 6 +- .../apache/doris/job/extensions/mtmv/MTMVTask.java | 9 +- .../org/apache/doris/job/manager/JobManager.java | 92 +- .../src/main/java/org/apache/doris/load/Load.java | 3 + .../org/apache/doris/master/ReportHandler.java | 7 +- .../main/java/org/apache/doris/mtmv/MTMVCache.java | 7 +- .../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 18 +- .../org/apache/doris/mysql/privilege/Role.java | 3 + .../org/apache/doris/nereids/StatementContext.java | 7 + .../exceptions/DialectTransformException.java | 3 +- .../exceptions/UnsupportedDialectException.java | 9 +- .../glue/translator/PhysicalPlanTranslator.java | 87 +- .../java/org/apache/doris/nereids/jobs/Job.java | 2 +- .../doris/nereids/jobs/executor/Analyzer.java | 2 + .../doris/nereids/jobs/executor/Rewriter.java | 2 + .../joinorder/hypergraph/ConflictRulesMaker.java | 108 + .../jobs/joinorder/hypergraph/HyperGraph.java | 73 +- .../jobs/joinorder/hypergraph/edge/FilterEdge.java | 4 + .../jobs/joinorder/hypergraph/edge/JoinEdge.java | 5 + .../nereids/parser/ComplexFnCallTransformer.java | 2 +- .../org/apache/doris/nereids/parser/Dialect.java | 101 + .../doris/nereids/parser/LogicalPlanBuilder.java | 28 +- .../parser/LogicalPlanBuilderAssistant.java | 3 +- .../apache/doris/nereids/parser/NereidsParser.java | 47 +- .../apache/doris/nereids/parser/ParseDialect.java | 129 - .../apache/doris/nereids/parser/ParserContext.java | 6 +- .../nereids/processor/post/PlanPostProcessors.java | 3 + .../processor/post/RuntimeFilterContext.java | 82 +- .../processor/post/RuntimeFilterGenerator.java | 7 +- .../processor/post/RuntimeFilterPruner.java | 64 +- .../post/RuntimeFilterPrunerForExternalTable.java | 165 ++ .../nereids/properties/FunctionalDependencies.java | 5 +- .../org/apache/doris/nereids/rules/RuleType.java | 2 + .../doris/nereids/rules/analysis/BindRelation.java | 2 +- .../nereids/rules/analysis/FillUpMissingSlots.java | 5 - .../analysis/HavingToFilter.java} | 24 +- .../nereids/rules/analysis/NormalizeAggregate.java | 264 +- .../mv/AbstractMaterializedViewAggregateRule.java | 208 +- .../mv/AbstractMaterializedViewRule.java | 285 ++- .../rules/exploration/mv/HyperGraphComparator.java | 140 +- .../exploration/mv/MaterializationContext.java | 11 +- .../nereids/rules/exploration/mv/Predicates.java | 4 +- .../rules/exploration/mv/PredicatesSplitter.java | 3 + .../rules/expression/rules/SimplifyCastRule.java | 9 +- .../rules/implementation/AggregateStrategies.java | 9 +- .../nereids/rules/rewrite/EliminateFilter.java | 10 +- .../nereids/rules/rewrite/EliminateJoinByFK.java | 6 +- .../doris/nereids/rules/rewrite/MergeTopNs.java | 56 + .../rules/rewrite/PredicatePropagation.java | 176 +- .../rewrite/PushProjectIntoOneRowRelation.java | 36 +- .../doris/nereids/stats/StatsCalculator.java | 8 +- .../doris/nereids/trees/expressions/Cast.java | 2 +- .../functions/ComputeSignatureHelper.java | 3 +- .../expressions/functions/agg/BitmapUnion.java | 8 +- .../functions/agg/BitmapUnionCount.java | 8 +- .../expressions/functions/scalar/CreateStruct.java | 8 +- .../{IsIpv4String.java => IsIpAddressInRange.java} | 26 +- .../expressions/functions/scalar/IsIpv4String.java | 6 +- .../expressions/functions/scalar/IsIpv6String.java | 6 +- .../expressions/functions/scalar/NonNullable.java | 10 + .../expressions/functions/scalar/Nullable.java | 10 + .../trees/expressions/literal/ArrayLiteral.java | 6 +- .../trees/expressions/literal/DecimalLiteral.java | 1 + .../expressions/literal/DecimalV3Literal.java | 2 +- .../trees/expressions/literal/DoubleLiteral.java | 14 - .../trees/expressions/literal/FloatLiteral.java | 9 - .../nereids/trees/expressions/literal/Literal.java | 8 + .../trees/expressions/literal/MapLiteral.java | 32 +- .../trees/expressions/literal/StructLiteral.java | 56 +- .../expressions/visitor/ScalarFunctionVisitor.java | 5 + .../doris/nereids/trees/plans/AbstractPlan.java | 9 +- .../apache/doris/nereids/trees/plans/ObjectId.java | 5 - .../org/apache/doris/nereids/trees/plans/Plan.java | 2 +- .../apache/doris/nereids/trees/plans/PlanType.java | 1 + .../doris/nereids/trees/plans/algebra/Project.java | 13 +- .../plans/commands/DeleteFromUsingCommand.java | 4 +- .../trees/plans/commands/InsertExecutor.java | 38 +- .../plans/commands/ShowConstraintsCommand.java | 66 + .../trees/plans/commands/UpdateCommand.java | 6 +- .../trees/plans/commands/info/CreateMTMVInfo.java | 97 +- .../trees/plans/commands/info/CreateTableInfo.java | 19 +- .../nereids/trees/plans/logical/LogicalJoin.java | 8 +- .../trees/plans/logical/LogicalSchemaScan.java | 5 +- .../trees/plans/physical/AbstractPhysicalPlan.java | 4 +- .../trees/plans/physical/PhysicalHashJoin.java | 14 + .../trees/plans/physical/PhysicalOlapScan.java | 7 +- .../trees/plans/physical/PhysicalSchemaScan.java | 10 +- .../trees/plans/physical/RuntimeFilter.java | 23 +- .../trees/plans/visitor/CommandVisitor.java | 5 + .../apache/doris/nereids/util/ExpressionUtils.java | 33 + ...eEquivalenceSet.java => ImmutableEqualSet.java} | 55 +- .../apache/doris/nereids/util/MutableState.java | 2 + .../org/apache/doris/nereids/util/PlanUtils.java | 23 +- .../doris/nereids/util/TypeCoercionUtils.java | 15 +- .../java/org/apache/doris/persist/EditLog.java | 4 +- .../org/apache/doris/persist/gson/GsonUtils.java | 17 +- .../org/apache/doris/planner/HashJoinNode.java | 12 +- .../org/apache/doris/planner/OlapScanNode.java | 23 +- .../java/org/apache/doris/planner/PlanNode.java | 12 +- .../java/org/apache/doris/planner/ScanNode.java | 2 +- .../org/apache/doris/planner/SchemaScanNode.java | 15 +- .../doris/planner/external/jdbc/JdbcTableSink.java | 28 +- .../java/org/apache/doris/plugin/AuditEvent.java | 2 + .../doris/plugin/DialectConverterPlugin.java | 61 + .../java/org/apache/doris/plugin/PluginInfo.java | 3 +- .../java/org/apache/doris/plugin/PluginMgr.java | 68 +- .../org/apache/doris/qe/AuditEventProcessor.java | 2 +- .../java/org/apache/doris/qe/AuditLogHelper.java | 2 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 34 +- .../main/java/org/apache/doris/qe/Coordinator.java | 14 +- .../main/java/org/apache/doris/qe/DdlExecutor.java | 6 + .../java/org/apache/doris/qe/GlobalVariable.java | 7 + .../java/org/apache/doris/qe/QeProcessorImpl.java | 9 + .../java/org/apache/doris/qe/SessionVariable.java | 42 +- .../java/org/apache/doris/qe/ShowExecutor.java | 61 +- .../java/org/apache/doris/qe/StmtExecutor.java | 12 +- .../WorkloadRuntimeStatusMgr.java | 223 ++ .../apache/doris/service/FrontendServiceImpl.java | 109 +- .../org/apache/doris/statistics/AnalysisInfo.java | 5 +- .../doris/statistics/AnalysisInfoBuilder.java | 9 +- .../apache/doris/statistics/AnalysisManager.java | 23 +- .../org/apache/doris/statistics/ColStatsData.java | 2 +- .../java/org/apache/doris/statistics/README.md | 46 +- .../doris/statistics/StatisticsAutoCollector.java | 3 + .../doris/statistics/StatisticsRepository.java | 8 + .../apache/doris/statistics/TableStatsMeta.java | 7 +- .../doris/statistics/util/StatisticsUtil.java | 1 + fe/fe-core/src/main/jflex/sql_scanner.flex | 1 + .../apache/doris/analysis/DecimalLiteralTest.java | 7 + .../org/apache/doris/analysis/MapLiteralTest.java | 4 +- .../doris/analysis/RangePartitionPruneTest.java | 2 +- .../org/apache/doris/analysis/SelectStmtTest.java | 5 + .../doris/analysis/ShowCreateLoadStmtTest.java | 98 + .../apache/doris/analysis/ShowIndexStmtTest.java | 2 +- ...inShowReplicaTest.java => ShowReplicaTest.java} | 28 +- .../apache/doris/analysis/StructLiteralTest.java | 9 +- .../org/apache/doris/catalog/CreateViewTest.java | 5 - .../org/apache/doris/catalog/RefreshTableTest.java | 12 + .../doris/datasource/RefreshCatalogTest.java | 25 +- .../job/base/JobExecutionConfigurationTest.java | 4 +- .../doris/nereids/parser/NereidsParserTest.java | 52 - .../doris/nereids/parser/ParserTestBase.java | 4 - .../exploration/mv/HyperGraphComparatorTest.java | 172 ++ .../exploration/mv/MaterializedViewUtilsTest.java | 49 + .../rules/expression/ExpressionRewriteTest.java | 8 +- .../expression/SimplifyArithmeticRuleTest.java | 18 +- .../nereids/rules/rewrite/MergeTopNsTest.java | 77 + .../rules/rewrite/PredicatePropagationTest.java | 16 + .../functions/ComputeSignatureHelperTest.java | 14 +- .../doris/nereids/trees/plans/ConstraintTest.java | 10 +- .../trees/plans/DeleteFromUsingCommandTest.java | 20 +- .../nereids/util/TrinoDialectPlanParseChecker.java | 60 - .../org/apache/doris/plugin/DialectPluginTest.java | 76 + .../{PluginTest.java => TestDialectPlugin1.java} | 41 +- .../{PluginTest.java => TestDialectPlugin2.java} | 39 +- .../doris/service/FrontendServiceImplTest.java | 4 +- .../apache/doris/statistics/ColStatsDataTest.java | 96 + .../statistics/StatisticsAutoCollectorTest.java | 9 + fe/pom.xml | 13 +- fe_plugins/http-dialect-converter/pom.xml | 119 + .../src/main/assembly/plugin.conf | 23 +- .../src/main/assembly/plugin.properties | 24 +- .../src/main/assembly/zip.xml | 0 .../dialect/http/HttpDialectConverterPlugin.java | 144 ++ .../plugin/dialect/http/HttpDialectUtils.java | 53 +- .../plugin/dialect/http/HttpDialectUtilsTest.java | 68 +- .../plugin/dialect/http}/SimpleHttpServer.java | 2 +- fe_plugins/pom.xml | 43 +- fe_plugins/sparksql-converter/pom.xml | 132 + .../src/main/assembly/plugin.conf | 19 +- .../src/main/assembly/plugin.properties | 24 +- .../src/main/assembly/zip.xml | 0 .../dialect}/spark/DateTruncFnCallTransformer.java | 8 +- .../spark/SparkSql3FnCallTransformers.java | 6 +- .../spark/SparkSql3LogicalPlanBuilder.java | 6 +- .../spark/SparkSqlDialectConverterPlugin.java | 47 + .../plugin/dialect}/spark/FnTransformTest.java | 41 +- .../doris/plugin/dialect/spark/ParserTest.java | 64 + fe_plugins/trino-converter/pom.xml | 159 ++ .../trino-converter/src/main/assembly/plugin.conf | 19 +- .../src/main/assembly/plugin.properties | 24 +- .../src/main/assembly/zip.xml | 0 .../dialect}/trino/DateDiffFnCallTransformer.java | 2 +- .../dialect/trino/TrinoDialectConverterPlugin.java | 48 +- .../dialect}/trino/TrinoFnCallTransformers.java | 3 +- .../dialect}/trino/TrinoLogicalPlanBuilder.java | 3 +- .../doris/plugin/dialect}/trino/TrinoParser.java | 33 +- .../plugin/dialect}/trino/FnTransformTest.java | 41 +- .../doris/plugin/dialect/trino/ParserTest.java | 34 +- gensrc/script/doris_builtins_functions.py | 11 +- gensrc/thrift/Descriptors.thrift | 6 +- gensrc/thrift/FrontendService.thrift | 7 + gensrc/thrift/PaloInternalService.thrift | 5 + gensrc/thrift/Types.thrift | 6 + regression-test/README.md | 15 +- .../data/correctness/test_str_to_date.out | 18 + .../test_outer_join_with_null_value.out | 3 + .../info_schema_db/test_info_schema_db.out | 226 ++ .../jdbc/test_mariadb_jdbc_catalog.out | 106 +- .../jdbc/test_mysql_jdbc_catalog.out | 91 +- .../jdbc/test_mysql_jdbc_catalog_nereids.out | 88 +- .../jdbc/test_oracle_jdbc_catalog.out | 2 + .../jdbc/test_pg_jdbc_catalog.out | 8 + .../jdbc/test_sqlserver_jdbc_catalog.out | 1 + .../test_index_compaction_fault_injection.out | 291 +++ ...st_index_compound_directory_fault_injection.out | 3 + ...test_low_wal_disk_space_fault_injection.csv.gz} | Bin .../nereids_p0/aggregate/agg_window_project.out | 4 + .../eliminate_outer_join/eliminate_outer_join.out | 185 +- .../data/nereids_p0/hint/fix_leading.out | 2 +- .../nereids_rules_p0/eager_aggregate/basic.out | 66 +- .../eager_aggregate/basic_one_side.out | 60 +- .../push_down_count_through_join.out | 664 +++-- .../push_down_count_through_join_one_side.out | 610 ++--- .../eager_aggregate/push_down_max_through_join.out | 337 ++- .../eager_aggregate/push_down_min_through_join.out | 337 ++- .../eager_aggregate/push_down_sum_through_join.out | 361 ++- .../push_down_sum_through_join_one_side.out | 337 ++- .../eliminate_join_condition.out | 43 +- .../eliminate_not_null/eliminate_not_null.out | 59 +- .../eliminate_outer_join/eliminate_outer_join.out | 94 +- .../push_down_filter_other_condition.out | 410 ++-- .../filter_push_down/push_filter_inside_join.out | 139 +- .../filter_push_down/push_filter_through.out | 599 +++-- .../limit_push_down/limit_push_down.out | 1004 ++++---- .../limit_push_down/order_push_down.out | 830 +++---- .../mv/agg_with_roll_up/aggregate_with_roll_up.out | 76 + .../nereids_rules_p0/mv/join/inner/inner_join.out | 22 + .../data/nereids_rules_p0/pkfk/eliminate_inner.out | 227 +- .../predicate_infer/infer_predicate.out | 533 ++-- .../push_down_limit_distinct.out | 24 +- .../push_down_top_n_distinct_through_union.out | 182 +- .../push_down_top_n_through_union.out | 245 +- .../transposeJoin/transposeSemiJoinAgg.out | 132 +- .../data/nereids_syntax_p0/constraint.out | 10 + .../shape/query17.out | 4 +- .../shape/query24.out | 4 +- .../shape/query25.out | 4 +- .../shape/query29.out | 4 +- .../shape/query39.out | 2 +- .../shape/query51.out | 85 +- .../shape/query53.out | 61 +- .../shape/query64.out | 4 +- .../shape/query65.out | 4 +- .../shape/query73.out | 2 +- .../{shape => constraints}/query23.out | 0 .../noStatsRfPrune/query17.out | 6 +- .../noStatsRfPrune/query25.out | 6 +- .../noStatsRfPrune/query29.out | 6 +- .../noStatsRfPrune/query39.out | 2 +- .../noStatsRfPrune/query51.out | 85 +- .../noStatsRfPrune/query53.out | 57 +- .../noStatsRfPrune/query58.out | 8 +- .../noStatsRfPrune/query64.out | 6 +- .../noStatsRfPrune/query65.out | 4 +- .../noStatsRfPrune/query72.out | 4 +- .../noStatsRfPrune/query73.out | 2 +- .../noStatsRfPrune/query74.out | 6 +- .../noStatsRfPrune/query83.out | 8 +- .../noStatsRfPrune/query95.out | 2 +- .../no_stats_shape/query17.out | 8 +- .../no_stats_shape/query24.out | 4 +- .../no_stats_shape/query25.out | 8 +- .../no_stats_shape/query29.out | 8 +- .../no_stats_shape/query39.out | 2 +- .../no_stats_shape/query51.out | 85 +- .../no_stats_shape/query53.out | 57 +- .../no_stats_shape/query58.out | 4 +- .../no_stats_shape/query64.out | 8 +- .../no_stats_shape/query65.out | 4 +- .../no_stats_shape/query72.out | 4 +- .../no_stats_shape/query73.out | 2 +- .../no_stats_shape/query74.out | 6 +- .../no_stats_shape/query83.out | 4 +- .../no_stats_shape/query95.out | 2 +- .../rf_prune/query39.out | 2 +- .../rf_prune/query51.out | 85 +- .../rf_prune/query53.out | 61 +- .../rf_prune/query64.out | 20 +- .../rf_prune/query72.out | 2 +- .../rf_prune/query73.out | 2 +- .../rf_prune/query74.out | 6 +- .../nereids_tpcds_shape_sf100_p0/shape/query17.out | 4 +- .../nereids_tpcds_shape_sf100_p0/shape/query24.out | 4 +- .../nereids_tpcds_shape_sf100_p0/shape/query25.out | 4 +- .../nereids_tpcds_shape_sf100_p0/shape/query29.out | 4 +- .../nereids_tpcds_shape_sf100_p0/shape/query39.out | 2 +- .../nereids_tpcds_shape_sf100_p0/shape/query51.out | 85 +- .../nereids_tpcds_shape_sf100_p0/shape/query53.out | 61 +- .../nereids_tpcds_shape_sf100_p0/shape/query64.out | 38 +- .../nereids_tpcds_shape_sf100_p0/shape/query65.out | 4 +- .../nereids_tpcds_shape_sf100_p0/shape/query73.out | 2 +- .../nereids_tpcds_shape_sf100_p0/shape/query74.out | 6 +- .../nostats_rf_prune/q20-rewrite.out | 4 +- .../nostats_rf_prune/q20.out | 4 +- .../nostats_rf_prune/q5.out | 6 +- .../rf_prune/q20-rewrite.out | 4 +- .../nereids_tpch_shape_sf1000_p0/rf_prune/q20.out | 4 +- .../shape/q20-rewrite.out | 4 +- .../nereids_tpch_shape_sf1000_p0/shape/q20.out | 4 +- .../data/nereids_tpch_shape_sf1000_p0/shape/q5.out | 4 +- .../data/nereids_tpch_shape_sf1000_p0/shape/q9.out | 6 +- .../shape_no_stats/q20-rewrite.out | 4 +- .../shape_no_stats/q20.out | 4 +- .../shape_no_stats/q5.out | 4 +- .../shape_no_stats/q9.out | 8 +- .../array_functions/test_array_with_scale_type.out | 8 +- .../cast_function/test_cast_struct.out | 2 +- .../test_is_ip_address_in_range_function.out | 27 + .../test_struct_functions_by_literal.out | 12 +- regression-test/data/rollup_p0/a.csv | 1 + .../rollup_p0/test_materialized_view_load_open.out | 10 + regression-test/data/variant_p0/load.out | 6 +- .../org/apache/doris/regression/suite/Suite.groovy | 2 +- .../apache/doris/regression/suite/Syncer.groovy | 2 +- regression-test/pipeline/common/doris-utils.sh | 36 +- .../pipeline/p0/conf/regression-conf.groovy | 3 +- .../clickbench/conf/opt_session_variables.sql | 2 +- regression-test/pipeline/performance/deploy.sh | 61 +- .../pipeline/performance/run-clickbench.sh | 9 +- regression-test/pipeline/performance/run-load.sh | 23 +- regression-test/pipeline/performance/run-tpcds.sh | 10 +- regression-test/pipeline/performance/run-tpch.sh | 9 +- .../alter_p2/test_alter_table_property.groovy | 2 +- .../suites/control_p0/set_replica_status.groovy | 6 +- .../suites/correctness/test_str_to_date.groovy | 21 +- .../test_outer_join_with_null_value.groovy | 211 ++ .../unique/test_unique_table_like.groovy | 2 +- .../test_array_zip_array_enumerate_uniq.groovy | 4 - .../suites/delete_p0/test_delete_on_mor.groovy | 6 +- .../broker_load/test_broker_load_func.groovy | 4 +- .../hive/test_hive_query_cache.groovy | 2 +- .../hive/test_partial_update_broker_load.groovy | 4 +- .../hive/test_show_columns.groovy | 62 - .../info_schema_db/test_info_schema_db.groovy | 134 + .../jdbc/test_pg_jdbc_catalog.groovy | 1 + .../hive/test_hive_statistic_auto.groovy | 12 +- .../test_index_compaction_fault_injection.groovy | 307 +++ ...index_compound_directory_fault_injection.groovy | 15 +- .../test_index_fault_injection.groovy | 8 +- .../test_load_stream_fault_injection.groovy | 2 - .../test_load_stream_stub_failure_injection.groovy | 6 +- .../test_low_wal_disk_space_fault_injection.groovy | 66 + ...st_wal_mem_back_pressure_fault_injection.groovy | 31 + ..._back_pressure_time_out_fault_injection.groovy} | 28 +- .../suites/index_p0/test_bitmap_index.groovy | 4 +- .../suites/insert_p0/test_struct_insert.groovy | 32 +- .../inverted_index_p0/test_array_index.groovy | 120 + .../suites/inverted_index_p0/test_show_data.groovy | 217 +- .../suites/job_p0/test_base_insert_job.groovy | 24 +- .../load_p0/stream_load/test_pipeline_load.groovy | 2 +- .../mtmv_p0/test_partition_refresh_mtmv.groovy | 30 + .../mv_p0/test_dup_mv_div/test_dup_mv_div.groovy | 9 +- .../mv_p0/test_dup_mv_json/test_dup_mv_json.groovy | 13 +- .../suites/mv_p0/test_tcu/test_tcu.groovy | 9 +- .../suites/nereids_function_p0/ip_functions.groovy | 8 +- .../nereids_p0/aggregate/agg_window_project.groovy | 22 + .../nereids_p0/create_table/test_ctas.groovy | 4 +- .../eliminate_outer_join.groovy | 6 +- .../nereids_p0/expression/case_when_to_if.groovy | 10 +- .../nereids_p0/expression/topn_to_max.groovy | 6 +- .../runtime_filter/runtime_filter.groovy | 2 +- .../bind_relation/bind_view.groovy | 1 + .../nereids_rules_p0/eager_aggregate/basic.groovy | 1 + .../eager_aggregate/basic_one_side.groovy | 1 + .../push_down_count_through_join.groovy | 1 + .../push_down_count_through_join_one_side.groovy | 1 + .../push_down_max_through_join.groovy | 1 + .../push_down_min_through_join.groovy | 1 + .../push_down_sum_through_join.groovy | 1 + .../push_down_sum_through_join_one_side.groovy | 1 + .../eliminate_join_condition.groovy | 1 + .../eliminate_not_null/eliminate_not_null.groovy | 1 + .../eliminate_outer_join.groovy | 1 + .../filter_push_through_aggregate.groovy | 1 + .../push_down_alias_through_join.groovy | 1 + .../push_down_expression_in_hash_join.groovy | 1 + .../push_down_filter_other_condition.groovy | 1 + .../push_filter_inside_join.groovy | 1 + .../filter_push_down/push_filter_through.groovy | 1 + .../infer_set_operator_distinct.groovy | 1 + .../limit_push_down/limit_push_down.groovy | 1 + .../limit_push_down/order_push_down.groovy | 1 + .../suites/nereids_rules_p0/load.groovy | 1 + .../agg_with_roll_up/aggregate_with_roll_up.groovy | 257 +- .../aggregate_without_roll_up.groovy | 9 +- .../mv/join/inner/inner_join.groovy | 38 +- .../mv/join/left_outer/outer_join.groovy | 44 +- .../mv/partition_mv_rewrite.groovy | 3 +- .../test_date_function_prune.groovy | 2 + .../test_multi_range_partition.groovy | 2 + .../test_partition_unique_model.groovy | 1 + .../nereids_rules_p0/pkfk/eliminate_inner.groovy | 4 +- .../predicate_infer/infer_predicate.groovy | 1 + .../push_down_limit_distinct.groovy | 1 + .../push_down_top_n_distinct_through_union.groovy | 1 + .../push_down_top_n_through_union.groovy | 1 + .../subquery_basic_pullup_and_subquery.groovy | 1 + .../basic/subquery_basic_pullup_basic.groovy | 1 + .../subquery/basic/subquery_basic_pullup_or.groovy | 1 + .../basic/subquery_basic_pullup_or_subquery.groovy | 1 + .../subquery/basic/subquery_basic_pullup_uk.groovy | 1 + .../subquery/basic/subquery_basic_ullup_and.groovy | 1 + .../subquery/misc/subquery_misc_pullup_dml.groovy | 1 + .../subquery/misc/subquery_misc_pullup_misc.groovy | 1 + .../subquery_multitable_pullup_and.groovy | 1 + .../subquery_multitable_pullup_and_subquery.groovy | 1 + .../subquery_multitable_pullup_basic.groovy | 1 + .../subquery_multitable_pullup_or.groovy | 1 + .../subquery_multitable_pullup_or_subquery.groovy | 1 + .../topop/subquery_topop_pullup_groupby.groovy | 1 + .../topop/subquery_topop_pullup_having.groovy | 1 + .../topop/subquery_topop_pullup_orderby.groovy | 1 + .../topop/subquery_topop_pullup_selectlist.groovy | 1 + .../topop/subquery_topop_pullup_winfunc.groovy | 1 + .../transposeJoin/transposeSemiJoinAgg.groovy | 2 + .../suites/nereids_syntax_p0/cast.groovy | 5 + .../suites/nereids_syntax_p0/constraint.groovy | 81 + .../nereids_tpcds_shape_sf1000_p0/ddl/shape.tmpl | 1 + .../shape/query1.groovy | 1 + .../shape/query10.groovy | 1 + .../shape/query11.groovy | 1 + .../shape/query12.groovy | 1 + .../shape/query13.groovy | 1 + .../shape/query14.groovy | 1 + .../shape/query15.groovy | 1 + .../shape/query16.groovy | 1 + .../shape/query17.groovy | 1 + .../shape/query18.groovy | 1 + .../shape/query19.groovy | 1 + .../shape/query2.groovy | 1 + .../shape/query20.groovy | 1 + .../shape/query21.groovy | 1 + .../shape/query22.groovy | 1 + .../shape/query23.groovy | 1 + .../shape/query24.groovy | 1 + .../shape/query25.groovy | 1 + .../shape/query26.groovy | 1 + .../shape/query27.groovy | 1 + .../shape/query28.groovy | 1 + .../shape/query29.groovy | 1 + .../shape/query3.groovy | 1 + .../shape/query30.groovy | 1 + .../shape/query31.groovy | 1 + .../shape/query32.groovy | 1 + .../shape/query33.groovy | 1 + .../shape/query34.groovy | 1 + .../shape/query35.groovy | 1 + .../shape/query36.groovy | 1 + .../shape/query37.groovy | 1 + .../shape/query38.groovy | 1 + .../shape/query39.groovy | 1 + .../shape/query4.groovy | 1 + .../shape/query40.groovy | 1 + .../shape/query41.groovy | 1 + .../shape/query42.groovy | 1 + .../shape/query43.groovy | 1 + .../shape/query44.groovy | 1 + .../shape/query45.groovy | 1 + .../shape/query46.groovy | 1 + .../shape/query47.groovy | 1 + .../shape/query48.groovy | 1 + .../shape/query49.groovy | 1 + .../shape/query5.groovy | 1 + .../shape/query50.groovy | 1 + .../shape/query51.groovy | 1 + .../shape/query52.groovy | 1 + .../shape/query53.groovy | 1 + .../shape/query54.groovy | 1 + .../shape/query55.groovy | 1 + .../shape/query56.groovy | 1 + .../shape/query57.groovy | 1 + .../shape/query58.groovy | 1 + .../shape/query59.groovy | 1 + .../shape/query6.groovy | 1 + .../shape/query60.groovy | 1 + .../shape/query61.groovy | 1 + .../shape/query62.groovy | 1 + .../shape/query63.groovy | 1 + .../shape/query64.groovy | 1 + .../shape/query65.groovy | 1 + .../shape/query66.groovy | 1 + .../shape/query67.groovy | 1 + .../shape/query68.groovy | 1 + .../shape/query69.groovy | 1 + .../shape/query7.groovy | 1 + .../shape/query70.groovy | 1 + .../shape/query71.groovy | 1 + .../shape/query72.groovy | 1 + .../shape/query73.groovy | 1 + .../shape/query74.groovy | 1 + .../shape/query75.groovy | 1 + .../shape/query76.groovy | 1 + .../shape/query77.groovy | 1 + .../shape/query78.groovy | 1 + .../shape/query79.groovy | 1 + .../shape/query8.groovy | 1 + .../shape/query80.groovy | 1 + .../shape/query81.groovy | 1 + .../shape/query82.groovy | 1 + .../shape/query83.groovy | 1 + .../shape/query84.groovy | 1 + .../shape/query85.groovy | 1 + .../shape/query86.groovy | 1 + .../shape/query87.groovy | 1 + .../shape/query88.groovy | 1 + .../shape/query89.groovy | 1 + .../shape/query9.groovy | 1 + .../shape/query90.groovy | 1 + .../shape/query91.groovy | 1 + .../shape/query92.groovy | 1 + .../shape/query93.groovy | 1 + .../shape/query94.groovy | 1 + .../shape/query95.groovy | 1 + .../shape/query96.groovy | 1 + .../shape/query97.groovy | 1 + .../shape/query98.groovy | 1 + .../shape/query99.groovy | 1 + .../constraints/load.groovy | 2549 ++++++++++++++++++++ .../{shape => constraints}/query23.groovy | 2 +- .../nereids_tpcds_shape_sf100_p0/ddl/rf_prune.tmpl | 1 + .../nereids_tpcds_shape_sf100_p0/ddl/shape.tmpl | 1 + .../noStatsRfPrune/query1.groovy | 3 +- .../noStatsRfPrune/query10.groovy | 3 +- .../noStatsRfPrune/query11.groovy | 3 +- .../noStatsRfPrune/query12.groovy | 3 +- .../noStatsRfPrune/query13.groovy | 3 +- .../noStatsRfPrune/query14.groovy | 3 +- .../noStatsRfPrune/query15.groovy | 3 +- .../noStatsRfPrune/query16.groovy | 3 +- .../noStatsRfPrune/query17.groovy | 3 +- .../noStatsRfPrune/query18.groovy | 3 +- .../noStatsRfPrune/query19.groovy | 3 +- .../noStatsRfPrune/query2.groovy | 3 +- .../noStatsRfPrune/query20.groovy | 3 +- .../noStatsRfPrune/query21.groovy | 3 +- .../noStatsRfPrune/query22.groovy | 3 +- .../noStatsRfPrune/query23.groovy | 3 +- .../noStatsRfPrune/query24.groovy | 3 +- .../noStatsRfPrune/query25.groovy | 3 +- .../noStatsRfPrune/query26.groovy | 3 +- .../noStatsRfPrune/query27.groovy | 3 +- .../noStatsRfPrune/query28.groovy | 3 +- .../noStatsRfPrune/query29.groovy | 3 +- .../noStatsRfPrune/query3.groovy | 3 +- .../noStatsRfPrune/query30.groovy | 3 +- .../noStatsRfPrune/query31.groovy | 3 +- .../noStatsRfPrune/query32.groovy | 3 +- .../noStatsRfPrune/query33.groovy | 3 +- .../noStatsRfPrune/query34.groovy | 3 +- .../noStatsRfPrune/query35.groovy | 3 +- .../noStatsRfPrune/query36.groovy | 3 +- .../noStatsRfPrune/query37.groovy | 3 +- .../noStatsRfPrune/query38.groovy | 3 +- .../noStatsRfPrune/query39.groovy | 3 +- .../noStatsRfPrune/query4.groovy | 3 +- .../noStatsRfPrune/query40.groovy | 3 +- .../noStatsRfPrune/query41.groovy | 3 +- .../noStatsRfPrune/query42.groovy | 3 +- .../noStatsRfPrune/query43.groovy | 3 +- .../noStatsRfPrune/query44.groovy | 3 +- .../noStatsRfPrune/query45.groovy | 3 +- .../noStatsRfPrune/query46.groovy | 3 +- .../noStatsRfPrune/query47.groovy | 3 +- .../noStatsRfPrune/query48.groovy | 3 +- .../noStatsRfPrune/query49.groovy | 3 +- .../noStatsRfPrune/query5.groovy | 3 +- .../noStatsRfPrune/query50.groovy | 3 +- .../noStatsRfPrune/query51.groovy | 3 +- .../noStatsRfPrune/query52.groovy | 3 +- .../noStatsRfPrune/query53.groovy | 3 +- .../noStatsRfPrune/query54.groovy | 3 +- .../noStatsRfPrune/query55.groovy | 3 +- .../noStatsRfPrune/query56.groovy | 3 +- .../noStatsRfPrune/query57.groovy | 3 +- .../noStatsRfPrune/query58.groovy | 3 +- .../noStatsRfPrune/query59.groovy | 3 +- .../noStatsRfPrune/query6.groovy | 3 +- .../noStatsRfPrune/query60.groovy | 3 +- .../noStatsRfPrune/query61.groovy | 3 +- .../noStatsRfPrune/query62.groovy | 3 +- .../noStatsRfPrune/query63.groovy | 3 +- .../noStatsRfPrune/query64.groovy | 3 +- .../noStatsRfPrune/query65.groovy | 3 +- .../noStatsRfPrune/query66.groovy | 3 +- .../noStatsRfPrune/query67.groovy | 3 +- .../noStatsRfPrune/query68.groovy | 3 +- .../noStatsRfPrune/query69.groovy | 3 +- .../noStatsRfPrune/query7.groovy | 3 +- .../noStatsRfPrune/query70.groovy | 3 +- .../noStatsRfPrune/query71.groovy | 3 +- .../noStatsRfPrune/query72.groovy | 3 +- .../noStatsRfPrune/query73.groovy | 3 +- .../noStatsRfPrune/query74.groovy | 3 +- .../noStatsRfPrune/query75.groovy | 3 +- .../noStatsRfPrune/query76.groovy | 3 +- .../noStatsRfPrune/query77.groovy | 3 +- .../noStatsRfPrune/query78.groovy | 3 +- .../noStatsRfPrune/query79.groovy | 3 +- .../noStatsRfPrune/query8.groovy | 3 +- .../noStatsRfPrune/query80.groovy | 3 +- .../noStatsRfPrune/query81.groovy | 3 +- .../noStatsRfPrune/query82.groovy | 3 +- .../noStatsRfPrune/query83.groovy | 3 +- .../noStatsRfPrune/query84.groovy | 3 +- .../noStatsRfPrune/query85.groovy | 3 +- .../noStatsRfPrune/query86.groovy | 3 +- .../noStatsRfPrune/query87.groovy | 3 +- .../noStatsRfPrune/query88.groovy | 3 +- .../noStatsRfPrune/query89.groovy | 3 +- .../noStatsRfPrune/query9.groovy | 3 +- .../noStatsRfPrune/query90.groovy | 3 +- .../noStatsRfPrune/query91.groovy | 3 +- .../noStatsRfPrune/query92.groovy | 3 +- .../noStatsRfPrune/query93.groovy | 3 +- .../noStatsRfPrune/query94.groovy | 3 +- .../noStatsRfPrune/query95.groovy | 3 +- .../noStatsRfPrune/query96.groovy | 3 +- .../noStatsRfPrune/query97.groovy | 3 +- .../noStatsRfPrune/query98.groovy | 3 +- .../noStatsRfPrune/query99.groovy | 3 +- .../no_stats_shape/query1.groovy | 3 +- .../no_stats_shape/query10.groovy | 3 +- .../no_stats_shape/query11.groovy | 3 +- .../no_stats_shape/query12.groovy | 3 +- .../no_stats_shape/query13.groovy | 3 +- .../no_stats_shape/query14.groovy | 3 +- .../no_stats_shape/query15.groovy | 3 +- .../no_stats_shape/query16.groovy | 3 +- .../no_stats_shape/query17.groovy | 3 +- .../no_stats_shape/query18.groovy | 3 +- .../no_stats_shape/query19.groovy | 3 +- .../no_stats_shape/query2.groovy | 3 +- .../no_stats_shape/query20.groovy | 3 +- .../no_stats_shape/query21.groovy | 3 +- .../no_stats_shape/query22.groovy | 3 +- .../no_stats_shape/query23.groovy | 3 +- .../no_stats_shape/query24.groovy | 3 +- .../no_stats_shape/query25.groovy | 3 +- .../no_stats_shape/query26.groovy | 3 +- .../no_stats_shape/query27.groovy | 3 +- .../no_stats_shape/query28.groovy | 3 +- .../no_stats_shape/query29.groovy | 3 +- .../no_stats_shape/query3.groovy | 3 +- .../no_stats_shape/query30.groovy | 3 +- .../no_stats_shape/query31.groovy | 3 +- .../no_stats_shape/query32.groovy | 3 +- .../no_stats_shape/query33.groovy | 3 +- .../no_stats_shape/query34.groovy | 3 +- .../no_stats_shape/query35.groovy | 3 +- .../no_stats_shape/query36.groovy | 3 +- .../no_stats_shape/query37.groovy | 3 +- .../no_stats_shape/query38.groovy | 3 +- .../no_stats_shape/query39.groovy | 3 +- .../no_stats_shape/query4.groovy | 3 +- .../no_stats_shape/query40.groovy | 3 +- .../no_stats_shape/query41.groovy | 3 +- .../no_stats_shape/query42.groovy | 3 +- .../no_stats_shape/query43.groovy | 3 +- .../no_stats_shape/query44.groovy | 3 +- .../no_stats_shape/query45.groovy | 3 +- .../no_stats_shape/query46.groovy | 3 +- .../no_stats_shape/query47.groovy | 3 +- .../no_stats_shape/query48.groovy | 3 +- .../no_stats_shape/query49.groovy | 3 +- .../no_stats_shape/query5.groovy | 3 +- .../no_stats_shape/query50.groovy | 3 +- .../no_stats_shape/query51.groovy | 3 +- .../no_stats_shape/query52.groovy | 3 +- .../no_stats_shape/query53.groovy | 3 +- .../no_stats_shape/query54.groovy | 3 +- .../no_stats_shape/query55.groovy | 3 +- .../no_stats_shape/query56.groovy | 3 +- .../no_stats_shape/query57.groovy | 3 +- .../no_stats_shape/query58.groovy | 3 +- .../no_stats_shape/query59.groovy | 3 +- .../no_stats_shape/query6.groovy | 3 +- .../no_stats_shape/query60.groovy | 3 +- .../no_stats_shape/query61.groovy | 3 +- .../no_stats_shape/query62.groovy | 3 +- .../no_stats_shape/query63.groovy | 3 +- .../no_stats_shape/query64.groovy | 3 +- .../no_stats_shape/query65.groovy | 3 +- .../no_stats_shape/query66.groovy | 3 +- .../no_stats_shape/query67.groovy | 3 +- .../no_stats_shape/query68.groovy | 3 +- .../no_stats_shape/query69.groovy | 3 +- .../no_stats_shape/query7.groovy | 3 +- .../no_stats_shape/query70.groovy | 3 +- .../no_stats_shape/query71.groovy | 3 +- .../no_stats_shape/query72.groovy | 3 +- .../no_stats_shape/query73.groovy | 3 +- .../no_stats_shape/query74.groovy | 3 +- .../no_stats_shape/query75.groovy | 3 +- .../no_stats_shape/query76.groovy | 3 +- .../no_stats_shape/query77.groovy | 3 +- .../no_stats_shape/query78.groovy | 3 +- .../no_stats_shape/query79.groovy | 3 +- .../no_stats_shape/query8.groovy | 3 +- .../no_stats_shape/query80.groovy | 3 +- .../no_stats_shape/query81.groovy | 3 +- .../no_stats_shape/query82.groovy | 3 +- .../no_stats_shape/query83.groovy | 3 +- .../no_stats_shape/query84.groovy | 3 +- .../no_stats_shape/query85.groovy | 3 +- .../no_stats_shape/query86.groovy | 3 +- .../no_stats_shape/query87.groovy | 3 +- .../no_stats_shape/query88.groovy | 3 +- .../no_stats_shape/query89.groovy | 3 +- .../no_stats_shape/query9.groovy | 3 +- .../no_stats_shape/query90.groovy | 3 +- .../no_stats_shape/query91.groovy | 3 +- .../no_stats_shape/query92.groovy | 3 +- .../no_stats_shape/query93.groovy | 3 +- .../no_stats_shape/query94.groovy | 3 +- .../no_stats_shape/query95.groovy | 3 +- .../no_stats_shape/query96.groovy | 3 +- .../no_stats_shape/query97.groovy | 3 +- .../no_stats_shape/query98.groovy | 3 +- .../no_stats_shape/query99.groovy | 3 +- .../rf_prune/query1.groovy | 1 + .../rf_prune/query10.groovy | 1 + .../rf_prune/query11.groovy | 1 + .../rf_prune/query12.groovy | 1 + .../rf_prune/query13.groovy | 1 + .../rf_prune/query14.groovy | 1 + .../rf_prune/query15.groovy | 1 + .../rf_prune/query16.groovy | 1 + .../rf_prune/query17.groovy | 1 + .../rf_prune/query18.groovy | 1 + .../rf_prune/query19.groovy | 1 + .../rf_prune/query2.groovy | 1 + .../rf_prune/query20.groovy | 1 + .../rf_prune/query21.groovy | 1 + .../rf_prune/query22.groovy | 1 + .../rf_prune/query23.groovy | 1 + .../rf_prune/query24.groovy | 1 + .../rf_prune/query25.groovy | 1 + .../rf_prune/query26.groovy | 1 + .../rf_prune/query27.groovy | 1 + .../rf_prune/query28.groovy | 1 + .../rf_prune/query29.groovy | 1 + .../rf_prune/query3.groovy | 1 + .../rf_prune/query30.groovy | 1 + .../rf_prune/query31.groovy | 1 + .../rf_prune/query32.groovy | 1 + .../rf_prune/query33.groovy | 1 + .../rf_prune/query34.groovy | 1 + .../rf_prune/query35.groovy | 1 + .../rf_prune/query36.groovy | 1 + .../rf_prune/query37.groovy | 1 + .../rf_prune/query38.groovy | 1 + .../rf_prune/query39.groovy | 1 + .../rf_prune/query4.groovy | 1 + .../rf_prune/query40.groovy | 1 + .../rf_prune/query41.groovy | 1 + .../rf_prune/query42.groovy | 1 + .../rf_prune/query43.groovy | 1 + .../rf_prune/query44.groovy | 1 + .../rf_prune/query45.groovy | 1 + .../rf_prune/query46.groovy | 1 + .../rf_prune/query47.groovy | 1 + .../rf_prune/query48.groovy | 1 + .../rf_prune/query49.groovy | 1 + .../rf_prune/query5.groovy | 1 + .../rf_prune/query50.groovy | 1 + .../rf_prune/query51.groovy | 1 + .../rf_prune/query52.groovy | 1 + .../rf_prune/query53.groovy | 1 + .../rf_prune/query54.groovy | 1 + .../rf_prune/query55.groovy | 1 + .../rf_prune/query56.groovy | 1 + .../rf_prune/query57.groovy | 1 + .../rf_prune/query58.groovy | 1 + .../rf_prune/query59.groovy | 1 + .../rf_prune/query6.groovy | 1 + .../rf_prune/query60.groovy | 1 + .../rf_prune/query61.groovy | 1 + .../rf_prune/query62.groovy | 1 + .../rf_prune/query63.groovy | 1 + .../rf_prune/query64.groovy | 1 + .../rf_prune/query65.groovy | 1 + .../rf_prune/query66.groovy | 1 + .../rf_prune/query67.groovy | 1 + .../rf_prune/query68.groovy | 1 + .../rf_prune/query69.groovy | 1 + .../rf_prune/query7.groovy | 1 + .../rf_prune/query70.groovy | 1 + .../rf_prune/query71.groovy | 1 + .../rf_prune/query72.groovy | 1 + .../rf_prune/query73.groovy | 1 + .../rf_prune/query74.groovy | 1 + .../rf_prune/query75.groovy | 1 + .../rf_prune/query76.groovy | 1 + .../rf_prune/query77.groovy | 1 + .../rf_prune/query78.groovy | 1 + .../rf_prune/query79.groovy | 1 + .../rf_prune/query8.groovy | 1 + .../rf_prune/query80.groovy | 1 + .../rf_prune/query81.groovy | 1 + .../rf_prune/query82.groovy | 1 + .../rf_prune/query83.groovy | 1 + .../rf_prune/query84.groovy | 1 + .../rf_prune/query85.groovy | 1 + .../rf_prune/query86.groovy | 1 + .../rf_prune/query87.groovy | 1 + .../rf_prune/query88.groovy | 1 + .../rf_prune/query89.groovy | 1 + .../rf_prune/query9.groovy | 1 + .../rf_prune/query90.groovy | 1 + .../rf_prune/query91.groovy | 1 + .../rf_prune/query92.groovy | 1 + .../rf_prune/query93.groovy | 1 + .../rf_prune/query94.groovy | 1 + .../rf_prune/query95.groovy | 1 + .../rf_prune/query96.groovy | 1 + .../rf_prune/query97.groovy | 1 + .../rf_prune/query98.groovy | 1 + .../rf_prune/query99.groovy | 1 + .../shape/query1.groovy | 1 + .../shape/query10.groovy | 1 + .../shape/query11.groovy | 1 + .../shape/query12.groovy | 1 + .../shape/query13.groovy | 1 + .../shape/query14.groovy | 1 + .../shape/query15.groovy | 1 + .../shape/query16.groovy | 1 + .../shape/query17.groovy | 1 + .../shape/query18.groovy | 1 + .../shape/query19.groovy | 1 + .../shape/query2.groovy | 1 + .../shape/query20.groovy | 1 + .../shape/query21.groovy | 1 + .../shape/query22.groovy | 1 + .../shape/query23.groovy | 1 + .../shape/query24.groovy | 1 + .../shape/query25.groovy | 1 + .../shape/query26.groovy | 1 + .../shape/query27.groovy | 1 + .../shape/query28.groovy | 1 + .../shape/query29.groovy | 1 + .../shape/query3.groovy | 1 + .../shape/query30.groovy | 1 + .../shape/query31.groovy | 1 + .../shape/query32.groovy | 1 + .../shape/query33.groovy | 1 + .../shape/query34.groovy | 1 + .../shape/query35.groovy | 1 + .../shape/query36.groovy | 1 + .../shape/query37.groovy | 1 + .../shape/query38.groovy | 1 + .../shape/query39.groovy | 1 + .../shape/query4.groovy | 1 + .../shape/query40.groovy | 1 + .../shape/query41.groovy | 1 + .../shape/query42.groovy | 1 + .../shape/query43.groovy | 1 + .../shape/query44.groovy | 1 + .../shape/query45.groovy | 1 + .../shape/query46.groovy | 1 + .../shape/query47.groovy | 1 + .../shape/query48.groovy | 1 + .../shape/query49.groovy | 1 + .../shape/query5.groovy | 1 + .../shape/query50.groovy | 1 + .../shape/query51.groovy | 1 + .../shape/query52.groovy | 1 + .../shape/query53.groovy | 1 + .../shape/query54.groovy | 1 + .../shape/query55.groovy | 1 + .../shape/query56.groovy | 1 + .../shape/query57.groovy | 1 + .../shape/query58.groovy | 1 + .../shape/query59.groovy | 1 + .../shape/query6.groovy | 1 + .../shape/query60.groovy | 1 + .../shape/query61.groovy | 1 + .../shape/query62.groovy | 1 + .../shape/query63.groovy | 1 + .../shape/query64.groovy | 1 + .../shape/query65.groovy | 1 + .../shape/query66.groovy | 1 + .../shape/query67.groovy | 1 + .../shape/query68.groovy | 1 + .../shape/query69.groovy | 1 + .../shape/query7.groovy | 1 + .../shape/query70.groovy | 1 + .../shape/query71.groovy | 1 + .../shape/query72.groovy | 1 + .../shape/query73.groovy | 1 + .../shape/query74.groovy | 1 + .../shape/query75.groovy | 1 + .../shape/query76.groovy | 1 + .../shape/query77.groovy | 1 + .../shape/query78.groovy | 1 + .../shape/query79.groovy | 1 + .../shape/query8.groovy | 1 + .../shape/query80.groovy | 1 + .../shape/query81.groovy | 1 + .../shape/query82.groovy | 1 + .../shape/query83.groovy | 1 + .../shape/query84.groovy | 1 + .../shape/query85.groovy | 1 + .../shape/query86.groovy | 1 + .../shape/query87.groovy | 1 + .../shape/query88.groovy | 1 + .../shape/query89.groovy | 1 + .../shape/query9.groovy | 1 + .../shape/query90.groovy | 1 + .../shape/query91.groovy | 1 + .../shape/query92.groovy | 1 + .../shape/query93.groovy | 1 + .../shape/query94.groovy | 1 + .../shape/query95.groovy | 1 + .../shape/query96.groovy | 1 + .../shape/query97.groovy | 1 + .../shape/query98.groovy | 1 + .../shape/query99.groovy | 1 + .../nostats_rf_prune/q1.groovy | 3 +- .../nostats_rf_prune/q10.groovy | 3 +- .../nostats_rf_prune/q11.groovy | 3 +- .../nostats_rf_prune/q12.groovy | 3 +- .../nostats_rf_prune/q13.groovy | 3 +- .../nostats_rf_prune/q14.groovy | 3 +- .../nostats_rf_prune/q15.groovy | 3 +- .../nostats_rf_prune/q16.groovy | 3 +- .../nostats_rf_prune/q17.groovy | 3 +- .../nostats_rf_prune/q18.groovy | 3 +- .../nostats_rf_prune/q19.groovy | 3 +- .../nostats_rf_prune/q2.groovy | 3 +- .../nostats_rf_prune/q20-rewrite.groovy | 3 +- .../nostats_rf_prune/q20.groovy | 3 +- .../nostats_rf_prune/q21.groovy | 3 +- .../nostats_rf_prune/q22.groovy | 3 +- .../nostats_rf_prune/q3.groovy | 3 +- .../nostats_rf_prune/q4.groovy | 3 +- .../nostats_rf_prune/q5.groovy | 3 +- .../nostats_rf_prune/q6.groovy | 3 +- .../nostats_rf_prune/q7.groovy | 3 +- .../nostats_rf_prune/q8.groovy | 3 +- .../nostats_rf_prune/q9.groovy | 3 +- .../rf_prune/q1.groovy | 3 +- .../rf_prune/q10.groovy | 3 +- .../rf_prune/q11.groovy | 3 +- .../rf_prune/q12.groovy | 3 +- .../rf_prune/q13.groovy | 3 +- .../rf_prune/q14.groovy | 3 +- .../rf_prune/q15.groovy | 3 +- .../rf_prune/q16.groovy | 3 +- .../rf_prune/q17.groovy | 3 +- .../rf_prune/q18.groovy | 3 +- .../rf_prune/q19.groovy | 3 +- .../rf_prune/q2.groovy | 3 +- .../rf_prune/q20-rewrite.groovy | 3 +- .../rf_prune/q20.groovy | 3 +- .../rf_prune/q21.groovy | 3 +- .../rf_prune/q22.groovy | 3 +- .../rf_prune/q3.groovy | 3 +- .../rf_prune/q4.groovy | 3 +- .../rf_prune/q5.groovy | 3 +- .../rf_prune/q6.groovy | 3 +- .../rf_prune/q7.groovy | 3 +- .../rf_prune/q8.groovy | 3 +- .../rf_prune/q9.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q1.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q10.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q11.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q12.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q13.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q14.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q15.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q16.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q17.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q18.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q19.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q2.groovy | 3 +- .../shape/q20-rewrite.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q20.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q21.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q22.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q3.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q4.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q5.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q6.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q7.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q8.groovy | 3 +- .../nereids_tpch_shape_sf1000_p0/shape/q9.groovy | 3 +- .../shape_no_stats/q1.groovy | 3 +- .../shape_no_stats/q10.groovy | 3 +- .../shape_no_stats/q11.groovy | 3 +- .../shape_no_stats/q12.groovy | 3 +- .../shape_no_stats/q13.groovy | 3 +- .../shape_no_stats/q14.groovy | 3 +- .../shape_no_stats/q15.groovy | 3 +- .../shape_no_stats/q16.groovy | 3 +- .../shape_no_stats/q17.groovy | 3 +- .../shape_no_stats/q18.groovy | 3 +- .../shape_no_stats/q19.groovy | 3 +- .../shape_no_stats/q2.groovy | 3 +- .../shape_no_stats/q20-rewrite.groovy | 3 +- .../shape_no_stats/q20.groovy | 3 +- .../shape_no_stats/q21.groovy | 3 +- .../shape_no_stats/q22.groovy | 3 +- .../shape_no_stats/q3.groovy | 3 +- .../shape_no_stats/q4.groovy | 3 +- .../shape_no_stats/q5.groovy | 3 +- .../shape_no_stats/q6.groovy | 3 +- .../shape_no_stats/q7.groovy | 3 +- .../shape_no_stats/q8.groovy | 3 +- .../shape_no_stats/q9.groovy | 3 +- .../test_auto_partition_behavior.groovy | 62 + .../auto_partition/test_auto_partition_load.groovy | 2 +- .../test_auto_range_partition.groovy | 2 +- .../auto_partition/sql/multi_thread_load.groovy | 4 +- .../test_is_ip_address_in_range_function.groovy | 67 + .../test_is_ip_string_functions.groovy | 4 +- .../test_materialized_view_load_open.groovy | 85 +- .../test_alter_database_property.groovy | 2 +- .../test_show_create_table_and_views.groovy | 2 +- .../suites/statistics/analyze_stats.groovy | 61 +- .../storage_medium_p0/test_disk_health.groovy | 23 +- .../test_storage_medium_has_disk.groovy | 166 ++ regression-test/suites/variant_p0/load.groovy | 8 +- thirdparty/build-thirdparty.sh | 3 +- tools/tpcds-tools/queries/sf100/query72.sql | 2 +- 1401 files changed, 20488 insertions(+), 10366 deletions(-) create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query.cpp create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query.h create mode 100644 be/src/runtime/runtime_query_statistics_mgr.cpp create mode 100644 be/src/runtime/runtime_query_statistics_mgr.h create mode 100644 be/src/vec/runtime/ip_address_cidr.h create mode 100644 be/test/olap/wal/wal_dirs_info_test.cpp rename be/test/olap/{ => wal}/wal_manager_test.cpp (100%) rename be/test/olap/{ => wal}/wal_reader_writer_test.cpp (100%) create mode 100644 docs/en/docs/install/k8s-deploy/helm-chart-deploy.md rename docs/en/docs/install/{k8s-deploy.md => k8s-deploy/operator-deploy.md} (100%) rename docs/en/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-CONFIG.md => SHOW-CONFIG.md} (88%) rename docs/en/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-REPLICA-DISTRIBUTION.md => SHOW-REPLICA-DISTRIBUTION.md} (77%) rename docs/en/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-REPLICA-STATUS.md => SHOW-REPLICA-STATUS.md} (82%) rename docs/en/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-DIAGNOSE-TABLET.md => SHOW-TABLET-DIAGNOSIS.md} (92%) rename docs/en/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-TABLET-STORAGE-FORMAT.md => SHOW-TABLET-STORAGE-FORMAT.md} (83%) create mode 100644 docs/zh-CN/docs/install/k8s-deploy/helm-chart-deploy.md rename docs/zh-CN/docs/install/{k8s-deploy.md => k8s-deploy/operator-deploy.md} (100%) rename docs/zh-CN/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-CONFIG.md => SHOW-CONFIG.md} (87%) rename docs/zh-CN/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-REPLICA-DISTRIBUTION.md => SHOW-REPLICA-DISTRIBUTION.md} (76%) rename docs/zh-CN/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-REPLICA-STATUS.md => SHOW-REPLICA-STATUS.md} (82%) rename docs/zh-CN/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-DIAGNOSE-TABLET.md => SHOW-TABLET-DIAGNOSIS.md} (92%) rename docs/zh-CN/docs/sql-manual/sql-reference/Database-Administration-Statements/{ADMIN-SHOW-TABLET-STORAGE-FORMAT.md => SHOW-TABLET-STORAGE-FORMAT.md} (83%) create mode 100644 fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/JdbcDataSourceConfig.java rename fe/fe-core/src/main/java/org/apache/doris/analysis/{AdminDiagnoseTabletStmt.java => DiagnoseTabletStmt.java} (92%) rename fe/fe-core/src/main/java/org/apache/doris/analysis/{AdminShowConfigStmt.java => ShowConfigStmt.java} (95%) rename fe/fe-core/src/main/java/org/apache/doris/analysis/{AdminShowReplicaDistributionStmt.java => ShowReplicaDistributionStmt.java} (93%) rename fe/fe-core/src/main/java/org/apache/doris/analysis/{AdminShowReplicaStatusStmt.java => ShowReplicaStatusStmt.java} (97%) rename fe/fe-core/src/main/java/org/apache/doris/analysis/{AdminShowTabletStorageFormatStmt.java => ShowTabletStorageFormatStmt.java} (93%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/cloud/rpc/MetaServiceClient.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/cloud/rpc/MetaServiceProxy.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/infoschema/ExternalInfoSchemaDatabase.java copy fe/fe-core/src/main/java/org/apache/doris/{catalog/external/TestExternalTable.java => datasource/infoschema/ExternalInfoSchemaTable.java} (55%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/joinorder/hypergraph/ConflictRulesMaker.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/parser/Dialect.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/parser/ParseDialect.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/RuntimeFilterPrunerForExternalTable.java copy fe/fe-core/src/main/java/org/apache/doris/nereids/{parser/ParserContext.java => rules/analysis/HavingToFilter.java} (62%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/MergeTopNs.java copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{IsIpv4String.java => IsIpAddressInRange.java} (75%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowConstraintsCommand.java rename fe/fe-core/src/main/java/org/apache/doris/nereids/util/{ImmutableEquivalenceSet.java => ImmutableEqualSet.java} (57%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/plugin/DialectConverterPlugin.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/resource/workloadschedpolicy/WorkloadRuntimeStatusMgr.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/analysis/ShowCreateLoadStmtTest.java rename fe/fe-core/src/test/java/org/apache/doris/analysis/{AdminShowReplicaTest.java => ShowReplicaTest.java} (80%) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/exploration/mv/HyperGraphComparatorTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/MergeTopNsTest.java delete mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/util/TrinoDialectPlanParseChecker.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/plugin/DialectPluginTest.java copy fe/fe-core/src/test/java/org/apache/doris/plugin/{PluginTest.java => TestDialectPlugin1.java} (54%) copy fe/fe-core/src/test/java/org/apache/doris/plugin/{PluginTest.java => TestDialectPlugin2.java} (55%) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/statistics/ColStatsDataTest.java create mode 100644 fe_plugins/http-dialect-converter/pom.xml copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/http-dialect-converter/src/main/assembly/plugin.conf (66%) mode change 100644 => 100755 copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/http-dialect-converter/src/main/assembly/plugin.properties (66%) mode change 100644 => 100755 copy fe_plugins/{auditloader => http-dialect-converter}/src/main/assembly/zip.xml (100%) create mode 100644 fe_plugins/http-dialect-converter/src/main/java/org/apache/doris/plugin/dialect/http/HttpDialectConverterPlugin.java rename fe/fe-core/src/main/java/org/apache/doris/common/util/SQLDialectUtils.java => fe_plugins/http-dialect-converter/src/main/java/org/apache/doris/plugin/dialect/http/HttpDialectUtils.java (77%) rename fe/fe-core/src/test/java/org/apache/doris/common/util/SQLDialectUtilsTest.java => fe_plugins/http-dialect-converter/src/test/java/org/apache/doris/plugin/dialect/http/HttpDialectUtilsTest.java (52%) rename {fe/fe-core/src/test/java/org/apache/doris/utframe => fe_plugins/http-dialect-converter/src/test/java/org/apache/doris/plugin/dialect/http}/SimpleHttpServer.java (98%) create mode 100644 fe_plugins/sparksql-converter/pom.xml copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/sparksql-converter/src/main/assembly/plugin.conf (66%) mode change 100644 => 100755 copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/sparksql-converter/src/main/assembly/plugin.properties (66%) mode change 100644 => 100755 copy fe_plugins/{auditloader => sparksql-converter}/src/main/assembly/zip.xml (100%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/sparksql-converter/src/main/java/org/apache/doris/plugin/dialect}/spark/DateTruncFnCallTransformer.java (95%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/sparksql-converter/src/main/java/org/apache/doris/plugin/dialect}/spark/SparkSql3FnCallTransformers.java (93%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/sparksql-converter/src/main/java/org/apache/doris/plugin/dialect}/spark/SparkSql3LogicalPlanBuilder.java (95%) create mode 100644 fe_plugins/sparksql-converter/src/main/java/org/apache/doris/plugin/dialect/spark/SparkSqlDialectConverterPlugin.java rename {fe/fe-core/src/test/java/org/apache/doris/nereids/parser => fe_plugins/sparksql-converter/src/test/java/org/apache/doris/plugin/dialect}/spark/FnTransformTest.java (77%) create mode 100644 fe_plugins/sparksql-converter/src/test/java/org/apache/doris/plugin/dialect/spark/ParserTest.java create mode 100644 fe_plugins/trino-converter/pom.xml copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/trino-converter/src/main/assembly/plugin.conf (66%) mode change 100644 => 100755 copy docker/thirdparties/docker-compose/spark/spark.yaml => fe_plugins/trino-converter/src/main/assembly/plugin.properties (66%) mode change 100644 => 100755 copy fe_plugins/{auditloader => trino-converter}/src/main/assembly/zip.xml (100%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/trino-converter/src/main/java/org/apache/doris/plugin/dialect}/trino/DateDiffFnCallTransformer.java (98%) rename fe/fe-core/src/test/java/org/apache/doris/plugin/PluginTest.java => fe_plugins/trino-converter/src/main/java/org/apache/doris/plugin/dialect/trino/TrinoDialectConverterPlugin.java (50%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/trino-converter/src/main/java/org/apache/doris/plugin/dialect}/trino/TrinoFnCallTransformers.java (95%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/trino-converter/src/main/java/org/apache/doris/plugin/dialect}/trino/TrinoLogicalPlanBuilder.java (99%) rename {fe/fe-core/src/main/java/org/apache/doris/nereids/parser => fe_plugins/trino-converter/src/main/java/org/apache/doris/plugin/dialect}/trino/TrinoParser.java (76%) rename {fe/fe-core/src/test/java/org/apache/doris/nereids/parser => fe_plugins/trino-converter/src/test/java/org/apache/doris/plugin/dialect}/trino/FnTransformTest.java (53%) rename fe/fe-core/src/test/java/org/apache/doris/nereids/parser/trino/QueryTest.java => fe_plugins/trino-converter/src/test/java/org/apache/doris/plugin/dialect/trino/ParserTest.java (54%) create mode 100644 regression-test/data/external_table_p0/info_schema_db/test_info_schema_db.out create mode 100644 regression-test/data/fault_injection_p0/test_index_compaction_fault_injection.out rename regression-test/data/fault_injection_p0/{test_wal_mem_back_pressure_fault_injection.csv.gz => test_low_wal_disk_space_fault_injection.csv.gz} (100%) create mode 100644 regression-test/data/nereids_syntax_p0/constraint.out copy regression-test/data/nereids_tpcds_shape_sf100_p0/{shape => constraints}/query23.out (100%) create mode 100644 regression-test/data/query_p0/sql_functions/ip_functions/test_is_ip_address_in_range_function.out create mode 100644 regression-test/data/rollup_p0/a.csv create mode 100644 regression-test/data/rollup_p0/test_materialized_view_load_open.out delete mode 100644 regression-test/suites/external_table_p0/hive/test_show_columns.groovy create mode 100644 regression-test/suites/external_table_p0/info_schema_db/test_info_schema_db.groovy create mode 100644 regression-test/suites/fault_injection_p0/test_index_compaction_fault_injection.groovy create mode 100644 regression-test/suites/fault_injection_p0/test_low_wal_disk_space_fault_injection.groovy copy regression-test/suites/fault_injection_p0/{test_wal_mem_back_pressure_fault_injection.groovy => test_wal_mem_back_pressure_time_out_fault_injection.groovy} (86%) create mode 100644 regression-test/suites/inverted_index_p0/test_array_index.groovy create mode 100644 regression-test/suites/nereids_syntax_p0/constraint.groovy create mode 100644 regression-test/suites/nereids_tpcds_shape_sf100_p0/constraints/load.groovy copy regression-test/suites/nereids_tpcds_shape_sf100_p0/{shape => constraints}/query23.groovy (97%) create mode 100644 regression-test/suites/query_p0/sql_functions/ip_functions/test_is_ip_address_in_range_function.groovy copy fe/fe-core/src/main/java/org/apache/doris/nereids/parser/ParserContext.java => regression-test/suites/storage_medium_p0/test_disk_health.groovy (65%) create mode 100644 regression-test/suites/storage_medium_p0/test_storage_medium_has_disk.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org