This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from c20567d088a change to 2.1.1-rc01
new 58675c271b2 [opt](statistics) Add wait row count reported logic for
sample analyze. (#32030)
new df5ec16d7c8 [Refactor](exectuor)Add schema type table active_queries
(#32057)
new 7b74b199a5e [fix](memory) Fix LRU cache deleter and memory tracking
(#32080)
new 8a8a06d8b6d [feat](Nereids) update struct info map when there is new
expr (#32119)
new 94a75c27e70 [feature](pipelineX) support paritition tablet sink
shuffle (#31689)
new fd1e0e933ec [opt](Nereids) outer join with is null stats estimation
enhancement (#31875)
new 99830b77a85 [feat](nereids) add merge aggregate rule (#31811)
new c8c6e863862 [fix](Nereids): ignore project and distribute in
test_cte_filter_pushdown and push_down_expression_in_hash_join (#32083)
new 3c4234111b7 [fix](nereids)EliminateSemiJoin should consider empty
table (#32107)
new 2f89ec961f6 [enhancement](Nereids) Optimize expression (#32067)
new dc687dc4cce [fix](merge-clod) fix file not found when load for mow
table (#32144)
new 628e1d5e417 [fix](Nereids): slot set in condition can be empty (#32169)
new 9ffe8842a2e [improvement](mtmv) Remove useless code and add some doc
(#32047)
new 3f4ae002a8c [fix](merge-cloud) fix no cluster for common user (#32097)
new e6f9bd40233 [Opt](exec) Reduce unnecessary find function calls (#32165)
new 1db57c06670 [Optimization][Scanner] Skip `_init_variant_columns` when
there are no variant columns, and ensure `inherit_tablet_index` is called only
once (#32174)
new 554f13ca12e [Fix](Variant) fix inverted index lost due to wrong column
unique id (#31992)
new 56a14c912a6 [fix](routineload) fix consume data too slow in partial
partitions (#32126)
new bede9480294 [enhancement](nereids) support unnest subquery with group
by and having clause (#32002)
new d02f7606de0 [chore](tools) update tools config (#32193)
new 141189de15d [fix](jdbc catalog) Fix the wrong method used in
loadColumnNames of JdbcIdentifierMapping (#32168)
new 985c4a3f508 [fix](mysql) Fix Connection Attributes Parsing Logic for
Compatibility (#32177)
new c33277a957a [fix](script) Fix the JAVA_OPTS set on macOS (#32170)
new e3150250bff [fix](jdbc catalog) fix get doris column info when lower
case (#32190)
new 36a0b93c442 [Enhancement](mor) Add unique mor table min max push down
case #32196
new 2d0706a67c8 [fix](nereids)move SimplifyAggGroupBy rule into analyze
phase (#32186)
new 9150c82545e [test](Nereids) add ckbench shape test (#32191)
new 0dc081088ce [doc](auto-inc) fix example sql (#32206)
new c85af1bfd65 [fix](iceberg) fix error when query iceberg table using
date predicate (#32194)
new 680fce8825a [chore](test) let regression test work well with nereids
(#32199)
new 7205f267ccf [opt](Nereids) support cast agg state type as legacy
planner (#32198)
new 4534300030b [fix](Operator) RepeatNode does not handle empty
expressions. (#32112)
new c919834df3d [fix](test) ckbench shape test failed because parallel
merge (#32224)
new 7d3a485665e [typo](docs) add additional explanation to the repeat
function (#32158)
new 0578b28d54c [fix](function) fixed the get_json_string function (#32150)
new 62023d705d6 [refactor](rename) rename task group to workload group in
be (#32204)
new ea2fbfaffaf [feature](Nereids) support agg state type in create table
(#32171)
new aca7328109e [bugfix]json_length() BE crash fix (#32145)
new c8f3643890c [exec](runtimefilter) support null aware in runtime filter
(#32152)
new bb457d7b0d1 [fix](test) ckbench shape unstable since
topn_opt_limit_threshold in fuzzy list (#32256)
new 687ab1a3e1b [fix](ip) conversion of ipv4 or ipv6 to arrow type #32240
new 41ca09ab214 [opt](Nereids) opt distinct agg without group by key plan
#32236
new 9767861ee96 [enhancement](test) opt the unique model by modify value
(#32043)
new abff6f0699a [doc](mtmv)fix doc char2 bug (#32271)
new 5a460eefc89 [opt](Nereids) remove group by key eliminate rule option
(#32238)
new 5e4da61df98 [Bug](top-n) do not get runtime predicate when predicate
not initialized (#32208)
new 04a59d60711 [improve](distinct agg) add check of hash table to decide
whether emplace value (#32063)
new 42ccc5489e4 [doc](ldap) opt the doc format (#31956)
new afa9f6e5d61 [Feat](nereids) support column default value current_date
(#32268)
new 9e014cfb8ad [fix](nereids) fix bug when grouping has same grouping set
(#32235)
new 5478193002b [Fix](Variant) support view for accessing variant
subcolumns and temp… (#32225)
new 8d988930bd5 [Fix](segment write) handle variant bloom filter in
segment writer (#32011)
new 9c1888e7ec2 [RuntimeFilter](exec) support min max runtime filter and
do refactor (#32210)
new c0776c7c075 [fix](cloud) ignore some case in cloud mode (#32261)
new 97b35d6830f [fix](nereids)AssertNumRow node's output should be
nullable (#32136)
new e3bb499cc6c [fix](function)revert function REPEAT nullable mode #32226
The 56 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/cgroup_cpu_ctl.cpp | 2 +-
be/src/agent/workload_group_listener.cpp | 35 +-
be/src/cloud/cloud_tablet_mgr.cpp | 353 ++++++++++++++++++
be/src/cloud/cloud_txn_delete_bitmap_cache.cpp | 183 +++++++++
be/src/cloud/cloud_txn_delete_bitmap_cache.h | 98 +++++
be/src/common/daemon.cpp | 2 +-
be/src/exec/schema_scanner.cpp | 3 +
.../schema_active_queries_scanner.cpp | 165 +++++++++
.../schema_active_queries_scanner.h} | 42 ++-
be/src/exprs/bloom_filter_func.h | 5 +-
be/src/exprs/hybrid_set.h | 30 +-
be/src/exprs/minmax_predicate.h | 14 +-
be/src/exprs/runtime_filter.cpp | 77 ++--
be/src/http/action/stream_load.cpp | 5 +-
be/src/io/fs/hdfs_file_system.h | 2 +-
be/src/olap/lru_cache.cpp | 48 +--
be/src/olap/lru_cache.h | 52 +--
be/src/olap/page_cache.cpp | 18 +-
be/src/olap/page_cache.h | 39 +-
be/src/olap/rowset/beta_rowset_writer.cpp | 5 +
be/src/olap/rowset/segment_creator.cpp | 13 +-
be/src/olap/rowset/segment_creator.h | 9 +-
.../segment_v2/bitshuffle_page_pre_decoder.h | 7 +-
be/src/olap/rowset/segment_v2/encoding_info.h | 4 +-
.../rowset/segment_v2/inverted_index_cache.cpp | 36 +-
.../olap/rowset/segment_v2/inverted_index_cache.h | 26 +-
be/src/olap/rowset/segment_v2/page_io.cpp | 17 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 4 +-
be/src/olap/schema_cache.h | 23 +-
be/src/olap/segment_loader.cpp | 20 +-
be/src/olap/segment_loader.h | 8 +-
be/src/olap/storage_engine.cpp | 16 +-
be/src/olap/storage_engine.h | 5 +-
be/src/olap/tablet_meta.cpp | 5 +-
be/src/olap/tablet_meta.h | 7 +-
be/src/olap/tablet_reader.cpp | 7 +-
be/src/olap/tablet_reader.h | 2 +-
be/src/olap/tablet_schema.cpp | 6 +-
be/src/olap/tablet_schema_cache.cpp | 21 +-
be/src/olap/tablet_schema_cache.h | 6 +-
be/src/olap/txn_manager.cpp | 21 +-
be/src/olap/txn_manager.h | 7 +
be/src/pipeline/exec/assert_num_rows_operator.cpp | 47 ++-
be/src/pipeline/exec/assert_num_rows_operator.h | 1 +
.../distinct_streaming_aggregation_operator.cpp | 130 ++++++-
.../exec/distinct_streaming_aggregation_operator.h | 4 +
...istinct_streaming_aggregation_sink_operator.cpp | 10 +-
...tinct_streaming_aggregation_source_operator.cpp | 3 +-
...istinct_streaming_aggregation_source_operator.h | 1 -
be/src/pipeline/exec/exchange_sink_operator.cpp | 142 ++++++-
be/src/pipeline/exec/exchange_sink_operator.h | 34 +-
be/src/pipeline/exec/repeat_operator.cpp | 6 +-
be/src/pipeline/exec/scan_operator.cpp | 2 +-
be/src/pipeline/pipeline_task.h | 2 +-
be/src/pipeline/pipeline_tracing.cpp | 10 +-
be/src/pipeline/pipeline_tracing.h | 4 +-
be/src/pipeline/pipeline_x/pipeline_x_task.h | 2 +-
be/src/pipeline/task_queue.h | 2 +-
be/src/pipeline/task_scheduler.cpp | 9 +-
be/src/pipeline/task_scheduler.h | 2 +-
be/src/runtime/exec_env.h | 8 +-
be/src/runtime/exec_env_init.cpp | 10 +-
be/src/runtime/fragment_mgr.cpp | 16 +-
be/src/runtime/load_channel_mgr.cpp | 11 +-
be/src/runtime/memory/cache_manager.cpp | 9 +-
be/src/runtime/memory/cache_manager.h | 29 +-
be/src/runtime/memory/cache_policy.cpp | 4 +-
be/src/runtime/memory/cache_policy.h | 10 +-
be/src/runtime/memory/lru_cache_policy.h | 80 +++-
be/src/runtime/memory/lru_cache_value_base.h | 51 +++
be/src/runtime/memory/mem_tracker_limiter.cpp | 8 +-
be/src/runtime/memory/mem_tracker_limiter.h | 14 +-
be/src/runtime/query_context.cpp | 30 +-
be/src/runtime/query_context.h | 6 +-
be/src/runtime/routine_load/data_consumer_group.h | 8 +-
be/src/runtime/routine_load/data_consumer_pool.cpp | 5 +-
be/src/runtime/runtime_predicate.h | 8 +-
be/src/runtime/runtime_state.cpp | 12 +-
be/src/runtime/types.cpp | 4 +-
.../workload_group.cpp} | 108 +++---
.../workload_group.h} | 31 +-
.../workload_group_manager.cpp} | 75 ++--
.../workload_group_manager.h} | 23 +-
be/src/service/point_query_executor.cpp | 19 +-
be/src/service/point_query_executor.h | 49 ++-
be/src/util/doris_metrics.cpp | 4 -
be/src/util/doris_metrics.h | 2 -
be/src/util/mem_info.cpp | 46 +--
be/src/util/obj_lru_cache.cpp | 6 +-
be/src/util/obj_lru_cache.h | 42 ++-
be/src/vec/core/block.cpp | 2 +-
be/src/vec/data_types/data_type_ipv4.h | 3 +
be/src/vec/data_types/data_type_ipv6.h | 3 +
be/src/vec/exec/distinct_vaggregation_node.cpp | 41 ++-
be/src/vec/exec/distinct_vaggregation_node.h | 4 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 3 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 3 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 2 +-
be/src/vec/exec/scan/new_olap_scanner.cpp | 5 +-
be/src/vec/exec/scan/scanner_context.h | 5 +-
be/src/vec/exec/scan/vscan_node.cpp | 2 +-
be/src/vec/exec/vaggregation_node.h | 6 +-
be/src/vec/exec/vassert_num_rows_node.cpp | 47 ++-
be/src/vec/exec/vassert_num_rows_node.h | 1 +
be/src/vec/exec/vrepeat_node.cpp | 5 +-
be/src/vec/exprs/vdirect_in_predicate.h | 37 +-
be/src/vec/exprs/vectorized_fn_call.cpp | 29 +-
be/src/vec/exprs/vectorized_fn_call.h | 7 +
be/src/vec/exprs/vexpr.cpp | 1 +
be/src/vec/exprs/vexpr.h | 7 +
be/src/vec/exprs/vruntimefilter_wrapper.cpp | 86 ++++-
be/src/vec/exprs/vruntimefilter_wrapper.h | 3 +-
be/src/vec/functions/function_json.cpp | 3 +-
be/src/vec/functions/function_jsonb.cpp | 5 +-
be/src/vec/functions/function_string.cpp | 1 -
be/src/vec/functions/function_string.h | 97 -----
be/src/vec/functions/function_utility.cpp | 12 +-
be/src/vec/functions/in.h | 16 +-
be/src/vec/sink/load_stream_stub.cpp | 22 +-
be/src/vec/sink/load_stream_stub.h | 2 +-
be/src/vec/sink/vdata_stream_sender.cpp | 44 +--
be/src/vec/sink/writer/async_result_writer.cpp | 7 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 2 +-
be/test/olap/lru_cache_test.cpp | 90 +++--
be/test/olap/page_cache_test.cpp | 43 ++-
bin/start_be.sh | 4 +-
docs/en/community/design/grouping_sets_design.md | 8 +-
docs/en/docs/admin-manual/privilege-ldap/ldap.md | 113 ++++--
docs/en/docs/advanced/auto-increment.md | 46 ++-
.../async-materialized-view.md | 6 +-
.../sql-functions/string-functions/repeat.md | 7 +
.../Create/CREATE-ASYNC-MATERIALIZED-VIEW.md | 2 +
.../sql-reference/Data-Types/AGG_STATE.md | 4 +-
.../zh-CN/community/design/grouping_sets_design.md | 12 +-
.../zh-CN/docs/admin-manual/privilege-ldap/ldap.md | 126 ++++---
docs/zh-CN/docs/advanced/auto-increment.md | 50 ++-
.../async-materialized-view.md | 6 +-
.../sql-functions/string-functions/repeat.md | 7 +
.../Create/CREATE-ASYNC-MATERIALIZED-VIEW.md | 1 +
.../sql-reference/Data-Types/AGG_STATE.md | 4 +-
.../org/apache/doris/catalog/AggStateType.java | 4 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 19 +-
fe/fe-core/src/main/cup/sql_parser.cup | 33 +-
.../org/apache/doris/analysis/BinaryPredicate.java | 11 +-
.../java/org/apache/doris/analysis/ColumnDef.java | 25 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 2 +-
.../org/apache/doris/analysis/DateLiteral.java | 4 +
.../org/apache/doris/analysis/SchemaTableType.java | 3 +-
.../org/apache/doris/catalog/AggregateType.java | 2 +-
.../doris/catalog/BuiltinTableValuedFunctions.java | 2 -
.../apache/doris/catalog/ColocateTableIndex.java | 5 +
.../main/java/org/apache/doris/catalog/Column.java | 35 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 9 +
.../doris/datasource/iceberg/IcebergUtils.java | 2 +-
.../datasource/jdbc/JdbcIdentifierMapping.java | 2 +-
.../doris/datasource/jdbc/client/JdbcClient.java | 10 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 16 +-
.../datasource/mapping/IdentifierMapping.java | 3 +-
.../main/java/org/apache/doris/mtmv/MTMVCache.java | 19 +-
.../org/apache/doris/mysql/MysqlAuthPacket.java | 5 +-
.../glue/translator/PhysicalPlanTranslator.java | 29 +-
.../doris/nereids/jobs/executor/Analyzer.java | 2 +
.../doris/nereids/jobs/executor/Rewriter.java | 55 +--
.../jobs/joinorder/hypergraph/edge/JoinEdge.java | 2 +-
.../apache/doris/nereids/memo/StructInfoMap.java | 22 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 38 +-
.../properties/ChildrenPropertiesRegulator.java | 22 +-
.../org/apache/doris/nereids/rules/RuleType.java | 3 +
.../nereids/rules/analysis/ExpressionAnalyzer.java | 20 +
.../nereids/rules/analysis/FillUpMissingSlots.java | 8 +-
.../nereids/rules/analysis/NormalizeAggregate.java | 50 ++-
.../nereids/rules/analysis/NormalizeRepeat.java | 12 +-
.../rules/exploration/join/InnerJoinLAsscom.java | 6 +-
.../rules/expression/ExpressionNormalization.java | 2 +
.../expression/rules/ConvertAggStateCast.java | 81 ++++
.../rules/expression/rules/FunctionBinder.java | 20 +
.../doris/nereids/rules/rewrite/ColumnPruning.java | 75 ++--
.../rules/rewrite/ConvertInnerOrCrossJoin.java | 4 +-
.../rules/rewrite/ConvertOuterJoinToAntiJoin.java | 4 +-
.../rules/rewrite/EliminateAssertNumRows.java | 13 +-
.../nereids/rules/rewrite/EliminateGroupByKey.java | 5 -
.../rewrite/EliminateNullAwareLeftAntiJoin.java | 2 +-
.../nereids/rules/rewrite/EliminateOuterJoin.java | 4 +-
.../nereids/rules/rewrite/EliminateSemiJoin.java | 58 +--
.../nereids/rules/rewrite/MergeAggregate.java | 211 +++++++++++
.../nereids/rules/rewrite/NormalizeToSlot.java | 28 +-
...CorrelatedFilterUnderApplyAggregateProject.java | 66 ++--
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 7 +-
.../rewrite/TransposeSemiJoinLogicalJoin.java | 2 +-
.../TransposeSemiJoinLogicalJoinProject.java | 10 +-
.../rewrite/UnCorrelatedApplyAggregateFilter.java | 85 +++--
.../mv/SelectMaterializedIndexWithAggregate.java | 2 +-
.../doris/nereids/stats/FilterEstimation.java | 31 +-
.../doris/nereids/stats/StatsCalculator.java | 112 +++++-
.../org/apache/doris/nereids/trees/TreeNode.java | 4 +-
.../doris/nereids/trees/expressions/Alias.java | 50 ++-
.../doris/nereids/trees/expressions/Any.java | 4 +
.../trees/expressions/ArrayItemReference.java | 4 +-
.../nereids/trees/expressions/BinaryOperator.java | 12 -
.../nereids/trees/expressions/Expression.java | 69 +++-
.../trees/expressions/MarkJoinSlotReference.java | 2 +-
.../nereids/trees/expressions/SlotReference.java | 54 ++-
.../trees/expressions/VirtualSlotReference.java | 6 +-
.../nereids/trees/expressions/WhenClause.java | 15 -
.../trees/expressions/WindowExpression.java | 2 +-
.../trees/expressions/functions/BoundFunction.java | 26 +-
.../trees/expressions/functions/scalar/Repeat.java | 4 +-
.../expressions/functions/table/ActiveQueries.java | 59 ---
.../visitor/TableValuedFunctionVisitor.java | 5 -
.../doris/nereids/trees/plans/AbstractPlan.java | 14 +-
.../org/apache/doris/nereids/trees/plans/Plan.java | 8 +-
.../doris/nereids/trees/plans/algebra/Repeat.java | 15 +-
.../plans/commands/info/ColumnDefinition.java | 64 ++--
.../trees/plans/commands/info/DefaultValue.java | 2 +
.../trees/plans/logical/LogicalAssertNumRows.java | 5 +-
.../nereids/trees/plans/logical/LogicalFilter.java | 6 +
.../nereids/trees/plans/logical/LogicalJoin.java | 9 +-
.../nereids/trees/plans/logical/LogicalUnion.java | 6 +
.../trees/plans/physical/AbstractPhysicalPlan.java | 10 -
.../plans/physical/PhysicalAssertNumRows.java | 5 +-
.../apache/doris/nereids/types/AggStateType.java | 19 +-
.../apache/doris/nereids/util/ExpressionUtils.java | 16 +-
.../org/apache/doris/nereids/util/PlanUtils.java | 86 ++++-
.../doris/nereids/util/TypeCoercionUtils.java | 8 +
.../apache/doris/planner/AssertNumRowsNode.java | 22 +-
.../java/org/apache/doris/qe/SessionVariable.java | 2 +-
.../apache/doris/service/FrontendServiceImpl.java | 2 +
.../apache/doris/statistics/OlapAnalysisTask.java | 2 +-
.../org/apache/doris/statistics/Statistics.java | 4 +
.../doris/statistics/util/StatisticsUtil.java | 26 ++
.../doris/tablefunction/MetadataGenerator.java | 71 +++-
.../tablefunction/MetadataTableValuedFunction.java | 3 +-
.../doris/tablefunction/TableValuedFunctionIf.java | 2 -
fe/fe-core/src/main/jflex/sql_scanner.flex | 1 +
.../doris/datasource/RefreshCatalogTest.java | 4 +-
.../doris/nereids/memo/StructInfoMapTest.java | 53 +++
.../rules/analysis/FillUpMissingSlotsTest.java | 6 +-
.../rules/rewrite/EliminateSemiJoinTest.java | 71 +++-
.../rules/rewrite/SimplifyAggGroupByTest.java | 15 +
.../doris/nereids/stats/FilterEstimationTest.java | 2 +-
.../doris/nereids/util/HyperGraphBuilder.java | 4 +-
.../apache/doris/planner/StatisticDeriveTest.java | 1 -
gensrc/script/doris_builtins_functions.py | 4 +-
gensrc/thrift/Descriptors.thrift | 3 +-
gensrc/thrift/Exprs.thrift | 5 +
gensrc/thrift/FrontendService.thrift | 3 +-
gensrc/thrift/PaloInternalService.thrift | 1 +
gensrc/thrift/PlanNodes.thrift | 3 +-
.../data/correctness_p0/test_current_date.out | 13 +
.../correctness_p0/test_grouping_sets_empty.out | 13 +
.../jdbc/test_mariadb_jdbc_catalog.out | 1 +
.../jdbc/test_mysql_jdbc_catalog.out | 1 +
.../jdbc/test_mysql_jdbc_catalog_nereids.out | 1 +
.../jdbc/test_mysql_jdbc_driver5_catalog.out | 1 +
.../data/jsonb_p0/test_jsonb_load_and_function.out | 3 +
.../data/nereids_clickbench_shape_p0/query1.out | 9 +
.../data/nereids_clickbench_shape_p0/query10.out | 12 +
.../data/nereids_clickbench_shape_p0/query11.out | 13 +
.../data/nereids_clickbench_shape_p0/query12.out | 13 +
.../data/nereids_clickbench_shape_p0/query13.out | 13 +
.../data/nereids_clickbench_shape_p0/query14.out | 13 +
.../data/nereids_clickbench_shape_p0/query15.out | 13 +
.../data/nereids_clickbench_shape_p0/query16.out | 10 +
.../data/nereids_clickbench_shape_p0/query17.out | 10 +
.../data/nereids_clickbench_shape_p0/query18.out | 10 +
.../data/nereids_clickbench_shape_p0/query19.out | 10 +
.../data/nereids_clickbench_shape_p0/query2.out | 10 +
.../data/nereids_clickbench_shape_p0/query20.out | 8 +
.../data/nereids_clickbench_shape_p0/query21.out | 10 +
.../data/nereids_clickbench_shape_p0/query22.out | 13 +
.../data/nereids_clickbench_shape_p0/query23.out | 13 +
.../data/nereids_clickbench_shape_p0/query24.out | 9 +
.../data/nereids_clickbench_shape_p0/query25.out | 11 +
.../data/nereids_clickbench_shape_p0/query26.out | 10 +
.../data/nereids_clickbench_shape_p0/query27.out | 11 +
.../data/nereids_clickbench_shape_p0/query28.out | 14 +
.../data/nereids_clickbench_shape_p0/query29.out | 14 +
.../data/nereids_clickbench_shape_p0/query3.out | 9 +
.../data/nereids_clickbench_shape_p0/query30.out | 9 +
.../data/nereids_clickbench_shape_p0/query31.out | 13 +
.../data/nereids_clickbench_shape_p0/query32.out | 13 +
.../data/nereids_clickbench_shape_p0/query33.out | 12 +
.../data/nereids_clickbench_shape_p0/query34.out | 12 +
.../data/nereids_clickbench_shape_p0/query35.out | 13 +
.../data/nereids_clickbench_shape_p0/query36.out | 13 +
.../data/nereids_clickbench_shape_p0/query37.out | 13 +
.../data/nereids_clickbench_shape_p0/query38.out | 13 +
.../data/nereids_clickbench_shape_p0/query39.out | 13 +
.../data/nereids_clickbench_shape_p0/query4.out | 9 +
.../data/nereids_clickbench_shape_p0/query40.out | 14 +
.../data/nereids_clickbench_shape_p0/query41.out | 13 +
.../data/nereids_clickbench_shape_p0/query42.out | 13 +
.../data/nereids_clickbench_shape_p0/query43.out | 13 +
.../data/nereids_clickbench_shape_p0/query5.out | 11 +
.../data/nereids_clickbench_shape_p0/query6.out | 12 +
.../data/nereids_clickbench_shape_p0/query7.out | 9 +
.../data/nereids_clickbench_shape_p0/query8.out | 13 +
.../data/nereids_clickbench_shape_p0/query9.out | 12 +
.../nereids_p0/cte/test_cte_filter_pushdown.out | 69 ++--
.../nereids_p0/explain/test_pushdown_explain.out | 74 ++++
.../nereids_p0/subquery/subquery_unnesting.out | 11 +
.../data/nereids_p0/subquery/test_subquery.out | 7 +
.../cte/test_cte_filter_pushdown.out | 69 ++--
.../eliminate_gby_key/eliminate_gby_key.out | 164 +++++++++
.../eliminate_join_condition.out | 4 +-
.../push_down_expression_in_hash_join.out | 158 +++-----
.../grouping_with_same_grouping_set.out | 9 +
.../merge_aggregate/merge_aggregate.out | 248 +++++++++++++
.../nereids_tpcds_shape_sf1000_p0/shape/query9.out | 73 ++--
.../noStatsRfPrune/query9.out | 73 ++--
.../no_stats_shape/query9.out | 73 ++--
.../rf_prune/query44.out | 71 ++--
.../rf_prune/query9.out | 73 ++--
.../nereids_tpcds_shape_sf100_p0/shape/query44.out | 71 ++--
.../nereids_tpcds_shape_sf100_p0/shape/query9.out | 73 ++--
.../test_unique_model_schema_value_change.out | 10 +
regression-test/data/variant_p0/view.out | 63 ++++
.../org/apache/doris/regression/suite/Suite.groovy | 2 +-
.../test_vertical_compaction_agg_state.groovy | 2 +-
.../suites/correctness/test_select_except.groovy | 2 +-
.../suites/correctness_p0/test_current_date.groovy | 75 ++++
.../test_grouping_sets_empty.groovy} | 52 ++-
.../agg_state/avg/test_agg_state_avg.groovy | 2 +-
.../test_agg_state_group_concat.groovy | 2 +-
.../agg_state/max/test_agg_state_max.groovy | 4 +-
.../nereids/test_agg_state_nereids.groovy | 5 +-
.../test_agg_state_quantile_union.groovy | 2 +-
.../datatype_p0/agg_state/test_agg_state.groovy | 2 +-
.../tvf/queries/test_queries_tvf.groovy | 2 +-
.../test_insert_from_tvf_with_common_user.groovy | 8 +
.../test_memtable_flush_fault.groovy | 3 +-
.../jsonb_p0/test_jsonb_load_and_function.groovy | 1 +
.../load_p0/stream_load/test_stream_load.groovy | 8 +
.../suites/mv_p0/dis_26495/dis_26495.groovy | 2 +-
.../suites/nereids_clickbench_shape_p0/load.groovy | 146 ++++++++
.../nereids_clickbench_shape_p0/query1.groovy | 29 ++
.../nereids_clickbench_shape_p0/query10.groovy | 30 ++
.../nereids_clickbench_shape_p0/query11.groovy | 31 ++
.../nereids_clickbench_shape_p0/query12.groovy | 31 ++
.../nereids_clickbench_shape_p0/query13.groovy | 31 ++
.../nereids_clickbench_shape_p0/query14.groovy | 31 ++
.../nereids_clickbench_shape_p0/query15.groovy | 31 ++
.../nereids_clickbench_shape_p0/query16.groovy | 31 ++
.../nereids_clickbench_shape_p0/query17.groovy | 31 ++
.../nereids_clickbench_shape_p0/query18.groovy | 31 ++
.../nereids_clickbench_shape_p0/query19.groovy | 31 ++
.../nereids_clickbench_shape_p0/query2.groovy | 31 ++
.../nereids_clickbench_shape_p0/query20.groovy | 31 ++
.../nereids_clickbench_shape_p0/query21.groovy | 31 ++
.../nereids_clickbench_shape_p0/query22.groovy | 31 ++
.../nereids_clickbench_shape_p0/query23.groovy | 31 ++
.../nereids_clickbench_shape_p0/query24.groovy | 31 ++
.../nereids_clickbench_shape_p0/query25.groovy | 31 ++
.../nereids_clickbench_shape_p0/query26.groovy | 31 ++
.../nereids_clickbench_shape_p0/query27.groovy | 31 ++
.../nereids_clickbench_shape_p0/query28.groovy | 31 ++
.../nereids_clickbench_shape_p0/query29.groovy | 31 ++
.../nereids_clickbench_shape_p0/query3.groovy | 29 ++
.../nereids_clickbench_shape_p0/query30.groovy | 31 ++
.../nereids_clickbench_shape_p0/query31.groovy | 31 ++
.../nereids_clickbench_shape_p0/query32.groovy | 31 ++
.../nereids_clickbench_shape_p0/query33.groovy | 31 ++
.../nereids_clickbench_shape_p0/query34.groovy | 31 ++
.../nereids_clickbench_shape_p0/query35.groovy | 31 ++
.../nereids_clickbench_shape_p0/query36.groovy | 31 ++
.../nereids_clickbench_shape_p0/query37.groovy | 31 ++
.../nereids_clickbench_shape_p0/query38.groovy | 31 ++
.../nereids_clickbench_shape_p0/query39.groovy | 31 ++
.../nereids_clickbench_shape_p0/query4.groovy | 29 ++
.../nereids_clickbench_shape_p0/query40.groovy | 31 ++
.../nereids_clickbench_shape_p0/query41.groovy | 31 ++
.../nereids_clickbench_shape_p0/query42.groovy | 31 ++
.../nereids_clickbench_shape_p0/query43.groovy | 30 ++
.../nereids_clickbench_shape_p0/query5.groovy | 29 ++
.../nereids_clickbench_shape_p0/query6.groovy | 29 ++
.../nereids_clickbench_shape_p0/query7.groovy | 30 ++
.../nereids_clickbench_shape_p0/query8.groovy | 30 ++
.../nereids_clickbench_shape_p0/query9.groovy | 31 ++
.../suites/nereids_function_p0/tvf/tvf.groovy | 2 +-
.../nereids_p0/cte/test_cte_filter_pushdown.groovy | 1 +
.../test_outerjoin_isnull_estimation.groovy | 54 +++
.../explain/test_pushdown_explain.groovy | 86 +++++
.../insert_into_table/no_partition.groovy | 11 -
.../nereids_p0/subquery/subquery_unnesting.groovy | 1 +
.../nereids_p0/subquery/test_subquery.groovy | 23 +-
.../cte/test_cte_filter_pushdown.groovy | 1 +
.../eliminate_gby_key/eliminate_gby_key.groovy | 251 +++++++++++++
.../push_down_expression_in_hash_join.groovy | 1 +
.../grouping_with_same_grouping_set.groovy} | 22 +-
.../merge_aggregate/merge_aggregate.groovy | 177 +++++++++
.../grouping_sets/test_grouping_sets.groovy | 2 +-
.../test_active_queries.groovy} | 15 +-
.../test_backend_active_tasks.groovy | 0
.../test_array_functions_with_where.groovy | 2 +-
.../query_p0/sql_functions/test_in_expr.groovy | 2 +-
.../test_alter_colocate_table.groovy | 3 +
.../test_unique_model_schema_value_change.groovy | 410 ++++++++++++---------
.../suites/statistics/test_agg_complex_type.groovy | 2 +-
.../storage_medium_p0/test_disk_health.groovy | 4 +
.../test_storage_medium_has_disk.groovy | 4 +
...test_partial_update_insert_schema_change.groovy | 2 +-
regression-test/suites/variant_p0/view.groovy | 83 +++++
tools/tpcds-tools/conf/opt/opt_sf1.sql | 1 -
tools/tpcds-tools/conf/opt/opt_sf100.sql | 1 -
tools/tpch-tools/conf/opt/opt_sf1.sql | 6 -
tools/tpch-tools/conf/opt/opt_sf100.sql | 7 -
tools/tpch-tools/conf/opt/opt_sf1000.sql | 6 -
tools/tpch-tools/conf/opt/opt_sf10000.sql | 6 -
409 files changed, 8045 insertions(+), 2538 deletions(-)
create mode 100644 be/src/cloud/cloud_tablet_mgr.cpp
create mode 100644 be/src/cloud/cloud_txn_delete_bitmap_cache.cpp
create mode 100644 be/src/cloud/cloud_txn_delete_bitmap_cache.h
create mode 100644 be/src/exec/schema_scanner/schema_active_queries_scanner.cpp
copy be/src/{vec/exec/vassert_num_rows_node.h =>
exec/schema_scanner/schema_active_queries_scanner.h} (54%)
create mode 100644 be/src/runtime/memory/lru_cache_value_base.h
rename be/src/runtime/{task_group/task_group.cpp =>
workload_group/workload_group.cpp} (81%)
rename be/src/runtime/{task_group/task_group.h =>
workload_group/workload_group.h} (87%)
rename be/src/runtime/{task_group/task_group_manager.cpp =>
workload_group/workload_group_manager.cpp} (59%)
rename be/src/runtime/{task_group/task_group_manager.h =>
workload_group/workload_group_manager.h} (70%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rules/ConvertAggStateCast.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/MergeAggregate.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/table/ActiveQueries.java
create mode 100644 regression-test/data/correctness_p0/test_current_date.out
create mode 100644
regression-test/data/correctness_p0/test_grouping_sets_empty.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query1.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query10.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query11.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query12.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query13.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query14.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query15.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query16.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query17.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query18.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query19.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query2.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query20.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query21.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query22.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query23.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query24.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query25.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query26.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query27.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query28.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query29.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query3.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query30.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query31.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query32.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query33.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query34.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query35.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query36.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query37.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query38.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query39.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query4.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query40.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query41.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query42.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query43.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query5.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query6.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query7.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query8.out
create mode 100644 regression-test/data/nereids_clickbench_shape_p0/query9.out
create mode 100644
regression-test/data/nereids_rules_p0/eliminate_gby_key/eliminate_gby_key.out
create mode 100644
regression-test/data/nereids_rules_p0/grouping_sets/grouping_with_same_grouping_set.out
create mode 100644
regression-test/data/nereids_rules_p0/merge_aggregate/merge_aggregate.out
create mode 100644 regression-test/data/variant_p0/view.out
create mode 100644
regression-test/suites/correctness_p0/test_current_date.groovy
copy regression-test/suites/{nereids_function_p0/tvf/tvf.groovy =>
correctness_p0/test_grouping_sets_empty.groovy} (50%)
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/load.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query1.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query10.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query11.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query12.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query13.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query14.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query15.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query16.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query17.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query18.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query19.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query2.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query20.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query21.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query22.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query23.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query24.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query25.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query26.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query27.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query28.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query29.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query3.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query30.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query31.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query32.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query33.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query34.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query35.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query36.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query37.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query38.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query39.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query4.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query40.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query41.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query42.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query43.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query5.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query6.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query7.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query8.groovy
create mode 100644
regression-test/suites/nereids_clickbench_shape_p0/query9.groovy
create mode 100644
regression-test/suites/nereids_p0/explain/test_outerjoin_isnull_estimation.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/eliminate_gby_key/eliminate_gby_key.groovy
copy regression-test/suites/{storage_medium_p0/test_disk_health.groovy =>
nereids_rules_p0/grouping_sets/grouping_with_same_grouping_set.groovy} (63%)
create mode 100644
regression-test/suites/nereids_rules_p0/merge_aggregate/merge_aggregate.groovy
copy
regression-test/suites/query_p0/{meta_scan/test_backend_active_tasks.groovy =>
schema_table/test_active_queries.groovy} (70%)
rename regression-test/suites/query_p0/{meta_scan =>
schema_table}/test_backend_active_tasks.groovy (100%)
create mode 100644 regression-test/suites/variant_p0/view.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
