This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from c7360fd0149 [feature](function) support ip function named
ipv4_cidr_to_range(addr, cidr) (#29819)
new 79d178ca54f [test](ut) added UT cases for show create materialized
view (#29563)
new f85b04c2c65 [fix](datatype) fixed decimal type implicit cast handling
in BinaryPredicate (#30181)
new 2f68aac885a [Improvement](Nereids) Support to query rewrite by
materialized view when join input has aggregate (#30230)
new 88fdb2677d8 [fix](catalog) fix Uninitialized connection pool
parameters in hmsjdbcclient (#30262)
new ca5a3147654 [fix](function) make STRLEFT and STRRIGHT and SUBSTR
function DEPEND_ON_ARGUMENT (#28352)
new cd70f45ce2c [test](ut) added UT cases for show build index (#29561)
new 7e1a986fa16 [feat](Nereids): eliminate left outer join by unique when
comparing mv (#30228)
new 2951f9a2c7f [fix](Nereids) relation in constraints should be multi
parts (#30293)
new e94683fffbd [pipelineX](refactor) refine relationship between shared
state and dependency (#30294)
new df504df4751 [regression test](schema change) add case for partition
(#30195)
new 101b2593fc5 [regression test](schema change) add case for
tinyint/smallint/int/bigint/float/double type in agg (#30193)
new 7e60369ba2e [Feature](materialized-view) support create mv with
count(*) (#30313)
new 72026778fe9 [optimize](inverted index) Use inverted index filter null
field (#30237)
new 1aa006c80f1 [fix](ci) add single quote to the value of the session
variables when setting it (#30295)
new 83ea486b15d [fix](Nereids): Except just can merge with left deep shape
(#30270)
new 63cf2777f97 [improvement](statistics)Catch load column stats
exception, avoid print too much stack info to fe.out #30315
new 67051318a25 [docs](fix)fix max_filter_ratio default value #30318
new 86d7a8be444 [improvement](statistics nereids)Nereids support select
mv. (#30267)
new 02876511149 [fix](char) fix char column type not check lenght (#30266)
new 1322c813d39 [Fix](executor)Fix return stack to fe #30316
new 825fe1470f6 [Docs](arm) update arm compilation and auto partition
(#30311)
new 2e6a00690f3 [Fix](smooth-upgrade) fix unnecessary high version of
smooth upgrade (#30283)
new 15728756e22 [improve](streamload) do not print stack trace when get
data from pipe meet cancel (#30297)
new bee6ae73c7d [minor](Nereids): enable PushDownTopNDistinctThroughJoin
(#30275)
new 49f879f8fda [regression test](framework) add waitFor action (#30289)
new 3d22f9cfc89 [feature](replica) Add drop replica safely on backend
(#30303)
new 5ba9987d3a3 [Fix](executor)Release resource correctly when drop
workload group (#30279)
new 5b462194d16 [Feature](materialized-view) support rewrite case when to
if on legacy planner to make mv work (#30320)
new 1d7d7ee9b68 [Chore](join) split out join hash map from hash map
(#30280)
new 61bab1f1c00 [Fix](inverted index) fix data size when drop inverted
index (#30327)
new ff47c69bf9e [doc](fix) K8s doc modify and add pvc network docs (#30307)
new 081da1299a9 [fix](fe) Fix `FrontendHbResponse` serialization
compatibility problem (#30337)
new 01c394acc20 [fix](inverted index)support merge null_bitmap during
index compaction (#30326)
new b1722231c44 [Fix](doc) Modify some default values in the documentation
(#30304)
new 6614d40dadf [bugfix](core) fix core due to send rpc and request is
deconstructed (#30344)
new b60a272be01 [Bug](pipeline) Fix pipeline load lose data use wrong var
check order (#30341)
new f87484d6b3e [fix](Nereids) fix create array function type coercion
(#30329)
The 37 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/be_exec_version_manager.h | 11 +-
be/src/clucene | 2 +-
be/src/common/exception.h | 2 +-
be/src/common/status.h | 9 +
be/src/io/fs/stream_load_pipe.cpp | 6 +-
be/src/olap/rowset/beta_rowset.cpp | 20 +
be/src/olap/rowset/beta_rowset.h | 1 +
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 2 +
be/src/olap/tablet_schema.cpp | 12 +
be/src/olap/tablet_schema.h | 2 +
be/src/olap/task/index_builder.cpp | 34 +-
be/src/olap/wal/wal_reader.cpp | 16 +-
be/src/olap/wal/wal_reader.h | 2 -
be/src/olap/wal/wal_writer.cpp | 6 +-
be/src/pipeline/exec/aggregation_sink_operator.h | 14 +-
be/src/pipeline/exec/aggregation_source_operator.h | 2 +-
be/src/pipeline/exec/analytic_sink_operator.h | 4 -
be/src/pipeline/exec/analytic_source_operator.h | 4 +-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 9 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 2 +-
.../pipeline/exec/multi_cast_data_stream_sink.cpp | 11 -
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 3 +-
.../exec/multi_cast_data_stream_source.cpp | 7 -
.../pipeline/exec/multi_cast_data_stream_source.h | 1 -
be/src/pipeline/exec/multi_cast_data_streamer.cpp | 32 +-
be/src/pipeline/exec/multi_cast_data_streamer.h | 13 +-
be/src/pipeline/exec/set_probe_sink_operator.h | 2 +-
be/src/pipeline/exec/set_sink_operator.h | 2 +-
be/src/pipeline/exec/set_source_operator.cpp | 9 +-
be/src/pipeline/exec/union_source_operator.cpp | 30 +-
be/src/pipeline/exec/union_source_operator.h | 1 -
be/src/pipeline/pipeline_x/dependency.cpp | 6 +-
be/src/pipeline/pipeline_x/dependency.h | 124 +-
.../local_exchange_source_operator.cpp | 14 +-
.../local_exchange_source_operator.h | 1 -
be/src/pipeline/pipeline_x/operator.cpp | 76 +-
be/src/pipeline/pipeline_x/operator.h | 23 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 12 +-
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 20 +-
be/src/pipeline/pipeline_x/pipeline_x_task.h | 26 +-
be/src/pipeline/task_scheduler.cpp | 2 +-
be/src/runtime/fragment_mgr.cpp | 8 +-
be/src/runtime/query_context.cpp | 16 +-
be/src/runtime/query_context.h | 4 +-
be/src/runtime/task_group/task_group.h | 17 +
be/src/runtime/task_group/task_group_manager.cpp | 98 +-
be/src/runtime/task_group/task_group_manager.h | 4 +
be/src/vec/common/hash_table/hash_map.h | 376 +-----
be/src/vec/common/hash_table/hash_map_context.h | 56 +-
.../hash_table/{hash_map.h => join_hash_table.h} | 276 +---
.../vec/common/hash_table/partitioned_hash_map.h | 3 +-
be/src/vec/common/hash_table/string_hash_map.h | 2 +
be/src/vec/data_types/data_type_decimal.cpp | 14 +-
be/src/vec/data_types/data_type_nullable.cpp | 33 +-
be/src/vec/data_types/data_type_number_base.cpp | 15 +-
be/src/vec/data_types/data_type_string.cpp | 14 +-
be/src/vec/exec/join/vhash_join_node.cpp | 2 +-
be/src/vec/exec/vset_operation_node.cpp | 16 +-
be/src/vec/exec/vset_operation_node.h | 21 +-
be/src/vec/functions/function_string.cpp | 6 +
be/src/vec/functions/function_string.h | 332 ++++-
be/src/vec/sink/writer/async_result_writer.cpp | 8 +-
be/test/exec/test_data/wal_scanner/wal | Bin 180 -> 220 bytes
docs/en/docs/admin-manual/config/be-config.md | 2 +-
docs/en/docs/advanced/partition/auto-partition.md | 2 +-
docs/en/docs/install/k8s-deploy/network.md | 377 ++++++
docs/en/docs/install/k8s-deploy/operator-deploy.md | 2 +-
.../docs/install/k8s-deploy/persistent-volume.md | 424 ++++++
.../docs/install/source-install/compilation-arm.md | 502 ++++----
.../sql-functions/string-functions/left.md | 47 -
.../sql-functions/string-functions/right.md | 47 -
.../sql-functions/string-functions/strleft.md | 23 +-
.../sql-functions/string-functions/strright.md | 23 +-
.../sql-functions/string-functions/substr.md | 50 -
.../sql-functions/string-functions/substring.md | 6 +-
.../Load/CREATE-ROUTINE-LOAD.md | 2 +-
.../ADMIN-SET-REPLICA-STATUS.md | 17 +-
docs/sidebars.json | 9 +-
docs/zh-CN/docs/admin-manual/config/be-config.md | 2 +-
.../docs/advanced/partition/auto-partition.md | 2 +-
docs/zh-CN/docs/install/k8s-deploy/network.md | 387 ++++++
.../docs/install/k8s-deploy/operator-deploy.md | 2 +-
.../docs/install/k8s-deploy/persistent-volume.md | 424 ++++++
.../docs/install/source-install/compilation-arm.md | 489 +++----
.../sql-functions/string-functions/left.md | 47 -
.../sql-functions/string-functions/right.md | 47 -
.../sql-functions/string-functions/strleft.md | 23 +-
.../sql-functions/string-functions/strright.md | 23 +-
.../sql-functions/string-functions/substr.md | 50 -
.../sql-functions/string-functions/substring.md | 8 +-
.../Load/CREATE-ROUTINE-LOAD.md | 2 +-
.../ADMIN-SET-REPLICA-STATUS.md | 16 +-
.../main/java/org/apache/doris/common/Config.java | 7 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 12 +-
.../doris/analysis/AdminSetReplicaStatusStmt.java | 4 +-
.../java/org/apache/doris/analysis/Analyzer.java | 2 +
.../java/org/apache/doris/analysis/CaseExpr.java | 14 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 11 +-
.../main/java/org/apache/doris/analysis/Expr.java | 13 +-
.../apache/doris/analysis/ShowBuildIndexStmt.java | 9 +-
.../doris/analysis/ShowReplicaStatusStmt.java | 2 +-
.../java/org/apache/doris/analysis/TypeDef.java | 1 -
.../main/java/org/apache/doris/catalog/Env.java | 5 +
.../org/apache/doris/catalog/MetadataViewer.java | 4 +
.../java/org/apache/doris/catalog/Replica.java | 29 +-
.../main/java/org/apache/doris/catalog/Tablet.java | 2 +-
.../org/apache/doris/clone/TabletSchedCtx.java | 12 +-
.../org/apache/doris/clone/TabletScheduler.java | 7 +-
.../apache/doris/common/proc/ReplicasProcNode.java | 2 +
.../datasource/jdbc/client/JdbcClientConfig.java | 12 +-
.../main/java/org/apache/doris/load/ExportJob.java | 2 +-
.../doris/nereids/analyzer/UnboundRelation.java | 20 +-
.../doris/nereids/jobs/executor/Rewriter.java | 6 +-
.../joinorder/hypergraph/bitmap/LongBitmap.java | 9 +
.../joinorder/hypergraph/node/AbstractNode.java | 40 +-
.../joinorder/hypergraph/node/DPhyperNode.java | 2 +-
.../joinorder/hypergraph/node/StructInfoNode.java | 91 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 19 +-
.../org/apache/doris/nereids/rules/RuleType.java | 4 +-
.../doris/nereids/rules/analysis/BindRelation.java | 19 +-
.../mv/AbstractMaterializedViewAggregateRule.java | 2 +-
.../mv/AbstractMaterializedViewRule.java | 21 +-
.../rules/exploration/mv/ComparisonResult.java | 36 +-
.../rules/exploration/mv/HyperGraphComparator.java | 38 +-
.../nereids/rules/exploration/mv/StructInfo.java | 24 +-
.../rules/implementation/AggregateStrategies.java | 6 +-
.../rules/rewrite/EliminateJoinByUnique.java | 11 +-
.../nereids/rules/rewrite/MergeSetOperations.java | 22 +-
.../rules/rewrite/MergeSetOperationsExcept.java | 64 +
.../rewrite/PushDownTopNDistinctThroughUnion.java | 8 +-
.../trees/expressions/functions/scalar/Array.java | 70 +-
.../trees/expressions/functions/scalar/Left.java | 7 +-
.../trees/expressions/functions/scalar/Right.java | 7 +-
.../expressions/functions/scalar/StrLeft.java | 7 +-
.../expressions/functions/scalar/StrRight.java | 7 +-
.../expressions/functions/scalar/Substring.java | 5 +-
.../plans/commands/info/ColumnDefinition.java | 1 -
.../nereids/trees/plans/logical/LogicalJoin.java | 7 +-
.../trees/plans/logical/LogicalOlapScan.java | 35 +-
.../org/apache/doris/nereids/util/JoinUtils.java | 17 +
.../org/apache/doris/nereids/util/PlanUtils.java | 6 +-
.../doris/nereids/util/TypeCoercionUtils.java | 3 +-
.../org/apache/doris/rewrite/CaseWhenToIf.java | 52 +
.../statistics/ColumnStatisticsCacheLoader.java | 29 +-
.../java/org/apache/doris/system/Diagnoser.java | 5 +-
.../apache/doris/system/FrontendHbResponse.java | 1 -
.../doris/analysis/ShowBuildIndexStmtTest.java | 239 ++++
.../analysis/ShowCreateMaterializedViewTest.java | 93 ++
.../rules/exploration/mv/EliminateJoinTest.java | 97 ++
gensrc/script/doris_builtins_functions.py | 16 +-
.../test_predicate_with_implicit_cast.out | 19 +
.../test_index_compaction_null.out | 1345 ++++++++++++++++++++
.../data/mv_p0/count_star/count_star.out | 32 +
regression-test/data/mv_p0/sum_count/sum_count.out | 61 +
.../data/mv_p0/test_casewhen/test_casewhen.out | 11 +
.../data/nereids_function_p0/scalar_function/R.out | 4 +-
.../data/nereids_function_p0/scalar_function/S.out | 4 +-
.../data/nereids_p0/set_operations/except.out | 148 +++
.../mv/agg_with_roll_up/aggregate_with_roll_up.out | 8 +
.../aggregate_without_roll_up.out | 24 +
.../mv/join/left_outer/outer_join.out | 8 +
.../push_down_top_n_distinct_through_union.out | 138 +-
.../shape/query49.out | 162 +--
.../noStatsRfPrune/query49.out | 168 +--
.../no_stats_shape/query49.out | 168 +--
.../rf_prune/query49.out | 162 +--
.../nereids_tpcds_shape_sf100_p0/shape/query49.out | 162 +--
.../string_functions/test_string_function.out | Bin 3418 -> 4134 bytes
.../data/schema_change_p0/test_partition.out | 14 +
.../test_schema_change_agg_check_all_types.out | 34 +
regression-test/data/statistics/test_select_mv.out | 47 +
.../doris/regression/action/WaitForAction.groovy | 70 +
.../org/apache/doris/regression/suite/Suite.groovy | 5 +
.../framework/src/main/groovy/suite.gdsl | 4 +-
regression-test/pipeline/common/doris-utils.sh | 3 +-
.../test_predicate_with_implicit_cast.groovy | 71 ++
.../datatype_p0/string/test_string_basic.groovy | 29 +
.../test_index_compaction_null.groovy | 305 +++++
.../suites/inverted_index_p0/test_show_data.groovy | 14 +-
.../load_p0/broker_load/ddl/agg_tbl_basic.sql | 4 +-
.../load_p0/broker_load/ddl/dup_tbl_basic.sql | 2 +-
.../load_p0/broker_load/ddl/mow_tbl_basic.sql | 2 +-
.../load_p0/broker_load/ddl/uniq_tbl_basic.sql | 2 +-
.../load_p0/broker_load/test_seq_load.groovy | 2 +-
.../routine_load/ddl/agg_tbl_basic_create.sql | 4 +-
.../routine_load/ddl/dup_tbl_basic_create.sql | 2 +-
.../routine_load/ddl/mow_tbl_basic_create.sql | 2 +-
.../routine_load/ddl/uniq_tbl_basic_create.sql | 2 +-
.../ddl/uniq_tbl_basic_create_sequence.sql | 2 +-
.../stream_load/ddl/agg_tbl_basic_create.sql | 4 +-
.../stream_load/ddl/dup_tbl_basic_create.sql | 2 +-
.../ddl/dup_tbl_basic_create_random_bucket.sql | 2 +-
.../stream_load/ddl/mow_tbl_basic_create.sql | 2 +-
.../stream_load/ddl/uniq_tbl_basic_create.sql | 2 +-
.../ddl/uniq_tbl_basic_create_sequence.sql | 2 +-
.../suites/load_p0/tvf/ddl/agg_tbl_basic_tvf.sql | 4 +-
.../suites/load_p0/tvf/ddl/dup_tbl_basic_tvf.sql | 2 +-
.../suites/load_p0/tvf/ddl/mow_tbl_basic_tvf.sql | 2 +-
.../suites/load_p0/tvf/ddl/uniq_tbl_basic_tvf.sql | 2 +-
.../suites/mv_p0/count_star/count_star.groovy | 77 ++
.../suites/mv_p0/sum_count/sum_count.groovy | 92 ++
.../mv_p0/test_casewhen/test_casewhen.groovy | 41 +
.../suites/nereids_p0/set_operations/except.groovy | 126 ++
.../limit_push_down/order_push_down.groovy | 1 +
.../agg_with_roll_up/aggregate_with_roll_up.groovy | 46 +
.../aggregate_without_roll_up.groovy | 135 +-
.../mv/join/dphyp_outer/outer_join_dphyp.groovy | 2 +-
.../mv/join/left_outer/outer_join.groovy | 118 +-
.../string_functions/test_string_function.groovy | 85 +-
.../test_alter_table_column.groovy | 99 +-
.../suites/schema_change_p0/test_partition.groovy | 68 +
.../test_schema_change_agg_check_all_types.groovy | 215 ++++
.../suites/statistics/test_select_mv.groovy | 97 ++
.../test_set_replica_drop.groovy | 84 ++
214 files changed, 8244 insertions(+), 2557 deletions(-)
copy be/src/vec/common/hash_table/{hash_map.h => join_hash_table.h} (53%)
create mode 100644 docs/en/docs/install/k8s-deploy/network.md
create mode 100644 docs/en/docs/install/k8s-deploy/persistent-volume.md
delete mode 100644
docs/en/docs/sql-manual/sql-functions/string-functions/left.md
delete mode 100644
docs/en/docs/sql-manual/sql-functions/string-functions/right.md
delete mode 100644
docs/en/docs/sql-manual/sql-functions/string-functions/substr.md
create mode 100644 docs/zh-CN/docs/install/k8s-deploy/network.md
create mode 100644 docs/zh-CN/docs/install/k8s-deploy/persistent-volume.md
delete mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/string-functions/left.md
delete mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/string-functions/right.md
delete mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/string-functions/substr.md
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/MergeSetOperationsExcept.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/rewrite/CaseWhenToIf.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/ShowBuildIndexStmtTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/ShowCreateMaterializedViewTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/exploration/mv/EliminateJoinTest.java
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_predicate_with_implicit_cast.out
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/test_index_compaction_null.out
create mode 100644 regression-test/data/mv_p0/count_star/count_star.out
create mode 100644 regression-test/data/mv_p0/sum_count/sum_count.out
create mode 100644 regression-test/data/mv_p0/test_casewhen/test_casewhen.out
create mode 100644 regression-test/data/nereids_p0/set_operations/except.out
create mode 100644 regression-test/data/schema_change_p0/test_partition.out
create mode 100644
regression-test/data/schema_change_p0/test_schema_change_agg_check_all_types.out
create mode 100644 regression-test/data/statistics/test_select_mv.out
create mode 100644
regression-test/framework/src/main/groovy/org/apache/doris/regression/action/WaitForAction.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_predicate_with_implicit_cast.groovy
create mode 100644
regression-test/suites/inverted_index_p0/index_compaction/test_index_compaction_null.groovy
create mode 100644 regression-test/suites/mv_p0/count_star/count_star.groovy
create mode 100644 regression-test/suites/mv_p0/sum_count/sum_count.groovy
create mode 100644
regression-test/suites/mv_p0/test_casewhen/test_casewhen.groovy
create mode 100644
regression-test/suites/nereids_p0/set_operations/except.groovy
create mode 100644
regression-test/suites/schema_change_p0/test_partition.groovy
create mode 100644
regression-test/suites/schema_change_p0/test_schema_change_agg_check_all_types.groovy
create mode 100644 regression-test/suites/statistics/test_select_mv.groovy
create mode 100644
regression-test/suites/tablet_scheduler_p2/test_set_replica_drop.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
