This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 41e31ee333a creat hdfs fs with it's resource id (#31505)
new 37590f17782 Make sure external table fetched dbId before call
getRowCount. (#31379)
new 7b3377d4740 [fix](Nereids) let with methods of plans use correct
logical properties (#31447)
new 2f6251ccdea [pipelineX](refactor) remove source state from operator
functions (#31435)
new 747faeed173 [Enhancement](group commit) optimize some group commit
code (#31392)
new 47d112e4e6e [fix](MySQL) implement `SHOW CHARSET` statement. (#31389)
new 9ffcf48cce1 [enhancement](Nereids) Support show process time and
process steps by explain statement (#31339)
new c0754583cbb [opt](plsql) Fix procedure key compatibility (#31445)
new a371a106034 [fix](Nereids) let time type coercion same with legacy
planner (#31472)
new 04de7aed404 [fix](case) fix testcase test_decimal256_index #31486
new 7f566f93650 Reset report_workload_runtime_status to optional (#31479)
new 3acfda413b4 [Chore](function) remove unused check on count function
(#31400)
new ab00c7012b0 [fix] Fix the incorrect class name in the getLogger method
call of MysqlTable. (#31465)
new e86cc7e8e8b [chore](log) reduce a lot inject debug point log #31474
new c5e6e3d45fc [fix](docs)Correcting spelling errors,add isolated file to
siderbars. (#31409)
new 5824f8a4bc2 [Feat](nereids) support multi-leading (#30379)
new 5bbe9f7b406 Fix replay binlog gc when not found db binlog (#31463)
new d0a8a309980 [improvement](iceberg/paimon)add show table stats (#31473)
new f1e14722d83 [docs](docs) Update 2.0.5 Release Note of EN & CN Version
(#31506)
new f18c8534958 [enhance](S3) Init default retry strategy for aws s3 sdk
(#31329)
new 883d022f846 [fix](paimon) fix hadoop.username does not take effect in
paimon catalog (#31478)
new e3f03e10b2a [cases](regression) Add data reliability check meta cases
(#31432)
new 7a42d3b52cb [fix](fe ut) fix TabletRepairAndBalanceTest (#31397)
The 22 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 2 +-
be/src/common/config.cpp | 2 +
be/src/common/config.h | 3 +
be/src/http/action/http_stream.cpp | 17 +-
be/src/http/action/stream_load.cpp | 17 +-
be/src/http/utils.cpp | 2 +-
be/src/http/utils.h | 2 +-
be/src/olap/tablet.cpp | 6 -
be/src/pipeline/exec/aggregation_sink_operator.cpp | 5 +-
be/src/pipeline/exec/aggregation_sink_operator.h | 3 +-
.../pipeline/exec/aggregation_source_operator.cpp | 70 +-
be/src/pipeline/exec/aggregation_source_operator.h | 27 +-
be/src/pipeline/exec/analytic_sink_operator.cpp | 4 +-
be/src/pipeline/exec/analytic_sink_operator.h | 3 +-
be/src/pipeline/exec/analytic_source_operator.cpp | 6 +-
be/src/pipeline/exec/analytic_source_operator.h | 3 +-
be/src/pipeline/exec/assert_num_rows_operator.cpp | 2 +-
be/src/pipeline/exec/assert_num_rows_operator.h | 2 +-
be/src/pipeline/exec/datagen_operator.cpp | 9 +-
be/src/pipeline/exec/datagen_operator.h | 3 +-
.../distinct_streaming_aggregation_operator.cpp | 18 +-
.../exec/distinct_streaming_aggregation_operator.h | 8 +-
be/src/pipeline/exec/empty_set_operator.cpp | 4 +-
be/src/pipeline/exec/empty_set_operator.h | 3 +-
be/src/pipeline/exec/exchange_sink_operator.cpp | 28 +-
be/src/pipeline/exec/exchange_sink_operator.h | 3 +-
be/src/pipeline/exec/exchange_source_operator.cpp | 12 +-
be/src/pipeline/exec/exchange_source_operator.h | 3 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 6 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 3 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 28 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 7 +-
be/src/pipeline/exec/jdbc_table_sink_operator.cpp | 5 +-
be/src/pipeline/exec/jdbc_table_sink_operator.h | 3 +-
be/src/pipeline/exec/join_probe_operator.h | 6 +-
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 9 +-
.../exec/multi_cast_data_stream_source.cpp | 9 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 3 +-
.../exec/nested_loop_join_build_operator.cpp | 4 +-
.../exec/nested_loop_join_build_operator.h | 3 +-
.../exec/nested_loop_join_probe_operator.cpp | 25 +-
.../exec/nested_loop_join_probe_operator.h | 5 +-
be/src/pipeline/exec/olap_table_sink_operator.h | 5 +-
be/src/pipeline/exec/olap_table_sink_v2_operator.h | 5 +-
.../pipeline/exec/partition_sort_sink_operator.cpp | 7 +-
.../pipeline/exec/partition_sort_sink_operator.h | 3 +-
.../exec/partition_sort_source_operator.cpp | 9 +-
.../pipeline/exec/partition_sort_source_operator.h | 3 +-
be/src/pipeline/exec/repeat_operator.cpp | 15 +-
be/src/pipeline/exec/repeat_operator.h | 9 +-
be/src/pipeline/exec/result_file_sink_operator.cpp | 5 +-
be/src/pipeline/exec/result_file_sink_operator.h | 3 +-
be/src/pipeline/exec/result_sink_operator.cpp | 3 +-
be/src/pipeline/exec/result_sink_operator.h | 3 +-
be/src/pipeline/exec/scan_operator.cpp | 12 +-
be/src/pipeline/exec/scan_operator.h | 7 +-
be/src/pipeline/exec/schema_scan_operator.cpp | 9 +-
be/src/pipeline/exec/schema_scan_operator.h | 3 +-
be/src/pipeline/exec/select_operator.h | 4 +-
be/src/pipeline/exec/set_probe_sink_operator.cpp | 4 +-
be/src/pipeline/exec/set_probe_sink_operator.h | 3 +-
be/src/pipeline/exec/set_sink_operator.cpp | 7 +-
be/src/pipeline/exec/set_sink_operator.h | 3 +-
be/src/pipeline/exec/set_source_operator.cpp | 14 +-
be/src/pipeline/exec/set_source_operator.h | 5 +-
be/src/pipeline/exec/sort_sink_operator.cpp | 5 +-
be/src/pipeline/exec/sort_sink_operator.h | 3 +-
be/src/pipeline/exec/sort_source_operator.cpp | 11 +-
be/src/pipeline/exec/sort_source_operator.h | 3 +-
.../exec/streaming_aggregation_operator.cpp | 37 +-
.../pipeline/exec/streaming_aggregation_operator.h | 31 +-
be/src/pipeline/exec/table_function_operator.cpp | 7 +-
be/src/pipeline/exec/table_function_operator.h | 18 +-
be/src/pipeline/exec/union_sink_operator.cpp | 5 +-
be/src/pipeline/exec/union_sink_operator.h | 3 +-
be/src/pipeline/exec/union_source_operator.cpp | 19 +-
be/src/pipeline/exec/union_source_operator.h | 5 +-
.../local_exchange_sink_operator.cpp | 6 +-
.../local_exchange/local_exchange_sink_operator.h | 3 +-
.../local_exchange_source_operator.cpp | 6 +-
.../local_exchange_source_operator.h | 3 +-
.../pipeline_x/local_exchange/local_exchanger.cpp | 59 +-
.../pipeline_x/local_exchange/local_exchanger.h | 35 +-
be/src/pipeline/pipeline_x/operator.cpp | 46 +-
be/src/pipeline/pipeline_x/operator.h | 48 +-
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 16 +-
be/src/runtime/group_commit_mgr.cpp | 3 +
be/src/runtime/runtime_query_statistics_mgr.cpp | 2 +-
be/src/util/s3_util.cpp | 4 +
be/test/http/stream_load_test.cpp | 2 -
docs/en/community/developer-guide/minidump.md | 177 -
docs/en/docs/releasenotes/release-2.0.5.md | 73 +
.../{bitshfitleft.md => bitshiftleft.md} | 0
.../{bitshfitright.md => bitshiftright.md} | 0
.../sql-reference/Show-Statements/SHOW-CHARSET.md | 21 +
.../Show-Statements/SHOW-COLLATION.md | 2 +-
...=> SHOW-CONVERT-LIGHT-SCHEMA-CHANGE-PROCESS.md} | 0
docs/sidebars.json | 36 +-
docs/zh-CN/community/developer-guide/minidump.md | 185 -
docs/zh-CN/docs/releasenotes/release-2.0.5.md | 68 +
.../sql-reference/Show-Statements/SHOW-CHARSET.md | 19 +
.../Show-Statements/SHOW-COLLATION.md | 2 +-
.../java/org/apache/doris/hudi/HudiJniScanner.java | 15 +-
.../src/main/java/org/apache/doris/hudi/Utils.java | 22 +-
.../org/apache/doris/catalog/PrimitiveType.java | 4 +
.../authentication/AuthenticationConfig.java | 8 +-
.../common/security/authentication/HadoopUGI.java | 20 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +
.../org/apache/doris/analysis/ExplainOptions.java | 8 +-
.../apache/doris/analysis/FunctionCallExpr.java | 6 -
.../java/org/apache/doris/analysis/QueryStmt.java | 15 +-
.../org/apache/doris/binlog/BinlogManager.java | 4 +
.../java/org/apache/doris/catalog/MysqlTable.java | 2 +-
.../doris/common/profile/SummaryProfile.java | 29 +-
.../org/apache/doris/common/util/TimeUtils.java | 1 -
.../org/apache/doris/datasource/ExternalTable.java | 8 +
.../datasource/hive/HiveMetaStoreClientHelper.java | 33 +-
.../datasource/iceberg/IcebergExternalTable.java | 12 -
.../datasource/paimon/PaimonExternalCatalog.java | 63 +-
.../paimon/PaimonFileExternalCatalog.java | 1 +
.../apache/doris/fs/remote/dfs/DFSFileSystem.java | 21 +-
.../org/apache/doris/nereids/CascadesContext.java | 53 +
.../org/apache/doris/nereids/NereidsPlanner.java | 94 +-
.../java/org/apache/doris/nereids/PlanProcess.java | 25 +-
.../doris/nereids/glue/LogicalPlanAdapter.java | 9 +-
.../org/apache/doris/nereids/hint/LeadingHint.java | 3 +-
.../jobs/cascades/OptimizeGroupExpressionJob.java | 1 +
.../doris/nereids/jobs/executor/Optimizer.java | 1 +
.../jobs/joinorder/hypergraph/GraphSimplifier.java | 2 +-
.../jobs/joinorder/hypergraph/HyperGraph.java | 2 +-
.../jobs/joinorder/hypergraph/edge/JoinEdge.java | 2 +-
.../hypergraph/receiver/PlanReceiver.java | 2 +-
.../nereids/jobs/rewrite/CustomRewriteJob.java | 19 +-
.../nereids/jobs/rewrite/PlanTreeRewriteJob.java | 27 +-
.../jobs/rewrite/RootPlanTreeRewriteJob.java | 72 +
.../doris/nereids/parser/LogicalPlanBuilder.java | 13 +-
.../nereids/processor/pre/PlanPreprocessors.java | 7 +-
.../processor/pre/PullUpSubqueryAliasToCTE.java | 76 +
.../nereids/rules/analysis/BindExpression.java | 6 +-
.../rules/analysis/EliminateLogicalSelectHint.java | 3 +-
.../doris/nereids/rules/analysis/LeadingJoin.java | 14 +-
.../nereids/rules/analysis/SubqueryToApply.java | 2 +-
.../rules/exploration/join/InnerJoinLAsscom.java | 8 +-
.../exploration/join/InnerJoinLAsscomProject.java | 4 +-
.../exploration/join/InnerJoinLeftAssociate.java | 8 +-
.../join/InnerJoinLeftAssociateProject.java | 4 +-
.../exploration/join/InnerJoinRightAssociate.java | 8 +-
.../join/InnerJoinRightAssociateProject.java | 8 +-
.../rules/exploration/join/JoinCommute.java | 5 +-
.../rules/exploration/join/JoinExchange.java | 29 +-
.../exploration/join/JoinExchangeBothProject.java | 11 +-
.../exploration/join/JoinExchangeLeftProject.java | 20 +-
.../exploration/join/JoinExchangeRightProject.java | 10 +-
.../rules/exploration/join/JoinReorderContext.java | 12 +
.../join/LogicalJoinSemiJoinTranspose.java | 8 +-
.../join/LogicalJoinSemiJoinTransposeProject.java | 8 +-
.../rules/exploration/join/OuterJoinAssoc.java | 4 +-
.../exploration/join/OuterJoinAssocProject.java | 4 +-
.../rules/exploration/join/OuterJoinLAsscom.java | 4 +-
.../exploration/join/OuterJoinLAsscomProject.java | 4 +-
.../join/SemiJoinSemiJoinTranspose.java | 4 +-
.../join/SemiJoinSemiJoinTransposeProject.java | 4 +-
.../rules/expression/ExpressionRewrite.java | 3 +-
.../rules/rewrite/AdjustConjunctsReturnType.java | 2 +-
.../nereids/rules/rewrite/AdjustNullable.java | 3 +-
.../rules/rewrite/ConvertInnerOrCrossJoin.java | 4 +-
.../rules/rewrite/ConvertOuterJoinToAntiJoin.java | 4 +-
.../rules/rewrite/EliminateDedupJoinCondition.java | 3 +-
.../rules/rewrite/EliminateJoinCondition.java | 3 +-
.../nereids/rules/rewrite/EliminateMarkJoin.java | 2 +-
.../nereids/rules/rewrite/EliminateNotNull.java | 3 +-
.../rewrite/EliminateNullAwareLeftAntiJoin.java | 2 +-
.../nereids/rules/rewrite/EliminateOuterJoin.java | 4 +-
.../doris/nereids/rules/rewrite/EliminateSort.java | 2 +
.../nereids/rules/rewrite/ExistsApplyToJoin.java | 8 +-
.../rules/rewrite/ExtractFilterFromCrossJoin.java | 2 +-
.../rules/rewrite/FindHashConditionForJoin.java | 2 +-
.../doris/nereids/rules/rewrite/InApplyToJoin.java | 8 +-
.../doris/nereids/rules/rewrite/OrExpansion.java | 6 +-
.../rules/rewrite/PullUpJoinFromUnionAll.java | 4 +-
.../rules/rewrite/PushDownAliasThroughJoin.java | 3 +-
.../PushDownExpressionsInHashCondition.java | 2 +-
.../rules/rewrite/PushDownFilterThroughJoin.java | 3 +-
.../rules/rewrite/PushDownJoinOtherCondition.java | 2 +-
.../rules/rewrite/PushFilterInsideJoin.java | 2 +-
.../doris/nereids/rules/rewrite/ReorderJoin.java | 10 +-
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 4 +-
.../nereids/rules/rewrite/SemiJoinCommute.java | 3 +-
.../rewrite/TransposeSemiJoinLogicalJoin.java | 1 +
.../TransposeSemiJoinLogicalJoinProject.java | 1 +
.../trees/copier/LogicalPlanDeepCopier.java | 2 +-
.../plans/commands/CreateProcedureCommand.java | 6 +-
.../trees/plans/commands/ExplainCommand.java | 17 +-
.../trees/plans/commands/info/FuncNameInfo.java | 70 +-
.../trees/plans/logical/LogicalCTEConsumer.java | 3 +-
.../trees/plans/logical/LogicalEmptyRelation.java | 2 +-
.../trees/plans/logical/LogicalGenerate.java | 8 +-
.../nereids/trees/plans/logical/LogicalJoin.java | 92 +-
.../trees/plans/logical/LogicalPartitionTopN.java | 3 +-
.../trees/plans/logical/LogicalProject.java | 3 +-
.../trees/plans/logical/LogicalResultSink.java | 2 +-
.../trees/plans/logical/LogicalSelectHint.java | 4 +
.../nereids/trees/plans/logical/LogicalTopN.java | 3 +-
.../nereids/trees/plans/logical/LogicalUnion.java | 5 -
.../nereids/trees/plans/logical/LogicalWindow.java | 3 +-
.../src/main/java/org/apache/doris/plsql/Exec.java | 2 +-
.../plsql/functions/DorisFunctionRegistry.java | 32 +-
.../doris/plsql/functions/FunctionRegistry.java | 2 +
.../plsql/functions/InMemoryFunctionRegistry.java | 5 +
.../apache/doris/plsql/metastore/PlsqlManager.java | 16 +-
.../doris/plsql/metastore/PlsqlMetaClient.java | 59 +-
.../apache/doris/plsql/metastore/PlsqlPackage.java | 12 +-
.../doris/plsql/metastore/PlsqlProcedureKey.java | 28 +-
.../plsql/metastore/PlsqlStoredProcedure.java | 19 +-
.../doris/plsql/packages/DorisPackageRegistry.java | 12 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 4 +
.../java/org/apache/doris/qe/ShowExecutor.java | 26 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 23 +-
.../ExternalFileTableValuedFunction.java | 4 +-
.../analysis/CreateMaterializedViewStmtTest.java | 16 -
.../doris/clone/TabletRepairAndBalanceTest.java | 15 +-
.../org/apache/doris/nereids/memo/MemoTest.java | 21 +-
.../pattern/GroupExpressionMatchingTest.java | 16 +-
.../rules/analysis/BindSlotReferenceTest.java | 6 +-
...ctSingleTableExpressionFromDisjunctionTest.java | 6 +-
.../rewrite/FindHashConditionForJoinTest.java | 4 +-
.../nereids/rules/rewrite/PushDownLimitTest.java | 4 +-
.../doris/nereids/stats/JoinEstimateTest.java | 4 +-
.../doris/nereids/trees/plans/PlanEqualsTest.java | 6 +-
.../nereids/trees/plans/PlanToStringTest.java | 2 +-
.../doris/nereids/util/HyperGraphBuilder.java | 8 +-
.../doris/nereids/util/LogicalPlanBuilder.java | 10 +-
.../org/apache/doris/nereids/util/PlanChecker.java | 2 +-
.../org/apache/doris/planner/QueryPlanTest.java | 6 +-
.../apache/doris/utframe/MockedBackendFactory.java | 7 +-
gensrc/thrift/FrontendService.thrift | 19 +-
regression-test/data/nereids_p0/cte/cte.out | 243 +
.../data/nereids_p0/hint/multi_leading.out | 649 ++
.../data/nereids_p0/hint/test_distribute.out | 10482 +++++++++++++++++++
.../data/nereids_p0/hint/test_leading.out | 24 +-
regression-test/data/nereids_rules_p0/cte/cte.out | 347 +
.../cte/test_cte_filter_pushdown.out | 0
.../cte/test_cte_name_reuse.out | 0
.../data/show_p0/test_show_char_set.out | 4 +
.../suites/data_reliability/check_meta.groovy | 34 +-
.../decimalv3/test_decimal256_index.groovy | 1 +
.../iceberg/test_iceberg_table_stats.groovy | 65 +
.../paimon/test_paimon_table_stats.groovy | 59 +
.../suites/nereids_p0/hint/fix_leading.groovy | 1 +
.../suites/nereids_p0/hint/multi_leading.groovy | 132 +
.../suites/nereids_p0/hint/test_distribute.groovy | 927 ++
.../suites/nereids_p0/hint/test_leading.groovy | 1 +
.../cte/test_cte_filter_pushdown.groovy | 113 +
.../cte/test_cte_name_reuse.groovy | 0
.../cte/test_cte_reuse_with_window.groovy | 0
.../suites/nereids_syntax_p0/type_cast.groovy | 12 +
.../suites/show_p0/test_show_char_set.groovy | 20 +-
258 files changed, 14698 insertions(+), 1493 deletions(-)
delete mode 100644 docs/en/community/developer-guide/minidump.md
create mode 100644 docs/en/docs/releasenotes/release-2.0.5.md
rename
docs/en/docs/sql-manual/sql-functions/bitwise-functions/{bitshfitleft.md =>
bitshiftleft.md} (100%)
rename
docs/en/docs/sql-manual/sql-functions/bitwise-functions/{bitshfitright.md =>
bitshiftright.md} (100%)
rename
docs/en/docs/sql-manual/sql-reference/Show-Statements/{SHOW-CONVERT-LIGHR-SCHEMA-CHANGE-PROCESS.md
=> SHOW-CONVERT-LIGHT-SCHEMA-CHANGE-PROCESS.md} (100%)
delete mode 100644 docs/zh-CN/community/developer-guide/minidump.md
create mode 100644 docs/zh-CN/docs/releasenotes/release-2.0.5.md
copy be/src/pipeline/exec/empty_set_operator.cpp =>
fe/fe-core/src/main/java/org/apache/doris/nereids/PlanProcess.java (64%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/processor/pre/PullUpSubqueryAliasToCTE.java
create mode 100644 regression-test/data/nereids_p0/cte/cte.out
create mode 100644 regression-test/data/nereids_p0/hint/multi_leading.out
create mode 100644 regression-test/data/nereids_p0/hint/test_distribute.out
create mode 100644 regression-test/data/nereids_rules_p0/cte/cte.out
copy regression-test/data/{nereids_p0 =>
nereids_rules_p0}/cte/test_cte_filter_pushdown.out (100%)
copy regression-test/data/{nereids_p0 =>
nereids_rules_p0}/cte/test_cte_name_reuse.out (100%)
create mode 100644 regression-test/data/show_p0/test_show_char_set.out
copy be/src/pipeline/exec/empty_set_operator.cpp =>
regression-test/suites/data_reliability/check_meta.groovy (51%)
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_table_stats.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_table_stats.groovy
create mode 100644 regression-test/suites/nereids_p0/hint/multi_leading.groovy
create mode 100644
regression-test/suites/nereids_p0/hint/test_distribute.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/cte/test_cte_filter_pushdown.groovy
rename regression-test/suites/{nereids_p0 =>
nereids_rules_p0}/cte/test_cte_name_reuse.groovy (100%)
rename regression-test/suites/{nereids_p0 =>
nereids_rules_p0}/cte/test_cte_reuse_with_window.groovy (100%)
copy be/src/pipeline/exec/empty_set_operator.cpp =>
regression-test/suites/show_p0/test_show_char_set.groovy (64%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
