This is an automated email from the ASF dual-hosted git repository. caiconghui pushed a change to branch transaction_quota in repository https://gitbox.apache.org/repos/asf/doris.git
discard e3cd997fc9c [enhancement](transatcion) show more details about transaction num when execute show data stmt add 43fb17e0ae2 [feature](merge-cloud) Refactor Compaction (#30839) add bc07c1a7a80 [fix](merge-cloud) Fix CloudInternalCatalog forget register a subtype (#30902) add add601e2b60 [fix](group_commit)Add bounds checking when reading wal file on group commit (#30940) add 18d1a5b12ca [enhancement](schema change) some types changes (#30919) add e9da7312194 [fix][security]security optimize for executable binary file doris_cloud access should be restricted (#30944) add 5e0dc0c9341 [fix](nereids)aggregate function cannot contain aggregate parameters (#30928) add 2e301202973 [fix](gc) fix a core introduced by #30854 (#30932) add 5f8d4530ba9 opt the rf code and remove rf unless code (#30861) add b739fcd8dfb [fix](group_commit) Wal file should be removed from _wal_path_map when renaming it to tmp directory (#30974) add 0cfc6cec01d [fix](ci) Disable MOR and memtable on sink node for cloud ci (#30968) add bb6e9e36d5f [fix](pipeline) Set the flag of short circuit only when hash join sink finished (#30977) add 900382e02e0 [fix](nereids)should not infer predicate for nullaware anti-join (#30924) add 89a44aadb24 [test](mtmv) Add mtmv increment create case (#30751) add 6e97f2d68cb Alter workload group queue prop sync for regression test (#30869) add 9f843c02b4b [feature](StoragePolicy) Add one http action to add storage policy back (#30879) add 75eaa1f4541 [fix](test) Increase the timeout duration for the test case (#30952) add bde0509772a [improvement](group_commit) Rename fail wal to tmp should only use in test P0 scenario (#30959) add 7ecfda572a6 [improvement](group_commit) Add bvar to monitor the count of replaying wal fail on group commit (#30941) add f26c8c2f06b [enhancement](stmt-forward) record query result for proxy query to avoid EOF (#30536) add 20186b31f45 [enhancement](mysql-channel) avoid potential buffer overflow when flushing send buffer occurs IOE (#30868) add 47ea3ea3909 [feat](fe) Show db total size and recycle bin size with `ShowDataStmt` (#30663) add 06e08fcec51 [chore](profile) Move DLLVM_PROFILE into service/CMakeLists.txt (#30705) add ebab3f5442b [fix](Docs) fix dev-prepare doc #30923 add 42bb263fe83 [fix](regex) fix wrong escape of function LIKE (#30557) add 19600673ebb [fix](nereids) collect all correlated slots from subquery in correct way (#30908) add e337b7cbb06 [improvement](memtracker) should counter memory usage to query when exchange sink buffer rpc (#30964) add f92081d5188 [feature](window-func) support percent_rank window function (#30926) add 9fa271a2993 [fix](cloud_p0) disable two phase read opt for cloud p0 (#30979) add fb406cc1885 [Feature](executor)Support ShowProcessStmt Show all Fe connection (#30907) add c6eb57cf083 [test](mtmv) Add materialized view which contain external table rewrite test (#30975) add bf4b5e5448d [enhancement](transatcion) show more details about transaction num when execute show data stmt add 02011c65526 fix This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (e3cd997fc9c) \ N -- N -- N refs/heads/transaction_quota (02011c65526) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: be/CMakeLists.txt | 2 +- be/src/common/config.cpp | 1 + be/src/common/config.h | 1 + be/src/common/status.h | 2 +- be/src/exec/data_sink.cpp | 4 + be/src/exprs/runtime_filter.cpp | 110 ++- be/src/exprs/runtime_filter.h | 20 +- be/src/exprs/runtime_filter_slots.h | 5 +- be/src/http/action/compaction_action.cpp | 21 +- be/src/olap/base_compaction.cpp | 31 +- be/src/olap/base_compaction.h | 20 +- be/src/olap/base_tablet.cpp | 4 +- be/src/olap/cold_data_compaction.cpp | 53 +- be/src/olap/cold_data_compaction.h | 17 +- be/src/olap/compaction.cpp | 988 +++++++++------------ be/src/olap/compaction.h | 122 +-- be/src/olap/cumulative_compaction.cpp | 89 +- be/src/olap/cumulative_compaction.h | 21 +- be/src/olap/full_compaction.cpp | 60 +- be/src/olap/full_compaction.h | 23 +- be/src/olap/merger.cpp | 100 ++- be/src/olap/merger.h | 28 +- be/src/olap/olap_server.cpp | 30 +- be/src/olap/rowset/rowset.cpp | 16 + be/src/olap/rowset/rowset.h | 3 + be/src/olap/rowset/segcompaction.cpp | 8 +- be/src/olap/schema_change.cpp | 2 +- be/src/olap/single_replica_compaction.cpp | 53 +- be/src/olap/single_replica_compaction.h | 20 +- be/src/olap/snapshot_manager.cpp | 17 - be/src/olap/storage_engine.cpp | 2 +- be/src/olap/tablet.cpp | 20 +- be/src/olap/tablet.h | 11 +- be/src/olap/txn_manager.cpp | 4 +- be/src/olap/txn_manager.h | 2 +- be/src/olap/wal/wal_info.cpp | 2 +- be/src/olap/wal/wal_info.h | 4 +- be/src/olap/wal/wal_manager.cpp | 9 + be/src/olap/wal/wal_reader.cpp | 14 +- be/src/olap/wal/wal_table.cpp | 26 +- be/src/pipeline/exec/analytic_source_operator.cpp | 4 +- be/src/pipeline/exec/datagen_operator.cpp | 8 +- be/src/pipeline/exec/exchange_sink_buffer.cpp | 9 + be/src/pipeline/exec/exchange_sink_buffer.h | 1 + be/src/pipeline/exec/hashjoin_build_sink.cpp | 2 +- be/src/pipeline/pipeline_task.cpp | 1 - be/src/pipeline/pipeline_task.h | 2 + be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 1 - be/src/pipeline/task_scheduler.cpp | 9 +- be/src/runtime/fragment_mgr.cpp | 10 +- be/src/runtime/runtime_filter_mgr.cpp | 69 +- be/src/runtime/runtime_filter_mgr.h | 10 +- be/src/service/CMakeLists.txt | 3 + .../aggregate_function_window.cpp | 2 + .../aggregate_function_window.h | 59 +- be/src/vec/core/sort_cursor.h | 2 +- be/src/vec/exec/format/wal/wal_reader.cpp | 12 +- be/src/vec/exec/format/wal/wal_reader.h | 1 + be/src/vec/exec/join/vhash_join_node.cpp | 2 +- be/src/vec/exec/runtime_filter_consumer.cpp | 15 +- be/src/vec/exec/vanalytic_eval_node.cpp | 2 +- be/src/vec/exec/vdata_gen_scan_node.cpp | 8 +- be/src/vec/functions/like.cpp | 64 +- .../compaction_delete_bitmap_calculator_test.cpp | 2 +- be/test/olap/cumulative_compaction_policy_test.cpp | 36 - ...mulative_compaction_time_series_policy_test.cpp | 35 - be/test/olap/delta_writer_test.cpp | 1 - .../olap/engine_storage_migration_task_test.cpp | 2 - be/test/olap/memtable_memory_limiter_test.cpp | 1 - be/test/olap/ordered_data_compaction_test.cpp | 9 +- be/test/olap/rowid_conversion_test.cpp | 4 +- be/test/runtime/load_stream_test.cpp | 2 - be/test/vec/olap/vertical_compaction_test.cpp | 20 +- cloud/script/start.sh | 2 + .../developer-guide/mac-dev/dev-prepare.md | 5 +- .../window-function-percent-rank.md | 128 +++ .../sql-reference/Show-Statements/SHOW-DATA.md | 28 +- docs/sidebars.json | 2 + .../developer-guide/mac-dev/dev-prepare.md | 5 +- .../window-function-percent-rank.md | 128 +++ .../sql-reference/Show-Statements/SHOW-DATA.md | 28 +- .../main/java/org/apache/doris/common/Config.java | 4 + .../org/apache/doris/analysis/CreateTableStmt.java | 6 + .../org/apache/doris/analysis/ShowDataStmt.java | 88 ++ .../apache/doris/analysis/ShowProcesslistStmt.java | 24 +- .../doris/catalog/BuiltinWindowFunctions.java | 2 + .../apache/doris/catalog/CatalogRecycleBin.java | 39 + .../java/org/apache/doris/catalog/Database.java | 20 +- .../java/org/apache/doris/catalog/FunctionSet.java | 16 + .../cloud/common/util/CloudPropertyAnalyzer.java | 4 +- .../apache/doris/common/util/PropertyAnalyzer.java | 4 + .../doris/httpv2/controller/SessionController.java | 3 +- .../httpv2/restv2/AddStoragePolicyAction.java | 89 ++ .../java/org/apache/doris/mysql/MysqlChannel.java | 22 +- .../org/apache/doris/mysql/ProxyMysqlChannel.java | 40 +- .../nereids/rules/analysis/NormalizeAggregate.java | 6 + .../rules/analysis/WindowFunctionChecker.java | 13 + .../nereids/rules/rewrite/InferPredicates.java | 1 - .../expressions/functions/window/PercentRank.java | 61 ++ .../expressions/visitor/WindowFunctionVisitor.java | 5 + .../trees/plans/commands/info/CreateTableInfo.java | 6 + .../java/org/apache/doris/nereids/util/Utils.java | 21 +- .../org/apache/doris/persist/gson/GsonUtils.java | 9 + .../java/org/apache/doris/policy/PolicyMgr.java | 28 + .../java/org/apache/doris/qe/ConnectContext.java | 17 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 14 +- .../java/org/apache/doris/qe/ConnectScheduler.java | 11 + .../java/org/apache/doris/qe/MasterOpExecutor.java | 10 +- .../java/org/apache/doris/qe/SessionVariable.java | 12 + .../java/org/apache/doris/qe/ShowExecutor.java | 51 +- .../java/org/apache/doris/qe/StmtExecutor.java | 40 +- .../resource/workloadgroup/WorkloadGroupMgr.java | 4 + .../apache/doris/service/FrontendServiceImpl.java | 18 +- .../apache/doris/statistics/AnalysisManager.java | 2 +- .../org/apache/doris/mysql/MysqlChannelTest.java | 92 ++ gensrc/thrift/FrontendService.thrift | 11 + .../test_null_aware_left_anti_join.out | 2 + .../datatype_p0/decimalv3}/test.csv | 0 .../window_function/window_fn.out | 58 ++ .../conditional_functions/test_query_like.out | 18 + .../nereids_p0/subquery/subquery_unnesting.out | 12 + .../push_down_filter_other_condition.out | 8 - .../external_table/mv_contain_external_table.out | 34 + .../conditional_functions/test_query_like.out | 18 + .../window_functions/test_window_fn.out | 12 + .../window_functions/test_window_function.out | 11 + .../test_schema_change_agg_check_all_types.out | 55 ++ .../org/apache/doris/regression/suite/Suite.groovy | 14 +- .../doris/regression/suite/SuiteCluster.groovy | 5 + .../pipeline/cloud_p0/conf/session_variables.sql | 2 +- .../test_null_aware_left_anti_join.groovy | 8 + .../suites/database_p0/test_alter_db.groovy | 2 +- .../suites/datatype_p0/decimalv3/test_load.groovy | 31 +- .../window_function/window_fn.groovy | 10 + .../suites/nereids_p0/aggregate/aggregate.groovy | 7 + .../conditional_functions/test_query_like.groovy | 7 + .../nereids_p0/subquery/subquery_unnesting.groovy | 1 + .../push_down_filter_other_condition.groovy | 4 - .../mv/availability/grace_period.groovy | 4 +- .../mv_contain_external_table.groovy | 216 +++++ .../cross_join_list_str_increment_create.groovy | 361 ++++++++ .../cross_join_range_date_increment_create.groovy | 356 ++++++++ ...cross_join_range_number_increment_create.groovy | 365 ++++++++ .../full_join_list_str_increment_create.groovy | 360 ++++++++ .../full_join_range_date_increment_create.groovy | 351 ++++++++ .../full_join_range_number_increment_create.groovy | 360 ++++++++ .../inner_join_list_str_increment_create.groovy | 375 ++++++++ .../inner_join_range_date_increment_create.groovy | 366 ++++++++ ...inner_join_range_number_increment_create.groovy | 376 ++++++++ ...left_anti_join_list_str_increment_create.groovy | 334 +++++++ ...ft_anti_join_range_date_increment_create.groovy | 325 +++++++ ..._anti_join_range_number_increment_create.groovy | 331 +++++++ .../left_join_list_str_increment_create.groovy | 334 +++++++ .../left_join_range_date_increment_create.groovy | 325 +++++++ .../left_join_range_number_increment_create.groovy | 331 +++++++ ...left_semi_join_list_str_increment_create.groovy | 334 +++++++ ...ft_semi_join_range_date_increment_create.groovy | 325 +++++++ ..._semi_join_range_number_increment_create.groovy | 331 +++++++ ...ight_anti_join_list_str_increment_create.groovy | 353 ++++++++ ...ht_anti_join_range_date_increment_create.groovy | 344 +++++++ ..._anti_join_range_number_increment_create.groovy | 353 ++++++++ .../right_join_list_str_increment_create.groovy | 375 ++++++++ .../right_join_range_date_increment_create.groovy | 366 ++++++++ ...right_join_range_number_increment_create.groovy | 375 ++++++++ ...ight_semi_join_list_str_increment_create.groovy | 352 ++++++++ ...ht_semi_join_range_date_increment_create.groovy | 344 +++++++ ..._semi_join_range_number_increment_create.groovy | 353 ++++++++ .../self_conn_list_str_increment_create.groovy | 343 +++++++ .../self_conn_range_date_increment_create.groovy | 334 +++++++ .../self_conn_range_number_increment_create.groovy | 344 +++++++ .../conditional_functions/test_query_like.groovy | 7 + .../window_functions/test_window_fn.groovy | 3 + .../window_functions/test_window_function.groovy | 2 + .../suites/query_p0/test_forward_qeury.groovy | 52 ++ .../test_schema_change_agg_check_all_types.groovy | 64 ++ .../suites/show_p0/test_show_data.groovy | 31 +- .../workload_manager_p0/test_curd_wlg.groovy | 6 +- 177 files changed, 13278 insertions(+), 1394 deletions(-) create mode 100644 docs/en/docs/sql-manual/sql-functions/window-functions/window-function-percent-rank.md create mode 100644 docs/zh-CN/docs/sql-manual/sql-functions/window-functions/window-function-percent-rank.md create mode 100644 fe/fe-core/src/main/java/org/apache/doris/httpv2/restv2/AddStoragePolicyAction.java copy be/src/olap/wal/wal_info.h => fe/fe-core/src/main/java/org/apache/doris/mysql/ProxyMysqlChannel.java (58%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/window/PercentRank.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mysql/MysqlChannelTest.java copy regression-test/{suites/datatype_p0/decimalv3/test_data => data/datatype_p0/decimalv3}/test.csv (100%) create mode 100644 regression-test/data/nereids_rules_p0/mv/external_table/mv_contain_external_table.out create mode 100644 regression-test/suites/nereids_rules_p0/mv/external_table/mv_contain_external_table.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/cross_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/cross_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/cross_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/full_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/full_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/full_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/inner_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/inner_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/inner_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_anti_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_anti_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_anti_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_semi_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_semi_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/left_semi_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_anti_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_anti_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_anti_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_semi_join_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_semi_join_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/right_semi_join_range_number_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/self_conn_list_str_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/self_conn_range_date_increment_create.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/increment_create/self_conn_range_number_increment_create.groovy create mode 100644 regression-test/suites/query_p0/test_forward_qeury.groovy copy be/src/olap/wal/wal_info.h => regression-test/suites/show_p0/test_show_data.groovy (60%) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org