This is an automated email from the ASF dual-hosted git repository. dataroaring pushed a change to branch fix_infinity_partition_key_to_sql in repository https://gitbox.apache.org/repos/asf/doris.git
discard cd22ad1cf0f [fix](catalog) Fix infinity partition key toSql add 2d9d3f79df0 [Bug](runtime-filter) fix publish not inited rf when broadcast join meet wake up by downsteam (#44823) add 3ce581ec0cd [minor](scan) Delete unused function in ScanNode (#44733) add 59ae8003866 [chore](binlog) Save table type in CreateTableRecord (#44735) add 4bd1cc1a01b [Enhancement] (nereids)implement showCreateDatabaseCommand in nereids (#43034) add 70415afa864 [Feat] (Nereids)support showTrash Command (#44684) add b8555c4dfa9 [Enhancement] (nereids)implement showCollationCommand in nereids (#43157) add b49374d30f3 [Enhancement] (nereids)implement showProcessListCommand in nereids (#43158) add 3e41c91246f [feat](Nereids) support refresh database command (#44298) add 2bd293c560a [Enhancement] (nereids)implement CreateSqlBlockCommand and AlterSqlBlockCommand in nereids (#44702) add 7d7f7fec5b3 [Opt](SegmentIterator) clear and release iterators memory footprint in advance when EOF (#44768) add 1abfd10c349 [Fix](Variant) fix some nested explode_variant_array bug and add more test (#44533) add 7526b9c3a3e [fix](inverted index) add a sequence number to an enum variable (#44605) add ed4f7fb5995 [feat](nereids) add rewrite rule :EliminateGroupByKeyByUniform (#43391) add 8514df82ca8 [Bug](runtime-filter) check rf dependency is set and fix wrong throw status (#44838) add fa13a700770 [feat] (inverted index) show index file size (#44120) add b2b0ac76c6c [feat](test) add bloomfilter ut case (#44351) add 334b3435bc9 [Enhancement] (nereids)implement CreateEncryptKeyCommand in nereids (#44807) add 54fe0b463a9 [Enhancement] (nereids)implement CreateRoleCommand in nereids (#44814) add 53ea2a0a1d1 [fix](coordinator) fix NereidsCoordinator can not interrupt query in fe (#44795) add 2cde7b0839d [fix](nereids) fix NereidsCoordinator compute wrong result when exists CTE (#44753) add 30b4df9d4f6 [fix](profile) Change the check of whether the username is admin and root to check whether the user specifically corresponds to admin permissions (#41714) add 0995618169d [opt](nereids) remove enable nereids rules usage (#44769) add 6f87e35bced [fix](mtmv) Fix data wrong when query with table operator such as TABLESAMPLE or tablet and so on (#43030) add ce9c7174fb5 [fix](auth) Prohibit deleting admin user (#44751) add 70b0a08815b [fix](nereids) fix merge_percentile_to_array when has same agg function (#44783) add 21e1d6d8a7c [fix](logstash) remove ShortNameResolver to solve thread race problem (#44598) add 171383e4e63 [fix](catalog) Fix infinity partition key toSql This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (cd22ad1cf0f) \ N -- N -- N refs/heads/fix_infinity_partition_key_to_sql (171383e4e63) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: be/src/cloud/cloud_base_compaction.cpp | 5 + be/src/cloud/cloud_cumulative_compaction.cpp | 4 + be/src/cloud/cloud_full_compaction.cpp | 4 + be/src/cloud/cloud_schema_change_job.cpp | 6 + .../exec/schema_scanner/schema_tables_scanner.cpp | 16 +- be/src/exprs/runtime_filter.cpp | 2 +- be/src/exprs/runtime_filter.h | 5 +- be/src/olap/bloom_filter.hpp | 272 ------------ .../rowset/segment_v2/block_split_bloom_filter.h | 1 - be/src/olap/rowset/segment_v2/bloom_filter.h | 2 +- .../segment_v2/bloom_filter_index_reader.cpp | 1 + .../segment_v2/bloom_filter_index_writer.cpp | 29 +- be/src/olap/rowset/segment_v2/segment_iterator.cpp | 8 + be/src/olap/rowset/segment_v2/segment_iterator.h | 2 + be/src/olap/tablet.cpp | 4 + be/src/olap/tablet_manager.cpp | 4 + be/src/olap/tablet_meta.h | 46 ++ be/src/pipeline/exec/hashjoin_build_sink.cpp | 39 +- be/src/vec/exprs/table_function/vexplode.cpp | 40 +- be/src/vec/exprs/table_function/vexplode.h | 1 + .../array/function_array_contains_all.cpp | 5 +- .../vec/functions/array/function_array_distance.h | 4 +- .../vec/functions/array/function_array_utils.cpp | 13 +- be/src/vec/functions/array/function_array_utils.h | 6 +- be/test/olap/bloom_filter_test.cpp | 160 ------- .../bloom_filter_index_reader_writer_test.cpp | 485 ++++++++++++++++++++- cloud/src/meta-service/keys.cpp | 8 + cloud/src/meta-service/keys.h | 6 + cloud/src/meta-service/meta_service.cpp | 2 + cloud/src/meta-service/meta_service_job.cpp | 22 +- .../src/meta-service/meta_service_tablet_stats.cpp | 111 ++++- cloud/src/meta-service/meta_service_tablet_stats.h | 2 + cloud/src/meta-service/meta_service_txn.cpp | 26 +- cloud/src/meta-service/txn_lazy_committer.cpp | 4 +- cloud/test/http_encode_key_test.cpp | 32 +- cloud/test/keys_test.cpp | 34 ++ cloud/test/meta_service_http_test.cpp | 14 + cloud/test/meta_service_job_test.cpp | 60 ++- cloud/test/meta_service_test.cpp | 24 + cloud/test/schema_kv_test.cpp | 6 + extension/logstash/lib/logstash/outputs/doris.rb | 50 +-- .../lib/logstash/util/shortname_resolver.rb | 58 --- extension/logstash/logstash-output-doris.gemspec | 1 - .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 25 +- fe/fe-core/src/main/cup/sql_parser.cup | 21 +- .../org/apache/doris/analysis/DropUserStmt.java | 4 +- .../org/apache/doris/analysis/ShowDataStmt.java | 484 +++++++++++--------- .../org/apache/doris/analysis/UserIdentity.java | 4 + .../org/apache/doris/binlog/CreateTableRecord.java | 5 + .../apache/doris/blockrule/SqlBlockRuleMgr.java | 12 +- .../apache/doris/catalog/CloudTabletStatMgr.java | 20 +- .../org/apache/doris/catalog/EncryptKeyHelper.java | 10 +- .../apache/doris/catalog/MaterializedIndex.java | 40 ++ .../java/org/apache/doris/catalog/OlapTable.java | 55 ++- .../java/org/apache/doris/catalog/Replica.java | 19 + .../main/java/org/apache/doris/catalog/Table.java | 3 + .../java/org/apache/doris/catalog/TableIf.java | 2 + .../org/apache/doris/catalog/TabletStatMgr.java | 17 +- .../org/apache/doris/datasource/ExternalTable.java | 5 + .../httpv2/rest/manager/QueryProfileAction.java | 2 +- .../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 6 + .../org/apache/doris/mysql/privilege/Auth.java | 4 + .../doris/nereids/jobs/executor/Rewriter.java | 2 + .../doris/nereids/parser/LogicalPlanBuilder.java | 113 ++++- .../apache/doris/nereids/properties/DataTrait.java | 211 +++++++-- .../org/apache/doris/nereids/rules/RuleType.java | 7 + .../doris/nereids/rules/analysis/BindRelation.java | 4 + .../mv/InitMaterializationContextHook.java | 5 + .../exploration/mv/MaterializedViewUtils.java | 20 +- .../nereids/rules/exploration/mv/StructInfo.java | 7 + .../rules/expression/ExpressionRewrite.java | 2 +- .../rewrite/EliminateGroupByKeyByUniform.java | 148 +++++++ .../nereids/rules/rewrite/ExprIdRewriter.java | 284 ++++++++++++ .../rules/rewrite/MergePercentileToArray.java | 26 +- .../nereids/rules/rewrite/PruneEmptyPartition.java | 7 +- .../nereids/rules/rewrite/PruneOlapScanTablet.java | 6 +- .../rules/rewrite/PushDownAggThroughJoin.java | 10 - .../rewrite/PushDownAggThroughJoinOneSide.java | 10 - .../rules/rewrite/PushDownDistinctThroughJoin.java | 7 - .../apache/doris/nereids/trees/plans/PlanType.java | 9 + .../plans/commands/AlterSqlBlockRuleCommand.java | 87 ++++ ...erCommand.java => CreateEncryptkeyCommand.java} | 62 +-- ...DropRoleCommand.java => CreateRoleCommand.java} | 42 +- .../plans/commands/CreateSqlBlockRuleCommand.java | 99 +++++ .../trees/plans/commands/DropRoleCommand.java | 4 - .../trees/plans/commands/DropUserCommand.java | 4 +- .../trees/plans/commands/ShowCollationCommand.java | 89 ++++ .../plans/commands/ShowCreateDatabaseCommand.java | 122 ++++++ .../plans/commands/ShowProcessListCommand.java | 131 ++++++ .../trees/plans/commands/ShowTrashCommand.java | 109 +++++ .../trees/plans/commands/SqlBlockRuleCommand.java | 117 +++++ .../trees/plans/commands/info/CreateMTMVInfo.java | 6 +- .../commands/refresh/RefreshDatabaseCommand.java | 149 +++++++ .../nereids/trees/plans/logical/LogicalFilter.java | 7 +- .../nereids/trees/plans/logical/LogicalHaving.java | 7 +- .../nereids/trees/plans/logical/LogicalJoin.java | 34 +- .../trees/plans/logical/LogicalOlapScan.java | 55 ++- .../trees/plans/logical/LogicalProject.java | 14 +- .../trees/plans/logical/LogicalQualify.java | 7 +- .../trees/plans/visitor/CommandVisitor.java | 45 ++ .../apache/doris/nereids/util/ExpressionUtils.java | 11 +- .../java/org/apache/doris/planner/ScanNode.java | 9 - .../org/apache/doris/qe/AbstractJobProcessor.java | 118 +++++ .../java/org/apache/doris/qe/JobProcessor.java | 5 +- .../org/apache/doris/qe/NereidsCoordinator.java | 5 +- .../org/apache/doris/qe/runtime/LoadProcessor.java | 74 +--- .../doris/qe/runtime/PipelineExecutionTask.java | 2 +- .../qe/runtime/PipelineExecutionTaskBuilder.java | 2 +- .../apache/doris/qe/runtime/QueryProcessor.java | 18 +- .../doris/qe/runtime/ThriftPlansBuilder.java | 11 +- .../apache/doris/service/FrontendServiceImpl.java | 1 + .../apache/doris/analysis/ShowDataStmtTest.java | 6 +- .../exploration/mv/MaterializedViewUtilsTest.java | 2 +- .../rewrite/EliminateGroupByKeyByUniformTest.java | 250 +++++++++++ .../rules/rewrite/EliminateGroupByKeyTest.java | 4 +- .../rules/rewrite/PruneOlapScanTabletTest.java | 21 +- .../apache/doris/nereids/sqltest/SqlTestBase.java | 3 + gensrc/proto/cloud.proto | 10 +- gensrc/thrift/BackendService.thrift | 7 +- gensrc/thrift/FrontendService.thrift | 1 + gensrc/thrift/MasterService.thrift | 4 + gensrc/thrift/Types.thrift | 6 +- .../test_nereids_refresh_catalog.out | 24 +- .../data/nereids_p0/show/test_show_collation.out | 5 + .../show/test_show_create_db_nereids.out | 7 + .../nereids_p0/system/test_query_sys_tables.out | 6 +- .../nereids_rules_p0/eager_aggregate/basic.out | 46 +- .../eager_aggregate/basic_one_side.out | 46 +- .../push_down_count_through_join_one_side.out | 472 ++++++++++++++------ .../eager_aggregate/push_down_max_through_join.out | 168 ++++--- .../eager_aggregate/push_down_min_through_join.out | 166 ++++--- .../push_down_sum_through_join_one_side.out | 254 +++++++---- .../eliminate_group_by_key_by_uniform.out | 269 ++++++++++++ .../merge_percentile_to_array.out | 12 + .../push_down_distinct_through_join.out | 11 +- .../data/query_p0/system/test_query_sys_tables.out | 6 +- regression-test/data/variant_p0/nested.out | 20 + .../org/apache/doris/regression/suite/Suite.groovy | 16 + .../suites/account_p0/test_system_user.groovy | 28 +- .../test_nereids_refresh_catalog.groovy | 28 +- .../test_http_permissions_check_auth.groovy | 66 +++ .../show_data/test_show_index_data.groovy | 399 +++++++++++++++++ .../show_data/test_show_index_data_p2.groovy | 397 +++++++++++++++++ .../ddl/account/test_nereids_role.groovy | 4 +- .../nereids_p0/ddl/alter/test_nereids_role.groovy | 66 --- .../ddl/show_trash/test_nereids_trash.groovy | 13 +- .../nereids_p0/show/test_show_collation.groovy | 20 +- .../show/test_show_create_db_nereids.groovy | 42 ++ .../show/test_show_process_list_command.groovy | 19 +- .../nereids_p0/test_nereids_encrypt_test.groovy | 2 +- .../push_down_count_through_join_one_side.groovy | 1 - .../eliminate_group_by_key_by_uniform.groovy | 221 ++++++++++ .../merge_percentile_to_array.groovy | 4 + .../aggregate_without_roll_up.groovy | 6 +- .../mv/is_in_debug_mode/is_in_debug_mode.groovy | 156 +++++++ .../with_table_operator/with_table_operator.groovy | 195 +++++++++ .../push_down_limit_distinct_through_join.groovy | 1 - .../distribute/test_multicast_sink.groovy | 60 +++ .../constraints/query23.groovy | 1 - .../tpcds_sf100/constraints/query23.groovy | 1 - .../sql_block_rule_p0/test_sql_block_rule.groovy | 11 +- regression-test/suites/variant_p0/nested.groovy | 53 ++- 162 files changed, 6670 insertions(+), 1652 deletions(-) delete mode 100644 be/src/olap/bloom_filter.hpp delete mode 100644 be/test/olap/bloom_filter_test.cpp delete mode 100644 extension/logstash/lib/logstash/util/shortname_resolver.rb create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/EliminateGroupByKeyByUniform.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/ExprIdRewriter.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AlterSqlBlockRuleCommand.java copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropUserCommand.java => CreateEncryptkeyCommand.java} (51%) copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropRoleCommand.java => CreateRoleCommand.java} (64%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CreateSqlBlockRuleCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowCollationCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowCreateDatabaseCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowProcessListCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowTrashCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/SqlBlockRuleCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/refresh/RefreshDatabaseCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/qe/AbstractJobProcessor.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/EliminateGroupByKeyByUniformTest.java create mode 100644 regression-test/data/nereids_p0/show/test_show_collation.out create mode 100644 regression-test/data/nereids_p0/show/test_show_create_db_nereids.out create mode 100644 regression-test/data/nereids_rules_p0/eliminate_gby_key/eliminate_group_by_key_by_uniform.out copy fe/fe-core/src/main/java/org/apache/doris/qe/JobProcessor.java => regression-test/suites/account_p0/test_system_user.groovy (67%) create mode 100644 regression-test/suites/http_auth_check/test_http_permissions_check_auth.groovy create mode 100644 regression-test/suites/inverted_index_p1/show_data/test_show_index_data.groovy create mode 100644 regression-test/suites/inverted_index_p2/show_data/test_show_index_data_p2.groovy delete mode 100644 regression-test/suites/nereids_p0/ddl/alter/test_nereids_role.groovy copy fe/fe-core/src/main/java/org/apache/doris/qe/JobProcessor.java => regression-test/suites/nereids_p0/ddl/show_trash/test_nereids_trash.groovy (74%) copy fe/fe-core/src/main/java/org/apache/doris/qe/JobProcessor.java => regression-test/suites/nereids_p0/show/test_show_collation.groovy (68%) create mode 100644 regression-test/suites/nereids_p0/show/test_show_create_db_nereids.groovy copy fe/fe-core/src/main/java/org/apache/doris/qe/JobProcessor.java => regression-test/suites/nereids_p0/show/test_show_process_list_command.groovy (62%) create mode 100644 regression-test/suites/nereids_rules_p0/eliminate_gby_key/eliminate_group_by_key_by_uniform.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/is_in_debug_mode/is_in_debug_mode.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/with_table_operator/with_table_operator.groovy create mode 100644 regression-test/suites/nereids_syntax_p0/distribute/test_multicast_sink.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org