This is an automated email from the ASF dual-hosted git repository. jacktengg pushed a change to branch spill_and_reserve in repository https://gitbox.apache.org/repos/asf/doris.git
omit 9f4c269d3fd fix bug time omit 3020eb00be6 [feat] reserve memory separately for sink and source operators (#41706) omit 4067c828022 [improvement] add detailed paused information in log omit 4eb45a884ac [feat]reserve and spill add 82eaba82310 [Fix](bug) Is null predicate get error query result (#41668) add 9f55836a603 [opt](index compaction)Use RAM dir to create tmp index_writer (#41371) add 46d6f6f9ef4 [extension](kettle) add kettle plugins to write doris (#41295) add 1b4cf4c9297 [fix](bloom filter)Fix drop column with bloom filter (#41369) add 0739991eb7e [Improvement](runtime-filter) set some rf brpc request to ignore_eovercrowded (#41698) add 2745e044e54 [fix](mtmv) Fix enable_materialized_view_nest_rewrite session variable is useless in some scene (#41472) add 0fdb1ee0825 [fix](mtmv) Disable sql_limit variable when query rewrite by materialize view (#40106) add f79692ee5aa [Fix](compile) Fix control reaches end of non-void function (#41692) add 5dbbdacd2bb Revert "[feature](nereids) extend infer predicates (#40878)" (#41696) add 6ed0bc813c4 [enhance](auth) Optimize the authentication logic of Ranger Doris (#41207) add 8278b16b934 [enhance](mtmv)Provide a method to determine whether incremental updates of multiple tables are allowed (#41691) add df3a3ab41ee [enhancement](sequence col) add session variable to skip sequence column check while INSERT INTO (#41655) add a977f356156 [fix](regression-test) Multi threaded testing (#39617) add 68b5bd7bec5 [enhancement](err-msg) Output column info when size invalid in block data convertor (#41535) add 8be40e27a8b [Bug](runtime-filter) send ignored rf when hash join build closed early (#41667) add a4ed2002ac1 [fix](heartbeat) fill default value for required field in TFrontendPingFrontendResult (#41609) add ce595c27c54 [fix](serde)fix the bug in DataTypeNullableSerDe.deserialize_column_from_fixed_json (#41217) add 334b473deb5 [feat](job)Implementing Job in Nereids (#41391) add 1e7275530fd [fix](followup) Stop tasks if waken by downstream tasks (#41628) add a2f2854b99b [chore](Variant) forbid variant type as hash join key (#41673) add 0d07e3d17ee [fix](mtmv) Fix written by mv successfully but not get mv lock. If use mv, data maybe wrong (#40173) add e6607b83d12 [fix](regression-test) fix flaky case test_partial_update_compaction_with_higher_version (#41717) add 4c74406734a [opt](memory) Support Memory Profile (#41310) add 02c671bd755 [fix](pipeline) Prevent re-scheduling a task at the same time (#41743) add 03162f73d76 [Bug](materialized-view) Fixed the problem of using drop table force and create mv stmt at the⦠(#41580) add d2d892b7615 [Fix]count tablet meta's static memory load from disk (#41429) add cce54255d05 [followup](memory) Block should be moved by hash shuffling (#41740) add a549f8c7411 [improvement](jdbc catalog) Print more errors when Jdbc Catalog fails to obtain a connection on FE (#41735) add 9b9dd36d1ab [fix](case) fix group commit case (#41755) new 4693c6f93e9 [feat]reserve and spill new e2a2ef852c9 [improvement] add detailed paused information in log new 9fc0b9c4462 [feat] reserve memory separately for sink and source operators (#41706) new 884821397b1 fix bug time This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (9f4c269d3fd) \ N -- N -- N refs/heads/spill_and_reserve (884821397b1) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: be/src/common/config.cpp | 7 +- be/src/common/config.h | 5 +- be/src/common/daemon.cpp | 30 +- be/src/exec/olap_common.h | 28 +- be/src/exprs/runtime_filter.cpp | 15 +- be/src/exprs/runtime_filter.h | 7 - be/src/exprs/runtime_filter_slots.h | 12 +- be/src/http/default_path_handlers.cpp | 155 ++--- be/src/olap/metadata_adder.h | 227 ++++++ be/src/olap/partial_update_info.h | 1 + be/src/olap/rowset/beta_rowset_writer.cpp | 2 +- be/src/olap/rowset/rowset_meta.cpp | 7 + be/src/olap/rowset/rowset_meta.h | 5 +- be/src/olap/rowset/segcompaction.cpp | 12 +- be/src/olap/rowset/segcompaction.h | 2 +- .../olap/rowset/segment_v2/bitmap_index_reader.h | 2 +- .../segment_v2/bloom_filter_index_reader.cpp | 6 + .../rowset/segment_v2/bloom_filter_index_reader.h | 4 +- be/src/olap/rowset/segment_v2/column_reader.cpp | 13 +- be/src/olap/rowset/segment_v2/column_reader.h | 4 +- be/src/olap/rowset/segment_v2/index_page.cpp | 9 + be/src/olap/rowset/segment_v2/index_page.h | 6 +- .../rowset/segment_v2/indexed_column_reader.cpp | 12 +- .../olap/rowset/segment_v2/indexed_column_reader.h | 4 +- .../segment_v2/inverted_index_compaction.cpp | 11 +- .../olap/rowset/segment_v2/inverted_index_reader.h | 3 +- .../olap/rowset/segment_v2/ordinal_page_index.cpp | 21 +- be/src/olap/rowset/segment_v2/ordinal_page_index.h | 4 +- be/src/olap/rowset/segment_v2/segment.cpp | 18 +- be/src/olap/rowset/segment_v2/segment.h | 4 +- be/src/olap/rowset/segment_v2/zone_map_index.cpp | 17 +- be/src/olap/rowset/segment_v2/zone_map_index.h | 5 +- be/src/olap/tablet_meta.cpp | 3 +- be/src/olap/tablet_meta.h | 3 +- be/src/olap/tablet_schema.cpp | 17 +- be/src/olap/tablet_schema.h | 10 +- be/src/olap/task/engine_publish_version_task.cpp | 13 +- be/src/pipeline/common/runtime_filter_consumer.cpp | 1 - be/src/pipeline/common/runtime_filter_consumer.h | 1 - be/src/pipeline/exec/exchange_sink_operator.cpp | 16 +- be/src/pipeline/exec/hashjoin_build_sink.cpp | 33 +- be/src/pipeline/exec/multi_cast_data_stream_sink.h | 15 +- be/src/pipeline/exec/operator.h | 2 + be/src/pipeline/pipeline.cpp | 8 +- be/src/pipeline/pipeline_fragment_context.cpp | 3 +- be/src/pipeline/pipeline_task.cpp | 27 +- be/src/runtime/exec_env.h | 4 + be/src/runtime/exec_env_init.cpp | 4 + be/src/runtime/group_commit_mgr.cpp | 1 - be/src/runtime/memory/cache_policy.h | 2 +- be/src/runtime/memory/global_memory_arbitrator.cpp | 13 +- be/src/runtime/memory/global_memory_arbitrator.h | 22 +- be/src/runtime/memory/mem_tracker_limiter.cpp | 300 ++------ be/src/runtime/memory/mem_tracker_limiter.h | 127 ++-- be/src/runtime/memory/memory_profile.cpp | 353 ++++++++++ be/src/runtime/memory/memory_profile.h | 82 +++ be/src/runtime/memory/memory_reclamation.cpp | 46 +- be/src/runtime/memory/thread_mem_tracker_mgr.h | 2 +- .../src/runtime/process_profile.cpp | 43 +- be/src/runtime/process_profile.h | 62 ++ .../routine_load/routine_load_task_executor.cpp | 4 +- be/src/runtime/runtime_filter_mgr.cpp | 5 + be/src/util/mem_info.cpp | 19 +- be/src/util/mem_info.h | 18 +- be/src/util/runtime_profile.cpp | 6 +- be/src/util/runtime_profile.h | 4 +- be/src/vec/common/allocator.cpp | 9 +- .../serde/data_type_datetimev2_serde.cpp | 6 + .../data_types/serde/data_type_datev2_serde.cpp | 6 + .../data_types/serde/data_type_decimal_serde.cpp | 6 + .../data_types/serde/data_type_nullable_serde.cpp | 5 +- .../data_types/serde/data_type_number_serde.cpp | 6 + be/src/vec/data_types/serde/data_type_serde.h | 11 +- .../vec/data_types/serde/data_type_string_serde.h | 6 + .../exec/format/parquet/vparquet_group_reader.cpp | 1 + be/src/vec/olap/olap_data_convertor.cpp | 7 +- be/src/vec/runtime/shared_hash_table_controller.h | 1 + be/test/exprs/runtime_filter_test.cpp | 5 - be/test/runtime/memory/mem_tracker_test.cpp | 3 +- be/test/testutil/run_all_tests.cpp | 2 + extension/kettle/README.md | 42 ++ extension/kettle/README_zh.md | 42 ++ extension/kettle/assemblies/plugin/pom.xml | 73 ++ .../assemblies/plugin/src/assembly/assembly.xml | 56 ++ .../plugin/src/main/resources/version.xml | 20 + extension/kettle/assemblies/pom.xml | 40 ++ extension/kettle/images/create.png | Bin 0 -> 1005589 bytes extension/kettle/images/create_zh.png | Bin 0 -> 1023236 bytes extension/kettle/images/running.png | Bin 0 -> 869441 bytes extension/kettle/images/running_zh.png | Bin 0 -> 827098 bytes extension/kettle/impl/pom.xml | 122 ++++ .../steps/dorisstreamloader/DorisStreamLoader.java | 169 +++++ .../dorisstreamloader/DorisStreamLoaderData.java | 54 +- .../dorisstreamloader/DorisStreamLoaderMeta.java | 368 ++++++++++ .../load/BatchBufferHttpEntity.java | 76 +++ .../dorisstreamloader/load/BatchBufferStream.java | 73 ++ .../dorisstreamloader/load/BatchRecordBuffer.java | 146 ++++ .../load/DefaultThreadFactory.java | 25 +- .../load/DorisBatchStreamLoad.java | 542 +++++++++++++++ .../steps/dorisstreamloader/load/DorisOptions.java | 159 +++++ .../load/DorisRuntimeException.java | 31 +- .../dorisstreamloader/load/EscapeHandler.java | 63 ++ .../dorisstreamloader/load/HttpPutBuilder.java | 130 ++++ .../steps/dorisstreamloader/load/HttpUtil.java | 48 ++ .../dorisstreamloader/load/LoadConstants.java | 38 ++ .../steps/dorisstreamloader/load/LoadStatus.java | 10 +- .../steps/dorisstreamloader/load/RespContent.java | 167 +++++ .../serializer/DorisRecordSerializer.java | 186 +++++ .../impl/src/main/resources/log4j.properties | 31 + .../messages/messages_en_US.properties | 26 + .../messages/messages_zh_CN.properties | 25 + .../DorisBatchStreamLoadTest.java | 59 ++ .../impl/src/test/resources/log4j2-test.properties | 28 + extension/kettle/pom.xml | 123 ++++ extension/kettle/ui/pom.xml | 71 ++ .../dorisstreamloader/DorisStreamLoaderDialog.java | 758 +++++++++++++++++++++ extension/kettle/ui/src/main/resources/doris.svg | 21 + extension/kettle/ui/src/main/resources/logo.png | Bin 0 -> 2296 bytes .../messages/messages_en_US.properties | 44 ++ .../messages/messages_zh_CN.properties | 44 ++ .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 25 +- .../java/org/apache/doris/alter/RollupJobV2.java | 6 +- .../apache/doris/alter/SchemaChangeHandler.java | 12 + .../org/apache/doris/analysis/CreateJobStmt.java | 1 + .../apache/doris/analysis/NativeInsertStmt.java | 3 +- .../apache/doris/analysis/PartitionExprUtil.java | 25 +- .../main/java/org/apache/doris/catalog/MTMV.java | 5 + .../java/org/apache/doris/catalog/OlapTable.java | 1 - .../main/java/org/apache/doris/catalog/Table.java | 5 - .../java/org/apache/doris/catalog/TableIf.java | 2 - .../authorizer/ranger/RangerAccessController.java | 7 + .../ranger/cache/CatalogCacheAccessController.java | 91 --- .../authorizer/ranger/cache/DatamaskCacheKey.java | 89 --- .../authorizer/ranger/cache/RangerCache.java | 107 --- .../cache/RangerCacheInvalidateListener.java | 41 -- .../authorizer/ranger/cache/RowFilterCacheKey.java | 82 --- .../authorizer/ranger/doris/DorisAccessType.java | 79 +-- .../authorizer/ranger/doris/DorisObjectType.java | 2 +- .../doris/RangerCacheDorisAccessController.java | 44 -- .../ranger/doris/RangerDorisAccessController.java | 177 +++-- .../ranger/doris/RangerDorisResource.java | 6 +- .../hive/RangerCacheHiveAccessController.java | 47 -- .../hive/RangerHiveAccessControllerFactory.java | 2 +- .../doris/common/util/DynamicPartitionUtil.java | 18 + .../org/apache/doris/datasource/ExternalTable.java | 6 - .../doris/datasource/jdbc/client/JdbcClient.java | 5 +- .../jdbc/client/JdbcClientException.java | 15 + .../doris/job/extensions/insert/InsertJob.java | 4 +- .../apache/doris/mtmv/MTMVPartitionCheckUtil.java | 144 ++++ .../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 5 + .../mysql/privilege/AccessControllerManager.java | 6 +- .../RangerDorisAccessControllerFactory.java | 6 +- .../org/apache/doris/nereids/CascadesContext.java | 9 + .../org/apache/doris/nereids/StatementContext.java | 3 +- .../doris/nereids/jobs/executor/Rewriter.java | 10 +- .../apache/doris/nereids/memo/StructInfoMap.java | 16 +- .../doris/nereids/parser/LogicalPlanBuilder.java | 28 + .../org/apache/doris/nereids/rules/RuleSet.java | 2 - .../doris/nereids/rules/analysis/BindSink.java | 6 +- .../nereids/rules/analysis/CheckAfterRewrite.java | 13 + .../mv/AbstractMaterializedViewRule.java | 19 +- .../mv/MaterializedViewOnlyJoinRule.java | 45 -- .../mv/MaterializedViewProjectFilterJoinRule.java | 1 + .../exploration/mv/MaterializedViewUtils.java | 14 +- .../rules/rewrite/InferPredicateByReplace.java | 266 -------- .../nereids/rules/rewrite/InferPredicates.java | 46 +- .../rules/rewrite/PredicatePropagation.java | 251 +++++++ .../nereids/rules/rewrite/PullUpPredicates.java | 95 +-- .../rules/rewrite/UnequalPredicateInfer.java | 576 ---------------- .../doris/nereids/trees/expressions/Like.java | 14 +- .../doris/nereids/trees/expressions/Not.java | 10 - .../trees/expressions/StringRegexPredicate.java | 6 +- .../trees/expressions/functions/BoundFunction.java | 6 +- .../trees/expressions/functions/Function.java | 6 +- .../functions/scalar/ScalarFunction.java | 6 +- .../apache/doris/nereids/trees/plans/PlanType.java | 1 + .../trees/plans/commands/CreateJobCommand.java | 73 ++ .../trees/plans/commands/info/CreateJobInfo.java | 263 +++++++ .../commands/insert/InsertIntoTableCommand.java | 14 +- .../trees/plans/logical/LogicalOlapScan.java | 29 +- .../trees/plans/visitor/CommandVisitor.java | 5 + .../doris/nereids/util/PredicateInferUtils.java | 179 ----- .../java/org/apache/doris/qe/SessionVariable.java | 17 + .../apache/doris/service/FrontendServiceImpl.java | 7 + .../doris/mtmv/MTMVPartitionCheckUtilTest.java | 269 ++++++++ .../doris/nereids/properties/UniformTest.java | 4 - .../rules/rewrite/InferPredicateByReplaceTest.java | 203 ------ .../rules/rewrite/PredicatePropagationTest.java | 67 ++ .../rules/rewrite/UnequalPredicateInferTest.java | 688 ------------------- .../org/apache/doris/nereids/util/PlanChecker.java | 7 +- .../java/org/apache/doris/policy/PolicyTest.java | 12 +- .../test_bloom_filter_drop_column.out} | 12 +- .../unique/test_unique_table_sequence.out | 16 +- .../data/job_p0/job_meta/job_query_test.out | 4 +- .../data/mtmv_p0/limit/refresh_with_sql_limit.out | 41 ++ .../data/nereids_hint_tpch_p0/shape/q12.out | 2 +- .../extend_infer_equal_predicate.out | 686 ------------------- .../infer_predicate/infer_unequal_predicates.out | 165 ----- .../mv/with_sql_limit/query_with_sql_limit.out | 19 + .../predicate_infer/infer_predicate.out | 11 +- .../nostats_rf_prune/q12.out | 2 +- .../nereids_tpch_shape_sf1000_p0/rf_prune/q12.out | 2 +- .../nereids_tpch_shape_sf1000_p0/shape/q12.out | 2 +- .../shape_no_stats/q12.out | 2 +- .../data/new_shapes_p0/hint_tpch/shape/q12.out | 2 +- .../tpch_sf1000/nostats_rf_prune/q12.out | 2 +- .../new_shapes_p0/tpch_sf1000/rf_prune/q12.out | 2 +- .../data/new_shapes_p0/tpch_sf1000/shape/q12.out | 2 +- .../tpch_sf1000/shape_no_stats/q12.out | 2 +- .../data/query_p0/scan_range/test_scan_range.out | 5 + .../org/apache/doris/regression/suite/Suite.groovy | 5 + .../test_bloom_filter_drop_column.groovy | 51 ++ .../unique/test_unique_table_sequence.groovy | 33 + ...al_update_compaction_with_higher_version.groovy | 2 +- ...nsert_group_commit_into_max_filter_ratio.groovy | 2 +- .../suites/job_p0/test_base_insert_job.groovy | 59 +- .../mtmv_p0/limit/refresh_with_sql_limit.groovy | 115 ++++ .../mv_with_force_drop/mv_with_force_drop.groovy | 52 ++ .../infer_predicate/infer_predicate.groovy | 14 +- .../suites/nereids_p0/join/test_join_on.groovy | 5 + .../extend_infer_equal_predicate.groovy | 357 ---------- .../infer_unequal_predicates.groovy | 189 ----- .../mv/direct_query/direct_query.groovy | 1 + .../mv/dml/with_lock/dml_rewrite_with_lock.groovy | 161 +++++ .../nested_mtmv_rewrite_switch.groovy | 169 +++++ .../union_all_compensate.groovy | 2 +- .../mv/with_sql_limit/query_with_sql_limit.groovy | 321 +++++++++ .../test_multi_range_partition.groovy | 4 +- .../query_p0/scan_range/test_scan_range.groovy | 5 + .../test_agg_schema_key_change_modify.groovy | 1 + .../test_agg_schema_key_change_modify1.groovy | 1 + .../test_agg_schema_value_modify.groovy | 1 + .../test_agg_schema_value_modify2.groovy | 2 + .../test_agg_schema_value_modify3.groovy | 2 +- .../test_dup_schema_key_change_modify.groovy | 1 + .../test_dup_schema_key_change_modify1.groovy | 2 +- .../test_dup_schema_value_modify.groovy | 2 +- .../test_dup_schema_value_modify1.groovy | 2 +- .../test_dup_schema_value_modify2.groovy | 3 +- .../test_dup_schema_value_modify3.groovy | 4 +- .../test_dup_schema_value_modify4.groovy | 2 - .../test_unique_schema_key_change_add.groovy | 1 - .../test_unique_schema_key_change_modify.groovy | 4 +- .../test_unique_schema_value_drop.groovy | 1 - .../test_unique_schema_value_modify.groovy | 2 +- .../test_unique_schema_value_modify2.groovy | 2 + 246 files changed, 7893 insertions(+), 4931 deletions(-) create mode 100644 be/src/olap/metadata_adder.h create mode 100644 be/src/runtime/memory/memory_profile.cpp create mode 100644 be/src/runtime/memory/memory_profile.h copy regression-test/suites/query_p0/scan_range/test_scan_range.groovy => be/src/runtime/process_profile.cpp (52%) create mode 100644 be/src/runtime/process_profile.h create mode 100644 extension/kettle/README.md create mode 100644 extension/kettle/README_zh.md create mode 100644 extension/kettle/assemblies/plugin/pom.xml create mode 100644 extension/kettle/assemblies/plugin/src/assembly/assembly.xml create mode 100644 extension/kettle/assemblies/plugin/src/main/resources/version.xml create mode 100644 extension/kettle/assemblies/pom.xml create mode 100644 extension/kettle/images/create.png create mode 100644 extension/kettle/images/create_zh.png create mode 100644 extension/kettle/images/running.png create mode 100644 extension/kettle/images/running_zh.png create mode 100644 extension/kettle/impl/pom.xml create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/DorisStreamLoader.java copy regression-test/suites/query_p0/scan_range/test_scan_range.groovy => extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/DorisStreamLoaderData.java (51%) create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/DorisStreamLoaderMeta.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/BatchBufferHttpEntity.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/BatchBufferStream.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/BatchRecordBuffer.java copy fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/hive/RangerHiveAccessControllerFactory.java => extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/DefaultThreadFactory.java (54%) create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/DorisBatchStreamLoad.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/DorisOptions.java copy fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/hive/RangerHiveAccessControllerFactory.java => extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/DorisRuntimeException.java (53%) create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/EscapeHandler.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/HttpPutBuilder.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/HttpUtil.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/LoadConstants.java copy fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/doris/DorisObjectType.java => extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/LoadStatus.java (69%) create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/load/RespContent.java create mode 100644 extension/kettle/impl/src/main/java/org/pentaho/di/trans/steps/dorisstreamloader/serializer/DorisRecordSerializer.java create mode 100644 extension/kettle/impl/src/main/resources/log4j.properties create mode 100644 extension/kettle/impl/src/main/resources/org/pentaho/di/trans/steps/dorisstreamloader/messages/messages_en_US.properties create mode 100644 extension/kettle/impl/src/main/resources/org/pentaho/di/trans/steps/dorisstreamloader/messages/messages_zh_CN.properties create mode 100644 extension/kettle/impl/src/test/java/org/pentaho/di/trans/steps/dorisstreamloader/DorisBatchStreamLoadTest.java create mode 100644 extension/kettle/impl/src/test/resources/log4j2-test.properties create mode 100644 extension/kettle/pom.xml create mode 100644 extension/kettle/ui/pom.xml create mode 100644 extension/kettle/ui/src/main/java/org/pentaho/di/ui/trans/steps/dorisstreamloader/DorisStreamLoaderDialog.java create mode 100644 extension/kettle/ui/src/main/resources/doris.svg create mode 100644 extension/kettle/ui/src/main/resources/logo.png create mode 100644 extension/kettle/ui/src/main/resources/org/pentaho/di/ui/trans/steps/dorisstreamloader/messages/messages_en_US.properties create mode 100644 extension/kettle/ui/src/main/resources/org/pentaho/di/ui/trans/steps/dorisstreamloader/messages/messages_zh_CN.properties delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/CatalogCacheAccessController.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/DatamaskCacheKey.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RangerCache.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RangerCacheInvalidateListener.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/cache/RowFilterCacheKey.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/doris/RangerCacheDorisAccessController.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/hive/RangerCacheHiveAccessController.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/mtmv/MTMVPartitionCheckUtil.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/MaterializedViewOnlyJoinRule.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/InferPredicateByReplace.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagation.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/UnequalPredicateInfer.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CreateJobCommand.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/CreateJobInfo.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/util/PredicateInferUtils.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mtmv/MTMVPartitionCheckUtilTest.java delete mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/InferPredicateByReplaceTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagationTest.java delete mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/UnequalPredicateInferTest.java copy regression-test/data/{query_p0/scan_range/test_scan_range.out => bloom_filter_p0/test_bloom_filter_drop_column.out} (62%) create mode 100644 regression-test/data/mtmv_p0/limit/refresh_with_sql_limit.out delete mode 100644 regression-test/data/nereids_rules_p0/infer_predicate/extend_infer_equal_predicate.out delete mode 100644 regression-test/data/nereids_rules_p0/infer_predicate/infer_unequal_predicates.out create mode 100644 regression-test/data/nereids_rules_p0/mv/with_sql_limit/query_with_sql_limit.out create mode 100644 regression-test/suites/bloom_filter_p0/test_bloom_filter_drop_column.groovy create mode 100644 regression-test/suites/mtmv_p0/limit/refresh_with_sql_limit.groovy create mode 100644 regression-test/suites/mv_p0/mv_with_force_drop/mv_with_force_drop.groovy delete mode 100644 regression-test/suites/nereids_rules_p0/infer_predicate/extend_infer_equal_predicate.groovy delete mode 100644 regression-test/suites/nereids_rules_p0/infer_predicate/infer_unequal_predicates.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dml/with_lock/dml_rewrite_with_lock.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/nested_mtmv_switch/nested_mtmv_rewrite_switch.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/with_sql_limit/query_with_sql_limit.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org