This is an automated email from the ASF dual-hosted git repository. felixwluo pushed a change to branch auto-pick-46661-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git
from 8438c51c5b2 [fix](func) Fix precision loss in ST_GeometryFromWKB coordinate parsing (#46661) add b0d5f9143db branch-3.0: [Bug](runtime-filter) fix missing rf when target not exist on backend where the producer is… #47108 (#47247) add e32ea57a092 branch-3.0: [fix](inverted index) fix case test_index_ddl_fault_injection #47253 (#47255) add 80f2d83a259 branch-3.0: [Test](index) fix the index property inconsistency for check_before_quit #46854 (#47207) add 0fbba02e3fc branch-3.0: [fix](ccr) Wrong tosql for alt tbl enable feature #46620 (#47208) add dc493c74641 branch-3.0: [fix](sql) Wrong result of tosql for drop column with rollup #47153 (#47205) add 1ea44506c8a branch-3.0: [fix](date_function) fix str_to_date function return wrong microsecond issue #47129 (#47261) add 8d23bf088ee branch-3.0: [test](case) Add nereids check (#47214) add 25e67f094bb branch-3.0: [test](case) fix tpcds_sf100 q17 result file #47169 (#47193) add cd1b10e2273 branch-3.0: [fix](hive docker)Reserve host port for hive2 namenode and datanode #47262 (#47304) add 5ef1a4d9c47 branch-3.0: [fix](cloud-mow)Fe should process KV_TXN_CONFLICT_RETRY_EXCEEDED_MAX_TIMES when geting delete bitmap lock fail #47161 (#47294) add 3083f0c00c3 branch-3.0: [Fix](test) Fix Show Data Case #47224 (#47293) add db0d489666c branch-3.0: [fix](binlog) Binlog ts not initialized #47174 (#47298) add 822c1326d7e branch-3.0: [chore](file_cache) Set enbale_dump_error_file to false by default #47229 (#47250) add 1c019d51f3b [chore](submodule) align clucene submodule branch with doris branch-3.0 (#47269) add 9045fb6f4e3 branch-3.0: [fix](cloud-mow)Fix case test_schema_change_with_mow_txn_conflict #47044 (#47306) add 8ddc7464236 branch-3.0: [fix](test) fix case failure for index compaction #47225 (#47237) add 6a13fd85b27 branch-3.0: [Fix](ShortCircuite) fix point query crash with prepared statement when encounter delete sign #47178 (#47222) add a5ea1efb6f2 branch-3.0: [Fix](Variant) fix variant may lost schema info when meet TXN_CONFLICT in cloud mode #47284 (#47309) add e55487603ba branch-3.0: [fix](test) fix case test_index_io_context #47290 (#47334) add 5e90377c9ed branch-3.0: [fix](cloud)(bulk load) fix memory leak in FE observer node #47074 (#47244) add baac2416eee branch-3.0: [Fix](recycler) Fix recycler fail when dealing with rowset [0-1] #47324 (#47335) add ae129e773da branch-3.0: [fix](s3filewriter) Fix s3_write_buffer_size boundary issue #47333 (#47341) add c4c526a8bf6 branch-3.0: [Fix](cloud) Cloud enable fe deploy mode from master-observers to multi-followers #45255 (#47215) add 016cb20158f [regression-test](fix) remove unused code in test_workload_sched_policy (#47344) add 99b2d629b0d [regression-test](case) remove two cases not suitable for cloud (#47353) add c30ff0677db [regression-test](fix) global var (#47125) add 5d70ee54c70 branch-3.0: [regression-test](framework) fix bug when sql returns two column with same name #47087 (#47135) add bff72833213 branch-3.0: [fix](cloud) fix file cache potential leakage #46561 (#47376) add 42c6257820b branch-3.0: [fix](docker) solve kerberos docker conflict #47260 (#47272) add 09878320242 branch-3.0: [Opt](regression) Add more test cases to external community pipeline #46897 (#46956) add 239f2d16f98 branch-3.0: [Opt](test) export/outfile case supports multi-kerberos env #47189 (#47238) add 110e0fcfb8e [branch-3.0]Add customStdAllocator for vector/map (#41193) (#47368) add 793634766b5 branch-3.0: [fix](hive docker)Sysctl reserve ports error #47373 (#47398) add bcea4fcd1f5 branch-3.0: [fix](hive docker)Unknown `--reserve-port` flags #47352 (#47355) add ee2979c6130 Revert "branch-3.0: [fix](date_function) fix str_to_date function return wrong microsecond issue #47129" (#47401) add 84a21bda28d branch-3.0: [fix](merge-on-write) Remove pending delete bitmap check when commit_txn() #47136 (#47283) add f8bd96932e8 branch-3.0: [fix](memory) Fix metadata memory tracking and profile (#47379) add ee46be6a6a9 branch-3.0: [improve](cloud-mow) modify some log (#47347) (#47433) add 4d5b371ea24 branch-3.0: [Opt](RowsetMeta) Add hint msg when encounter `TXN_VALUE_TOO_LARGE` in `commit_rowset()/update_tmp_rowset()` #47241 (#47429) add a3580a610d9 branch-3.0: [fix](regression test) Fix S3 load profile test failed in multi-frontends environment. #47330 (#47442) add cc38fad16c2 branch-3.0: [Bug](dead lock) Fix dead lock in Tablet Stat Mgr #46959 (#47418) add ac412b32aa6 branch-3.0: [fix](cloud-mow)Fix case test_cloud_mow_stream_load_with_commit_fail #47240 (#47435) add d23584f5e7b branch-3.0: [opt](docker)Replace healthy container with `--wait` #47357 (#47420) add 0f897ed9443 branch-3.0: [fix](Nereids) Use the schema saved during planning as the schema of the original target table #47337 (#47402) add e4eaf130604 branch-3.0: [Bug](function) fix wrong result when case when have more than 256 conditions and the… #47179 (#47391) add 28a46013747 branch-3.0: [regression-test](case) fix test_bloom_filter_hit.groovy #47057 (#47348) add db381d862be branch-3.0: [opt](jsonb) add ut for the jsonb parser #47181 (#47387) add 4acf8fbaaa3 branch-3.0: [regression-test](case) fix percentile case #47359 (#47394) add 0f63ced618a branch-3.0: [test](load) add p0 cases for insert docs #44364 (#44987) add 6856b74e416 branch-3.0: [opt](join) Check the property of nullable from intermediate row #45017 (#45475) add ce8d389b9c4 branch-3.0: [fix](local exchange) Use tokens to ensure that try_dequeue maintains strict order. #45741 (#45844) add fd514be024a branch-3.0: [Fix](test) test_cumu_compaction_with_delete case should be nonConcurrent #47372 (#47447) add c0f256f18ee branch-3.0: [improve](cloud-mow)Add delete bitmap metrics for MS #47047 (#47451) add 2ce46b95088 branch-3.0: [Fix](Test) debug point case should be nonConcurrent #47443 (#47450) add 0ac65471f09 branch-3.0: [opt](docker)Add healthy check for ES and Kafka #47362 (#47413) add 1f8faaa4525 branch-3.0: [opt](hive docker)Exit on creating table failed #47390 (#47452) add 778549008af [regression-test](fix) fix sql bug (#47361) add 2ebf871c0cb branch-3.0 [fix](delete) fix insert into cols should be corresponding to the query output for delete from command #47406 (#47454) add 13db9d5c314 branch-3.0: [Fix](Test) debug point should be cleared in the end #47458 (#47464) add 8cc7d60a5b3 branch-3.0: [opt](iceberg docker)Add health check for iceberg rest container #46767 (#47356) add 7446007285e branch-3.0: [Fix](recycler) Delete again to double check when recycle tablet failed by some bugs #47475 (#47477) add d3da2bf6552 branch-3.0: [fix](bug) Fix `Config.max_query_retry_time=1` analysis planner is null #47287 (#47480) add 900b2606a57 branch-3.0: [fix](cloud) Fix cloud -230 retry not reset ctx state #47326 (#47469) add 64dd61bb1b6 branch-3.0: [chore](binlog) Log download binlog cost #47360 (#47397) add 25d52ab5055 branch-3.0: [test](p0) don't run move-memtable injection cases in cloud mode #47311 (#47468) add a2827a25eb6 branch-3.0: [fix](cloud-mow) Make delete bitmap cache expired time more reasonable #47295 (#47490) add 7950af36c83 branch-3.0: [fix](cloud-mow) Make some timeout about mow more reasonable #46365 (#47489) add 4799310c3e6 branch-3.0: [fix](cloud) Fix cloud decomission and check wal #47187 (#47483) add f552fe23383 branch-3.0: [fix](fe) Fix `slf4j` contains multiple SLF4J bindings #45945 (#47466) add a3651509249 branch-3.0: [fix](restore) Release snapshots after the FINISHED state is persisted #47277 (#47285) add 8b0fdf35f34 branch-3.0: [regression-test](case) enlarge compaction_width_array_column.groovy … #47059 (#47365) add 1179fb16430 branch-3.0: [Test](check) Skip view for check meta test #47175 (#47190) add 5911412b43e branch-3.0: [Fix](partial update) Forbid partial update when table is in SCHEMA_CHANGE/ROLLUP in FE #46985 (#47160) add 1ba5dbe6264 branch-3.0: [Improvement]downgrade resource tag when there is not queryable replica #44255 (#45262) add b1d8fc4fc0d branch-3.0: [regression-test](fix) enlarge statistic test case's waiting time #45590 (#46015) add a419b59b2f7 branch-3.0: [regression-test](fix) remove mow 2pc test cases #46609 (#46730) add 112395c3920 branch-3.0: [chore](persist) Save old index schema map in TableAddOrDropColumnsInfo #46606 (#46740) add 1927b965620 branch-3.0: [regression](minio) test minio as doris storage vault #45417 (#46309) add 3231215543e branch-3.0: [Test](Export) add some debug logs for export #47400 (#47474) add 6ae85be688b branch-3.0: [test](move-memtable) mitigate flaky injection test `skip_two_backends` #47082 (#47110) add e533bc98308 branch-3.0: [opt](regression-test) Adjust the stream load timeout check of the regression framework #47037 (#47048) add 1cc177c21f8 branch-3.0: [fix](nereids)fix logical repeat computefd #47321 (#47346) add 4ec7f892284 branch-3.0: [fix](backup) filter the staled task response by job id #47416 (#47444) add 35ed78923b4 branch-3.0: [fix](cloud) Fix async mtmv job retry when meet -230 in cloud #47370 (#47482) add 3c594a5970d branch-3.0: [fix](cloud) shorten cache lock held time and add metrics #47472 (#47494) add 430bf6d1d75 Merge branch 'branch-3.0' into auto-pick-46661-branch-3.0 No new revisions were added by this update. Summary of changes: .gitmodules | 2 +- be/src/cloud/cloud_base_compaction.cpp | 2 +- be/src/cloud/cloud_cumulative_compaction.cpp | 2 +- be/src/cloud/cloud_schema_change_job.cpp | 2 +- be/src/cloud/cloud_storage_engine.cpp | 31 - be/src/cloud/cloud_storage_engine.h | 1 - be/src/cloud/cloud_tablet.cpp | 17 +- be/src/cloud/cloud_tablet_mgr.cpp | 4 +- be/src/cloud/config.cpp | 2 +- be/src/common/config.cpp | 10 +- be/src/common/config.h | 7 +- be/src/common/daemon.cpp | 11 +- be/src/exprs/runtime_filter.cpp | 50 +- be/src/io/cache/block_file_cache.cpp | 428 +++--- be/src/io/cache/block_file_cache.h | 93 +- be/src/io/cache/file_block.cpp | 18 +- be/src/io/cache/file_block.h | 6 + be/src/io/cache/fs_file_cache_storage.cpp | 2 +- be/src/io/fs/s3_file_writer.cpp | 37 +- be/src/olap/compaction.cpp | 13 +- be/src/olap/compaction.h | 2 +- be/src/olap/delta_writer_v2.h | 1 - be/src/olap/memtable_writer.h | 1 - be/src/olap/metadata_adder.h | 73 +- be/src/olap/rowid_conversion.h | 29 +- be/src/olap/rowset/beta_rowset_writer.h | 2 +- be/src/olap/rowset/segcompaction.cpp | 3 +- be/src/olap/rowset/segcompaction.h | 10 +- .../rowset/segment_v2/indexed_column_reader.cpp | 6 +- .../olap/rowset/segment_v2/indexed_column_reader.h | 15 +- .../segment_v2/inverted_index_fs_directory.cpp | 14 - be/src/olap/rowset/segment_v2/page_handle.h | 12 +- be/src/olap/rowset/segment_v2/segment.cpp | 17 +- be/src/olap/rowset/segment_v2/segment.h | 7 +- be/src/olap/rowset_builder.h | 1 - be/src/olap/segment_loader.cpp | 3 +- be/src/olap/segment_loader.h | 13 +- be/src/olap/simple_rowid_conversion.h | 5 +- be/src/olap/tablet_manager.cpp | 19 +- be/src/olap/tablet_manager.h | 3 - be/src/olap/tablet_meta.cpp | 6 - be/src/olap/tablet_meta.h | 4 - be/src/olap/tablet_schema.cpp | 2 - be/src/olap/tablet_schema.h | 7 +- be/src/olap/tablet_schema_cache.cpp | 2 +- be/src/pipeline/exec/hashjoin_probe_operator.cpp | 29 +- be/src/pipeline/local_exchange/local_exchanger.h | 5 +- be/src/runtime/exec_env.h | 16 +- be/src/runtime/exec_env_init.cpp | 15 +- be/src/runtime/memory/cache_policy.h | 6 + be/src/runtime/memory/lru_cache_policy.h | 38 +- be/src/runtime/memory/lru_cache_value_base.h | 11 +- be/src/runtime/memory/mem_tracker_limiter.cpp | 58 +- be/src/runtime/memory/mem_tracker_limiter.h | 14 +- be/src/runtime/memory/memory_profile.cpp | 305 ++-- be/src/runtime/memory/memory_profile.h | 69 +- be/src/runtime/runtime_filter_mgr.cpp | 10 - be/src/runtime/runtime_filter_mgr.h | 1 - be/src/runtime/thread_context.h | 4 +- be/src/service/backend_service.cpp | 21 +- be/src/service/point_query_executor.cpp | 25 +- be/src/util/runtime_profile.cpp | 4 +- be/src/util/runtime_profile.h | 45 +- be/src/vec/common/custom_allocator.h | 82 ++ be/src/vec/functions/function_case.h | 13 +- be/src/vec/runtime/partitioner.h | 1 - be/src/vec/sink/vdata_stream_sender.h | 1 - be/test/io/cache/block_file_cache_test.cpp | 108 +- be/test/io/fs/s3_file_writer_test.cpp | 392 +++++ be/test/util/jsonb_parser_simd_test.cpp | 406 +++++ be/test/vec/exec/concurrent_queue_order.cpp | 109 ++ build.sh | 4 +- cloud/src/common/bvars.cpp | 5 + cloud/src/common/bvars.h | 2 + cloud/src/common/config.h | 9 +- cloud/src/common/network_util.cpp | 11 + cloud/src/meta-service/injection_point_http.cpp | 120 +- cloud/src/meta-service/meta_service.cpp | 75 +- cloud/src/meta-service/meta_service_helper.h | 11 +- cloud/src/meta-service/meta_service_job.cpp | 16 +- cloud/src/meta-service/meta_service_resource.cpp | 27 + cloud/src/meta-service/meta_service_schema.cpp | 14 +- cloud/src/meta-service/meta_service_schema.h | 6 +- cloud/src/meta-service/meta_service_txn.cpp | 37 +- cloud/src/recycler/recycler.cpp | 61 +- cloud/src/resource-manager/resource_manager.cpp | 258 +++- cloud/test/fdb_injection_test.cpp | 3 + cloud/test/meta_service_http_test.cpp | 4 +- cloud/test/meta_service_job_test.cpp | 2 +- cloud/test/meta_service_test.cpp | 148 -- cloud/test/resource_test.cpp | 4 + .../docker-compose/clickhouse/clickhouse.yaml.tpl | 7 - .../thirdparties/docker-compose/db2/db2.yaml.tpl | 7 - .../docker-compose/elasticsearch/es.yaml.tpl | 7 +- .../elasticsearch/scripts/es_init.sh | 2 + .../docker-compose/hive/hive-2x.yaml.tpl | 20 +- .../docker-compose/hive/hive-2x_settings.env | 2 +- .../docker-compose/hive/hive-3x.yaml.tpl | 20 +- .../partition_location_1/create_table.hql | 3 +- .../partition_location_2/create_table.hql | 1 + .../data/regression/crdmm_data/create_table.hql | 2 +- .../docker-compose/hive/scripts/hive-metastore.sh | 32 +- .../docker-compose/iceberg/entrypoint.sh.tpl | 7 + .../docker-compose/iceberg/iceberg.yaml.tpl | 46 +- .../docker-compose/kafka/kafka.yaml.tpl | 14 + .../docker-compose/mariadb/mariadb-10.yaml.tpl | 7 - .../minio-RELEASE.2024-11-07.env} | 2 +- .../minio-RELEASE.2024-11-07.yaml.tpl} | 39 +- .../docker-compose/minio/script/minio_init.sh} | 32 +- .../docker-compose/mysql/mysql-5.7.yaml.tpl | 8 +- .../docker-compose/oceanbase/oceanbase.yaml.tpl | 8 +- .../docker-compose/oracle/oracle-11.yaml.tpl | 7 - .../postgresql/postgresql-14.yaml.tpl | 7 - .../docker-compose/sqlserver/sqlserver.yaml.tpl | 8 +- docker/thirdparties/run-thirdparties-docker.sh | 72 +- .../main/java/org/apache/doris/common/Config.java | 11 +- .../apache/doris/alter/SchemaChangeHandler.java | 11 +- .../org/apache/doris/alter/SchemaChangeJobV2.java | 4 +- .../org/apache/doris/analysis/AlterTableStmt.java | 7 +- .../apache/doris/analysis/DropColumnClause.java | 2 +- .../org/apache/doris/backup/BackupHandler.java | 28 +- .../java/org/apache/doris/backup/RestoreJob.java | 18 +- .../org/apache/doris/binlog/BinlogManager.java | 46 +- .../java/org/apache/doris/catalog/OlapTable.java | 9 + .../org/apache/doris/catalog/TabletStatMgr.java | 58 +- .../doris/cloud/catalog/CloudClusterChecker.java | 15 +- .../org/apache/doris/cloud/catalog/CloudEnv.java | 13 +- .../doris/cloud/catalog/CloudTabletRebalancer.java | 89 +- .../transaction/CloudGlobalTransactionMgr.java | 38 +- .../doris/datasource/FederationBackendPolicy.java | 3 + .../org/apache/doris/httpv2/rest/LoadAction.java | 2 + .../apache/doris/job/extensions/mtmv/MTMVTask.java | 46 +- .../org/apache/doris/load/ExportTaskExecutor.java | 34 + .../org/apache/doris/load/GroupCommitManager.java | 6 + .../org/apache/doris/load/loadv2/LoadManager.java | 1 + .../java/org/apache/doris/metric/MetricRepo.java | 6 + .../java/org/apache/doris/mysql/MysqlProto.java | 3 +- .../org/apache/doris/mysql/privilege/Auth.java | 9 + .../mysql/privilege/CommonUserProperties.java | 11 + .../apache/doris/mysql/privilege/UserProperty.java | 22 + .../doris/mysql/privilege/UserPropertyMgr.java | 8 + .../org/apache/doris/nereids/StatementContext.java | 7 + .../generator/PlanPatternGeneratorAnalyzer.java | 4 +- .../apache/doris/nereids/properties/DataTrait.java | 4 + .../nereids/rules/analysis/CollectRelation.java | 14 +- .../trees/plans/commands/DeleteFromCommand.java | 3 +- .../commands/insert/InsertIntoTableCommand.java | 16 +- .../nereids/trees/plans/logical/LogicalRepeat.java | 2 +- .../doris/persist/TableAddOrDropColumnsInfo.java | 8 +- .../org/apache/doris/planner/OlapScanNode.java | 47 +- .../org/apache/doris/planner/OlapTableSink.java | 4 + .../java/org/apache/doris/qe/ConnectContext.java | 8 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 3 +- .../java/org/apache/doris/qe/SessionVariable.java | 2 +- .../java/org/apache/doris/qe/StmtExecutor.java | 6 +- .../main/java/org/apache/doris/system/Backend.java | 14 + .../org/apache/doris/system/BeSelectionPolicy.java | 33 +- .../apache/doris/analysis/AlterTableStmtTest.java | 21 + .../doris/analysis/DropColumnClauseTest.java | 2 +- .../persist/TableAddOrDropColumnsInfoTest.java | 5 +- .../apache/doris/planner/ResourceTagQueryTest.java | 12 +- .../apache/doris/system/SystemInfoServiceTest.java | 23 + fe/pom.xml | 30 +- gensrc/proto/cloud.proto | 4 +- regression-test/conf/regression-conf.groovy | 11 + ...st_cloud_mow_stream_load_with_txn_conflict.out} | Bin 134 -> 122 bytes .../fault_injection_p0/cloud/test_stream_load.csv | 2 + .../partial_update/during_sc.csv | 2 + .../test_partial_update_during_sc.out} | Bin 236 -> 347 bytes .../test_insert_docs_demo.out} | Bin 141 -> 142 bytes .../delete/delete_mow_partial_update.out | Bin 887 -> 1148 bytes .../eliminate_gby_key/eliminate_gby_key.out} | Bin 122 -> 128 bytes .../data/point_query_p0/test_point_query.out | Bin 9833 -> 9896 bytes .../join/test_low_bucket/test_low_bucket.out | Bin 0 -> 945 bytes .../test_aggregate_all_functions2.out | Bin 8332 -> 8294 bytes .../case_function/test_case_function.out | Bin 361 -> 462 bytes regression-test/data/tpcds_sf100_p2/sql/q17.out | Bin 6376 -> 6594 bytes .../schema_change_with_txn_conflict.out} | Bin 131 -> 185 bytes .../create/test_minio_storage_vault.out} | Bin 109 -> 136 bytes .../workload_manager_p0/skip_rg_test_table.csv | 2 + .../regression/action/StreamLoadAction.groovy | 10 +- .../org/apache/doris/regression/suite/Suite.groovy | 43 +- .../doris/regression/suite/SuiteCluster.groovy | 36 + .../cloud_p0/conf/regression-conf-custom.groovy | 2 + regression-test/pipeline/p0/conf/fe.conf | 1 + regression-test/plugins/aliyun_oss_sdk.groovy | 7 + .../plugins/cloud_show_data_plugin.groovy | 94 +- .../bloom_filter_p0/test_bloom_filter_hit.groovy | 6 + .../test_binlog_config_change.groovy | 8 +- .../inverted_index/test_get_binlog.groovy | 10 +- .../inverted_index/test_ingest_binlog.groovy | 8 +- .../inverted_index/test_multi_buckets.groovy | 8 +- .../inverted_index/test_backup_restore.groovy | 8 +- .../node_mgr/test_cloud_decommission.groovy | 301 ++++ .../suites/cloud_p0/node_mgr/test_ms_api.groovy | 1553 ++++++++++++++++++++ .../node_mgr/test_sql_mode_node_mgr.groovy | 41 + .../cloud_p0/query_retry/test_retry_e-230.groovy | 39 +- .../test_retry_e-230_async_mtmv_job.groovy | 139 ++ .../compaction_width_array_column.groovy | 3 +- .../test_cumu_compaction_with_delete.groovy | 2 +- .../suites/control_p0/test_set_max_retry.groovy | 25 +- .../suites/data_reliability/check_meta.groovy | 4 + .../suites/datatype_p0/scalar_types/load.groovy | 6 +- .../export_p2/test_export_max_file_size.groovy | 269 ++-- .../test_outfile_orc_max_file_size.groovy | 218 +-- .../suites/export_p2/test_outfile_p2.groovy | 95 +- .../jdbc/test_jdbc_query_tvf.groovy | 2 +- .../lower_case/test_conflict_name.groovy | 2 +- .../lower_case/test_meta_names_mapping.groovy | 2 +- .../tvf/test_frontends_disks_tvf.groovy | 2 +- .../test_insert_from_tvf_with_common_user.groovy | 2 +- .../tvf/test_local_tvf_compression.groovy | 2 +- .../tvf/test_local_tvf_enclose.groovy | 2 +- ...test_local_tvf_parquet_unsigned_integers.groovy | 2 +- .../tvf/test_local_tvf_with_complex_type.groovy | 2 +- ...t_local_tvf_with_complex_type_element_at.groovy | 2 +- ...l_tvf_with_complex_type_insertinto_doris.groovy | 2 +- .../tvf/test_read_csv_empty_line_as_null.groovy | 2 +- .../external_table_p0/tvf/test_s3_tvf.groovy | 2 +- .../tvf/test_s3_tvf_compression.groovy | 2 +- .../tvf/test_s3_tvf_parquet_compress.groovy | 2 +- .../tvf/test_s3_tvf_with_resource.groovy | 2 +- .../tvf/test_tvf_csv_line_end.groovy | 2 +- ..._cloud_mow_stream_load_with_txn_conflict.groovy | 61 + .../test_partial_update_during_sc.groovy | 118 ++ .../test_disable_move_memtable.groovy | 516 +++---- .../test_full_compaciton_run_status.groovy | 2 + .../test_index_bkd_writer_fault_injection.groovy | 2 +- .../test_index_compaction_fault_injection.groovy | 4 +- ...index_compound_directory_fault_injection.groovy | 2 +- .../test_index_ddl_fault_injection.groovy | 2 +- .../test_index_fault_injection.groovy | 4 +- .../test_index_io_context.groovy | 4 +- ...oad_stream_back_pressure_fault_injection.groovy | 154 +- ...d_stream_stub_close_wait_fault_injection.groovy | 130 +- .../test_load_stream_stub_failure_injection.groovy | 138 +- .../test_multi_replica_fault_injection.groovy | 9 +- .../test_writer_v2_fault_injection.groovy | 162 +- .../suites/insert_p0/test_insert_docs_demo.groovy | 111 ++ .../test_index_compaction_unique_keys_arr.groovy | 2 +- .../index_change/test_index_change_1.groovy | 8 +- .../index_change/test_index_change_2.groovy | 4 +- .../index_change/test_index_change_3.groovy | 4 +- .../index_change/test_index_change_4.groovy | 4 +- .../test_index_compaction_dup_keys.groovy | 2 +- .../test_index_compaction_null.groovy | 4 +- .../test_index_compaction_p0.groovy | 5 +- .../test_index_compaction_unique_keys.groovy | 2 +- .../storage_format/test_storage_format_v1.groovy | 2 +- .../storage_format/test_storage_format_v2.groovy | 2 +- .../inverted_index_p0/test_count_on_index.groovy | 4 +- .../test_index_equal_select.groovy | 2 +- .../test_index_key_match_select.groovy | 2 +- .../test_index_like_select.groovy | 4 +- .../test_index_match_phrase.groovy | 4 +- .../test_index_match_select.groovy | 8 +- .../test_index_no_need_read_data.groovy | 2 +- .../test_index_range_between_select.groovy | 4 +- ...test_index_range_bigger_and_equal_select.groovy | 2 +- .../test_index_range_bigger_select.groovy | 2 +- .../test_index_range_in_select.groovy | 4 +- .../test_index_range_not_in_select.groovy | 4 +- ...est_index_range_smaller_and_equal_select.groovy | 2 +- .../test_index_range_smaller_select.groovy | 2 +- .../test_inverted_index_mor.groovy | 2 +- .../test_inverted_index_null.groovy | 2 +- .../test_inverted_index_null_ram_dir.groovy | 2 +- .../test_inverted_index_v2_file_size.groovy | 2 +- .../suites/inverted_index_p0/test_lowercase.groovy | 2 +- .../test_pk_no_need_read_data.groovy | 2 +- .../test_mow_with_null_sequence.groovy | 4 +- .../test_index_compaction_p1.groovy | 6 +- .../suites/inverted_index_p2/test_show_data.groovy | 6 +- .../stream_load/test_load_with_decimal.groovy | 2 +- .../stream_load/test_stream_load_properties.groovy | 4 + .../suites/manager/test_manager_interface_1.groovy | 8 +- .../delete/delete_mow_partial_update.groovy | 45 + .../eliminate_gby_key/eliminate_gby_key.groovy | 5 + .../distribute/local_shuffle.groovy | 2 +- .../suites/nereids_syntax_p0/match.groovy | 6 +- .../test_auto_partition_behavior.groovy | 2 +- .../suites/point_query_p0/test_point_query.groovy | 7 + .../join/test_low_bucket/test_low_bucket.groovy | 285 ++++ .../test_aggregate_all_functions2.groovy | 5 +- .../case_function/test_case_function.groovy | 548 +++++++ .../query_profile/s3_load_profile_test.groovy | 53 +- ...test_schema_change_with_mow_txn_conflict.groovy | 50 +- .../test_cloud_follower_show_data.groovy | 11 +- .../test_cloud_mtmv_show_data.groovy | 62 +- ...ema_change_add_and_drop_column_show_data.groovy | 24 +- ...hema_change_add_and_drop_index_show_data.groovy | 20 +- ...d_schema_change_reorder_column_show_data.groovy | 15 +- .../test_cloud_delete_table_rows_show_data.groovy | 27 +- ...oud_drop_and_recover_partition_show_data.groovy | 40 +- .../test_cloud_drop_table_show_data.groovy | 44 +- ... => test_cloud_truncate_table_show_data.groovy} | 53 +- .../test_cloud_disable_compaction_show_data.groovy | 11 +- .../test_cloud_inverted_index_v1_show_data.groovy | 11 +- .../test_cloud_inverted_index_v2_show_data.groovy | 11 +- .../test_cloud_lz4_show_data.groovy | 11 +- .../test_cloud_zstd_show_data.groovy | 11 +- .../test_cloud_agg_show_data.groovy | 11 +- .../test_cloud_dup_show_data.groovy | 16 +- .../test_cloud_mor_show_data.groovy | 11 +- .../test_cloud_mow_partial_update_show_data.groovy | 13 +- .../test_cloud_mow_show_data.groovy | 11 +- .../statistics/test_external_partition.groovy | 2 +- .../test_schema_change_statistics.groovy | 2 +- .../schema_change_with_txn_conflict.groovy | 52 + .../create/test_minio_storage_vault.groovy | 71 + .../workload_manager_p0/test_resource_tag.groovy | 99 ++ .../test_workload_sched_policy.groovy | 57 - 312 files changed, 8233 insertions(+), 2736 deletions(-) create mode 100644 be/src/vec/common/custom_allocator.h create mode 100644 be/test/util/jsonb_parser_simd_test.cpp create mode 100644 be/test/vec/exec/concurrent_queue_order.cpp copy docker/thirdparties/docker-compose/{postgresql/postgresql-14.env => minio/minio-RELEASE.2024-11-07.env} (96%) copy docker/thirdparties/docker-compose/{oceanbase/oceanbase.yaml.tpl => minio/minio-RELEASE.2024-11-07.yaml.tpl} (61%) copy docker/{runtime/broker/resource/broker_is_alive.sh => thirdparties/docker-compose/minio/script/minio_init.sh} (64%) mode change 100755 => 100644 copy regression-test/data/fault_injection_p0/cloud/{test_cloud_mow_stream_load_with_commit_fail.out => test_cloud_mow_stream_load_with_txn_conflict.out} (91%) create mode 100644 regression-test/data/fault_injection_p0/cloud/test_stream_load.csv create mode 100644 regression-test/data/fault_injection_p0/partial_update/during_sc.csv copy regression-test/data/{update/test_unique_table_update.out => fault_injection_p0/partial_update/test_partial_update_during_sc.out} (51%) copy regression-test/data/{bloom_filter_p0/test_bloom_filter_drop_column.out => insert_p0/test_insert_docs_demo.out} (67%) copy regression-test/data/{nereids_p0/colocate/test_set_operation_colocate.out => nereids_rules_p0/eliminate_gby_key/eliminate_gby_key.out} (85%) create mode 100644 regression-test/data/query_p0/join/test_low_bucket/test_low_bucket.out copy regression-test/data/{auto_increment_p2/test_unique_auto_inc_concurrent.out => variant_p0/schema_change/schema_change_with_txn_conflict.out} (57%) copy regression-test/data/{compaction/test_single_compaction_with_variant_inverted_index.out => vault_p0/create/test_minio_storage_vault.out} (77%) create mode 100644 regression-test/data/workload_manager_p0/skip_rg_test_table.csv create mode 100644 regression-test/suites/cloud_p0/node_mgr/test_cloud_decommission.groovy create mode 100644 regression-test/suites/cloud_p0/node_mgr/test_ms_api.groovy create mode 100644 regression-test/suites/cloud_p0/query_retry/test_retry_e-230_async_mtmv_job.groovy copy fe/fe-core/src/main/java/org/apache/doris/load/loadv2/JobState.java => regression-test/suites/control_p0/test_set_max_retry.groovy (59%) create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_stream_load_with_txn_conflict.groovy create mode 100644 regression-test/suites/fault_injection_p0/partial_update/test_partial_update_during_sc.groovy create mode 100644 regression-test/suites/insert_p0/test_insert_docs_demo.groovy create mode 100644 regression-test/suites/query_p0/join/test_low_bucket/test_low_bucket.groovy rename regression-test/suites/show_data_p2/test_table_operation/{test_cloud_truncate_and_recover_table_show_data.groovy => test_cloud_truncate_table_show_data.groovy} (77%) create mode 100644 regression-test/suites/variant_p0/schema_change/schema_change_with_txn_conflict.groovy create mode 100644 regression-test/suites/vault_p0/create/test_minio_storage_vault.groovy create mode 100644 regression-test/suites/workload_manager_p0/test_resource_tag.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org