This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch auto-pick-47313-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard ef6a4ee3677 [fix](restore) Make the DirMoveTask idempotent. (#47313)
add ee2979c6130 Revert "branch-3.0: [fix](date_function) fix str_to_date
function return wrong microsecond issue #47129" (#47401)
add 84a21bda28d branch-3.0: [fix](merge-on-write) Remove pending delete
bitmap check when commit_txn() #47136 (#47283)
add f8bd96932e8 branch-3.0: [fix](memory) Fix metadata memory tracking and
profile (#47379)
add ee46be6a6a9 branch-3.0: [improve](cloud-mow) modify some log (#47347)
(#47433)
add 4d5b371ea24 branch-3.0: [Opt](RowsetMeta) Add hint msg when encounter
`TXN_VALUE_TOO_LARGE` in `commit_rowset()/update_tmp_rowset()` #47241 (#47429)
add a3580a610d9 branch-3.0: [fix](regression test) Fix S3 load profile
test failed in multi-frontends environment. #47330 (#47442)
add cc38fad16c2 branch-3.0: [Bug](dead lock) Fix dead lock in Tablet Stat
Mgr #46959 (#47418)
add ac412b32aa6 branch-3.0: [fix](cloud-mow)Fix case
test_cloud_mow_stream_load_with_commit_fail #47240 (#47435)
add d23584f5e7b branch-3.0: [opt](docker)Replace healthy container with
`--wait` #47357 (#47420)
add 0f897ed9443 branch-3.0: [fix](Nereids) Use the schema saved during
planning as the schema of the original target table #47337 (#47402)
add e4eaf130604 branch-3.0: [Bug](function) fix wrong result when case
when have more than 256 conditions and the… #47179 (#47391)
add 28a46013747 branch-3.0: [regression-test](case) fix
test_bloom_filter_hit.groovy #47057 (#47348)
add db381d862be branch-3.0: [opt](jsonb) add ut for the jsonb parser
#47181 (#47387)
add 4acf8fbaaa3 branch-3.0: [regression-test](case) fix percentile case
#47359 (#47394)
add 0f63ced618a branch-3.0: [test](load) add p0 cases for insert docs
#44364 (#44987)
add 6856b74e416 branch-3.0: [opt](join) Check the property of nullable
from intermediate row #45017 (#45475)
add ce8d389b9c4 branch-3.0: [fix](local exchange) Use tokens to ensure
that try_dequeue maintains strict order. #45741 (#45844)
add fd514be024a branch-3.0: [Fix](test) test_cumu_compaction_with_delete
case should be nonConcurrent #47372 (#47447)
add c0f256f18ee branch-3.0: [improve](cloud-mow)Add delete bitmap metrics
for MS #47047 (#47451)
add 2ce46b95088 branch-3.0: [Fix](Test) debug point case should be
nonConcurrent #47443 (#47450)
add 0ac65471f09 branch-3.0: [opt](docker)Add healthy check for ES and
Kafka #47362 (#47413)
add 1f8faaa4525 branch-3.0: [opt](hive docker)Exit on creating table
failed #47390 (#47452)
add 778549008af [regression-test](fix) fix sql bug (#47361)
add 2ebf871c0cb branch-3.0 [fix](delete) fix insert into cols should be
corresponding to the query output for delete from command #47406 (#47454)
add 13db9d5c314 branch-3.0: [Fix](Test) debug point should be cleared in
the end #47458 (#47464)
add 8cc7d60a5b3 branch-3.0: [opt](iceberg docker)Add health check for
iceberg rest container #46767 (#47356)
add 7446007285e branch-3.0: [Fix](recycler) Delete again to double check
when recycle tablet failed by some bugs #47475 (#47477)
add d3da2bf6552 branch-3.0: [fix](bug) Fix `Config.max_query_retry_time=1`
analysis planner is null #47287 (#47480)
add 900b2606a57 branch-3.0: [fix](cloud) Fix cloud -230 retry not reset
ctx state #47326 (#47469)
add 64dd61bb1b6 branch-3.0: [chore](binlog) Log download binlog cost
#47360 (#47397)
add 25d52ab5055 branch-3.0: [test](p0) don't run move-memtable injection
cases in cloud mode #47311 (#47468)
add a2827a25eb6 branch-3.0: [fix](cloud-mow) Make delete bitmap cache
expired time more reasonable #47295 (#47490)
add 7950af36c83 branch-3.0: [fix](cloud-mow) Make some timeout about mow
more reasonable #46365 (#47489)
add 4799310c3e6 branch-3.0: [fix](cloud) Fix cloud decomission and check
wal #47187 (#47483)
add f552fe23383 branch-3.0: [fix](fe) Fix `slf4j` contains multiple SLF4J
bindings #45945 (#47466)
add a3651509249 branch-3.0: [fix](restore) Release snapshots after the
FINISHED state is persisted #47277 (#47285)
add 8b0fdf35f34 branch-3.0: [regression-test](case) enlarge
compaction_width_array_column.groovy … #47059 (#47365)
add 1179fb16430 branch-3.0: [Test](check) Skip view for check meta test
#47175 (#47190)
add 5911412b43e branch-3.0: [Fix](partial update) Forbid partial update
when table is in SCHEMA_CHANGE/ROLLUP in FE #46985 (#47160)
add 1ba5dbe6264 branch-3.0: [Improvement]downgrade resource tag when there
is not queryable replica #44255 (#45262)
add b1d8fc4fc0d branch-3.0: [regression-test](fix) enlarge statistic test
case's waiting time #45590 (#46015)
add a419b59b2f7 branch-3.0: [regression-test](fix) remove mow 2pc test
cases #46609 (#46730)
add 112395c3920 branch-3.0: [chore](persist) Save old index schema map in
TableAddOrDropColumnsInfo #46606 (#46740)
add 1927b965620 branch-3.0: [regression](minio) test minio as doris
storage vault #45417 (#46309)
add 3231215543e branch-3.0: [Test](Export) add some debug logs for export
#47400 (#47474)
add 6ae85be688b branch-3.0: [test](move-memtable) mitigate flaky injection
test `skip_two_backends` #47082 (#47110)
add e533bc98308 branch-3.0: [opt](regression-test) Adjust the stream load
timeout check of the regression framework #47037 (#47048)
add 1cc177c21f8 branch-3.0: [fix](nereids)fix logical repeat computefd
#47321 (#47346)
add 4ec7f892284 branch-3.0: [fix](backup) filter the staled task response
by job id #47416 (#47444)
add e0e78fa2b60 [fix](restore) Make the DirMoveTask idempotent. (#47313)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ef6a4ee3677)
\
N -- N -- N refs/heads/auto-pick-47313-branch-3.0 (e0e78fa2b60)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/cloud/cloud_tablet.cpp | 17 +-
be/src/cloud/config.cpp | 2 +-
be/src/common/config.cpp | 2 +-
be/src/common/daemon.cpp | 11 +-
be/src/olap/delta_writer_v2.h | 1 -
be/src/olap/memtable_writer.h | 1 -
be/src/olap/metadata_adder.h | 73 ++-
.../rowset/segment_v2/indexed_column_reader.cpp | 6 +-
.../olap/rowset/segment_v2/indexed_column_reader.h | 15 +-
be/src/olap/rowset/segment_v2/page_handle.h | 12 +-
be/src/olap/rowset/segment_v2/segment.cpp | 17 +-
be/src/olap/rowset/segment_v2/segment.h | 7 +-
be/src/olap/rowset_builder.h | 1 -
be/src/olap/segment_loader.cpp | 3 +-
be/src/olap/segment_loader.h | 13 +-
be/src/olap/tablet_manager.cpp | 19 +-
be/src/olap/tablet_manager.h | 3 -
be/src/olap/tablet_meta.cpp | 6 -
be/src/olap/tablet_meta.h | 4 -
be/src/olap/tablet_schema.cpp | 2 -
be/src/olap/tablet_schema.h | 7 +-
be/src/olap/tablet_schema_cache.cpp | 2 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 29 +-
be/src/pipeline/local_exchange/local_exchanger.h | 5 +-
be/src/runtime/exec_env.h | 16 +-
be/src/runtime/exec_env_init.cpp | 15 +-
be/src/runtime/memory/cache_policy.h | 6 +
be/src/runtime/memory/lru_cache_policy.h | 38 +-
be/src/runtime/memory/lru_cache_value_base.h | 11 +-
be/src/runtime/memory/mem_tracker_limiter.cpp | 58 ++-
be/src/runtime/memory/mem_tracker_limiter.h | 14 +-
be/src/runtime/memory/memory_profile.cpp | 305 ++++++------
be/src/runtime/memory/memory_profile.h | 69 ++-
be/src/service/backend_service.cpp | 21 +-
be/src/util/runtime_profile.cpp | 4 +-
be/src/util/runtime_profile.h | 45 +-
be/src/vec/functions/function_case.h | 13 +-
be/src/vec/runtime/partitioner.h | 1 -
be/src/vec/sink/vdata_stream_sender.h | 1 -
be/test/util/jsonb_parser_simd_test.cpp | 406 +++++++++++++++
be/test/vec/exec/concurrent_queue_order.cpp | 109 ++++
cloud/src/common/bvars.cpp | 5 +
cloud/src/common/bvars.h | 2 +
cloud/src/meta-service/meta_service.cpp | 40 +-
cloud/src/meta-service/meta_service_helper.h | 11 +-
cloud/src/meta-service/meta_service_job.cpp | 16 +-
cloud/src/meta-service/meta_service_txn.cpp | 37 +-
cloud/src/recycler/recycler.cpp | 36 +-
cloud/test/meta_service_job_test.cpp | 2 +-
cloud/test/meta_service_test.cpp | 148 ------
.../docker-compose/clickhouse/clickhouse.yaml.tpl | 7 -
.../thirdparties/docker-compose/db2/db2.yaml.tpl | 7 -
.../docker-compose/elasticsearch/es.yaml.tpl | 7 +-
.../elasticsearch/scripts/es_init.sh | 2 +
.../docker-compose/hive/hive-2x.yaml.tpl | 11 +-
.../docker-compose/hive/hive-3x.yaml.tpl | 11 +-
.../partition_location_1/create_table.hql | 3 +-
.../partition_location_2/create_table.hql | 1 +
.../data/regression/crdmm_data/create_table.hql | 2 +-
.../docker-compose/hive/scripts/hive-metastore.sh | 32 +-
.../docker-compose/iceberg/entrypoint.sh.tpl | 7 +
.../docker-compose/iceberg/iceberg.yaml.tpl | 46 +-
.../docker-compose/kafka/kafka.yaml.tpl | 14 +
.../docker-compose/mariadb/mariadb-10.yaml.tpl | 7 -
.../minio-RELEASE.2024-11-07.env} | 2 +-
.../minio-RELEASE.2024-11-07.yaml.tpl} | 39 +-
.../docker-compose/minio/script/minio_init.sh} | 32 +-
.../docker-compose/mysql/mysql-5.7.yaml.tpl | 8 +-
.../docker-compose/oceanbase/oceanbase.yaml.tpl | 8 +-
.../docker-compose/oracle/oracle-11.yaml.tpl | 7 -
.../postgresql/postgresql-14.yaml.tpl | 7 -
.../docker-compose/sqlserver/sqlserver.yaml.tpl | 8 +-
docker/thirdparties/run-thirdparties-docker.sh | 44 +-
.../main/java/org/apache/doris/common/Config.java | 8 +-
.../apache/doris/alter/SchemaChangeHandler.java | 11 +-
.../org/apache/doris/alter/SchemaChangeJobV2.java | 4 +-
.../org/apache/doris/analysis/DateLiteral.java | 5 -
.../org/apache/doris/backup/BackupHandler.java | 28 +-
.../java/org/apache/doris/backup/RestoreJob.java | 18 +-
.../java/org/apache/doris/catalog/OlapTable.java | 9 +
.../org/apache/doris/catalog/TabletStatMgr.java | 58 ++-
.../doris/cloud/catalog/CloudClusterChecker.java | 15 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 89 ++--
.../transaction/CloudGlobalTransactionMgr.java | 17 +-
.../doris/datasource/FederationBackendPolicy.java | 3 +
.../org/apache/doris/httpv2/rest/LoadAction.java | 2 +
.../org/apache/doris/load/ExportTaskExecutor.java | 34 ++
.../org/apache/doris/load/GroupCommitManager.java | 6 +
.../java/org/apache/doris/metric/MetricRepo.java | 6 +
.../java/org/apache/doris/mysql/MysqlProto.java | 3 +-
.../org/apache/doris/mysql/privilege/Auth.java | 9 +
.../mysql/privilege/CommonUserProperties.java | 11 +
.../apache/doris/mysql/privilege/UserProperty.java | 22 +
.../doris/mysql/privilege/UserPropertyMgr.java | 8 +
.../org/apache/doris/nereids/StatementContext.java | 7 +
.../generator/PlanPatternGeneratorAnalyzer.java | 4 +-
.../apache/doris/nereids/properties/DataTrait.java | 4 +
.../nereids/rules/analysis/CollectRelation.java | 14 +-
.../executable/DateTimeExtractAndTransform.java | 4 +-
.../expressions/functions/scalar/StrToDate.java | 3 +-
.../trees/plans/commands/DeleteFromCommand.java | 3 +-
.../commands/insert/InsertIntoTableCommand.java | 16 +-
.../nereids/trees/plans/logical/LogicalRepeat.java | 2 +-
.../doris/persist/TableAddOrDropColumnsInfo.java | 8 +-
.../org/apache/doris/planner/OlapScanNode.java | 47 +-
.../org/apache/doris/planner/OlapTableSink.java | 4 +
.../java/org/apache/doris/qe/ConnectContext.java | 8 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 3 +-
.../java/org/apache/doris/qe/SessionVariable.java | 2 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 6 +-
.../main/java/org/apache/doris/system/Backend.java | 14 +
.../org/apache/doris/system/BeSelectionPolicy.java | 33 +-
.../persist/TableAddOrDropColumnsInfoTest.java | 5 +-
.../apache/doris/planner/ResourceTagQueryTest.java | 12 +-
.../apache/doris/system/SystemInfoServiceTest.java | 23 +
fe/pom.xml | 30 +-
gensrc/proto/cloud.proto | 2 -
regression-test/conf/regression-conf.groovy | 10 +
.../fault_injection_p0/cloud/test_stream_load.csv | 2 +
.../partial_update/during_sc.csv | 2 +
.../test_partial_update_during_sc.out} | Bin 236 -> 347 bytes
.../test_insert_docs_demo.out} | Bin 141 -> 142 bytes
.../delete/delete_mow_partial_update.out | Bin 887 -> 1148 bytes
.../eliminate_gby_key/eliminate_gby_key.out} | Bin 122 -> 128 bytes
.../test_aggregate_all_functions2.out | Bin 8332 -> 8294 bytes
.../case_function/test_case_function.out | Bin 361 -> 462 bytes
.../create/test_minio_storage_vault.out} | Bin 109 -> 136 bytes
.../workload_manager_p0/skip_rg_test_table.csv | 2 +
.../regression/action/StreamLoadAction.groovy | 10 +-
.../org/apache/doris/regression/suite/Suite.groovy | 16 +-
regression-test/pipeline/p0/conf/fe.conf | 1 +
.../bloom_filter_p0/test_bloom_filter_hit.groovy | 6 +
.../node_mgr/test_cloud_decommission.groovy | 301 +++++++++++
.../cloud_p0/query_retry/test_retry_e-230.groovy | 39 +-
.../compaction_width_array_column.groovy | 3 +-
.../test_cumu_compaction_with_delete.groovy | 2 +-
.../suites/control_p0/test_set_max_retry.groovy | 25 +-
.../suites/data_reliability/check_meta.groovy | 4 +
.../test_partial_update_during_sc.groovy | 118 +++++
.../test_disable_move_memtable.groovy | 516 +++++++++----------
...oad_stream_back_pressure_fault_injection.groovy | 154 +++---
...d_stream_stub_close_wait_fault_injection.groovy | 130 ++---
.../test_load_stream_stub_failure_injection.groovy | 138 +++---
.../test_multi_replica_fault_injection.groovy | 9 +-
.../test_writer_v2_fault_injection.groovy | 162 +++---
.../suites/insert_p0/test_insert_docs_demo.groovy | 111 +++++
.../stream_load/test_stream_load_properties.groovy | 4 +
.../delete/delete_mow_partial_update.groovy | 45 ++
.../test_date_function_v2.groovy | 60 ---
.../eliminate_gby_key/eliminate_gby_key.groovy | 5 +
.../distribute/local_shuffle.groovy | 2 +-
.../test_aggregate_all_functions2.groovy | 5 +-
.../case_function/test_case_function.groovy | 548 +++++++++++++++++++++
.../query_profile/s3_load_profile_test.groovy | 53 +-
...test_schema_change_with_mow_txn_conflict.groovy | 50 +-
.../test_schema_change_statistics.groovy | 2 +-
.../schema_change_with_txn_conflict.groovy | 3 +
.../create/test_minio_storage_vault.groovy | 71 +++
.../workload_manager_p0/test_resource_tag.groovy | 99 ++++
159 files changed, 3785 insertions(+), 1542 deletions(-)
create mode 100644 be/test/util/jsonb_parser_simd_test.cpp
create mode 100644 be/test/vec/exec/concurrent_queue_order.cpp
copy docker/thirdparties/docker-compose/{postgresql/postgresql-14.env =>
minio/minio-RELEASE.2024-11-07.env} (96%)
copy docker/thirdparties/docker-compose/{oceanbase/oceanbase.yaml.tpl =>
minio/minio-RELEASE.2024-11-07.yaml.tpl} (61%)
copy docker/{runtime/broker/resource/broker_is_alive.sh =>
thirdparties/docker-compose/minio/script/minio_init.sh} (64%)
mode change 100755 => 100644
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load.csv
create mode 100644
regression-test/data/fault_injection_p0/partial_update/during_sc.csv
copy regression-test/data/{update/test_unique_table_update.out =>
fault_injection_p0/partial_update/test_partial_update_during_sc.out} (51%)
copy regression-test/data/{bloom_filter_p0/test_bloom_filter_drop_column.out
=> insert_p0/test_insert_docs_demo.out} (67%)
copy regression-test/data/{nereids_p0/colocate/test_set_operation_colocate.out
=> nereids_rules_p0/eliminate_gby_key/eliminate_gby_key.out} (85%)
copy
regression-test/data/{compaction/test_single_compaction_with_variant_inverted_index.out
=> vault_p0/create/test_minio_storage_vault.out} (77%)
create mode 100644
regression-test/data/workload_manager_p0/skip_rg_test_table.csv
create mode 100644
regression-test/suites/cloud_p0/node_mgr/test_cloud_decommission.groovy
copy fe/fe-core/src/main/java/org/apache/doris/load/loadv2/JobState.java =>
regression-test/suites/control_p0/test_set_max_retry.groovy (59%)
create mode 100644
regression-test/suites/fault_injection_p0/partial_update/test_partial_update_during_sc.groovy
create mode 100644
regression-test/suites/insert_p0/test_insert_docs_demo.groovy
delete mode 100644
regression-test/suites/nereids_p0/sql_functions/datetime_functions/test_date_function_v2.groovy
create mode 100644
regression-test/suites/vault_p0/create/test_minio_storage_vault.groovy
create mode 100644
regression-test/suites/workload_manager_p0/test_resource_tag.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
