This is an automated email from the ASF dual-hosted git repository.
airborne pushed a change to branch auto-pick-47041-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard d704915fcd0 [fix](build index) Forbid building indexes for ngram BF
indexes (#47041)
add 8499253c728 [regression-test](fix) global var in p2 cases (#47152)
add 415aa23e25e branch-3.0: [fix](cloud-mow) Fix the issue of inaccurate
estimation of txn size when updating delete bitmap #46969 (#47046)
add e193da859c0 branch-3.0: [Chore](Notice)Update Notice year #46908
(#46932)
add 5ddd8a98090 [fix](test) fix unstable test after some test migration
(#46834) (#47157)
add c342cc52153 branch-3.0: [fix](json) fix parsing double in jsonb #46977
(#47064)
add 540e8bd0061 branch-3.0: [regression](metrics) add a regression for
version metrics #45593 (#45884)
add b5103970887 branch-3.0: [regression-test](fix) opensky_p2 case #47122
(#47124)
add 9b7477dc7f0 branch-3.0: [fix](metrics) Correct statistical method for
file cache stats #47020 (#47106)
add 089ef91067d branch-3.0: [opt](storage vault) Check `s3.root.path`
cannot be empty #47078 (#47196)
add 4820ba2d41d [feat](cloud) Add injection point http api for ms (#41982)
(#47204)
add d7f3801b207 branch-3.0: [opt](cloud) Fix frequent rlock for
SystemInfoService.getClusterXxx() #47203 (#47210)
add 991b9f64590 [fix](recycler) Fix premature exit recycling when there is
an invalid storage vault (#46798) (#47159)
add b3c39a2dd17 [fix](mac compile) fix compile failed on mac (#47186)
add 6e008c87dae Update .asf.yaml (#47217)
add 7e6fbd6f3cd branch-3.0: [fix](Nereids) insert lock all target tables
#47033 (#47243)
add 181c38963ad branch-3.0: [fix](group commit) prepare command should
consider table may be recreated #46900 (#46923)
add f24c3ee6413 branch-3.0: [fix](coldheat) fix missing partition's
storage policy in create_table_like stmt #47009 (#47183)
add b0d5f9143db branch-3.0: [Bug](runtime-filter) fix missing rf when
target not exist on backend where the producer is… #47108 (#47247)
add e32ea57a092 branch-3.0: [fix](inverted index) fix case
test_index_ddl_fault_injection #47253 (#47255)
add 80f2d83a259 branch-3.0: [Test](index) fix the index property
inconsistency for check_before_quit #46854 (#47207)
add 0fbba02e3fc branch-3.0: [fix](ccr) Wrong tosql for alt tbl enable
feature #46620 (#47208)
add dc493c74641 branch-3.0: [fix](sql) Wrong result of tosql for drop
column with rollup #47153 (#47205)
add 1ea44506c8a branch-3.0: [fix](date_function) fix str_to_date function
return wrong microsecond issue #47129 (#47261)
add 8d23bf088ee branch-3.0: [test](case) Add nereids check (#47214)
add 25e67f094bb branch-3.0: [test](case) fix tpcds_sf100 q17 result file
#47169 (#47193)
add cd1b10e2273 branch-3.0: [fix](hive docker)Reserve host port for hive2
namenode and datanode #47262 (#47304)
add 5ef1a4d9c47 branch-3.0: [fix](cloud-mow)Fe should process
KV_TXN_CONFLICT_RETRY_EXCEEDED_MAX_TIMES when geting delete bitmap lock fail
#47161 (#47294)
add 3083f0c00c3 branch-3.0: [Fix](test) Fix Show Data Case #47224 (#47293)
add db0d489666c branch-3.0: [fix](binlog) Binlog ts not initialized #47174
(#47298)
add 822c1326d7e branch-3.0: [chore](file_cache) Set enbale_dump_error_file
to false by default #47229 (#47250)
add 1c019d51f3b [chore](submodule) align clucene submodule branch with
doris branch-3.0 (#47269)
add 9045fb6f4e3 branch-3.0: [fix](cloud-mow)Fix case
test_schema_change_with_mow_txn_conflict #47044 (#47306)
add 8ddc7464236 branch-3.0: [fix](test) fix case failure for index
compaction #47225 (#47237)
add 6a13fd85b27 branch-3.0: [Fix](ShortCircuite) fix point query crash
with prepared statement when encounter delete sign #47178 (#47222)
add a5ea1efb6f2 branch-3.0: [Fix](Variant) fix variant may lost schema
info when meet TXN_CONFLICT in cloud mode #47284 (#47309)
add e55487603ba branch-3.0: [fix](test) fix case test_index_io_context
#47290 (#47334)
add 5e90377c9ed branch-3.0: [fix](cloud)(bulk load) fix memory leak in FE
observer node #47074 (#47244)
add baac2416eee branch-3.0: [Fix](recycler) Fix recycler fail when dealing
with rowset [0-1] #47324 (#47335)
add ae129e773da branch-3.0: [fix](s3filewriter) Fix s3_write_buffer_size
boundary issue #47333 (#47341)
add c4c526a8bf6 branch-3.0: [Fix](cloud) Cloud enable fe deploy mode from
master-observers to multi-followers #45255 (#47215)
add 016cb20158f [regression-test](fix) remove unused code in
test_workload_sched_policy (#47344)
add 99b2d629b0d [regression-test](case) remove two cases not suitable for
cloud (#47353)
add c30ff0677db [regression-test](fix) global var (#47125)
add 5d70ee54c70 branch-3.0: [regression-test](framework) fix bug when sql
returns two column with same name #47087 (#47135)
add bff72833213 branch-3.0: [fix](cloud) fix file cache potential leakage
#46561 (#47376)
add 42c6257820b branch-3.0: [fix](docker) solve kerberos docker conflict
#47260 (#47272)
add 09878320242 branch-3.0: [Opt](regression) Add more test cases to
external community pipeline #46897 (#46956)
add 239f2d16f98 branch-3.0: [Opt](test) export/outfile case supports
multi-kerberos env #47189 (#47238)
add 5af3c52c830 [fix](build index) Forbid building indexes for ngram BF
indexes (#47041)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d704915fcd0)
\
N -- N -- N refs/heads/auto-pick-47041-branch-3.0 (5af3c52c830)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 4 +-
.gitmodules | 2 +-
NOTICE.txt | 2 +-
be/src/cloud/cloud_schema_change_job.cpp | 2 +-
be/src/cloud/cloud_storage_engine.cpp | 31 -
be/src/cloud/cloud_storage_engine.h | 1 -
be/src/cloud/cloud_tablet_mgr.cpp | 4 +-
be/src/common/config.cpp | 5 +-
be/src/common/config.h | 4 +-
be/src/exprs/runtime_filter.cpp | 50 +-
be/src/io/cache/block_file_cache.cpp | 317 ++--
be/src/io/cache/block_file_cache.h | 40 +-
be/src/io/cache/cached_remote_file_reader.cpp | 10 +-
be/src/io/cache/cached_remote_file_reader.h | 2 +-
be/src/io/cache/file_block.cpp | 8 +-
be/src/io/cache/file_block.h | 5 +
be/src/io/fs/s3_file_writer.cpp | 37 +-
be/src/olap/compaction.cpp | 2 +-
.../segment_v2/inverted_index_fs_directory.cpp | 14 -
be/src/runtime/runtime_filter_mgr.cpp | 10 -
be/src/runtime/runtime_filter_mgr.h | 1 -
be/src/service/point_query_executor.cpp | 25 +-
be/src/util/jsonb_parser_simd.h | 22 +-
.../aggregate_function_collect.h | 2 +-
.../aggregate_function_distinct.h | 2 +-
be/test/io/cache/block_file_cache_test.cpp | 108 +-
be/test/io/fs/s3_file_writer_test.cpp | 392 +++++
build.sh | 3 +-
cloud/CMakeLists.txt | 4 +
cloud/src/common/config.h | 18 +-
cloud/src/common/network_util.cpp | 11 +
cloud/src/meta-service/CMakeLists.txt | 1 +
cloud/src/meta-service/injection_point_http.cpp | 344 +++++
cloud/src/meta-service/meta_service.cpp | 90 +-
cloud/src/meta-service/meta_service_http.cpp | 4 +
cloud/src/meta-service/meta_service_resource.cpp | 30 +-
cloud/src/meta-service/meta_service_schema.cpp | 14 +-
cloud/src/meta-service/meta_service_schema.h | 6 +-
cloud/src/meta-service/meta_service_txn.cpp | 2 +-
cloud/src/meta-service/txn_lazy_committer.cpp | 5 +-
cloud/src/recycler/hdfs_accessor.cpp | 1 +
cloud/src/recycler/recycler.cpp | 246 +++-
cloud/src/resource-manager/resource_manager.cpp | 258 +++-
cloud/test/fdb_injection_test.cpp | 3 +
cloud/test/meta_service_http_test.cpp | 4 +-
cloud/test/meta_service_test.cpp | 55 +
cloud/test/recycler_test.cpp | 136 ++
cloud/test/resource_test.cpp | 4 +
common/cpp/sync_point.h | 2 +-
dist/NOTICE-dist.txt | 2 +-
.../docker-compose/hive/hive-2x.yaml.tpl | 9 +-
.../docker-compose/hive/hive-2x_settings.env | 2 +-
.../docker-compose/hive/hive-3x.yaml.tpl | 9 +-
docker/thirdparties/run-thirdparties-docker.sh | 27 +-
.../main/java/org/apache/doris/common/Config.java | 3 +-
.../org/apache/doris/analysis/AlterTableStmt.java | 7 +-
.../org/apache/doris/analysis/DateLiteral.java | 5 +
.../apache/doris/analysis/DropColumnClause.java | 2 +-
.../org/apache/doris/binlog/BinlogManager.java | 46 +-
.../apache/doris/catalog/ListPartitionInfo.java | 4 +
.../apache/doris/catalog/RangePartitionInfo.java | 3 +
.../org/apache/doris/cloud/catalog/CloudEnv.java | 13 +-
.../apache/doris/cloud/catalog/CloudPartition.java | 14 +-
.../doris/cloud/system/CloudSystemInfoService.java | 56 +-
.../transaction/CloudGlobalTransactionMgr.java | 21 +-
.../property/constants/S3Properties.java | 2 +
.../org/apache/doris/load/loadv2/LoadManager.java | 1 +
.../executable/DateTimeExtractAndTransform.java | 4 +-
.../expressions/functions/scalar/StrToDate.java | 3 +-
.../commands/insert/InsertIntoTableCommand.java | 11 +-
.../apache/doris/planner/GroupCommitPlanner.java | 1 +
.../apache/doris/analysis/AlterTableStmtTest.java | 21 +
.../doris/analysis/DropColumnClauseTest.java | 2 +-
gensrc/proto/cloud.proto | 2 +-
regression-test/conf/regression-conf.groovy | 1 +
.../external_table_p0/jdbc/test_jdbc_query_tvf.out | Bin 2342 -> 2354 bytes
.../test_switch_catalog_and_delete_internal.out | Bin 107 -> 133 bytes
...st_cloud_mow_stream_load_with_txn_conflict.out} | Bin 134 -> 122 bytes
regression-test/data/json_p0/test_json_double.csv | 2 +
.../data/json_p0/test_json_load_double.out | Bin 0 -> 271 bytes
.../data/point_query_p0/test_point_query.out | Bin 9833 -> 9896 bytes
.../join/test_low_bucket/test_low_bucket.out | Bin 0 -> 945 bytes
regression-test/data/tpcds_sf100_p2/sql/q17.out | Bin 6376 -> 6594 bytes
.../schema_change_with_txn_conflict.out} | Bin 131 -> 185 bytes
.../org/apache/doris/regression/suite/Suite.groovy | 27 +
.../doris/regression/suite/SuiteCluster.groovy | 36 +
.../cloud_p0/conf/regression-conf-custom.groovy | 2 +
regression-test/plugins/aliyun_oss_sdk.groovy | 7 +
.../plugins/cloud_show_data_plugin.groovy | 94 +-
.../suites/auth_p0/test_query_tvf_auth.groovy | 6 +-
.../test_binlog_config_change.groovy | 8 +-
.../inverted_index/test_get_binlog.groovy | 10 +-
.../inverted_index/test_ingest_binlog.groovy | 8 +-
.../inverted_index/test_multi_buckets.groovy | 8 +-
.../inverted_index/test_backup_restore.groovy | 8 +-
.../suites/cloud_p0/node_mgr/test_ms_api.groovy | 1553 ++++++++++++++++++++
.../node_mgr/test_sql_mode_node_mgr.groovy | 41 +
.../create_table_use_partition_policy.groovy | 55 +-
...paction_with_dup_key_max_file_size_limit.groovy | 6 +-
.../suites/datatype_p0/scalar_types/load.groovy | 6 +-
.../export_p2/test_export_max_file_size.groovy | 269 ++--
.../test_outfile_orc_max_file_size.groovy | 218 +--
.../suites/export_p2/test_outfile_p2.groovy | 95 +-
.../jdbc/test_jdbc_query_tvf.groovy | 2 +-
.../test_switch_catalog_and_delete_internal.groovy | 10 +-
.../lower_case/test_conflict_name.groovy | 2 +-
.../lower_case/test_meta_names_mapping.groovy | 2 +-
.../tvf/test_frontends_disks_tvf.groovy | 2 +-
.../test_insert_from_tvf_with_common_user.groovy | 2 +-
.../tvf/test_local_tvf_compression.groovy | 2 +-
.../tvf/test_local_tvf_enclose.groovy | 2 +-
...test_local_tvf_parquet_unsigned_integers.groovy | 2 +-
.../tvf/test_local_tvf_with_complex_type.groovy | 2 +-
...t_local_tvf_with_complex_type_element_at.groovy | 2 +-
...l_tvf_with_complex_type_insertinto_doris.groovy | 2 +-
.../tvf/test_read_csv_empty_line_as_null.groovy | 2 +-
.../external_table_p0/tvf/test_s3_tvf.groovy | 2 +-
.../tvf/test_s3_tvf_compression.groovy | 2 +-
.../tvf/test_s3_tvf_parquet_compress.groovy | 2 +-
.../tvf/test_s3_tvf_with_resource.groovy | 2 +-
.../tvf/test_tvf_csv_line_end.groovy | 2 +-
..._cloud_mow_stream_load_with_txn_conflict.groovy | 61 +
.../test_full_compaciton_run_status.groovy | 2 +
.../test_index_bkd_writer_fault_injection.groovy | 2 +-
.../test_index_compaction_fault_injection.groovy | 4 +-
...index_compound_directory_fault_injection.groovy | 2 +-
.../test_index_ddl_fault_injection.groovy | 2 +-
.../test_index_fault_injection.groovy | 4 +-
.../test_index_io_context.groovy | 4 +-
.../test_index_compaction_unique_keys_arr.groovy | 2 +-
.../index_change/test_index_change_1.groovy | 8 +-
.../index_change/test_index_change_2.groovy | 4 +-
.../index_change/test_index_change_3.groovy | 4 +-
.../index_change/test_index_change_4.groovy | 4 +-
.../test_index_compaction_dup_keys.groovy | 2 +-
.../test_index_compaction_null.groovy | 4 +-
.../test_index_compaction_p0.groovy | 5 +-
.../test_index_compaction_unique_keys.groovy | 2 +-
.../storage_format/test_storage_format_v1.groovy | 2 +-
.../storage_format/test_storage_format_v2.groovy | 2 +-
.../inverted_index_p0/test_count_on_index.groovy | 4 +-
.../test_index_equal_select.groovy | 2 +-
.../test_index_key_match_select.groovy | 2 +-
.../test_index_like_select.groovy | 4 +-
.../test_index_match_phrase.groovy | 4 +-
.../test_index_match_select.groovy | 8 +-
.../test_index_no_need_read_data.groovy | 2 +-
.../test_index_range_between_select.groovy | 4 +-
...test_index_range_bigger_and_equal_select.groovy | 2 +-
.../test_index_range_bigger_select.groovy | 2 +-
.../test_index_range_in_select.groovy | 4 +-
.../test_index_range_not_in_select.groovy | 4 +-
...est_index_range_smaller_and_equal_select.groovy | 2 +-
.../test_index_range_smaller_select.groovy | 2 +-
.../test_inverted_index_mor.groovy | 2 +-
.../test_inverted_index_null.groovy | 2 +-
.../test_inverted_index_null_ram_dir.groovy | 2 +-
.../test_inverted_index_v2_file_size.groovy | 2 +-
.../suites/inverted_index_p0/test_lowercase.groovy | 2 +-
.../test_pk_no_need_read_data.groovy | 2 +-
.../test_mow_with_null_sequence.groovy | 4 +-
.../test_index_compaction_p1.groovy | 6 +-
.../suites/inverted_index_p2/test_show_data.groovy | 10 +-
.../test_json_load_double.groovy} | 69 +-
.../stream_load/test_load_with_decimal.groovy | 2 +-
.../suites/manager/test_manager_interface_1.groovy | 8 +-
.../suites/metrics_p0/test_version_metrics.groovy | 75 +
.../test_date_function_v2.groovy | 60 +
.../suites/nereids_syntax_p0/match.groovy | 6 +-
regression-test/suites/opensky_p2/load.groovy | 4 +-
.../test_auto_partition_behavior.groovy | 2 +-
.../suites/point_query_p0/test_point_query.groovy | 7 +
.../join/test_low_bucket/test_low_bucket.groovy | 285 ++++
...test_schema_change_with_mow_txn_conflict.groovy | 2 +-
.../test_cloud_follower_show_data.groovy | 11 +-
.../test_cloud_mtmv_show_data.groovy | 62 +-
...ema_change_add_and_drop_column_show_data.groovy | 24 +-
...hema_change_add_and_drop_index_show_data.groovy | 20 +-
...d_schema_change_reorder_column_show_data.groovy | 15 +-
.../test_cloud_delete_table_rows_show_data.groovy | 27 +-
...oud_drop_and_recover_partition_show_data.groovy | 40 +-
.../test_cloud_drop_table_show_data.groovy | 44 +-
... => test_cloud_truncate_table_show_data.groovy} | 53 +-
.../test_cloud_disable_compaction_show_data.groovy | 11 +-
.../test_cloud_inverted_index_v1_show_data.groovy | 11 +-
.../test_cloud_inverted_index_v2_show_data.groovy | 11 +-
.../test_cloud_lz4_show_data.groovy | 11 +-
.../test_cloud_zstd_show_data.groovy | 11 +-
.../test_cloud_agg_show_data.groovy | 11 +-
.../test_cloud_dup_show_data.groovy | 16 +-
.../test_cloud_mor_show_data.groovy | 11 +-
.../test_cloud_mow_partial_update_show_data.groovy | 13 +-
.../test_cloud_mow_show_data.groovy | 11 +-
.../statistics/test_external_partition.groovy | 2 +-
.../schema_change_with_txn_conflict.groovy | 49 +
.../vault_p0/create/test_create_vault.groovy | 63 +
.../test_workload_sched_policy.groovy | 57 -
197 files changed, 5072 insertions(+), 1347 deletions(-)
create mode 100644 cloud/src/meta-service/injection_point_http.cpp
copy
regression-test/data/fault_injection_p0/cloud/{test_cloud_mow_stream_load_with_commit_fail.out
=> test_cloud_mow_stream_load_with_txn_conflict.out} (91%)
create mode 100644 regression-test/data/json_p0/test_json_double.csv
create mode 100644 regression-test/data/json_p0/test_json_load_double.out
create mode 100644
regression-test/data/query_p0/join/test_low_bucket/test_low_bucket.out
copy
regression-test/data/{auto_increment_p2/test_unique_auto_inc_concurrent.out =>
variant_p0/schema_change/schema_change_with_txn_conflict.out} (57%)
create mode 100644 regression-test/suites/cloud_p0/node_mgr/test_ms_api.groovy
create mode 100644
regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_stream_load_with_txn_conflict.groovy
copy regression-test/suites/{jsonb_p0/test_jsonb_cast.groovy =>
json_p0/test_json_load_double.groovy} (52%)
create mode 100644
regression-test/suites/metrics_p0/test_version_metrics.groovy
create mode 100644
regression-test/suites/nereids_p0/sql_functions/datetime_functions/test_date_function_v2.groovy
create mode 100644
regression-test/suites/query_p0/join/test_low_bucket/test_low_bucket.groovy
rename
regression-test/suites/show_data_p2/test_table_operation/{test_cloud_truncate_and_recover_table_show_data.groovy
=> test_cloud_truncate_table_show_data.groovy} (77%)
create mode 100644
regression-test/suites/variant_p0/schema_change/schema_change_with_txn_conflict.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
