This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch auto-pick-48775-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 6ea6e4e8daf [Fix](merge-on-write) should re-calculate delete bitmaps
between segments if BE restart before publish (#48775)
add cd7e03f59b2 branch-3.0: [fix](index build) Correct inverted index
behavior after dynamically adding a column #48389 (#48547)
add 68ffec777ad branch-3.0: [fix](build index) Forbid building indexes for
ngram BF indexes #47041 (#47146)
add d036421157a branch-3.0: [test](stable) fix some unstable hive and mc
cases #48697 (#48769)
add ac7bc80eeeb branch-3.0 [fix] (inverted index) Fix UTF-8 4-byte
truncation issue and add configuration to control correct term writing (#48657)
(#48792)
add 75103ae89d8 [test](fe) Add session variable enable_reserve_memory for
testing (#48806)
add 6ddff3dec12 [improve](ipv6) Enhance ipv6 type to accept uint128
strings in netwo… (#48802)
add 92ab9be5a54 branch-3.0: [case](auth)grant usage_priv to user when in
vault mode #47316 (#48413)
add e531acbd585 branch 3.0: [fix](regression) topn-filter unstable case
#47797 (#48367)
add 48e65ebba6e branch-3.0: [case](mtmv)The impact of validating the base
table and m… (#48549)
add 77c6b81ef28 branch-3.0: [fix](file-cache) Clear file cache when tablet
meta not found in ms #48318 (#48437)
add 230774bdf6f branch-3.0: [test](kerberos)Add hdfs(tvf),outfile and
export test (#48433) (#48814)
add f4aefd058cd branch-3.0: [fix](Nereids) nested window function with
order by raise exception #48492 (#48676)
add 9fb783187b9 branch-3.0: [fix](regression) fix cache p0 regression
tests #48515 (#48561)
add 10595e5b46b branch-3.0: [fix](nereids)fix unstable
test_correlated_filter_removed case #48520 (#48659)
add 9ec20604558 branch-3.0: [fix](nereids) fix create/alter view column
name force cast to lower case #48569 (#48600)
add 17c7309d548 branch-3.0: [fix](Nereids) divide const folding for
decimalv3 return type is not correct #48641 (#48679)
add 634f2d5e03d branch-3.0: [fix](Nereids) string constant folding process
regex delim by mistake #48783 (#48822)
add 9fadab4544f branch-3.0: [enhancement](threadpool) reduce thread pool
for arrow flight and spill io threads #48530 (#48555)
add 8e77cc94be9 branch-3.0: [fix](cloud) Modify the log level to prevent
too many logs #48524 (#48796)
add d5c6a0c8cfe branch-3.0: [Chore](client) Do not log in thrift exception
when ADDRESS_SANITIZER is defined #48430 (#48453)
add 1ac212cdd16 branch-3.0: [fix](memtable) revert #47860 and fix #47610
#48489 (#48637)
add 5dfcabf1de4 branch-3.0: [fix](cloud) fix filecache warmup crash due to
spurious wakeup #48623 (#48654)
add 31342672dc9 branch-3.0: [fix](cloud) speed up file cache initializtion
#48687 (#48798)
add 79df82ba620 branch-3.0: [fix](func) Fix be core dump caused by mem out
of bound #48693 (#48845)
add f7ed94624e9 branch-3.0-pick: [Fix](cloud) Should consider tablet state
change whether to skip `sync_rowsets` in publish phase (#48400) (#48667)
add 4757dadad5b branch-3.0: [fix](heartbeat) avoid failure immediately due
to connection reset #48444 (#48634)
add 2edecb87531 branch-3.0: [fix])(catalog)add equals for external table
#47956 (#48348)
add eff7875a263 branch-3.0: [enhance](mtmv)mv_infos not hold read lock of
tables #47415 (#48674)
add aa9a7ef5e64 branch-3.0: [enhance](auth)The priority of attributes is
higher than session vari… (#48548)
add 9c95d0d8f90 branch-3.0: [fix](nereids)Support negative partition range
value and negative column default value. #48297 (#48421)
add e71c5c0bb8f branch-3.0:[opt](mtmv) metadata cache of external table no
longer be refreshed b… (#48767)
add 9c39a343fc7 [fix](load) add lock for
runtime_state->tablet_commit_infos (#48709) (#48732)
add f662722abe9 branch-3.0-pick: [Fix](mow) Fix some logs for mow (#48523)
(#48664)
add 32eb08266e8 branch-3.0-pick: [Opt](merge-on-write) Check delete bitmap
cache after writing it (#48233) (#48493)
add 9ff8d4891e9 branch-3.0: [fix](cold hot separation) Fix the issue that
files on the remote storage are not deleted after triggering cold data
compaction. (#48109) (#48445)
add 8163b6bdab9 [Fix](merge-on-write) should re-calculate delete bitmaps
between segments if BE restart before publish (#48775)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6ea6e4e8daf)
\
N -- N -- N refs/heads/auto-pick-48775-branch-3.0 (8163b6bdab9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 20 +-
.../cloud/cloud_engine_calc_delete_bitmap_task.h | 3 +
be/src/cloud/cloud_tablet.cpp | 23 +-
be/src/cloud/cloud_tablet.h | 3 +
be/src/cloud/cloud_warm_up_manager.cpp | 9 +-
be/src/clucene | 2 +-
be/src/common/config.cpp | 3 +
be/src/common/config.h | 3 +
be/src/io/cache/fs_file_cache_storage.cpp | 93 +-
be/src/io/fs/multi_table_pipe.cpp | 4 +-
be/src/olap/base_tablet.cpp | 16 +-
be/src/olap/base_tablet.h | 4 +
be/src/olap/memtable_writer.cpp | 7 +-
be/src/olap/olap_server.cpp | 2 +-
.../rowset/segment_v2/inverted_index_writer.cpp | 1 +
be/src/olap/task/index_builder.cpp | 11 +-
be/src/olap/task/index_builder.h | 18 +-
be/src/runtime/fragment_mgr.cpp | 31 +-
be/src/runtime/runtime_state.h | 27 +-
.../runtime/stream_load/stream_load_executor.cpp | 2 +-
be/src/service/internal_service.cpp | 2 +-
be/src/vec/functions/function_ip.cpp | 3 +
be/src/vec/functions/function_ip.h | 44 +
be/src/vec/functions/function_string.cpp | 14 +-
be/src/vec/runtime/ipv6_value.h | 11 +
be/src/vec/sink/writer/vtablet_writer.cpp | 21 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 5 +-
be/src/vec/spill/spill_stream_manager.cpp | 3 +-
be/test/olap/index_builder_test.cpp | 2422 ++++++++++++++++++++
.../segment_v2/inverted_index_writer_test.cpp | 828 +++++++
cloud/src/meta-service/meta_service.cpp | 34 +-
cloud/test/meta_service_test.cpp | 23 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +-
.../apache/doris/alter/SchemaChangeHandler.java | 17 +-
.../apache/doris/analysis/BuildIndexClause.java | 4 +
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../java/org/apache/doris/catalog/Replica.java | 4 +-
.../apache/doris/cloud/catalog/CloudReplica.java | 4 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 18 +-
.../transaction/CloudGlobalTransactionMgr.java | 18 +-
.../transaction/DeleteBitmapUpdateLockContext.java | 6 +
.../apache/doris/datasource/ExternalCatalog.java | 18 +
.../apache/doris/datasource/ExternalDatabase.java | 19 +
.../org/apache/doris/datasource/ExternalTable.java | 18 +
.../doris/datasource/hive/HMSExternalTable.java | 2 -
.../org/apache/doris/master/ReportHandler.java | 16 +
.../doris/nereids/parser/LogicalPlanBuilder.java | 18 +-
.../processor/post/TopnFilterPushDownVisitor.java | 2 +-
.../ExtractAndNormalizeWindowExpression.java | 2 +-
.../functions/executable/NumericArithmetic.java | 7 +-
.../functions/executable/StringArithmetic.java | 57 +-
...rNull.java => Ipv6FromUInt128StringOrNull.java} | 23 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../java/org/apache/doris/qe/ConnectContext.java | 65 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 4 +-
.../java/org/apache/doris/qe/SessionVariable.java | 9 +
.../java/org/apache/doris/system/HeartbeatMgr.java | 9 +
.../doris/tablefunction/MetadataGenerator.java | 26 +-
.../org/apache/doris/alter/IndexChangeJobTest.java | 34 +-
.../doris/alter/SchemaChangeHandlerTest.java | 154 +-
.../doris/datasource/ExternalEqualsTest.java | 52 +
.../org/apache/doris/qe/ConnectContextTest.java | 70 +
gensrc/proto/cloud.proto | 1 +
gensrc/script/doris_builtins_functions.py | 2 +
gensrc/thrift/AgentService.thrift | 2 +
.../data/datatype_p0/ip/test_data/ipv6_uint128.csv | 105 +
.../data/datatype_p0/ip/test_ip_basic.out | Bin 9441 -> 15062 bytes
.../hive/test_prepare_hive_data_in_case.out | Bin 267 -> 173 bytes
.../kerberos/test_non_catalog_kerberos.out} | Bin 141 -> 135 bytes
... test_tablet_state_change_in_publish_phase.out} | Bin 193 -> 227 bytes
.../test_function_string.out} | Bin 109 -> 121 bytes
.../test_index_change_on_new_column.out | Bin 245 -> 611 bytes
regression-test/data/mtmv_p0/test_base_mtmv.out | Bin 987 -> 1193 bytes
.../partition_p0/test_negative_partition_value.out | Bin 0 -> 375 bytes
.../test_negative_default_column_value.out} | Bin 141 -> 143 bytes
regression-test/data/view_p0/view_p0.out | Bin 982 -> 1144 bytes
.../pipeline/external/conf/regression-conf.groovy | 1 +
regression-test/pipeline/p0/conf/be.conf | 3 +
.../test_property_session.groovy} | 42 +-
.../suites/auth_call/test_ddl_job_auth.groovy | 12 +-
.../suites/auth_call/test_ddl_mtmv_auth.groovy | 10 +-
.../suites/auth_call/test_ddl_table_auth.groovy | 14 +-
.../cache/http/test_list_cache_file.groovy | 6 +-
.../warm_up/table/test_warm_up_table.groovy | 11 +-
.../suites/cloud_p0/cache/ttl/alter_ttl_1.groovy | 8 +-
.../suites/cloud_p0/cache/ttl/alter_ttl_2.groovy | 5 +-
.../suites/cloud_p0/cache/ttl/alter_ttl_3.groovy | 6 +-
.../suites/cloud_p0/cache/ttl/alter_ttl_4.groovy | 6 +-
.../cloud_p0/cache/ttl/alter_ttl_max_int64.groovy | 6 +-
.../cloud_p0/cache/ttl/alter_ttl_random.groovy | 6 +-
.../cloud_p0/cache/ttl/alter_ttl_seconds.groovy | 6 +-
.../cache/ttl/create_table_as_select.groovy | 13 +-
.../cloud_p0/cache/ttl/create_table_like.groovy | 7 +-
.../suites/cloud_p0/cache/ttl/test_ttl.groovy | 80 +-
.../cloud_p0/cache/ttl/test_ttl_lru_evict.groovy | 4 +-
.../cold_data_compaction.groovy} | 64 +-
.../suites/datatype_p0/ip/test_ip_basic.groovy | 50 +
.../hive/test_prepare_hive_data_in_case.groovy | 3 +-
.../kerberos/test_non_catalog_kerberos.groovy | 146 ++
.../test_max_compute_partition_prune.groovy | 3 +-
...est_tablet_state_change_in_publish_phase.groovy | 161 ++
.../test_function_string.groovy} | 34 +-
.../test_index_change_on_new_column.groovy | 90 +-
.../suites/mtmv_p0/test_base_mtmv.groovy | 38 +-
.../suites/mtmv_p0/test_build_mtmv.groovy | 15 +-
.../suites/mtmv_p0/test_hive_refresh_mtmv.groovy | 12 +
.../suites/mtmv_p0/test_replace_mtmv.groovy | 16 +-
.../fold_constant_numeric_arithmatic.groovy | 3 +
.../fold_constant_string_arithmatic.groovy | 123 +-
.../subquery/test_correlated_filter_removed.groovy | 16 +-
.../normalize_window_nullable_agg_test.groovy | 10 +
.../test_negative_partition_value.groovy | 58 +
.../query_p0/test_array_orderby_limit.groovy | 10 +-
.../test_negative_default_column_value.groovy} | 22 +-
regression-test/suites/view_p0/view_p0.groovy | 19 +
115 files changed, 5182 insertions(+), 446 deletions(-)
create mode 100644 be/test/olap/index_builder_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index_writer_test.cpp
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{ToIpv6OrNull.java
=> Ipv6FromUInt128StringOrNull.java} (71%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/ExternalEqualsTest.java
create mode 100644
regression-test/data/datatype_p0/ip/test_data/ipv6_uint128.csv
copy
regression-test/data/{unique_with_mow_p0/partial_update/test_partial_update_after_delete.out
=> external_table_p0/kerberos/test_non_catalog_kerberos.out} (90%)
copy
regression-test/data/fault_injection_p0/cloud/{test_cloud_mow_stale_resp_load_compaction_conflict.out
=> test_tablet_state_change_in_publish_phase.out} (76%)
copy
regression-test/data/{compaction/test_single_compaction_with_variant_inverted_index.out
=> function_p0/test_function_string.out} (88%)
create mode 100644
regression-test/data/partition_p0/test_negative_partition_value.out
copy regression-test/data/{bloom_filter_p0/test_bloom_filter_drop_column.out
=> table_p0/test_negative_default_column_value.out} (67%)
copy regression-test/suites/{auth_call/test_dml_cancel_profile_auth.groovy =>
account_p0/test_property_session.groovy} (57%)
copy
regression-test/suites/{fault_injection_p0/test_cold_data_compaction_fault_injection.groovy
=> cold_heat_separation/cold_data_compaction.groovy} (65%)
create mode 100644
regression-test/suites/external_table_p0/kerberos/test_non_catalog_kerberos.groovy
create mode 100644
regression-test/suites/fault_injection_p0/cloud/test_tablet_state_change_in_publish_phase.groovy
copy regression-test/suites/{correctness/test_float_round_up.groovy =>
function_p0/test_function_string.groovy} (57%)
create mode 100644
regression-test/suites/partition_p0/test_negative_partition_value.groovy
copy regression-test/suites/{nereids_syntax_p0/order_by_const.groovy =>
table_p0/test_negative_default_column_value.groovy} (59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
