This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch auto-pick-42949-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
omit b002a42890a [Fix](Rowset Id) Use a randomly generated rowset ID to
handle memory write failures (#42949)
add d0b061420cd [opt](store) allow to set storage_page_size for tables
(#43690) (#43918)
add fd7233143cf branch-3.0: [misc](config) adjust disk resourse limit mode
entrance threshold #43779 (#43950)
add 5f1dca011b9 branch-3.0: [fix](cloud) fix file cache missing when
compaction and improve bvars #43804 (#43951)
add 83f3dbd7a63 branch-3.0: [cases](ip) improve cases for ip functions
(#43346)
add b85c39462ea branch-3.0: [improve](load) do not block delta writer if
memtable memory is low #42649 (#43943)
add 50475fa936f branch-3.0: [test](mtmv) Auto calc the value of
sync_cbo_rewrite variable to makesure the same test code in different version
(#43331)
add b3a102541d2 branch-3.0: [fix](mtmv) Fix generate hyper graph wrongly
when has filter which can not push down #43539 (#43944)
add 0c695b94156 branch-3.0: [fix](mtmv) Fix partition track column fail
when 'select *' used in related partition side #43531 (#43940)
add de05a9b330e branch-3.0: [Fix](UT) Fix status UT error introduced by
#43731 #43922 (#43925)
add 74f48b6fadd branch-3.0: [opt](s3filewriter) Optimize exception
handling when put object #43809 (#43964)
add c645310bb9a branch-3.0: [refactor](regression) Re-arrange cases for
data-partitioning doc (#43637)
add 27125e6d1d0 [fix](cloud-mow) tablet_id should use int64_t to avoid
truncation problem when removing old delete bitmap (#43968)
add 59e7ece6c72 [Fix](multi-catalog)Fixed incorrect parameter transmission
when obtaining files by hms partition and incorrect parameter transmission
concurrently. #43767 (#43914)
add 122d1ae4384 branch-3.0: [fix](regression)Fix unstable delta rows case.
#43928 (#43987)
add adfbe69415e branch-3.0: [Fix](auto-increment) Fix duplicate
auto-increment column value problem #43774 (#43983)
add f2c3201217e [Refactor](inverted index) refactor inverted index file
writer for v1/v2 index write #42328 (#43993)
add 78735fec7a3 branch-3.0: [refactor](binlog) put recording dropped
resource into a seperate method #43938 (#43965)
add 415d9e06c2e branch-3.0: [improvement](statistics)Skip auto analyze
empty table. #43865 (#44035)
add d44c2364dc8 branch-3.0: [fix](datacheck) let count skip opt via meta
#43743 (#43980)
add 6fb32f532b4 branch-3.0: [Fix](DDL) Fix wrong show create table stmt
for auto list multi-columns partition #43967 (#44005)
add a50bba39e4e Revert "[Improvement](shuffle) Use a knob to decide
whether a serial … (#44076)
add f52b29738d9 [fix](inverted index) Fix the incorrect type usage in the
test_storage_page_size_fault case. #44080 (#44081)
add 2f8df59ec58 branch-3.0: [fix](test) fix setFeFrontend config #44068
(#44072)
add 6e3751a5c2c [fix](cloud-mow) MS should create new Transaction to
continue geting delete bitmap when encounter TXN_TOO_OLD (#44074)
add 502126a4bf0 branch-3.0: [Fix](ShortCircuit) fix open segments leading
to bad performace #44073 (#44077)
add d252fca2b6b branch-3.0: [improve](backup) Add the commit seq at the
backup job level. #44049 (#44065)
add a4406ff586b [cherry-pick](branch-3.0) Pick "[Fix](status) Fix wrong
status check in data size check (#43545)" (#44085)
add 43facc4a581 branch-3.0: [fix](tool) fix fdbcli help #44079 (#44087)
add 0de658625e9 branch-3.0: [docs](fdb_ctl) remove fdbmonitor.pid file
when stopping fdb #44053 (#44055)
add 028a4509eab branch-3.0: [fix](Export) fix a memory leak in the FE
because of the ExportJob #44019 (#44088)
add 72729ed7880 branch-3.0: [fix](inverted index) Fix undefined behavior
in write_v2 #44084 (#44091)
add 4ccf9426d18 branch-3.0: [thirdparty](patch) Fix brpc (1.4.0) security
issue CVE-2023-31039 #44066 (#44090)
add 6bae390d60f branch-3.0: [opt](paimon)Optimize the display of
splitstate to prevent too many splits #43982 (#44059)
add d9babfdab5d branch-3.0: [fix](binlog) add modify comment binlog when
replaying journal #43827 (#43985)
add 3e445227a96 branch-3.0: [improve](http) Save the requested url in http
execution error #43855 (#44051)
add 15e26de31d1 [feature](function) add approx_top_k aggregation function
(#44082)
add fdbd9caf977 branch-3.0: [opt](inverted index) add performance
profiling for remote io access in inverted index #43542 (#44093)
add 50f3ef17fb1 branch-3.0: [Opt](ShortCircuit) opt some serialization and
fix error when prepared statment excute failed #43974 (#44116)
add d58aafb32d1 branch-3.0: [fix](Nereids) simplify comparison predicate
do wrong cast #44054 (#44107)
add 833e679a6af branch-3.0: [fix](dynamic partition) data lost with very
small dynamic_partition.start #43898 (#44032)
add b7a62a06ec1 [branch-3.0](runtime filter) pick #43885 (#44130)
add d68516780a4 [feat](nereids)disable join reorder if any table row count
is not available (#43000) branch-3.0 (#44026)
add 2aa1fa281ea branch-3.0: [fix](Nereids) fold const return type does not
matched with type coercion #44022 (#44139)
add 7f2e5f844f1 [pick](branch-3.0) #41754 #41770 (#44143)
add e9116e64eaa [Feature](sink) support parallel outfile (#41039) (#44125)
add 449e9d67187 [fix](analyzer) fixed the NullPointerException (#43269)
(#44162)
add 0a6a79e0f9d branch-3.0: [feat](catalog)Support Pre-Execution
Authentication for HMS Type Iceberg Catalog Operations. #43445 (#44127)
add b0244ff5544 [refactor](exchange) Optimize the logic related to sending
and closing (#41968) (#44175)
add 984b47d9b12 branch-3.0: [fix](external) fix count(*) performance
fallback in external table query #44172 (#44193)
add b84aefa013f [Bug](outfile) fix missing result when parallel outfile
enabled (#43205) (#44184)
add 6c338e60cd0 [cherry-pick](branch-30) fix exchange of tablet shuffle
send block error (#44102) (#44166)
add 0928ace94f6 branch-3.0: [Bug](function) fix cut_ipv6 function error
about modify the input column data #43921 (#44179)
add 3a45819bc81 [fix](nereids)the column name should be case insensitive
in tablet prune (#44198)
add 7d50da93cb4 [fix](compile) fix macos compile failed (#44061) (#44201)
add c45ba399015 branch-3.0: [test](statistics)Add stats test for replace
table. #44011 (#44211)
add c914d8044a0 [opt] (binlog) Support Modify ViewDef binlog #41167
(#44115)
add 17afb65f432 [fix](nereids)add physical property in post processor
(#42862) branch-3.0 (#44027)
add d38c7224c8e [opt](binlog) Support drop view binlog #39781 (#44112)
add 3016fb760ed [chore](autopick)Delete Auto Pick Branch (#44235)
add 2eff82ec1eb [chore](release) bump to 3.0.3-rc01 (#44217)
add eb0054f5bd0 Revert "[fix](inverted index) Fix the incorrect type usage
in the test_storage_page_size_fault case." (#44232)
add aff8d7c0096 branch-3.0: [chore](sink) `enable_parallel_result_sink`
default value is changed to false #43933 (#44241)
add b137aaef311 [fix](config) Turn off default value of
`enable_cloud_tablet_report` (#44176)
add 486fb5be5e1 [fix](jvm)fix jvm metrics memory leak. (#44218)
add d541430c396 [chore](ci) fix download url (#44259)
add c149e8343f1 branch-3.0: [fix](s3) do not replace https scheme if
specified #44242 (#44249)
add a346e77da7a [fix](s3) do not replace https scheme if specified #44242
(#44243)
add d8cb16e24c3 branch-3.0: [chore](ci) adjust some invalid url #44261
(#44269)
add 4b32de3ca1f [chore](ci) trigger ut if dir gensrc changed (#43949)
(#44275)
add 74804782b51 [chore](ci) adjust cloud_p0 regression-conf-custom.groovy
(#44264)
add 3155548dfee [fix](case) fix test_schema_change_ck (#41654) (#44254)
add ccd1875fb2b branch-3.0: [fix](auth)Fix all priv not contain
Show_view_priv #43605 (#44140)
add f2e4b748bfc branch-3.0: [fix](mtmv)After failure, one should quickly
return to avoid repeated failures #44174 (#44203)
add 8f2898dd61e branch-3.0: [fix](transaction load) transaction may
publish stuck if fe restart #44190 (#44266)
add aa64b644d12 branch-3.0: [fix](test) logging result of show tablet to
investigate problem #44224 (#44256)
add dcf3785dfb1 Revert "[opt](store) allow to set storage_page_size for
tables (#43690)" (#44246)
add 843f7b5883a [fix](runtime filter) Fix runtime filter producers (#44293)
add 2e7ed69aa8c branch-3.0: [fix](regression) warmup_show_stmt flaky by
concurrent execution #44226 (#44287)
add 8277c51c78c branch-3.0: [Fix](cases) Make auto&dynamic cases sleep
long enough #44228 (#44276)
add 0b98983b846 branch-3.0: [fix](cloud) fix BlockFileCache::get_or_set
crash #44013 (#44146)
add 2332c5a12ba branch-3.0: [chore](build) put tools in release package
#44216 (#44323)
add 55a06fd57d4 branch-3.0: [fix](Nereids) simplify conditional function
generate wrong nullable #44209 (#44334)
add 7e0410ed266 branch-3.0: [improvement](statistics)Change auto analyze
max width to 300 and health threshold to 90. #42104 (#44366)
add 9cd12878aee branch-3.0: [Fix](ms) Fix ci-uncaught ut coredump due to
dynamic rate limit setting #44362 (#44370)
add 67e0500920a branch-3.0: [test](doc) add cancel-warm-up example in
doris's doc to regression test #43286 (#44372)
add 1e253cd04a4 [Improvement](runtime-filter) send
RUNTIME_BLOOM_FILTER_MAX_SIZE to b… #38972 (#42321)
add bedaa26fa51 [opt](test) Make the case stable. (#44195) (#43203)
(#44368)
add 55ebad01217 [chore] bump to 3.0.3-rc02 (#44390)
add ece8411dd3f [fix](branch-3.0) Fix regression-test arrow flight sql
port (#44407)
add 3418dfd8cad [test](routine load) fix some unstable routine load cases
(#42252) (#44376)
add cd59bc3fd4b branch-3.0: [fix](move-memtable) immediately return error
when close wait failed #44344 (#44386)
add 5281fb45480 branch-3.0: [fix](Nereids) repeat's output properties is
not right #44297 (#44336)
add ce557525971 Revert "branch-3.0: [improve](load) do not block delta
writer if memtable memory is low #42649 (#43943)" (#44428)
add a1c039ed780 branch-3.0: [fix](case) fix mow cluster key case #43066
(#44434)
add 2122f13e4b6 branch-3.0: [opt](scan) Release instances of Segment to
avoid consuming a large amount of memory in ParallelScannerBuilder #44189
(#44445)
add eeda1ce48f2 [pick](mtmv) Pick some pr to branch 3.0 #41674 #43095
#44164 (#44290)
add ee7b8e34cec branch-3.0: [case](mtmv)Cannot compare the number of
replicas to 1, as the pipeline may force the number of replicas to be set
#44417 (#44462)
add 5f1f5ef328f [fix](regression) fix
unique_with_mow_c_p0/test_schema_change_ck (#44342) (#44487)
add 94a6eacd9df branch-3.0: [fix](suites) Fix syncer ingest binlog with
multiple replicas #44444 (#44486)
add 2f7052206e4 Revert "[fix] (compaction) fix compaction score in time
series policy (#40242)" (#44491)
add 7489aafff36 [fix](bloom filter)Fix drop column with bloom filter index
(#44361) (#44476)
add e1b8296d3b9 branch-3.0: [Fix](checker) Fixed infinite loop after
internal error in checker. #44479 (#44495)
add b71b35e0094 branch-3.0: [fix](regression) fix txn insert case #44395
(#44492)
add 49d699c766d [opt](file_cache) Add config to enable base compaction
output to file cache (#44497) (#44496)
add 43f06a5e262 [chore] bump to 3.0.3-rc03 (#44521)
add 74b9658688f branch-3.0: [fix](readme) remove contributor graph and
change to contributor wall #44534 (#44535)
add ef6258321cf [feat](binlog) Add replace table binlog #44263 (#44518)
add d993874d40d branch-3.0: [fix](index) Fix create index/index def to sql
#44392 (#44493)
add a5a2a56114d [branch-3.0](pick) pick #44169 #44367 (#44394)
add fbe0e6e80e8 branch-3.0: [fix](local shuffle) Fix unbalanced data
distribution #44137 (#44234)
add fe0b4378949 branch-3.0: [minor](log) Add more information in error
message #44452 (#44474)
add 27ee6ed1bd6 branch-3.0: [fix](coordinator) Fix wrong bucket assginment
in old-version coordin… #44539 (#44571)
add fc5be46c3b8 branch-3.0: [fix](table) Disable create, alter auto bucket
table with colocate #44396 (#44509)
add b64ae7811fc [pick](branch-3.0) #38215 #43281 #43960 (#44244)
add 1298e84a40d branch-3.0: [fix](nereids)lag and lead function's
nullability is wrong #44050 (#44557)
add 98e8b2c8503 branch-3.0: [Fix](full compaction) Full compaction should
not do ordered data compaction #44359 (#44432)
add 168f75ebf52 [Improvement](runtime-filter) enlarge
merge_filter_callback timeout_m… #42602 (#44593)
add 92e0221bf77 [branch-3.0](pick) pick #44421 #44459 #44545 (#44591)
add 23e871700fc [feat](binlog) Support add/build/drop inverted index
binlog #44418 (#44583)
add a812d38cef6 branch-3.0: [fix](group commit) remove unused code #44015
(#44052)
add 1b785c4480f branch-3.0: [improve](cloud-mow) Optimize log output when
missing delete bitmap cache #44446 (#44559)
add 1b34ae3574a branch-3.0: [improve][ms] Bvars add the FDB
get_count_normalized indicator #44036 (#44350)
add 6da869417ef branch-3.0: [fix](config) fe config
sync_image_timeout_second should not be masterOnly #43954 (#44383)
add c3e381b7b3c branch-3.0: [Fix](merge-on-write) Fix
`MergeIndexDeleteBitmapCalculator::calculate_one()` coredump #44284 (#44328)
add 590459ba8ef branch-3.0: [fix](cloud) explicit message when parse
file_cache_path error #44004 (#44157)
add 9d1103927f3 branch-3.0: [fix](hive)Fixed the issue of reading hive
table with empty lzo files #43979 (#44062)
add 7918de0a68a branch-3.0: [fix](regression-test) Remove docker tag from
non docker case `test_dynamic_partition_mod_distribution_key` #44229 (#44303)
add 1b06f0288c9 branch-3.0: [enhance](mtmv)MTMV no longer generate cache
when replaying logs #44283 (#44307)
add 4e1cadb8b00 branch-3.0: [Fix](Job)The INSERT execution failed, but the
task record status is marked as successful. #44292 (#44442)
add 6e3446986d0 branch-3.0: [enhancement][fix] update storage vault case
for upgrade test #43948 (#44322)
add 53553158340 branch-3.0: [Fix](Job)Fix some issues in the Insert job.
#44543 (#44595)
add 756c6352855 branch-3.0: [fix](iceberg)Fix count(*) error with dangling
delete problem #44039 (#44100)
add 6d0df37a1af branch-3.0: [fix](iceberg)Delete the data files when
deleting the table #43441 (#44134)
add 97ecbba3e82 branch-3.0: [test](auth)Add grant show_view_priv to new
user #44260 (#44437)
add 5a754f947ed branch-3.0: [test](doc) add regression test case for load
high availability #43481 (#43945)
add f6ed2e5c1a4 branch-3.0: [performance](load) fix broker load scan
ranges for unsplittable files #43161 (#43975)
add 6390254f10b branch-3.0: [enhancement](cloud-schema-change) Rowset
[0-1] should not engage in delete bitmap calculation during MOW SC #44171
(#44258)
add 12ee1cff9fd branch-3.0: [Bug](function)fix json_object function check
null nums error as return bool #44321 (#44380)
add 4883e1eecc1 branch-3.0: [fix](sync mv) fix rewrite wrongly with sync
mv #39284 (#44516)
add 6d5d08e6309 [Chore](runtime-filter) add rpc error msg to
RuntimeFilterContext (#43517) (#44622)
add eef9ffd9de2 [fix](index) Fix CREATE/DROP INDEX stmt toSql #44494
(#44584)
add a565672578c [performance](move-memtable) async close tablet streams
(#41156 & #43813) (#44471)
add 8ec52e4dfad [fix](cloud-mow) Fix the issue of missing and removing
some old version delete bitmap (#44448)
add 940313c5e7f branch-3.0: [Fix](nereids) fix create view and alter view
using old parser checking #43263 (#44455)
add 123edb61192 branch-3.0: [fix](coordinator) Fix wrong bucket assignment
#44603 (#44636)
add 47c3f05206d branch-3.0: [cleanup](load) remove bvar
"g_memtable_input_block_allocated_size" #44304 (#44643)
add 49948419391 branch-3.0: [fix](backup) Automatic adapt upload/download
snapshot batch size #44560 (#44639)
add 78556dab2b6 branch-3.0: [feat](backup) Add config
backup_handler_update_interval_millis #44628 (#44638)
add 03b197189ac [fix](nereids)should set isForwardedToMaster and
redirectStatus to null before fallback to legacy planner (#44178)
add 26beabb0f04 [cherry-pick](branch-30) pick prs (#41779) (#41623)
(#44406)
add 676ce907f93 branch-3.0: [fix](inverted index) Content Check for
Tokenize Function Parser #44465 (#44554)
add cd70f1984e0 branch-3.0: [fix](nereids) fix ptopN push down under multi
winexprs with partial forbidden type #44617 (#44649)
add fd2936ae5ae branch-3.0: [Fix](insert) Fix
ENABLE_AUTO_CREATE_WHEN_OVERWRITE forward to Master #44570 (#44594)
add 29416e994fe [fix-3.0](auto-partition) Fix unintended partition
creation when insert overwrite auto detect for auto partition table (#44450)
add 750732eef1c [feat](binlog) Support rename rollup & partition binlogs
#44526 (#44663)
add 5e890c05f80 branch-3.0: [opt](mtmv) Support any_value aggregate
function rollup rewrite when exsits aggregate materialized view #44412 (#44566)
add ab7e094a258 branch-3.0: [fix](mtmv)When compatibility fails, null
pointers should not be reported #44464 (#44541)
add 39afe63ee62 branch-3.0: [opt](nereids) optimize push limit to agg
#44042 (#44656)
add b4750f14f45 [Feature](runtime-filter) cancel query when
runtime_filter's rpc fail… #43627 (#44657)
add fbc103ac425 [opt](paimon)Optimize the storage location of the
serialized paimon table for 3.0 (#44274) (#44664)
add 32e8d184fc2 branch-3.0: [Chore](runtime-filter) change some rf dcheck
to exception #44354 (#44371)
add 1992e2d9412 branch-3.0: [fix](nereids)add physical property in post
processor (#43001)
add 44ae865642d [chore](regression-test) Remove some flaky profile test.
#42396 (#44668)
add 6eb6a089509 branch-3.0: [fix](hyperscan) Fix hyper scan fall back to
re2 #44547 (#44652)
add eea11ed3cfe branch-3.0: [fix](build index)Fix non-master nodes cannot
see the latest build index job status #44544 (#44629)
add a324dcc22d5 branch-3.0: [improve](backup) Limit the output size of
show backup/restore job progress #44681 (#44706)
add 57483092d9d branch-3.0: [Fix](group commit) Fix Group Commit Selecting
Non-Alive Backend Instances #44577 (#44659)
add c4786e8775f branch-3.0: (fix)[db] Fix create database and create table
data race #44600 (#44682)
add df705edc7e0 branch-3.0: [enhance](table)Remove unnecessary locks
#44416 (#44467)
add ed7bd4631c2 [Bug](runtime-filter) avoid ignore rf multiple times
(#44408) (#44689)
add fe88ab2ec50 branch-3.0: [fix](planner) FunctionCallExpr clone should
be deep copy #44678 (#44710)
add 755d35cd616 branch-3.0: [fix](compaction)Fix cluster key column
duplicated in value columns group #44610 (#44709)
add 5ca36a48035 [fix](runtime filter) Avoid to use ignored runtime filter
(#44708) (#44718)
add 956c2357710 branch-3.0: [feat](binlog) Support drop rollup binlog
#44677 (#44714)
add 705012ef0d7 branch-3.0: [enhance](orc) Optimize ORC Predicate Pushdown
for OR-connected Predicate #43255 (#44436)
add 95fe7f08096 branch-3.0: [fix](clone) Fix wrong clone file path #44746
(#44772)
add ad29b07ea5e [fix](ip-search)fix ip search with inverted index (#44580)
(#44712)
add ec5ffadf963 branch-3.0: [fix](ip-search)fix ip search with inverted
index #44580 (#44762)
add 0f8813df877 branch-3.0: [regression-test](fix) fix case failed due to
global variable #44564 (#44606)
add 0ded2d97b63 branch-3.0: [test](mtmv)add create partition and partition
scrolling (#42852)
add ec09d89dccf [feat](nereids)set runtime filter wait time according to
table row count and table type #42640 branch-3.0 (#44031)
add be92ae2f9b4 branch-3.0: [opt](inverted index) Add troubleshooting logs
#44182 (#44291)
add 28915148227 branch-3.0: [improvement](jdbc catalog) Optimize JDBC
driver property settings #42923 (#44404)
add 16f36aacab9 branch-3.0: [enhance](regression-test) fix hudi
incremental query bug and add hudi p2 cases #44003 (#44457)
add 0c51bc6fc53 branch-3.0: [fix](meta-cache) fix refreshOnlyCatalogCache
when use_meta_cache = false #44363 (#44458)
add 8d580e9163a branch-3.0: [Bug](function)window funnel function should
support datetimev2 type get scale info #44420 (#44523)
add 61595df1e3d branch-3.0: [fix](inverted index) Modify Error Handling
for File Open Failure #44551 (#44675)
add 8e9eb1c0bf8 branch-3.0: [improve](cloud) adjust timeout settings for
BE brpc connection pool to meta-service #44374 (#44578)
add c67a806a9b5 branch-3.0: [opt](log) Detail log for file cache resource
limit mode #44094 (#44646)
add 9ff34b2bd97 branch-3.0: [Fix](Job)Fix the Calculation of the First
Trigger Time and Add a Single-Time Scheduling Compensation Logic #44268 (#44402)
add 9893fd7d50b branch-3.0: [improve](join) reuse the join block to reduce
malloc memory #43738 (#44774)
add 88926d2b7ee [fix](orc) check all the cases before
build_search_argument (#44615) (#44802)
add 7780dda2fdc branch-3.0: [improvement](mysql)Support mysql
COM_RESET_CONNECTION command. #44747 (#44787)
add 8e2c58175ea [feature](nereids)support show view command in nereids
(#44699)
add 47fbbfabace branch-3.0: [fix](iceberg)Bring field_id with parquet
files And fix map type's key optional #44470 (#44827)
add 73379300bfc [fix](nereids) fix months_add/ months_sub/
years_add/years_sub compute wrong result because
SimplifyArithmeticComparisonRule (#44725) (#44813)
add cb5a0b7649a branch-3.0: [Improvement](shuffle) Use a knob to decide
whether a serial exchange… #44676 (#44731)
add 95aacdaa99e [fix](sql_cache) fix sql cache result wrong of
from_unixtime(col, 'yyyy-MM-dd HH:mm:ss') (#44631) (#44811)
add 7af87cc80e2 branch-3.0: [refactor](cancel) Reduce lock scope in cancel
worker #42520 (#44837)
add d8bed481b38 [enhance](mtmv)External partition prune #44415 #44567
#44673 (#44844)
add 9affc1035ba branch-3.0: [Opt](SegmentIterator) clear and release
iterators memory footprint in advance when EOF #44768 (#44839)
add 19d9296fb9a [fix](cache) fix same sql return wrong result when switch
database with use db and enable sql cache (#44782) (#44852)
add cc85069f976 [Bug](runtime-filter) fix publish not inited rf when
broadcast join meet wake up by downsteam #44823 (#44860)
add 8e881cedd3e [fix](cluster key) 3.0 forbid mow cluster key (#44737)
add 66b9b8f8d26 branch-3.0: [Fix](TPartitionVersionInfo) Fix duplicate
`TPartitionVersionInfo` in `PublishVersionTask.partitionVersionInfos` #44846
(#44883)
add 06d9a44559d branch-3.0: [chore](binlog) Save table type in
CreateTableRecord #44735 (#44835)
add 866b70477f5 branch-3.0: [improve](routine load) ensure load balance
after scaling up BE nodes #44693 (#44798)
add 6e045458d0a [fix](nereids) fix UnknownValue's reference in simplify
range rule #44637 (#44770)
add 38799405c68 branch-3.0: [fix](arrow-flight-sql) Fix Doris NULL column
conversion to arrow batch #43929 (#44231)
add 74e085c7b94 branch-3.0: [feat] (inverted index) show index file size
#44120 (#44851)
add 5149adb8994 branch-3.0: [fix](unique key)
getEnableUniqueKeyMergeOnWrite should check keys type #44692 (#44895)
add 3db632d7644 branch-3.0: [fix](profile) only printed for non-sink
nodes in the merge profile. #44040 (#44251)
add 7e408541527 branch-3.0: [chore](test) Add info about buildKit required
with docker-compose #44095 (#44721)
add 0850bf3a263 branch-3.0: [fix](drop sql) add force in the tosql for
drop table and drop database #43227 (#44447)
add 5ed069e7a63 branch-3.0: [fix](cloud-mow)Fix some implicit conversion
loses when complie mow code #44410 (#44644)
add 5bf0c2a3cca branch-3.0: [conf](fe) Print jvm `ClassHistogram` in fe gc
log after full gc #44010 (#44245)
add bef24e34a30 branch-3.0: [opt](auto-inc) Allow to miss auto-increment
column and other value columns in partial update #44528 (#44800)
add 43f8b963553 branch-3.0: [fix](catalog) Fix infinity partition key
toSql #44834 (#44889)
add 3b45611a39e branch-3.0: [opt](ms) print segment key bounds size when
prepare/commit/update rowset meta #44715 (#44888)
add 34b5c99c13f [cherry-pick](branch-3.0)Change spin lock to mutex
(#44898)
add 15673516a94 branch-3.0: [test](move-memtable) fix false positives in
sinkv2 injection tests #44552 (#44930)
add 4a18647cdad branch-3.0: [fix](ForkJoinPool) we should not new a thread
pool every call #44891 (#44939)
add 052b7f90eec branch-3.0: [Opt](checker) Add checker for delete bitmaps
#44154 (#44952)
add feec68396ef branch-3.0: [fix](memory) Fix UT `ThreadMemTrackerMgrTest`
#44147 (#44935)
add 9a00544a9e4 branch-3.0: [fix](memory) Fix compatibility with CgroupV2
#44579 (#44933)
add 0460f61e777 branch-3.0: [fix](scanner) Delete meaningless finish
dependency in schema scanner #44915 (#44962)
add 12ba87a8d05 branch-3.0: [fix](recycler) fix idx file leak in recycler
#44908 (#44966)
add bb4c3f77ebf branch-3.0: [fix](func) Fix BE core dump caused by buffer
access out of bounds #44919 (#44969)
add fff936bf37d branch-3.0: [fix](agg) Fixed a core dump when using the
IPv6 type in array_agg. #44877 (#44917)
add abff86aab57 branch-3.0: [opt](exec) Use PASSTHROUGH to improve the
concurrency of the ADAPTIVE_PASSTHROUGH SINK. #44925 (#44964)
add 8efb98e8518 [feature](hive)support hive catalog read json table.
(#43469) (#44848)
add c76763bdbed [fix](maxcompute)add mc catalog read partition table
partition prune(#44508) (#44868)
add 5db6952b1d8 branch-3.0: [fix](auth)fix be enable http auth, some
request link never return. #44959 (#44980)
add e8ce6434b09 branch-3.0: [Test] add test for check show create table
sql #45002 (#45019)
add 7e8b4064a29 [Improvement](queue) Return value of concurrent queue
should be proce… (#45033)
add baedeb29e95 [feature](function) support
orthogonal_bitmap_expr_calculate & orthogonal_bitmap_expr_calculate_count for
nereids (#44671) (#44991) (#45011)
add fffe19a86bf branch-3.0: [fix](routine load) replace heavy work pool
with routine load thread pool for metadata fetching #44907 (#45039)
add 9d73f277c3c branch-3.0: [Fix](merge-on-write) Should clear
`GetDeleteBitmapUpdateLockResponse` when geting delete bitmap update lock fail
and retry #44975 (#45010)
add bbfb363cccd branch-3.0: [fix](third party) fix hang when destroy of
rdkafka instances #44913 (#44950)
add d6482e1b084 branch-3.0: [fix](hudi) upgrade hudi to 0.15.0
(#44267)(#44995) (#45054)
add 4f78c0ce7ce branch-3.0: [fix](arrow-flight-sql) Fix query result is
empty and not return query error message #45023 (#45052)
add 4952a7c54b7 branch-3.0: [fix](mtmv) Fix data wrong when query with
table operator such as TABLESAMPLE or tablet and so on #43030 (#44873)
add e5217a2cdfd branch-3.0: [fix](mtmv) Fix filter position different but
same causing rewritten by materialized view fail #44575 (#44899)
add 0734cc3c0f2 branch-3.0: [fix](mtmv) Fix mv rewrite fail when base
table add column #44867 (#44955)
add 5980ab05bfa [test](mtmv) Add inject statistic when mv rewrite
regression test to make sure rewrite result stable (#43785) (#44826)
add 0f00f11dbe0 branch-3.0: [opt](nereids) enhance
PUSH_DOWN_AGG_THROUGH_JOIN_ONE_SIDE #43856 (#45066)
add ff7c8cba7c2 [pick](branch-3.0) pick #41310 #41969 (#44945)
add 333f5a767cf [pick](branch-3.0) pick #41891 (#44946)
add b12d0eb4631 [pick](branch-3.0) pick #44489 #44894 (#45031)
add 4511e0fa1ec branch-3.0: [Chore](Job)Add scheduling logs for periodic
jobs. #44843 (#45070)
add 01f0003792d [fix](test)set replication_allocation = 1 (#45078)
add 175d9087212 branch-3.0: [fix](outfile) add regression test for outfile
#44734 (#44808)
add 17dec13b96e branch-3.0: [fix](Export) Fix the problem of exporting
stuck #44944 (#45093)
add b50b745e9ba branch-3.0: [opt](paimon)Remove unnecessary fields #44906
(#45097)
add 8de08c83476 branch-3.0: [improvement](information_schema)Support show
default value in information_schema. #44849 (#45079)
add 45fb516d74e branch-3.0: [fix](recycler) Process self-defined domain
names for s3 storage vault #45072 (#45100)
add d1c20c46e21 branch-3.0: [opt](cloud) reset ms response message in case
it is reused for retry #45068 (#45112)
add 3f3a9f42c4b branch-3.0: [fix](runtime_profile) fix race condition in
to_thrift #45047 (#45098)
add e6629acf720 branch-3.0: [fix](editlog) Fix replay BatchDropInfo #45077
(#45101)
add acae6ad059a branch-3.0: [fix](jdbc catalog) set
`enable_jdbc_cast_predicate_push_down` default true #44548 (#44759)
add 0525ed7d285 branch-3.0: [fix](routine load) fix invalid EOF tasks
scheduling delay #44949 (#45087)
add f4b98400783 branch-3.0: [Fix](merge-on-write) Add defensive check
before partial update #44687 (#45082)
add 054ae34b560 [improvement](compaction) reduce tablet skip compaction
time (#44273) (#44794)
add 15c3807f91f branch-3.0: [enchement](mc)mc catalog append netowrk
config #44194 (#45074)
add 7df5c10fc0f branch-3.0: [fix](hudi)Add hudi catalog read partition
table partition prune #44669 (#45111)
add 9add76b4d24 branch-3.0: [bugfix](hive)Fix split assignment leak.
releated to issue (#40683). #44845 (#45143)
add a364a715acd branch-3.0: [chore](job-test)Add comments to the job's
test cases #44627 (#45141)
add 16d5f027695 branch-3.0: [Fix](http)Enhanced Security Checks for Audit
Log File Names #44612 (#44832)
add d5f4d455d08 branch-3.0: [fix](case)fix manager show proc case
unstable. #45040 (#45139)
add 3ed7c556e19 branch-3.0: [feat](catalog)Replace HadoopUGI with
HadoopKerberosAuthenticator to Support Kerberos Ticket Auto-Renewal #44916
(#45137)
add fcd2ee74757 [fix](branch-3.0) Fix the data type mapping for complex
types in Doris to the ORC and Parquet file formats (#45122)
add bdd5e953192 branch-3.0: [Fix](job)Fix CAS competition failure leading
to message publishing failure. #45018 (#45029)
add abe8f22a061 branch-3.0: [enhance](mtmv)Optimize MTMV lock logic #44967
(#45014)
add 7c94ac5854a [fix](auth) Prohibit deleting admin user (#44751) (#45084)
add e9a60c4acf0 [fix](auth)Fix the need for low-level table permissions
when querying views in certain situations (#44621) (#44841)
add 860f7d057ac [feat](iceberg)Supports using `rest` type catalog to read
tables in unity catalog for 3.0 (#43525) (#45161)
add 46bd816f42d [opt](inverted index) Optimize the codes exception
handling process #44205 #44601 (#44862)
add 90ffe9068be [feat](nereids) adjust min/max for partition key #41729
branch-3.0 (#45110)
add 0bd1aba0ca5 [cherry-pick](branch3.0) impl scalar functions trim_in,
ltrim_in and rtrim_in (#42642)
add ab072829fba [Fix](Rowset Id) Use a randomly generated rowset ID to
handle memory write failures (#42949)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b002a42890a)
\
N -- N -- N refs/heads/auto-pick-42949-branch-3.0 (ab072829fba)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/delete-auto-pick-branch.yml | 37 +
README.md | 9 +-
be/src/cloud/cloud_base_compaction.cpp | 5 +
be/src/cloud/cloud_cumulative_compaction.cpp | 9 +-
be/src/cloud/cloud_delete_bitmap_action.cpp | 61 +-
be/src/cloud/cloud_delete_bitmap_action.h | 5 +-
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 2 +-
be/src/cloud/cloud_full_compaction.cpp | 4 +
be/src/cloud/cloud_meta_mgr.cpp | 36 +-
be/src/cloud/cloud_meta_mgr.h | 5 +-
be/src/cloud/cloud_schema_change_job.cpp | 9 +-
be/src/cloud/cloud_tablet.cpp | 10 +-
be/src/cloud/config.cpp | 4 +-
be/src/cloud/config.h | 4 +-
be/src/clucene | 2 +-
be/src/common/cgroup_memory_ctl.cpp | 23 +-
be/src/common/config.cpp | 31 +-
be/src/common/config.h | 30 +-
be/src/common/daemon.cpp | 30 +-
be/src/common/status.h | 3 +-
be/src/exec/lzo_decompressor.cpp | 1 +
be/src/exec/schema_scanner.cpp | 4 -
be/src/exec/schema_scanner.h | 7 +-
.../exec/schema_scanner/schema_columns_scanner.cpp | 14 +-
.../exec/schema_scanner/schema_tables_scanner.cpp | 16 +-
be/src/exprs/bloom_filter_func.h | 31 +-
be/src/exprs/runtime_filter.cpp | 234 +-
be/src/exprs/runtime_filter.h | 33 +-
be/src/exprs/runtime_filter_slots.h | 4 +-
be/src/exprs/runtime_filter_slots_cross.h | 4 +-
be/src/http/default_path_handlers.cpp | 189 +-
be/src/http/http_client.cpp | 22 +-
be/src/http/http_client.h | 3 +-
be/src/http/http_handler_with_auth.cpp | 11 +
be/src/index-tools/index_tool.cpp | 2 +-
be/src/io/cache/block_file_cache.cpp | 245 +-
be/src/io/cache/block_file_cache.h | 14 +-
be/src/io/cache/file_cache_common.cpp | 9 +-
be/src/io/cache/file_cache_common.h | 2 +
be/src/io/fs/file_system.cpp | 34 +-
be/src/io/fs/file_system.h | 2 +-
be/src/io/fs/local_file_system.cpp | 50 +
be/src/io/fs/local_file_system.h | 6 +-
be/src/io/fs/remote_file_system.cpp | 10 +-
be/src/io/fs/remote_file_system.h | 8 +-
be/src/io/fs/s3_file_system.h | 7 +-
be/src/io/fs/s3_file_writer.cpp | 9 +-
be/src/olap/compaction.cpp | 51 +-
.../cumulative_compaction_time_series_policy.cpp | 68 +-
be/src/olap/delete_bitmap_calculator.cpp | 70 +-
be/src/olap/full_compaction.cpp | 3 +
be/src/olap/memtable.cpp | 6 -
be/src/olap/merger.cpp | 2 +-
be/src/olap/options.cpp | 29 +-
be/src/olap/options.h | 4 +-
be/src/olap/parallel_scanner_builder.cpp | 20 +-
be/src/olap/parallel_scanner_builder.h | 2 +-
be/src/olap/rowset/beta_rowset_writer.cpp | 8 +
be/src/olap/rowset/beta_rowset_writer.h | 2 +
be/src/olap/rowset/segcompaction.cpp | 13 +
be/src/olap/rowset/segcompaction.h | 3 +
be/src/olap/rowset/segment_v2/column_reader.cpp | 2 +-
.../inverted_index/query/conjunction_query.cpp | 5 +-
.../inverted_index/query/conjunction_query.h | 3 +-
.../inverted_index/query/disjunction_query.cpp | 6 +-
.../inverted_index/query/disjunction_query.h | 3 +-
.../inverted_index/query/phrase_edge_query.cpp | 2 +-
.../inverted_index/query/phrase_edge_query.h | 2 +-
.../inverted_index/query/phrase_prefix_query.cpp | 3 +-
.../inverted_index/query/phrase_prefix_query.h | 2 +-
.../inverted_index/query/phrase_query.cpp | 8 +-
.../segment_v2/inverted_index/query/phrase_query.h | 3 +-
.../rowset/segment_v2/inverted_index/query/query.h | 1 +
.../inverted_index/query/regexp_query.cpp | 4 +-
.../segment_v2/inverted_index/query/regexp_query.h | 2 +-
.../olap/rowset/segment_v2/inverted_index_common.h | 103 +
.../segment_v2/inverted_index_compaction.cpp | 7 -
.../segment_v2/inverted_index_compound_reader.cpp | 15 +
.../segment_v2/inverted_index_file_reader.cpp | 5 +-
.../rowset/segment_v2/inverted_index_file_reader.h | 4 +-
.../segment_v2/inverted_index_file_writer.cpp | 531 +-
.../rowset/segment_v2/inverted_index_file_writer.h | 70 +-
.../segment_v2/inverted_index_fs_directory.cpp | 37 +-
.../segment_v2/inverted_index_fs_directory.h | 7 +-
.../rowset/segment_v2/inverted_index_reader.cpp | 94 +-
.../olap/rowset/segment_v2/inverted_index_reader.h | 83 +-
.../rowset/segment_v2/inverted_index_searcher.cpp | 3 +
.../rowset/segment_v2/inverted_index_writer.cpp | 49 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 8 +
be/src/olap/rowset/segment_v2/segment_iterator.h | 2 +
be/src/olap/rowset/segment_v2/segment_writer.cpp | 39 +-
be/src/olap/rowset/segment_v2/segment_writer.h | 1 +
.../rowset/segment_v2/vertical_segment_writer.cpp | 37 +-
.../rowset/segment_v2/vertical_segment_writer.h | 1 +
be/src/olap/schema_change.cpp | 2 +-
be/src/olap/single_replica_compaction.cpp | 14 +-
be/src/olap/single_replica_compaction.h | 1 -
be/src/olap/tablet.cpp | 28 +-
be/src/olap/tablet_manager.cpp | 7 +-
be/src/olap/tablet_meta.cpp | 10 +-
be/src/olap/tablet_meta.h | 46 +
be/src/olap/task/engine_clone_task.cpp | 30 +-
be/src/olap/task/engine_clone_task.h | 2 -
be/src/olap/task/engine_publish_version_task.cpp | 13 +-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 67 +-
be/src/pipeline/exec/exchange_sink_buffer.h | 26 +-
be/src/pipeline/exec/exchange_sink_operator.cpp | 186 +-
be/src/pipeline/exec/exchange_sink_operator.h | 32 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 36 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 4 +-
.../pipeline/exec/memory_scratch_sink_operator.cpp | 2 +-
.../exec/nested_loop_join_build_operator.cpp | 10 +-
.../exec/nested_loop_join_build_operator.h | 3 +-
.../exec/nested_loop_join_probe_operator.cpp | 18 +-
be/src/pipeline/exec/operator.h | 4 +-
.../exec/partitioned_hash_join_sink_operator.cpp | 8 +-
.../exec/partitioned_hash_join_sink_operator.h | 3 +-
be/src/pipeline/exec/result_file_sink_operator.cpp | 157 +-
be/src/pipeline/exec/result_file_sink_operator.h | 14 +-
be/src/pipeline/exec/result_sink_operator.cpp | 34 +-
be/src/pipeline/exec/schema_scan_operator.cpp | 5 +-
be/src/pipeline/exec/schema_scan_operator.h | 5 -
.../local_exchange_sink_operator.cpp | 4 +
.../local_exchange/local_exchange_sink_operator.h | 2 +
be/src/pipeline/local_exchange/local_exchanger.cpp | 13 -
be/src/pipeline/local_exchange/local_exchanger.h | 35 +-
be/src/pipeline/pipeline.h | 8 +
be/src/pipeline/pipeline_fragment_context.cpp | 66 +-
be/src/pipeline/pipeline_fragment_context.h | 4 +-
be/src/pipeline/pipeline_task.h | 2 +
be/src/runtime/buffer_control_block.cpp | 239 +-
be/src/runtime/buffer_control_block.h | 58 +-
be/src/runtime/exec_env.h | 5 +
be/src/runtime/exec_env_init.cpp | 8 +-
be/src/runtime/fragment_mgr.cpp | 39 +-
be/src/runtime/load_channel.cpp | 6 +-
be/src/runtime/load_channel.h | 2 +-
be/src/runtime/load_stream.cpp | 135 +-
be/src/runtime/load_stream.h | 5 +-
be/src/runtime/load_stream_writer.cpp | 12 +-
be/src/runtime/load_stream_writer.h | 11 +-
be/src/runtime/memory/global_memory_arbitrator.cpp | 13 +-
be/src/runtime/memory/global_memory_arbitrator.h | 22 +-
be/src/runtime/memory/mem_tracker_limiter.cpp | 300 +-
be/src/runtime/memory/mem_tracker_limiter.h | 127 +-
be/src/runtime/memory/memory_profile.cpp | 353 +
be/src/runtime/memory/memory_profile.h | 82 +
be/src/runtime/memory/memory_reclamation.cpp | 46 +-
be/src/runtime/memory/thread_mem_tracker_mgr.h | 2 +-
be/src/runtime/process_profile.cpp | 44 +
be/src/runtime/process_profile.h | 62 +
be/src/runtime/query_context.cpp | 2 +-
be/src/runtime/query_context.h | 6 +
be/src/runtime/result_buffer_mgr.cpp | 76 +-
be/src/runtime/result_buffer_mgr.h | 30 +-
.../routine_load/routine_load_task_executor.cpp | 4 +-
.../routine_load/routine_load_task_executor.h | 2 +
be/src/runtime/runtime_filter_mgr.cpp | 153 +-
be/src/runtime/runtime_filter_mgr.h | 58 +-
be/src/runtime/runtime_state.cpp | 24 +-
be/src/runtime/runtime_state.h | 8 +-
.../arrow_flight/arrow_flight_batch_reader.cpp | 291 +-
.../arrow_flight/arrow_flight_batch_reader.h | 69 +-
be/src/service/arrow_flight/flight_sql_service.cpp | 57 +-
be/src/service/http_service.cpp | 13 +-
be/src/service/internal_service.cpp | 66 +-
be/src/service/internal_service.h | 5 +
be/src/service/point_query_executor.cpp | 11 -
be/src/udf/udf.h | 9 +
be/src/util/arrow/row_batch.cpp | 46 +-
be/src/util/arrow/row_batch.h | 12 +-
be/src/util/arrow/utils.cpp | 3 +-
be/src/util/doris_metrics.h | 5 +
be/src/util/jvm_metrics.cpp | 4 +-
be/src/util/mem_info.cpp | 37 +-
be/src/util/mem_info.h | 18 +-
be/src/util/ref_count_closure.h | 24 +-
be/src/util/runtime_profile.cpp | 11 +-
be/src/util/runtime_profile.h | 4 +-
be/src/util/security.h | 35 +
.../vec/aggregate_functions/aggregate_function.h | 1 +
.../aggregate_function_approx_top.h | 109 +
.../aggregate_function_approx_top_k.cpp | 43 +
.../aggregate_function_approx_top_k.h | 229 +
.../aggregate_function_approx_top_sum.cpp | 71 +
.../aggregate_function_approx_top_sum.h | 245 +
.../aggregate_function_collect.cpp | 10 +-
.../aggregate_function_orthogonal_bitmap.h | 2 +-
.../aggregate_function_simple_factory.cpp | 8 +-
be/src/vec/columns/column_array.cpp | 6 +
be/src/vec/columns/column_array.h | 1 +
be/src/vec/columns/column_complex.h | 8 +
be/src/vec/columns/column_const.h | 4 +
be/src/vec/columns/column_decimal.cpp | 8 +
be/src/vec/columns/column_decimal.h | 2 +
be/src/vec/columns/column_map.cpp | 6 +
be/src/vec/columns/column_map.h | 2 +
be/src/vec/columns/column_nullable.cpp | 6 +
be/src/vec/columns/column_nullable.h | 2 +
be/src/vec/columns/column_string.cpp | 22 +
be/src/vec/columns/column_string.h | 2 +
be/src/vec/columns/column_struct.cpp | 7 +
be/src/vec/columns/column_struct.h | 2 +
be/src/vec/columns/column_vector.cpp | 8 +
be/src/vec/columns/column_vector.h | 2 +
be/src/vec/common/allocator.cpp | 9 +-
be/src/vec/common/arena_with_free_lists.h | 104 +
be/src/vec/common/bit_helpers.h | 45 +
be/src/vec/common/space_saving.h | 342 +
.../vec/data_types/serde/data_type_array_serde.h | 2 +
.../data_types/serde/data_type_bitmap_serde.cpp | 59 +-
.../vec/data_types/serde/data_type_bitmap_serde.h | 13 +-
.../data_types/serde/data_type_date64_serde.cpp | 20 +-
.../vec/data_types/serde/data_type_hll_serde.cpp | 48 +-
.../vec/data_types/serde/data_type_ipv6_serde.cpp | 37 +-
.../vec/data_types/serde/data_type_jsonb_serde.cpp | 28 +-
be/src/vec/data_types/serde/data_type_map_serde.h | 4 +
.../data_types/serde/data_type_nullable_serde.h | 2 +
.../data_types/serde/data_type_number_serde.cpp | 57 +-
.../data_types/serde/data_type_object_serde.cpp | 35 +
.../vec/data_types/serde/data_type_object_serde.h | 4 +-
.../serde/data_type_quantilestate_serde.h | 56 +-
be/src/vec/data_types/serde/data_type_serde.h | 24 +-
.../vec/data_types/serde/data_type_struct_serde.h | 2 +
be/src/vec/exec/format/json/new_json_reader.cpp | 555 +-
be/src/vec/exec/format/json/new_json_reader.h | 32 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 486 +-
be/src/vec/exec/format/orc/vorc_reader.h | 45 +-
be/src/vec/exec/format/parquet/schema_desc.cpp | 17 +
be/src/vec/exec/format/parquet/schema_desc.h | 8 +
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 6 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 2 +-
be/src/vec/exec/format/table/hudi_jni_reader.cpp | 14 +-
be/src/vec/exec/format/table/hudi_jni_reader.h | 4 +-
.../format/table/iceberg/arrow_schema_util.cpp | 134 +
.../exec/format/table/iceberg/arrow_schema_util.h | 45 +
be/src/vec/exec/format/table/iceberg/types.cpp | 3 +-
be/src/vec/exec/format/table/iceberg/types.h | 4 +
be/src/vec/exec/format/table/iceberg_reader.cpp | 48 +-
be/src/vec/exec/format/table/iceberg_reader.h | 2 +-
.../exec/format/table/max_compute_jni_reader.cpp | 6 +-
be/src/vec/exec/format/table/paimon_jni_reader.cpp | 7 +-
be/src/vec/exec/format/table/paimon_jni_reader.h | 3 +-
be/src/vec/exec/scan/scanner_context.cpp | 9 +-
be/src/vec/exec/scan/vfile_scanner.cpp | 25 +-
be/src/vec/exprs/vcase_expr.cpp | 2 +-
be/src/vec/exprs/vcast_expr.cpp | 2 +-
be/src/vec/exprs/vectorized_agg_fn.cpp | 16 +-
be/src/vec/exprs/vectorized_fn_call.cpp | 3 +-
be/src/vec/exprs/vexpr.cpp | 9 +-
be/src/vec/exprs/vexpr.h | 3 +-
be/src/vec/exprs/vin_predicate.cpp | 2 +-
be/src/vec/exprs/vmatch_predicate.cpp | 2 +-
be/src/vec/exprs/vruntimefilter_wrapper.h | 3 +-
be/src/vec/functions/function.h | 2 +
be/src/vec/functions/function_ip.h | 12 +-
be/src/vec/functions/function_java_udf.cpp | 3 +-
be/src/vec/functions/function_java_udf.h | 2 +
be/src/vec/functions/function_json.cpp | 6 +-
be/src/vec/functions/function_regexp.cpp | 15 +-
be/src/vec/functions/function_string.cpp | 162 +-
be/src/vec/functions/function_tokenize.cpp | 6 +
be/src/vec/functions/like.cpp | 21 +-
be/src/vec/functions/like.h | 4 +-
be/src/vec/runtime/shared_hash_table_controller.h | 1 +
be/src/vec/runtime/vparquet_transformer.cpp | 50 +-
be/src/vec/runtime/vparquet_transformer.h | 5 +-
be/src/vec/sink/autoinc_buffer.cpp | 33 +-
be/src/vec/sink/varrow_flight_result_writer.cpp | 64 +-
be/src/vec/sink/varrow_flight_result_writer.h | 16 +-
be/src/vec/sink/vdata_stream_sender.cpp | 309 +-
be/src/vec/sink/vdata_stream_sender.h | 224 +-
be/src/vec/sink/vrow_distribution.h | 1 +
.../writer/iceberg/viceberg_partition_writer.cpp | 2 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 7 +-
be/src/vec/sink/writer/vtablet_writer_v2.h | 2 +-
be/test/common/space_saving_test.cpp | 300 +
be/test/exec/test_data/orc_scanner/orders.orc | Bin 0 -> 1293 bytes
be/test/http/http_client_test.cpp | 8 +-
be/test/io/fs/local_file_system_test.cpp | 50 +
...mulative_compaction_time_series_policy_test.cpp | 2 +-
.../common/inverted_index_common_test.cpp | 343 +
.../compaction/index_compaction_test.cpp | 4 +-
.../index_compaction_with_deleted_term.cpp | 4 +-
.../segment_v2/inverted_index_file_writer_test.cpp | 515 +
be/test/runtime/memory/mem_tracker_test.cpp | 2 +-
.../runtime/memory/thread_mem_tracker_mgr_test.cpp | 8 +-
be/test/runtime/result_buffer_mgr_test.cpp | 13 +-
be/test/testutil/desc_tbl_builder.cpp | 29 +-
be/test/testutil/desc_tbl_builder.h | 17 +-
be/test/testutil/run_all_tests.cpp | 2 +
.../table/iceberg/arrow_schema_util_test.cpp | 304 +
.../format/table/iceberg/schema_parser_test.cpp | 24 +
be/test/vec/exec/orc_reader_test.cpp | 158 +
build-for-release.sh | 7 +-
build.sh | 2 +
cloud/script/run_all_tests.sh | 2 +
cloud/src/common/bvars.cpp | 9 +
cloud/src/common/bvars.h | 5 +
cloud/src/common/config.h | 8 +
cloud/src/meta-service/keys.cpp | 8 +
cloud/src/meta-service/keys.h | 6 +
cloud/src/meta-service/meta_service.cpp | 98 +-
cloud/src/meta-service/meta_service.h | 1 +
cloud/src/meta-service/meta_service_helper.h | 10 +-
cloud/src/meta-service/meta_service_http.cpp | 14 +-
cloud/src/meta-service/meta_service_job.cpp | 22 +-
.../src/meta-service/meta_service_tablet_stats.cpp | 111 +-
cloud/src/meta-service/meta_service_tablet_stats.h | 2 +
cloud/src/meta-service/meta_service_txn.cpp | 26 +-
cloud/src/meta-service/txn_kv.cpp | 3 +
cloud/src/meta-service/txn_lazy_committer.cpp | 4 +-
cloud/src/recycler/checker.cpp | 459 +-
cloud/src/recycler/checker.h | 28 +
cloud/src/recycler/recycler.cpp | 28 +-
cloud/src/recycler/s3_accessor.cpp | 3 +-
cloud/src/recycler/s3_accessor.h | 1 +
cloud/src/recycler/s3_obj_client.cpp | 1 +
cloud/src/recycler/util.cpp | 66 +
cloud/src/recycler/util.h | 5 +
cloud/test/http_encode_key_test.cpp | 32 +-
cloud/test/keys_test.cpp | 34 +
cloud/test/meta_service_http_test.cpp | 14 +
cloud/test/meta_service_job_test.cpp | 60 +-
cloud/test/meta_service_test.cpp | 191 +-
cloud/test/recycler_test.cpp | 503 +-
cloud/test/s3_accessor_test.cpp | 68 +
cloud/test/schema_kv_test.cpp | 6 +
conf/be.conf | 2 +-
conf/fe.conf | 4 +-
docker/runtime/doris-compose/Readme.md | 2 +
.../docker-compose/hive/scripts/README | 4 +-
.../scripts/create_preinstalled_scripts/run69.hql | 35 +
.../scripts/create_preinstalled_scripts/run70.hql | 73 +
.../scripts/create_preinstalled_scripts/run71.hql | 13 +
.../docker-compose/hive/scripts/hive-metastore.sh | 2 +-
.../json/json_all_complex_types/dt=dt1/000000_0 | 3 +
.../json/json_all_complex_types/dt=dt2/000000_0 | 1 +
.../json/json_all_complex_types/dt=dt3/000000_0 | 2 +
.../preinstalled_data/json/json_load_data_table/1 | 13 +
.../json/json_nested_complex_table/1 | 2 +
.../json/json_nested_complex_table/2 | 1 +
.../json/json_nested_complex_table/modify_2 | 2 +
.../user_empty_lzo/part-m-00000.lzo | Bin 0 -> 42 bytes
.../docker-compose/iceberg/entrypoint.sh.tpl | 12 +-
.../{ => iceberg}/run01.sql | 0
.../{ => iceberg}/run02.sql | 0
.../{ => iceberg}/run03.sql | 0
.../{ => iceberg}/run04.sql | 0
.../{ => iceberg}/run05.sql | 0
.../create_preinstalled_scripts/iceberg/run06.sql | 21 +
.../{run06.sql => paimon/run01.sql} | 0
docker/thirdparties/run-thirdparties-docker.sh | 2 +-
fe/.idea/vcs.xml | 2 +-
fe/be-java-extensions/hadoop-hudi-scanner/pom.xml | 227 +
.../apache/doris/hudi/HadoopHudiColumnValue.java | 219 +
.../apache/doris/hudi/HadoopHudiJniScanner.java | 271 +
.../src/main/resources/package.xml | 0
.../java/org/apache/doris/hudi/HudiJniScanner.java | 16 +-
.../src/main/java/org/apache/doris/hudi/Utils.java | 14 +-
.../org/apache/doris/hudi/BaseSplitReader.scala | 15 +-
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 6 +-
.../org/apache/doris/jdbc/MySQLJdbcExecutor.java | 5 +
.../doris/maxcompute/MaxComputeJniScanner.java | 47 +-
.../org/apache/doris/paimon/PaimonJniScanner.java | 4 +-
fe/be-java-extensions/pom.xml | 1 +
.../main/java/org/apache/doris/common/Config.java | 23 +-
.../common/security/authentication/HadoopUGI.java | 103 -
.../authentication/PreExecutionAuthenticator.java | 116 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 15 +-
fe/fe-core/src/main/cup/sql_parser.cup | 21 +-
.../main/java/org/apache/doris/alter/Alter.java | 10 +-
.../org/apache/doris/alter/IndexChangeJob.java | 5 +
.../doris/alter/MaterializedViewHandler.java | 16 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 4 +-
.../apache/doris/alter/SchemaChangeHandler.java | 28 +-
.../org/apache/doris/alter/SchemaChangeJobV2.java | 2 +-
.../org/apache/doris/analysis/AlterTableStmt.java | 4 +
.../org/apache/doris/analysis/BaseViewStmt.java | 26 +
.../apache/doris/analysis/CreateIndexClause.java | 6 +-
.../java/org/apache/doris/analysis/DropDbStmt.java | 3 +
.../org/apache/doris/analysis/DropIndexClause.java | 6 +-
.../org/apache/doris/analysis/DropTableStmt.java | 3 +
.../org/apache/doris/analysis/DropUserStmt.java | 4 +-
.../apache/doris/analysis/FunctionCallExpr.java | 2 +-
.../org/apache/doris/analysis/FunctionName.java | 5 +
.../java/org/apache/doris/analysis/IndexDef.java | 2 +-
.../java/org/apache/doris/analysis/KeysDesc.java | 4 +-
.../apache/doris/analysis/NativeInsertStmt.java | 1 +
.../org/apache/doris/analysis/OutFileClause.java | 21 +-
.../apache/doris/analysis/ShowBuildIndexStmt.java | 10 +
.../org/apache/doris/analysis/ShowDataStmt.java | 484 +-
.../org/apache/doris/analysis/UserIdentity.java | 4 +
.../org/apache/doris/backup/BackupHandler.java | 45 +-
.../java/org/apache/doris/backup/BackupJob.java | 80 +-
.../java/org/apache/doris/backup/RestoreJob.java | 65 +-
.../java/org/apache/doris/backup/Snapshot.java | 11 +-
.../org/apache/doris/binlog/BinlogManager.java | 92 +
.../org/apache/doris/binlog/CreateTableRecord.java | 5 +
.../java/org/apache/doris/binlog/DBBinlog.java | 146 +-
.../org/apache/doris/binlog/DropTableRecord.java | 7 +-
.../org/apache/doris/catalog/AccessPrivilege.java | 2 +-
.../doris/catalog/BuiltinAggregateFunctions.java | 28 +-
.../doris/catalog/BuiltinScalarFunctions.java | 6 +
.../apache/doris/catalog/CloudTabletStatMgr.java | 20 +-
.../java/org/apache/doris/catalog/Database.java | 19 +-
.../main/java/org/apache/doris/catalog/Env.java | 56 +-
.../main/java/org/apache/doris/catalog/Index.java | 2 +-
.../apache/doris/catalog/ListPartitionInfo.java | 33 +-
.../main/java/org/apache/doris/catalog/MTMV.java | 12 +-
.../apache/doris/catalog/MaterializedIndex.java | 40 +
.../java/org/apache/doris/catalog/OlapTable.java | 108 +-
.../org/apache/doris/catalog/PartitionKey.java | 3 +-
.../java/org/apache/doris/catalog/Replica.java | 19 +
.../java/org/apache/doris/catalog/S3Resource.java | 2 +-
.../main/java/org/apache/doris/catalog/Table.java | 3 +
.../java/org/apache/doris/catalog/TableIf.java | 2 +
.../apache/doris/catalog/TabletInvertedIndex.java | 13 +-
.../org/apache/doris/catalog/TabletStatMgr.java | 17 +-
.../doris/clone/DynamicPartitionScheduler.java | 9 +
.../doris/common/NereidsSqlCacheManager.java | 49 +-
.../doris/common/proc/TabletHealthProcDir.java | 2 +-
.../apache/doris/common/util/RuntimeProfile.java | 13 +-
.../apache/doris/datasource/ExternalCatalog.java | 7 +
.../org/apache/doris/datasource/ExternalTable.java | 59 +
.../org/apache/doris/datasource/FileGroupInfo.java | 98 +-
.../apache/doris/datasource/FileQueryScanNode.java | 13 +
.../org/apache/doris/datasource/FileScanNode.java | 1 -
.../apache/doris/datasource/InternalCatalog.java | 32 +-
.../doris/datasource/hive/HMSExternalCatalog.java | 20 +-
.../doris/datasource/hive/HMSExternalTable.java | 81 +-
.../datasource/hive/HiveMetaStoreClientHelper.java | 24 +-
.../doris/datasource/hive/source/HiveScanNode.java | 45 +-
.../apache/doris/datasource/hudi/HudiUtils.java | 52 +-
.../hudi/source/COWIncrementalRelation.java | 21 +-
.../hudi/source/HudiLocalEngineContext.java | 67 +-
.../hudi/source/HudiPartitionProcessor.java | 14 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 142 +-
.../doris/datasource/hudi/source/HudiSplit.java | 3 +-
.../hudi/source/MORIncrementalRelation.java | 14 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 3 +
.../iceberg/IcebergHMSExternalCatalog.java | 7 +
.../datasource/iceberg/IcebergMetadataCache.java | 14 +-
.../datasource/iceberg/IcebergMetadataOps.java | 127 +-
.../iceberg/IcebergRestExternalCatalog.java | 2 -
.../datasource/iceberg/IcebergTransaction.java | 26 +-
.../datasource/iceberg/source/IcebergScanNode.java | 10 +-
.../doris/datasource/jdbc/client/JdbcClient.java | 6 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 8 +-
.../maxcompute/MaxComputeExternalCatalog.java | 57 +
.../maxcompute/MaxComputeExternalTable.java | 33 +-
.../maxcompute/source/MaxComputeScanNode.java | 63 +-
.../apache/doris/datasource/mvcc/MvccSnapshot.java | 25 +
.../apache/doris/datasource/mvcc/MvccTable.java | 33 +
.../doris/datasource/mvcc/MvccTableInfo.java | 84 +
.../operations/ExternalMetadataOperations.java | 4 +-
.../datasource/operations/ExternalMetadataOps.java | 4 +
.../datasource/paimon/PaimonExternalCatalog.java | 88 +-
.../datasource/paimon/source/PaimonScanNode.java | 60 +-
.../property/constants/MCProperties.java | 8 +
.../apache/doris/httpv2/rest/GetLogFileAction.java | 38 +-
.../org/apache/doris/job/base/AbstractJob.java | 8 +-
.../doris/job/base/JobExecutionConfiguration.java | 5 +-
.../apache/doris/job/disruptor/TaskDisruptor.java | 11 +-
.../doris/job/executor/TimerJobSchedulerTask.java | 2 +
.../doris/job/extensions/insert/InsertTask.java | 33 +-
.../org/apache/doris/job/manager/JobManager.java | 3 +
.../apache/doris/job/scheduler/JobScheduler.java | 12 +-
.../org/apache/doris/job/task/AbstractTask.java | 3 +
.../main/java/org/apache/doris/load/ExportJob.java | 6 +
.../main/java/org/apache/doris/load/ExportMgr.java | 30 +-
.../org/apache/doris/load/GroupCommitManager.java | 4 +-
.../doris/load/routineload/RoutineLoadManager.java | 1 +
.../load/routineload/RoutineLoadTaskScheduler.java | 2 +-
.../org/apache/doris/master/ReportHandler.java | 9 +-
.../java/org/apache/doris/mtmv/BaseTableInfo.java | 9 +
.../doris/mtmv/MTMVPartitionExprDateTrunc.java | 2 +-
.../org/apache/doris/mtmv/MTMVPartitionInfo.java | 3 +-
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 27 +-
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 6 +
.../MTMVRelatedPartitionDescInitGenerator.java | 3 +-
.../MTMVRelatedPartitionDescRollUpGenerator.java | 3 +-
.../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 22 +-
.../org/apache/doris/mtmv/MTMVRewriteUtil.java | 10 +-
.../main/java/org/apache/doris/mtmv/MTMVUtil.java | 3 +-
.../org/apache/doris/nereids/CascadesContext.java | 8 +
.../org/apache/doris/nereids/NereidsPlanner.java | 54 +-
.../org/apache/doris/nereids/StatementContext.java | 41 +
.../glue/translator/PhysicalPlanTranslator.java | 47 +-
.../jobs/joinorder/hypergraph/HyperGraph.java | 2 +-
.../jobs/joinorder/hypergraph/edge/Edge.java | 11 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 12 +
.../post/ProjectAggregateExpressionsForCse.java | 11 +-
.../properties/ChildOutputPropertyDeriver.java | 5 +-
.../doris/nereids/rules/analysis/BindRelation.java | 5 +-
.../rules/analysis/EliminateLogicalSelectHint.java | 9 +-
.../nereids/rules/analysis/SubqueryToApply.java | 8 +-
.../mv/AbstractMaterializedViewAggregateRule.java | 111 +-
.../mv/AbstractMaterializedViewRule.java | 57 +-
.../mv/AsyncMaterializationContext.java | 14 +-
.../rules/exploration/mv/HyperGraphComparator.java | 77 +-
.../mv/InitMaterializationContextHook.java | 17 +-
.../exploration/mv/MaterializationContext.java | 51 +-
...terializedViewAggregateOnNoneAggregateRule.java | 2 +-
.../exploration/mv/MaterializedViewUtils.java | 28 +-
.../nereids/rules/exploration/mv/StructInfo.java | 41 +-
.../exploration/mv/SyncMaterializationContext.java | 25 +-
.../exploration/mv/mapping/RelationMapping.java | 100 +-
.../rules/exploration/mv/mapping/SlotMapping.java | 13 +-
.../mv/rollup/AggFunctionRollUpHandler.java | 6 +-
.../ContainDistinctFunctionRollupHandler.java | 1 +
.../exploration/mv/rollup/DirectRollupHandler.java | 4 +-
.../mv/rollup/MappingRollupHandler.java | 28 +-
.../rules/OneListPartitionEvaluator.java | 14 +-
.../expression/rules/OnePartitionEvaluator.java | 4 +-
.../rules/OneRangePartitionEvaluator.java | 14 +-
.../rules/expression/rules/PartitionPruner.java | 18 +-
.../rules/SimplifyArithmeticComparisonRule.java | 11 +-
.../rules/SimplifyComparisonPredicate.java | 15 +-
.../rules/SimplifyConditionalFunction.java | 3 +-
.../rules/expression/rules/SimplifyRange.java | 235 +-
.../expression/rules/SupportJavaDateFormatter.java | 3 +-
.../rules/UnknownPartitionEvaluator.java | 12 +-
.../rules/implementation/AggregateStrategies.java | 14 +-
.../nereids/rules/rewrite/CheckPrivileges.java | 6 +-
.../nereids/rules/rewrite/LimitAggToTopNAgg.java | 61 +-
.../nereids/rules/rewrite/PruneEmptyPartition.java | 7 +-
.../rules/rewrite/PruneFileScanPartition.java | 32 +-
.../nereids/rules/rewrite/PruneOlapScanTablet.java | 10 +-
.../rewrite/PushDownAggThroughJoinOneSide.java | 123 +-
.../mv/AbstractSelectMaterializedIndexRule.java | 12 +
.../SelectMaterializedIndexWithoutAggregate.java | 1 +
.../doris/nereids/stats/StatsCalculator.java | 194 +-
.../expressions/functions/AlwaysNotNullable.java | 9 -
.../functions/agg/AggregateFunction.java | 4 +
.../expressions/functions/agg/AggregatePhase.java | 23 +
.../trees/expressions/functions/agg/AnyValue.java | 13 +-
.../expressions/functions/agg/ApproxTopK.java | 94 +
.../expressions/functions/agg/ApproxTopSum.java | 94 +
.../trees/expressions/functions/agg/ArrayAgg.java | 5 +-
.../trees/expressions/functions/agg/BitmapAgg.java | 5 +-
.../expressions/functions/agg/BitmapIntersect.java | 5 +-
.../expressions/functions/agg/BitmapUnion.java | 5 +-
.../functions/agg/BitmapUnionCount.java | 5 +-
.../expressions/functions/agg/BitmapUnionInt.java | 5 +-
.../expressions/functions/agg/CollectList.java | 5 +-
.../expressions/functions/agg/CollectSet.java | 5 +-
.../trees/expressions/functions/agg/Count.java | 5 +-
.../expressions/functions/agg/CountByEnum.java | 3 +-
.../functions/agg/GroupArrayIntersect.java | 5 +-
.../trees/expressions/functions/agg/Histogram.java | 5 +-
.../trees/expressions/functions/agg/HllUnion.java | 5 +-
.../expressions/functions/agg/HllUnionAgg.java | 5 +-
.../expressions/functions/agg/IntersectCount.java | 5 +-
.../trees/expressions/functions/agg/MapAgg.java | 5 +-
.../functions/agg/MultiDistinctCount.java | 5 +-
.../functions/agg/MultiDistinctSum0.java | 5 +-
.../trees/expressions/functions/agg/Ndv.java | 5 +-
.../agg/NotNullableAggregateFunction.java | 48 +
.../agg/OrthogonalBitmapExprCalculate.java | 84 +
.../agg/OrthogonalBitmapExprCalculateCount.java | 86 +
.../functions/agg/OrthogonalBitmapIntersect.java | 11 +-
.../agg/OrthogonalBitmapIntersectCount.java | 13 +-
.../functions/agg/OrthogonalBitmapUnionCount.java | 11 +-
.../expressions/functions/agg/PercentileArray.java | 5 +-
.../expressions/functions/agg/QuantileUnion.java | 5 +-
.../expressions/functions/agg/SequenceCount.java | 5 +-
.../trees/expressions/functions/agg/Sum0.java | 5 +-
.../expressions/functions/agg/WindowFunnel.java | 4 +
.../executable/DateTimeExtractAndTransform.java | 9 +
.../functions/executable/NumericArithmetic.java | 21 +-
.../functions/executable/StringArithmetic.java | 69 +
.../expressions/functions/scalar/LtrimIn.java | 84 +
.../expressions/functions/scalar/RtrimIn.java | 84 +
.../trees/expressions/functions/scalar/TrimIn.java | 84 +
.../trees/expressions/functions/window/Lag.java | 3 +-
.../trees/expressions/functions/window/Lead.java | 3 +-
.../visitor/AggregateFunctionVisitor.java | 10 +
.../expressions/visitor/ScalarFunctionVisitor.java | 15 +
.../apache/doris/nereids/trees/plans/PlanType.java | 1 +
.../trees/plans/commands/CreateTableCommand.java | 3 +-
.../trees/plans/commands/ExecuteCommand.java | 8 +-
.../trees/plans/commands/ExplainCommand.java | 4 +
.../trees/plans/commands/ShowViewCommand.java | 157 +
.../trees/plans/commands/info/AlterViewInfo.java | 14 +-
.../trees/plans/commands/info/BaseViewInfo.java | 4 +
.../trees/plans/commands/info/CreateMTMVInfo.java | 7 +-
.../trees/plans/commands/info/CreateTableInfo.java | 4 +
.../trees/plans/commands/info/CreateViewInfo.java | 11 +-
.../commands/info/MTMVPartitionDefinition.java | 3 +-
.../plans/commands/info/ShowCreateMTMVInfo.java | 13 +-
.../trees/plans/commands/info/TableNameInfo.java | 31 +
.../trees/plans/commands/insert/InsertUtils.java | 10 +
.../plans/commands/insert/OlapInsertExecutor.java | 10 +-
.../trees/plans/logical/LogicalAggregate.java | 12 +
.../trees/plans/logical/LogicalFileScan.java | 16 +-
.../trees/plans/logical/LogicalHudiScan.java | 2 +-
.../trees/plans/logical/LogicalOlapScan.java | 55 +-
.../nereids/trees/plans/logical/LogicalWindow.java | 10 +-
.../trees/plans/physical/PhysicalFileSink.java | 9 +-
.../plans/physical/PhysicalHashAggregate.java | 4 +-
.../trees/plans/visitor/CommandVisitor.java | 5 +
.../org/apache/doris/persist/AlterViewInfo.java | 4 +
.../java/org/apache/doris/persist/BarrierLog.java | 9 +
.../org/apache/doris/persist/BatchDropInfo.java | 16 +-
.../java/org/apache/doris/persist/DropInfo.java | 32 +-
.../java/org/apache/doris/persist/EditLog.java | 70 +-
.../doris/persist/ReplaceTableOperationLog.java | 28 +-
.../persist/TableAddOrDropInvertedIndicesInfo.java | 4 +
.../org/apache/doris/planner/OlapScanNode.java | 7 -
.../org/apache/doris/planner/OlapTableSink.java | 33 +-
.../java/org/apache/doris/planner/ScanNode.java | 10 +-
.../apache/doris/planner/SingleNodePlanner.java | 7 +-
.../java/org/apache/doris/qe/ConnectContext.java | 30 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 7 +
.../main/java/org/apache/doris/qe/Coordinator.java | 123 +-
.../java/org/apache/doris/qe/GlobalVariable.java | 1 +
.../org/apache/doris/qe/MysqlConnectProcessor.java | 3 +
.../org/apache/doris/qe/NereidsCoordinator.java | 2 -
.../java/org/apache/doris/qe/SessionVariable.java | 73 +-
.../apache/doris/qe/ShortCircuitQueryContext.java | 20 +-
.../java/org/apache/doris/qe/ShowExecutor.java | 12 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 52 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 16 +
.../org/apache/doris/qe/cache/CacheAnalyzer.java | 19 +-
.../org/apache/doris/rpc/BackendServiceProxy.java | 4 +-
.../doris/scheduler/disruptor/TaskDisruptor.java | 11 +-
.../scheduler/manager/TransientTaskManager.java | 4 +-
.../apache/doris/service/FrontendServiceImpl.java | 11 +-
.../arrowflight/DorisFlightSqlProducer.java | 135 +-
.../arrowflight/FlightSqlConnectProcessor.java | 17 +-
.../sessions/FlightSqlConnectContext.java | 3 +-
.../arrowflight/tokens/FlightTokenManagerImpl.java | 22 +-
.../doris/statistics/StatisticConstants.java | 4 +-
.../doris/statistics/StatisticsAutoCollector.java | 24 +-
.../apache/doris/statistics/TableStatsMeta.java | 4 +
.../doris/transaction/DatabaseTransactionMgr.java | 13 +
.../apache/doris/analysis/AlterTableStmtTest.java | 55 +
.../doris/analysis/CreateIndexClauseTest.java | 12 +-
.../analysis/CreateTableAsSelectStmtTest.java | 2 +-
.../org/apache/doris/analysis/DropDbStmtTest.java | 12 +-
.../apache/doris/analysis/DropIndexClauseTest.java | 10 +-
.../apache/doris/analysis/DropTableStmtTest.java | 5 +-
.../org/apache/doris/analysis/IndexDefTest.java | 4 +-
.../apache/doris/analysis/ShowDataStmtTest.java | 6 +-
.../org/apache/doris/backup/BackupJobTest.java | 7 +-
.../doris/catalog/ListPartitionInfoTest.java | 25 +
.../org/apache/doris/catalog/PartitionKeyTest.java | 6 +
.../doris/catalog/RangePartitionInfoTest.java | 29 +
.../org/apache/doris/catalog/S3ResourceTest.java | 16 +
.../apache/doris/datasource/FileGroupIntoTest.java | 66 +
.../datasource/iceberg/IcebergTransactionTest.java | 1 +
.../apache/doris/httpv2/GetLogFileActionTest.java | 60 +
.../job/base/JobExecutionConfigurationTest.java | 12 +-
.../apache/doris/mtmv/MTMVPartitionUtilTest.java | 5 +-
.../doris/nereids/mv/IdStatisticsMapTest.java | 2 +-
.../properties/ChildOutputPropertyDeriverTest.java | 74 +-
.../nereids/rules/exploration/mv/MappingTest.java | 269 +
.../exploration/mv/MaterializedViewUtilsTest.java | 20 +
.../expression/SimplifyArithmeticRuleTest.java | 8 +-
.../rules/expression/SimplifyRangeTest.java | 4 +
.../rules/SimplifyComparisonPredicateTest.java | 12 +
.../rules/SimplifyConditionalFunctionTest.java | 8 +-
.../nereids/rules/rewrite/EliminateSortTest.java | 7 +-
.../rules/rewrite/PruneOlapScanTabletTest.java | 21 +-
.../rewrite/PushDownMinMaxSumThroughJoinTest.java | 16 +-
.../apache/doris/nereids/sqltest/SqlTestBase.java | 3 +
.../doris/persist/DropAndRecoverInfoTest.java | 10 +-
.../persist/ReplaceTableOperationLogTest.java | 4 +-
.../doris/planner/HashDistributionPrunerTest.java | 24 +-
.../org/apache/doris/planner/OlapScanNodeTest.java | 5 +-
.../java/org/apache/doris/qe/StmtExecutorTest.java | 4 +-
.../statistics/StatisticsAutoCollectorTest.java | 2 +-
.../doris/statistics/util/StatisticsUtilTest.java | 27 +-
.../transaction/DatabaseTransactionMgrTest.java | 6 +-
.../org/apache/doris/utframe/AnotherDemoTest.java | 15 +-
.../java/org/apache/doris/utframe/DemoTest.java | 15 +-
fe/pom.xml | 6 +-
gensrc/proto/cloud.proto | 11 +-
gensrc/proto/internal_service.proto | 18 +
gensrc/script/gen_build_version.sh | 2 +-
gensrc/thrift/BackendService.thrift | 7 +-
gensrc/thrift/FrontendService.thrift | 19 +-
gensrc/thrift/MasterService.thrift | 4 +
gensrc/thrift/PaloInternalService.thrift | 8 +-
gensrc/thrift/PlanNodes.thrift | 17 +-
regression-test/conf/regression-conf.groovy | 3 +
.../data/account_p0/test_information_schema.out | 7 +
.../data/arrow_flight_sql_p0/test_select.out | 4 +
.../test_bloom_filter_drop_column.out | 2 +-
...compaction_remove_old_version_delete_bitmap.out | 67 +-
.../create_view_nereids/create_view_use_mv.out | 15 +
.../test_create_view_nereids.out | 397 +
.../data/ddl_p0/test_create_view_nereids.out | 397 -
.../outfile/test_outfile_complex_type.out | 25 +
.../outfile/test_outfile_jsonb_and_variant.out | 25 +
.../export_p0/outfile/test_outfile_null_type.out | 37 +
.../hive/hive_json_basic_test.out | 115 +
.../data/external_table_p0/hive/test_hive_orc.out | 48 +
.../hive/test_hive_use_meta_cache.out | 106 +-
.../iceberg/iceberg_drop_rest_table.out | 9 +
.../iceberg/iceberg_read_unitycatalog_table.out | 40 +
.../iceberg/test_iceberg_optimize_count.out | 3 +
.../hudi/test_hudi_incremental.out | 523 +
.../hudi/test_hudi_orc_tables.out | 15 +
.../hudi/test_hudi_partition_prune.out | 357 +
.../hudi/test_hudi_schema_evolution.out | 65 +
.../external_table_p2/hudi/test_hudi_snapshot.out | Bin 0 -> 696105 bytes
.../external_table_p2/hudi/test_hudi_timestamp.out | 31 +
.../hudi/test_hudi_timetravel.out | 356 +-
.../test_max_compute_partition_prune.out | 125 +
.../test_auto_inc_fetch_fail.out | 10 +
.../fault_injection_p0/test_index_io_context.out | 73 +
.../test_index_compaction_unique_keys_arr.out | 67 +
.../index_compaction/documents-1.json | 1000 ++
.../index_compaction/documents-10.json | 1000 ++
.../index_compaction/documents-11.json | 1000 ++
.../index_compaction/documents-12.json | 1000 ++
.../index_compaction/documents-13.json | 1000 ++
.../index_compaction/documents-14.json | 1000 ++
.../index_compaction/documents-15.json | 1000 ++
.../index_compaction/documents-16.json | 1000 ++
.../index_compaction/documents-17.json | 1000 ++
.../index_compaction/documents-18.json | 1000 ++
.../index_compaction/documents-19.json | 1000 ++
.../index_compaction/documents-2.json} | 0
.../index_compaction/documents-20.json | 1000 ++
.../index_compaction/documents-3.json | 1000 ++
.../index_compaction/documents-4.json | 1000 ++
.../index_compaction/documents-5.json | 1000 ++
.../index_compaction/documents-6.json | 1000 ++
.../index_compaction/documents-7.json | 1000 ++
.../index_compaction/documents-8.json | 1000 ++
.../index_compaction/documents-9.json | 1000 ++
.../inverted_index_p0/test_index_approx_top_k.out | 109 +
.../test_index_approx_top_sum.out | 109 +
.../test_ip_cidr_search_with_inverted_index.out | 4 -
regression-test/data/mv_p0/ssb/q_1_1/q_1_1.out | 7 +-
.../nereids_function_p0/fn_test_ip_invalid.csv | 31 +
.../data/nereids_function_p0/fn_test_ip_normal.csv | 72 +
.../nereids_function_p0/fn_test_ip_nullable.csv | 100 +
.../nereids_function_p0/fn_test_ip_special.csv | 29 +
.../fn_test_ip_special_no_null.csv | 28 +
.../nereids_function_p0/scalar_function/IP.out | 11779 +++++++++++++++++++
.../data/nereids_function_p0/test_ip.csv | 100 +
.../data/nereids_hint_tpcds_p0/shape/query23.out | 63 +-
.../data/nereids_hint_tpcds_p0/shape/query32.out | 43 +-
.../data/nereids_hint_tpcds_p0/shape/query38.out | 91 +-
.../data/nereids_hint_tpcds_p0/shape/query41.out | 2 +-
.../data/nereids_hint_tpcds_p0/shape/query97.out | 61 +-
.../data/nereids_p0/aggregate/window_funnel.out | 3 +
.../nereids_p0/dist_expr_list/dist_expr_list.out | 16 +
.../data/nereids_p0/show/show_view_command.out | 17 +
.../nereids_p0/system/test_query_sys_tables.out | 6 +-
.../push_down_count_through_join_one_side.out | 22 +
.../mv/agg_with_roll_up/any_value_roll_up.out | 73 +
.../aggregate_without_roll_up.out | 8 +
.../mv/dml/rewrite/rewrite_when_dml.out | 19 +
.../mv/join/inner/inner_join_x.out | 25 +
.../mv/join/left_outer/outer_join.out | 94 +
.../anti/other_join_conjuncts_anti.out | 65 +
.../inner/other_join_conjuncts_inner.out | 1489 +++
.../outer/other_join_conjuncts_outer.out | 2545 ++++
.../semi/other_join_conjuncts_semi.out | 281 +
.../data/nereids_rules_p0/mv/tpch/mv_tpch_test.out | 180 +
.../simplify_conditional_function.out | 3 +
.../data/nereids_syntax_p0/window_function.out | 6 +
.../nereids_syntax_p1/mv/aggregate/agg_sync_mv.out | 320 +-
.../shape/query23.out | 63 +-
.../shape/query32.out | 43 +-
.../shape/query38.out | 91 +-
.../shape/query41.out | 2 +-
.../shape/query97.out | 61 +-
.../constraints/query23.out | 63 +-
.../noStatsRfPrune/query23.out | 63 +-
.../noStatsRfPrune/query32.out | 43 +-
.../noStatsRfPrune/query38.out | 91 +-
.../noStatsRfPrune/query41.out | 2 +-
.../noStatsRfPrune/query97.out | 57 +-
.../no_stats_shape/query23.out | 63 +-
.../no_stats_shape/query32.out | 43 +-
.../no_stats_shape/query38.out | 91 +-
.../no_stats_shape/query41.out | 2 +-
.../no_stats_shape/query97.out | 57 +-
.../rf_prune/query23.out | 63 +-
.../rf_prune/query32.out | 43 +-
.../rf_prune/query38.out | 91 +-
.../rf_prune/query41.out | 2 +-
.../rf_prune/query97.out | 57 +-
.../nereids_tpcds_shape_sf100_p0/shape/query23.out | 63 +-
.../nereids_tpcds_shape_sf100_p0/shape/query32.out | 43 +-
.../nereids_tpcds_shape_sf100_p0/shape/query38.out | 91 +-
.../nereids_tpcds_shape_sf100_p0/shape/query41.out | 2 +-
.../nereids_tpcds_shape_sf100_p0/shape/query97.out | 57 +-
.../shape/query23.out | 63 +-
.../shape/query32.out | 43 +-
.../shape/query38.out | 97 +-
.../shape/query41.out | 2 +-
.../shape/query97.out | 57 +-
.../tpcds_sf100/constraints/query23.out | 63 +-
.../tpcds_sf100/noStatsRfPrune/query23.out | 63 +-
.../tpcds_sf100/noStatsRfPrune/query32.out | 43 +-
.../tpcds_sf100/noStatsRfPrune/query38.out | 91 +-
.../tpcds_sf100/noStatsRfPrune/query41.out | 2 +-
.../tpcds_sf100/noStatsRfPrune/query97.out | 57 +-
.../tpcds_sf100/no_stats_shape/query23.out | 63 +-
.../tpcds_sf100/no_stats_shape/query32.out | 43 +-
.../tpcds_sf100/no_stats_shape/query38.out | 91 +-
.../tpcds_sf100/no_stats_shape/query41.out | 2 +-
.../tpcds_sf100/no_stats_shape/query97.out | 57 +-
.../new_shapes_p0/tpcds_sf100/rf_prune/query23.out | 63 +-
.../new_shapes_p0/tpcds_sf100/rf_prune/query32.out | 43 +-
.../new_shapes_p0/tpcds_sf100/rf_prune/query38.out | 91 +-
.../new_shapes_p0/tpcds_sf100/rf_prune/query41.out | 2 +-
.../new_shapes_p0/tpcds_sf100/rf_prune/query97.out | 57 +-
.../new_shapes_p0/tpcds_sf100/shape/query23.out | 63 +-
.../new_shapes_p0/tpcds_sf100/shape/query32.out | 43 +-
.../new_shapes_p0/tpcds_sf100/shape/query38.out | 91 +-
.../new_shapes_p0/tpcds_sf100/shape/query41.out | 2 +-
.../new_shapes_p0/tpcds_sf100/shape/query97.out | 57 +-
.../new_shapes_p0/tpcds_sf1000/shape/query23.out | 63 +-
.../new_shapes_p0/tpcds_sf1000/shape/query32.out | 43 +-
.../new_shapes_p0/tpcds_sf1000/shape/query38.out | 91 +-
.../new_shapes_p0/tpcds_sf1000/shape/query41.out | 2 +-
.../new_shapes_p0/tpcds_sf1000/shape/query97.out | 61 +-
.../test_dynamic_partition_small_start.out} | 0
.../data/query_p0/aggregate/array_agg.out | 3 +
.../ip_functions/test_cut_ipv6_function.out | 5 +
.../json_function/test_query_json_object.out | 4 +
.../string_functions/test_regexp_chinese.out | 3 +
.../string_functions/test_trim_in.out | 547 +
.../data/query_p0/system/test_query_sys_tables.out | 6 +-
.../test_new_partial_update_delete.out | 52 -
.../unique_with_mow_c_p0/test_schema_change_ck.out | 316 +-
.../test_partial_update_auto_inc.out | 8 +
regression-test/framework/pom.xml | 3 +-
.../org/apache/doris/regression/Config.groovy | 16 +-
.../org/apache/doris/regression/suite/Suite.groovy | 125 +-
.../doris/regression/suite/SuiteContext.groovy | 2 +-
.../apache/doris/regression/suite/Syncer.groovy | 95 +-
.../doris/regression/suite/SyncerContext.groovy | 27 +-
.../pipeline/cloud_p0/conf/fe_custom.conf | 1 +
.../cloud_p0/conf/regression-conf-custom.groovy | 6 +-
regression-test/pipeline/cloud_p0/run.sh | 6 +
.../pipeline/cloud_p1/conf/fe_custom.conf | 1 +
regression-test/pipeline/common/github-utils.sh | 5 +
regression-test/pipeline/external/conf/fe.conf | 6 +-
regression-test/pipeline/p0/conf/fe.conf | 4 +-
.../pipeline/p0/conf/regression-conf.groovy | 7 +
regression-test/pipeline/p1/conf/be.conf | 2 +-
regression-test/pipeline/p1/conf/fe.conf | 6 +-
.../account_p0/test_information_schema.groovy | 22 +
.../suites/account_p0/test_system_user.groovy | 39 +
.../suites/arrow_flight_sql_p0/test_select.groovy | 12 +
.../test_account_management_user_auth.groovy | 3 +-
.../test_grant_show_view_priv_auth.groovy | 94 +
.../suites/auth_p0/test_grant_all_auth.groovy | 36 +
.../suites/auth_p0/test_select_view_auth.groovy | 89 +
.../test_bloom_filter_drop_column.groovy | 71 +-
.../ccr_mow_syncer_p0/test_ingest_binlog.groovy | 36 +-
.../check_before_quit/check_before_quit.groovy | 26 +
.../warm_up/hotspot/test_warmup_show_stmt_2.groovy | 10 +-
...paction_remove_old_version_delete_bitmap.groovy | 151 +-
...e_compaction_with_variant_inverted_index.groovy | 2 +-
.../suites/data_reliability/check_meta.groovy | 2 +-
.../create_view_nereids/create_view_use_mv.groovy | 97 +
.../test_create_view_nereids.groovy | 0
.../ddl_p0/test_create_table_like_nereids.groovy | 41 +-
.../import-way/load-high-availability.md.groovy | 57 +
.../Utility-Statements/cancel-warm-up.md.groovy | 42 +
.../doc/table-design/data-partition.md.groovy | 311 -
.../data-partitioning/auto-partitioning.md.groovy | 157 +
.../data-partitioning/basic-concepts.md.groovy | 60 +
.../dynamic-partitioning.md.groovy | 91 +
.../manual-partitioning.md.groovy | 75 +
.../outfile/test_outfile_complex_type.groovy | 106 +
.../outfile/test_outfile_jsonb_and_variant.groovy | 104 +
.../outfile/test_outfile_null_type.groovy | 111 +
.../suites/export_p0/test_outfile.groovy | 15 +-
.../hive/hive_json_basic_test.groovy | 71 +
.../external_table_p0/hive/test_hive_orc.groovy | 12 +
.../hive/test_hive_use_meta_cache.groovy | 171 +-
.../iceberg/iceberg_drop_rest_table.groovy | 90 +
.../iceberg/iceberg_read_unitycatalog_table.groovy | 62 +
.../iceberg/test_iceberg_optimize_count.groovy | 13 +-
.../jdbc/test_clickhouse_jdbc_catalog.groovy | 6 -
.../jdbc/test_jdbc_catalog_push_cast.groovy | 2 +
.../paimon/paimon_tb_mix_format.groovy | 5 +
.../tvf/test_s3_tvf_with_resource.groovy | 1 -
.../tvf/test_user_empty_lzo.groovy | 41 +
.../hudi/test_hudi_catalog.groovy | 39 +
.../hudi/test_hudi_incremental.groovy | 119 +
.../hudi/test_hudi_orc_tables.groovy | 41 +
.../hudi/test_hudi_partition_prune.groovy | 333 +
.../hudi/test_hudi_schema_evolution.groovy | 60 +
.../hudi/test_hudi_snapshot.groovy | 98 +
.../hudi/test_hudi_timestamp.groovy | 76 +
.../hudi/test_hudi_timetravel.groovy | 143 +-
.../test_external_catalog_maxcompute.groovy | 5 +-
.../test_max_compute_partition_prune.groovy | 282 +
.../test_auto_inc_fetch_fail.groovy | 63 +
.../test_build_index_with_clone_fault.groovy | 1 +
.../test_full_compaction_with_ordered_data.groovy | 208 +
.../test_index_io_context.groovy | 113 +
...st_skip_index_compaction_fault_injection.groovy | 240 +
.../test_variant_bloom_filter.groovy | 10 +-
.../test_writer_v2_fault_injection.groovy | 5 +-
.../test_iot_auto_detect_fail.groovy | 167 +
.../suites/insert_p0/insert_with_null.groovy | 5 +
regression-test/suites/insert_p0/test_jdbc.groovy | 102 +
.../suites/insert_p0/transaction/txn_insert.groovy | 5 +
.../transaction/txn_insert_restart_fe.groovy | 1 +
.../test_index_compaction_unique_keys_arr.groovy | 191 +-
.../test_index_compaction_p0.groovy | 25 +-
.../inverted_index_p0/load/test_insert.groovy | 2 +-
.../inverted_index_p0/load/test_stream_load.groovy | 2 +-
.../test_index_approx_top_k.groovy | 153 +
.../test_index_approx_top_sum.groovy | 153 +
.../test_inverted_index_writer_exception.groovy | 89 +
.../test_ip_cidr_search_with_inverted_index.groovy | 9 +-
.../suites/inverted_index_p0/test_tokenize.groovy | 11 +
.../test_index_compaction_p1.groovy | 11 +-
.../show_data/test_show_index_data.groovy | 399 +
.../show_data/test_show_index_data_p2.groovy | 397 +
.../test_variant_index_format_v1.groovy | 2 +-
.../suites/job_p0/test_base_insert_job.groovy | 53 +-
.../test_routine_load_condition.groovy | 1 +
.../test_routine_load_restart_fe.groovy | 3 +-
.../suites/load_p2/test_single_replica_load.groovy | 2 +-
.../suites/manager/test_manager_interface_1.groovy | 122 -
.../suites/manager/test_manager_interface_4.groovy | 146 +
.../test_alter_distribution_type_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_mtmv_property.groovy | 3 +-
.../agg_have_dup_base/agg_have_dup_base.groovy | 2 +
.../diffrent_serialize/diffrent_serialize.groovy | 2 +
.../mv_p0/agg_state/test_agg_state_max_by.groovy | 3 +
.../suites/mv_p0/case_ignore/case_ignore.groovy | 3 +
.../suites/mv_p0/count_star/count_star.groovy | 2 +
.../suites/mv_p0/dis_26495/dis_26495.groovy | 2 +
.../suites/mv_p0/k1ap2spa/k1ap2spa.groovy | 2 +
regression-test/suites/mv_p0/k1s2m3/k1s2m3.groovy | 1 +
.../mv_p0/k1s2m3_auto_inc/k1s2m3_auto_inc.groovy | 1 +
.../multi_agg_with_same_slot.groovy | 1 +
.../mv_p0/multi_slot_k123p/multi_slot_k123p.groovy | 1 +
.../multi_slot_k1a2p2ap3p.groovy | 1 +
.../multi_slot_k1a2p2ap3ps.groovy | 1 +
.../multi_slot_k1p2ap3p/multi_slot_k1p2ap3p.groovy | 1 +
.../multi_slot_k1p2ap3ps.groovy | 1 +
.../multi_slot_multi_mv/multi_slot_multi_mv.groovy | 1 +
.../suites/mv_p0/mv_with_view/mv_with_view.groovy | 1 +
.../suites/mv_p0/null_insert/null_insert.groovy | 1 +
.../mv_p0/routine_load_hll/routine_load_hll.groovy | 1 +
.../mv_p0/ssb/multiple_ssb/multiple_ssb.groovy | 1 +
.../multiple_ssb_between.groovy | 2 +
.../suites/mv_p0/ssb/q_1_1/q_1_1.groovy | 20 +-
.../suites/mv_p0/ssb/q_2_1/q_2_1.groovy | 2 +
.../suites/mv_p0/ssb/q_3_1/q_3_1.groovy | 2 +
.../suites/mv_p0/ssb/q_4_1/q_4_1.groovy | 2 +
.../suites/mv_p0/ssb/q_4_1_r1/q_4_1_r1.groovy | 1 +
.../suites/mv_p0/sum_count/sum_count.groovy | 1 +
.../mv_p0/sum_divede_count/sum_devide_count.groovy | 2 +
.../suites/mv_p0/test_28741/test_28741.groovy | 2 +-
.../test_approx_count_distinct.groovy | 1 +
.../suites/mv_p0/test_base/test_base.groovy | 1 +
.../mv_p0/test_casewhen/test_casewhen.groovy | 1 +
.../mv_p0/test_create_mv/test_create_mv.groovy | 2 +
.../test_create_mv_complex_type.groovy | 2 +
.../suites/mv_p0/test_doc_e4/test_doc_e4.groovy | 1 +
.../test_dup_group_by_mv_abs.groovy | 1 +
.../test_dup_group_by_mv_plus.groovy | 1 +
.../mv_p0/test_dup_mv_abs/test_dup_mv_abs.groovy | 1 +
.../mv_p0/test_dup_mv_bin/test_dup_mv_bin.groovy | 1 +
.../test_dup_mv_bitmap_hash.groovy | 3 +
.../mv_p0/test_dup_mv_plus/test_dup_mv_plus.groovy | 2 +-
.../test_dup_mv_repeat/test_dup_mv_repeat.groovy | 1 +
.../mv_p0/test_dup_mv_year/test_dup_mv_year.groovy | 1 +
.../test_duplicate_mv/test_duplicate_mv.groovy | 2 +
.../suites/mv_p0/test_mv_dp/test_mv_dp.groovy | 2 +
.../suites/mv_p0/test_mv_mor/test_mv_mor.groovy | 2 +
.../suites/mv_p0/test_mv_mow/test_mv_mow.groovy | 1 +
.../suites/mv_p0/test_ndv/test_ndv.groovy | 1 +
.../suites/mv_p0/test_nvl/test_nvl.groovy | 1 +
.../suites/mv_p0/test_o2/test_o2.groovy | 1 +
.../suites/mv_p0/test_substr/test_substr.groovy | 1 +
.../mv_p0/test_tbl_name/test_tbl_name.groovy | 1 +
.../mv_p0/test_upper_alias/test_upper_alias.groovy | 1 +
.../test_user_activity/test_user_activity.groovy | 1 +
regression-test/suites/mv_p0/unique/unique.groovy | 1 +
.../testAggQueryOnAggMV1.groovy | 1 +
.../testAggQueryOnAggMV10.groovy | 1 +
.../testAggQueryOnAggMV11.groovy | 1 +
.../testAggQueryOnAggMV2.groovy | 1 +
.../testAggQueryOnAggMV3.groovy | 2 +-
.../testAggQuqeryOnAggMV5.groovy | 1 +
.../testAggQuqeryOnAggMV6.groovy | 1 +
.../testAggQuqeryOnAggMV7.groovy | 2 +
.../testAggTableCountDistinctInBitmapType.groovy | 1 +
.../testAggregateMVCalcAggFunctionQuery.groovy | 1 +
.../testBitmapUnionInQuery.groovy | 2 +-
.../testCountDistinctToBitmap.groovy | 4 +
.../testIncorrectMVRewriteInSubquery.groovy | 1 +
.../testIncorrectRewriteCountDistinct.groovy | 1 +
.../testJoinOnLeftProjectToJoin.groovy | 3 +
.../mv_p0/ut/testNDVToHll/testNDVToHll.groovy | 1 +
.../testOrderByQueryOnProjectView.groovy | 1 +
.../ut/testProjectionMV1/testProjectionMV1.groovy | 1 +
.../ut/testProjectionMV2/testProjectionMV2.groovy | 1 +
.../ut/testProjectionMV3/testProjectionMV3.groovy | 1 +
.../ut/testProjectionMV4/testProjectionMV4.groovy | 1 +
.../ut/testQueryOnStar/testQueryOnStar.groovy | 1 +
.../testSelectMVWithTableAlias.groovy | 2 +
.../testSingleMVMultiUsage.groovy | 1 +
.../mv_p0/ut/testSubQuery/testSubQuery.groovy | 2 +-
.../ut/testUnionDistinct/testUnionDistinct.groovy | 2 +
.../test_orthogonal_bitmap_expr_calculate.groovy | 55 +
.../suites/nereids_function_p0/load.groovy | 305 +
.../nereids_function_p0/scalar_function/IP.groovy | 272 +
.../nereids_p0/aggregate/window_funnel.groovy | 21 +
.../cache/parse_sql_from_sql_cache.groovy | 81 +
.../suites/nereids_p0/delta_row/delta_row.groovy | 36 +-
.../dist_expr_list/dist_expr_list.groovy | 308 +
.../fold_constant_numeric_arithmatic.groovy | 9 +
.../nereids_p0/show/show_view_command.groovy | 80 +
.../datetime_functions/test_date_function.groovy | 11 +
.../window_functions/test_lead_lag_nullable.groovy | 80 +
.../push_down_count_through_join_one_side.groovy | 95 +
.../expression/test_simplify_range.groovy | 28 +
.../mv/agg_on_none_agg/agg_on_none_agg.groovy | 11 +
.../agg_optimize_when_uniform.groovy | 4 +
.../mv/agg_variety/agg_variety.groovy | 6 +
.../agg_with_roll_up/aggregate_with_roll_up.groovy | 3 +
.../mv/agg_with_roll_up/any_value_roll_up.groovy | 417 +
.../aggregate_without_roll_up.groovy | 197 +-
.../mv/availability/grace_period.groovy | 2 +
.../availability/materialized_view_switch.groovy | 5 +
.../create_commit_mtmv_many_task.groovy | 200 +
.../range_date_datetrunc_part_up.groovy | 143 +
.../create_part_and_up/range_date_part_up.groovy | 209 +
.../range_date_part_up_rewrite.groovy | 216 +
.../range_datetime_part_up_rewrite.groovy | 217 +
.../mv/dimension/dimension_1.groovy | 3 +
.../mv/dimension/dimension_2_3.groovy | 3 +
.../mv/dimension/dimension_2_4.groovy | 4 +
.../mv/dimension/dimension_2_5.groovy | 4 +
.../mv/dimension/dimension_2_6.groovy | 6 +
.../mv/dimension/dimension_2_full_join.groovy | 2 +
.../mv/dimension/dimension_2_inner_join.groovy | 3 +
.../mv/dimension/dimension_2_left_anti_join.groovy | 3 +
.../mv/dimension/dimension_2_left_join.groovy | 3 +
.../mv/dimension/dimension_2_left_semi_join.groovy | 3 +
.../dimension/dimension_2_right_anti_join.groovy | 3 +
.../mv/dimension/dimension_2_right_join.groovy | 3 +
.../dimension/dimension_2_right_semi_join.groovy | 3 +
.../mv/dimension/dimension_self_conn.groovy | 3 +
.../dimension_2_join_agg.groovy | 15 +-
.../dimension_join_agg_negative.groovy | 3 +
.../filter_equal_or_notequal.groovy | 3 +
.../mv/dimension_predicate/full_join_filter.groovy | 3 +
.../dimension_predicate/inner_join_filter.groovy | 3 +
.../left_anti_join_filter.groovy | 3 +
.../mv/dimension_predicate/left_join_filter.groovy | 3 +
.../left_semi_join_filter.groovy | 3 +
.../right_anti_join_filter.groovy | 3 +
.../dimension_predicate/right_join_filter.groovy | 3 +
.../right_semi_join_filter.groovy | 3 +
.../mv/direct_query/direct_query.groovy | 3 +
.../mv/dml/rewrite/rewrite_when_dml.groovy | 291 +
.../mv/grouping_sets/grouping_sets.groovy | 3 +
.../mv/is_in_debug_mode/is_in_debug_mode.groovy | 156 +
.../mv/join/dphyp_inner/inner_join_dphyp.groovy | 4 +
.../mv/join/dphyp_outer/outer_join_dphyp.groovy | 4 +
.../mv/join/inner/inner_join.groovy | 4 +
.../mv/join/inner/inner_join_x.groovy | 128 +
.../mv/join/left_outer/outer_join.groovy | 213 +
.../inner_join_infer_and_derive.groovy | 3 +
.../left_join_infer_and_derive.groovy | 2 +
.../right_join_infer_and_derive.groovy | 3 +
.../mv/negative/negative_test.groovy | 5 +-
.../mv/nested/nested_materialized_view.groovy | 4 +
.../mv/nested_mtmv/nested_mtmv.groovy | 202 +-
.../nested_mtmv_rewrite_switch.groovy | 3 +
.../anti/other_join_conjuncts_anti.groovy | 463 +
.../inner/other_join_conjuncts_inner.groovy | 877 ++
.../outer/other_join_conjuncts_outer.groovy | 1507 +++
.../semi/other_join_conjuncts_semi.groovy | 461 +
.../mv/partition_mv_rewrite.groovy | 4 +
.../mv/same_name/sync_async_same_name.groovy | 2 +
.../nereids_rules_p0/mv/scan/scan_table.groovy | 4 +
.../single_table_without_aggregate.groovy | 1 +
.../nereids_rules_p0/mv/tpch/mv_tpch_test.groovy | 357 +-
.../union_all_compensate.groovy | 3 +
.../partition_curd_union_rewrite.groovy | 51 +-
.../partition_curd_union_rewrite_hive.groovy | 259 +
.../mv/union_rewrite/usercase_union_rewrite.groovy | 3 +
.../mv/unsafe_equals/null_un_safe_equals.groovy | 2 +
.../nereids_rules_p0/mv/variant/variant_mv.groovy | 9 +-
.../mv/with_auth/with_select_table_auth.groovy | 3 +
.../mv/with_sql_limit/query_with_sql_limit.groovy | 4 +
.../with_table_operator/with_table_operator.groovy | 195 +
.../push_down_multi_filter_through_window.groovy | 20 +
.../simplify_conditional_function.groovy | 2 +
.../tablet_prune/test_tablet_prune.groovy | 39 +
.../mv/aggregate/agg_sync_mv.groovy | 247 +-
.../mv/newMv/aggHaveDupBase.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/case_ignore.groovy | 2 +
.../mv/newMv/dup_gb_mv_abs.groovy | 1 +
.../mv/newMv/dup_gb_mv_plus.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/dup_mv_abs.groovy | 2 +-
.../nereids_syntax_p0/mv/newMv/dup_mv_bin.groovy | 1 +
.../mv/newMv/dup_mv_bm_hash.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/dup_mv_plus.groovy | 2 +-
.../nereids_syntax_p0/mv/newMv/dup_mv_year.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot1.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot2.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot3.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot4.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot5.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/multi_slot6.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/mv_with_view.groovy | 1 +
.../nereids_syntax_p0/mv/newMv/single_slot.groovy | 2 +-
.../mv/newMv/sum_devide_count.groovy | 2 +-
.../nereids_syntax_p0/mv/newMv/unique_mv.groovy | 1 +
.../nereids_syntax_p0/mv/ut/MVMultiUsage.groovy | 3 +
.../suites/nereids_syntax_p0/mv/ut/MVWithAs.groovy | 3 +
.../nereids_syntax_p0/mv/ut/aggCDInBitmap.groovy | 4 +-
.../nereids_syntax_p0/mv/ut/aggMVCalcAggFun.groovy | 2 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV1.groovy | 1 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV10.groovy | 1 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV11.groovy | 3 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV2.groovy | 1 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV3.groovy | 1 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV5.groovy | 2 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV6.groovy | 1 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV7.groovy | 1 +
.../nereids_syntax_p0/mv/ut/bitmapUnionIn.groovy | 3 +
.../nereids_syntax_p0/mv/ut/distinctQuery.groovy | 2 +
.../nereids_syntax_p0/mv/ut/incMVReInSub.groovy | 3 +
.../nereids_syntax_p0/mv/ut/incRewriteCD.groovy | 3 +
.../mv/ut/joinOnCalcToJoin.groovy | 5 +
.../mv/ut/joinOnLeftPToJoin.groovy | 5 +
.../nereids_syntax_p0/mv/ut/onlyGroupBy.groovy | 3 +
.../nereids_syntax_p0/mv/ut/orderByOnPView.groovy | 2 +
.../nereids_syntax_p0/mv/ut/projectMV1.groovy | 3 +
.../nereids_syntax_p0/mv/ut/projectMV2.groovy | 3 +
.../nereids_syntax_p0/mv/ut/projectMV3.groovy | 3 +
.../nereids_syntax_p0/mv/ut/projectMV4.groovy | 3 +
.../suites/nereids_syntax_p0/mv/ut/subQuery.groovy | 2 +-
.../suites/nereids_syntax_p0/mv/ut/unionDis.groovy | 2 +
.../suites/nereids_syntax_p0/rollup/agg.groovy | 1 +
.../nereids_syntax_p0/rollup/agg_date.groovy | 1 +
.../suites/nereids_syntax_p0/rollup/bitmap.groovy | 1 +
.../suites/nereids_syntax_p0/rollup/date.groovy | 1 +
.../suites/nereids_syntax_p0/rollup/hll/hll.groovy | 1 +
.../hll_with_light_sc/hll_with_light_sc.groovy | 1 +
.../nereids_syntax_p0/window_function.groovy | 39 +
.../mv/aggregate/agg_sync_mv.groovy | 6 +-
.../nereids_tpch_p0/tpch/push_topn_to_agg.groovy | 4 +-
.../auto_partition/test_auto_dynamic.groovy | 2 +-
...t_dynamic_partition_mod_distribution_key.groovy | 2 +-
.../test_dynamic_partition_small_start.groovy | 54 +
.../query_p0/aggregate/aggregate_count1.groovy | 2 +-
.../suites/query_p0/aggregate/array_agg.groovy | 16 +
.../query_p0/aggregate/select_distinct.groovy | 2 +-
.../join_with_column_casesensetive.groovy | 2 +-
.../suites/query_p0/cast/test_cast.groovy | 2 +-
.../query_p0/except/test_query_except.groovy | 2 +-
.../query_p0/group_concat/test_group_concat.groovy | 2 +-
.../grouping_sets/test_grouping_sets1.groovy | 2 +-
.../suites/query_p0/having/having.groovy | 2 +-
.../query_p0/intersect/test_intersect.groovy | 2 +-
.../suites/query_p0/join/test_join2.groovy | 2 +-
.../suites/query_p0/join/test_left_join1.groovy | 2 +-
.../join/test_nestedloop_outer_join.groovy | 2 +-
.../join/test_partitioned_hash_join.groovy | 2 +-
.../query_p0/lateral_view/lateral_view.groovy | 2 +-
.../query_p0/limit/OffsetInSubqueryWithJoin.groovy | 2 +-
.../query_p0/literal_view/lietral_test.groovy | 2 +-
.../query_p0/operator/test_set_operator.groovy | 2 +-
.../query_p0/operator/test_sort_operator.groovy | 2 +-
.../session_variable/test_default_limit.groovy | 2 +-
.../query_p0/show/test_show_create_table.groovy | 2 +-
.../test_aggregate_all_functions.groovy | 2 +-
.../case_function/test_case_function_null.groovy | 2 +-
.../datetime_functions/test_date_function.groovy | 11 +
.../hash_functions/test_hash_function.groovy | 2 +-
.../ip_functions/test_cut_ipv6_function.groovy | 16 +
.../ip_functions/test_ip_functions.groovy | 2 +-
.../json_function/test_query_json_insert.groovy | 2 +-
.../json_function/test_query_json_object.groovy | 2 +
.../json_functions/test_json_function.groovy | 2 +-
.../sql_functions/math_functions/test_conv.groovy | 2 +-
.../test_multi_string_search.groovy | 2 +-
.../spatial_functions/test_gis_function.groovy | 2 +-
.../string_functions/test_regexp_chinese.groovy | 35 +
.../string_functions/test_string_function.groovy | 2 +-
.../string_functions/test_trim_in.groovy | 204 +
.../table_function/explode_split.groovy | 2 +-
.../sql_functions/test_alias_function.groovy | 2 +-
.../query_p0/sql_functions/test_predicate.groovy | 2 +-
.../test_width_bucket_function.groovy | 2 +-
.../suites/query_p0/subquery/test_subquery2.groovy | 2 +-
.../suites/query_p0/test_data_type_marks.groovy | 2 +-
.../suites/query_p0/test_dict_with_null.groovy | 2 +-
.../query_p0/test_orderby_nullliteral.groovy | 2 +-
.../suites/query_p0/test_select_constant.groovy | 2 +-
.../test_select_with_predicate_like.groovy | 2 +-
.../test_select_with_predicate_prune.groovy | 2 +-
.../query_p0/type_inference/test_largeint.groovy | 2 +-
.../with/test_with_and_two_phase_agg.groovy | 2 +-
.../suites/query_profile/scanner_profile.groovy | 104 -
.../query_profile/test_execute_by_frontend.groovy | 90 -
.../test_agg_vals_schema_change.groovy | 4 +-
.../suites/show_p0/test_show_tablet.groovy | 2 +
.../suites/statistics/test_analyze_mv.groovy | 31 +-
.../test_auto_analyze_black_white_list.groovy | 3 +-
.../suites/statistics/test_replace_table.grovvy | 81 +
.../suites/table_p0/test_colocate_table.groovy | 63 +
.../test_new_partial_update_delete.groovy | 116 +-
.../test_partial_update_delete.groovy | 5 +-
.../test_schema_change_ck.groovy | 50 +-
.../test_partial_update_auto_inc.groovy | 42 +-
.../suites/variant_p0/with_index/var_index.groovy | 2 +-
regression-test/suites/vault_p0/create/load.groovy | 204 +
.../vault_p0/create/test_create_vault.groovy | 135 -
run-cloud-ut.sh | 1 +
thirdparty/download-thirdparty.sh | 2 +-
.../patches/brpc-1.4.0-no-pthread_mutex-hook.patch | 419 +
thirdparty/patches/brpc-1.5.0-remove-wordexp.patch | 36 +
thirdparty/patches/librdkafka-1.9.2.patch | 111 +-
tools/fdb/fdb_ctl.sh | 8 +-
tools/tpcds-tools/bin/run-tpcds-queries.sh | 31 -
tools/tpcds-tools/conf/opt/opt_sf1.sql | 0
tools/tpcds-tools/conf/opt/opt_sf100.sql | 0
tools/tpcds-tools/conf/opt/opt_sf1000.sql | 1 -
tools/tpcds-tools/conf/opt/opt_sf10000.sql | 1 -
tools/tpch-tools/bin/run-tpch-queries.sh | 28 -
.../conf/opt/backup_session_variables.sql | 0
tools/tpch-tools/conf/opt/opt_sf1.sql | 0
tools/tpch-tools/conf/opt/opt_sf100.sql | 0
tools/tpch-tools/conf/opt/opt_sf1000.sql | 1 -
tools/tpch-tools/conf/opt/opt_sf10000.sql | 1 -
1241 files changed, 74444 insertions(+), 9904 deletions(-)
create mode 100644 .github/workflows/delete-auto-pick-branch.yml
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index_common.h
create mode 100644 be/src/runtime/memory/memory_profile.cpp
create mode 100644 be/src/runtime/memory/memory_profile.h
create mode 100644 be/src/runtime/process_profile.cpp
create mode 100644 be/src/runtime/process_profile.h
create mode 100644 be/src/util/security.h
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top.h
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_k.cpp
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_k.h
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_sum.cpp
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_sum.h
create mode 100644 be/src/vec/common/arena_with_free_lists.h
create mode 100644 be/src/vec/common/bit_helpers.h
create mode 100644 be/src/vec/common/space_saving.h
create mode 100644 be/src/vec/exec/format/table/iceberg/arrow_schema_util.cpp
create mode 100644 be/src/vec/exec/format/table/iceberg/arrow_schema_util.h
create mode 100644 be/test/common/space_saving_test.cpp
create mode 100644 be/test/exec/test_data/orc_scanner/orders.orc
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/common/inverted_index_common_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index_file_writer_test.cpp
create mode 100644
be/test/vec/exec/format/table/iceberg/arrow_schema_util_test.cpp
create mode 100644 be/test/vec/exec/orc_reader_test.cpp
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run69.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run70.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run71.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_all_complex_types/dt=dt1/000000_0
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_all_complex_types/dt=dt2/000000_0
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_all_complex_types/dt=dt3/000000_0
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_load_data_table/1
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_nested_complex_table/1
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_nested_complex_table/2
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/json_nested_complex_table/modify_2
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/user_empty_lzo/part-m-00000.lzo
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{
=> iceberg}/run01.sql (100%)
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{
=> iceberg}/run02.sql (100%)
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{
=> iceberg}/run03.sql (100%)
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{
=> iceberg}/run04.sql (100%)
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{
=> iceberg}/run05.sql (100%)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run06.sql
rename
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/{run06.sql
=> paimon/run01.sql} (100%)
create mode 100644 fe/be-java-extensions/hadoop-hudi-scanner/pom.xml
create mode 100644
fe/be-java-extensions/hadoop-hudi-scanner/src/main/java/org/apache/doris/hudi/HadoopHudiColumnValue.java
create mode 100644
fe/be-java-extensions/hadoop-hudi-scanner/src/main/java/org/apache/doris/hudi/HadoopHudiJniScanner.java
copy fe/be-java-extensions/{avro-scanner =>
hadoop-hudi-scanner}/src/main/resources/package.xml (100%)
delete mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/HadoopUGI.java
create mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/PreExecutionAuthenticator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/mvcc/MvccSnapshot.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/mvcc/MvccTable.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/mvcc/MvccTableInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/AggregatePhase.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/ApproxTopK.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/ApproxTopSum.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/NotNullableAggregateFunction.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/OrthogonalBitmapExprCalculate.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/OrthogonalBitmapExprCalculateCount.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/LtrimIn.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/RtrimIn.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/TrimIn.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowViewCommand.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/FileGroupIntoTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/httpv2/GetLogFileActionTest.java
create mode 100644
regression-test/data/ddl_p0/create_view_nereids/create_view_use_mv.out
create mode 100644
regression-test/data/ddl_p0/create_view_nereids/test_create_view_nereids.out
delete mode 100644 regression-test/data/ddl_p0/test_create_view_nereids.out
create mode 100644
regression-test/data/export_p0/outfile/test_outfile_complex_type.out
create mode 100644
regression-test/data/export_p0/outfile/test_outfile_jsonb_and_variant.out
create mode 100644
regression-test/data/export_p0/outfile/test_outfile_null_type.out
create mode 100644
regression-test/data/external_table_p0/hive/hive_json_basic_test.out
create mode 100644
regression-test/data/external_table_p0/iceberg/iceberg_drop_rest_table.out
create mode 100644
regression-test/data/external_table_p0/iceberg/iceberg_read_unitycatalog_table.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_incremental.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_orc_tables.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_partition_prune.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_schema_evolution.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_snapshot.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_timestamp.out
create mode 100644
regression-test/data/external_table_p2/maxcompute/test_max_compute_partition_prune.out
create mode 100644
regression-test/data/fault_injection_p0/test_auto_inc_fetch_fail.out
create mode 100644
regression-test/data/fault_injection_p0/test_index_io_context.out
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-1.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-10.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-11.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-12.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-13.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-14.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-15.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-16.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-17.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-18.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-19.json
copy regression-test/data/{fault_injection_p0/documents-1000.json =>
inverted_index_p0/index_compaction/documents-2.json} (100%)
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-20.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-3.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-4.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-5.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-6.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-7.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-8.json
create mode 100644
regression-test/data/inverted_index_p0/index_compaction/documents-9.json
create mode 100644
regression-test/data/inverted_index_p0/test_index_approx_top_k.out
create mode 100644
regression-test/data/inverted_index_p0/test_index_approx_top_sum.out
create mode 100644
regression-test/data/nereids_function_p0/fn_test_ip_invalid.csv
create mode 100644
regression-test/data/nereids_function_p0/fn_test_ip_normal.csv
create mode 100644
regression-test/data/nereids_function_p0/fn_test_ip_nullable.csv
create mode 100644
regression-test/data/nereids_function_p0/fn_test_ip_special.csv
create mode 100644
regression-test/data/nereids_function_p0/fn_test_ip_special_no_null.csv
create mode 100644
regression-test/data/nereids_function_p0/scalar_function/IP.out
create mode 100644 regression-test/data/nereids_function_p0/test_ip.csv
create mode 100644
regression-test/data/nereids_p0/dist_expr_list/dist_expr_list.out
create mode 100644 regression-test/data/nereids_p0/show/show_view_command.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/agg_with_roll_up/any_value_roll_up.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/dml/rewrite/rewrite_when_dml.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/join/inner/inner_join_x.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/other_join_conjuncts/anti/other_join_conjuncts_anti.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/other_join_conjuncts/inner/other_join_conjuncts_inner.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/other_join_conjuncts/outer/other_join_conjuncts_outer.out
create mode 100644
regression-test/data/nereids_rules_p0/mv/other_join_conjuncts/semi/other_join_conjuncts_semi.out
copy regression-test/data/{correctness/test_crossjoin_inlineview_slot.out =>
partition_p0/dynamic_partition/test_dynamic_partition_small_start.out} (100%)
create mode 100644
regression-test/data/query_p0/sql_functions/string_functions/test_regexp_chinese.out
create mode 100644
regression-test/data/query_p0/sql_functions/string_functions/test_trim_in.out
create mode 100644 regression-test/suites/account_p0/test_system_user.groovy
create mode 100644
regression-test/suites/auth_call/test_grant_show_view_priv_auth.groovy
create mode 100644 regression-test/suites/auth_p0/test_grant_all_auth.groovy
create mode 100644 regression-test/suites/auth_p0/test_select_view_auth.groovy
create mode 100644
regression-test/suites/ddl_p0/create_view_nereids/create_view_use_mv.groovy
rename regression-test/suites/ddl_p0/{ =>
create_view_nereids}/test_create_view_nereids.groovy (100%)
create mode 100644
regression-test/suites/doc/data-operate/import/import-way/load-high-availability.md.groovy
create mode 100644
regression-test/suites/doc/sql-manual/sql-statements/Utility-Statements/cancel-warm-up.md.groovy
delete mode 100644
regression-test/suites/doc/table-design/data-partition.md.groovy
create mode 100644
regression-test/suites/doc/table-design/data-partitioning/auto-partitioning.md.groovy
create mode 100644
regression-test/suites/doc/table-design/data-partitioning/basic-concepts.md.groovy
create mode 100644
regression-test/suites/doc/table-design/data-partitioning/dynamic-partitioning.md.groovy
create mode 100644
regression-test/suites/doc/table-design/data-partitioning/manual-partitioning.md.groovy
create mode 100644
regression-test/suites/export_p0/outfile/test_outfile_complex_type.groovy
create mode 100644
regression-test/suites/export_p0/outfile/test_outfile_jsonb_and_variant.groovy
create mode 100644
regression-test/suites/export_p0/outfile/test_outfile_null_type.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/hive_json_basic_test.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/iceberg_drop_rest_table.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/iceberg_read_unitycatalog_table.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_user_empty_lzo.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_catalog.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_incremental.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_orc_tables.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_partition_prune.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_schema_evolution.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_snapshot.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_timestamp.groovy
create mode 100644
regression-test/suites/external_table_p2/maxcompute/test_max_compute_partition_prune.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_auto_inc_fetch_fail.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_full_compaction_with_ordered_data.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_index_io_context.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_skip_index_compaction_fault_injection.groovy
create mode 100644
regression-test/suites/insert_overwrite_p0/test_iot_auto_detect_fail.groovy
create mode 100644 regression-test/suites/insert_p0/test_jdbc.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_index_approx_top_k.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_index_approx_top_sum.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_inverted_index_writer_exception.groovy
create mode 100644
regression-test/suites/inverted_index_p1/show_data/test_show_index_data.groovy
create mode 100644
regression-test/suites/inverted_index_p2/show_data/test_show_index_data_p2.groovy
create mode 100644
regression-test/suites/manager/test_manager_interface_4.groovy
create mode 100644
regression-test/suites/nereids_function_p0/agg_function/test_orthogonal_bitmap_expr_calculate.groovy
create mode 100644
regression-test/suites/nereids_function_p0/scalar_function/IP.groovy
create mode 100644
regression-test/suites/nereids_p0/dist_expr_list/dist_expr_list.groovy
create mode 100644
regression-test/suites/nereids_p0/show/show_view_command.groovy
create mode 100644
regression-test/suites/nereids_p0/sql_functions/window_functions/test_lead_lag_nullable.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/expression/test_simplify_range.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/agg_with_roll_up/any_value_roll_up.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/create_part_and_up/create_commit_mtmv_many_task.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/create_part_and_up/range_date_datetrunc_part_up.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/create_part_and_up/range_date_part_up.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/create_part_and_up/range_date_part_up_rewrite.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/create_part_and_up/range_datetime_part_up_rewrite.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/dml/rewrite/rewrite_when_dml.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/is_in_debug_mode/is_in_debug_mode.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/join/inner/inner_join_x.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/other_join_conjuncts/anti/other_join_conjuncts_anti.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/other_join_conjuncts/inner/other_join_conjuncts_inner.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/other_join_conjuncts/outer/other_join_conjuncts_outer.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/other_join_conjuncts/semi/other_join_conjuncts_semi.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/union_rewrite/partition_curd_union_rewrite_hive.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/mv/with_table_operator/with_table_operator.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/tablet_prune/test_tablet_prune.groovy
create mode 100644
regression-test/suites/partition_p0/dynamic_partition/test_dynamic_partition_small_start.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/string_functions/test_regexp_chinese.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/string_functions/test_trim_in.groovy
delete mode 100644 regression-test/suites/query_profile/scanner_profile.groovy
delete mode 100644
regression-test/suites/query_profile/test_execute_by_frontend.groovy
create mode 100644 regression-test/suites/statistics/test_replace_table.grovvy
create mode 100644 regression-test/suites/table_p0/test_colocate_table.groovy
create mode 100644 regression-test/suites/vault_p0/create/load.groovy
create mode 100644 thirdparty/patches/brpc-1.4.0-no-pthread_mutex-hook.patch
create mode 100644 thirdparty/patches/brpc-1.5.0-remove-wordexp.patch
delete mode 100644 tools/tpcds-tools/conf/opt/opt_sf1.sql
delete mode 100644 tools/tpcds-tools/conf/opt/opt_sf100.sql
delete mode 100644 tools/tpcds-tools/conf/opt/opt_sf1000.sql
delete mode 100644 tools/tpcds-tools/conf/opt/opt_sf10000.sql
delete mode 100644 tools/tpch-tools/conf/opt/backup_session_variables.sql
delete mode 100644 tools/tpch-tools/conf/opt/opt_sf1.sql
delete mode 100644 tools/tpch-tools/conf/opt/opt_sf100.sql
delete mode 100644 tools/tpch-tools/conf/opt/opt_sf1000.sql
delete mode 100644 tools/tpch-tools/conf/opt/opt_sf10000.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
