This is an automated email from the ASF dual-hosted git repository. kxiao pushed a change to branch branch-2.0 in repository https://gitbox.apache.org/repos/asf/doris.git
from d3e1baddeb [feature](branch-2.0) add failure tolerance for strict mode partial update stream load (#22100) new 95606570d6 [enhancement](config) enlarge max_bytes_per_broker_scanner to 5G #22099 new 9ddbf200cd [bug](node) fix partiton sort node core dump when eos (#22108) new 791196054b [fix](partial-update) fix update core for merge-on-write table (#22090) new db5300fba4 fix(compaction) release the block and segment iterator after reading to the end of the segment file (#22082) new 7d019152f5 [improvement](iceberg) Optimize the split to the user-specified size #22078 new efb699a463 [refactor](be) use std::move to improve performance of push_back #22056 new d363007e90 [Bug][Colocate] when adding a table to the colocate group, we should check that the number of buckets per partition is the same (#21906) new 1e60089d3b [improvement](spark-load) support datev2 and datetimev2 #21839 new 3b4dbcafc2 [fix](docs) update version since of stream load enable_profile (#21786) new 3c6676ce2e [Improvement](pipeline) support send eos on local exchange and remove some unused code (#22086) new 31316cd41e [Fix](planner) fix rewritten alias function's original function is not analyzed again (#21497) new d7521ed7f4 [Fix](Nereids)fix insert into default value exception (#21924) new 29f45eaf04 [Fix](Sonar)Fix Java heap space error (#22135) new 3a710117b8 [fix](in) throw exception for unsupported data type of in expr (#22050) new 5cad1861e5 [enhance](nereids) enable wf partition topn by default (#21860) new 054c573cf4 [Fix](binlog) Fix bugs in tombstone (#22031) new bff1ea378e [fix](inverted index) fix regression case test_index_change_7 occasional failure (#22066) new 8eb75c34ab [fix](Nereids) remove double sigature of ceil, floor and round (#22134) new 94a7c7f8e3 [opt](Nereids) check multiple distinct functions that cannot be transformed into muti_distinct (#21626) new 056374e126 [opt](filecache) use weak_ptr to cache the file handle of file segment (#21975) new 11b6dbfab9 [enhancement](config) Enlarge broker scanner bytes conf to 500G, 5G is still not enough (#22126) The 21 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/sonarcloud.yml | 2 +- be/src/common/config.cpp | 1 + be/src/common/config.h | 2 + be/src/exec/olap_common.h | 14 +- be/src/exprs/create_predicate_function.h | 3 +- be/src/io/cache/block/block_file_cache.cpp | 43 +++++ be/src/io/cache/block/block_file_cache.h | 25 +++ be/src/io/cache/block/block_file_segment.cpp | 26 +-- be/src/io/cache/block/block_file_segment.h | 6 +- be/src/io/cache/block/block_lru_file_cache.cpp | 3 + be/src/io/cache/block/block_lru_file_cache.h | 1 + be/src/olap/rowset/segment_v2/segment_writer.cpp | 4 +- be/src/olap/tablet.cpp | 9 +- be/src/olap/tablet.h | 3 +- be/src/pipeline/exec/exchange_source_operator.cpp | 1 - be/src/runtime/fragment_mgr.cpp | 2 +- be/src/service/brpc_service.cpp | 2 +- be/src/service/internal_service.cpp | 17 +- be/src/service/internal_service.h | 2 +- be/src/util/proto_util.h | 56 ------ be/src/vec/columns/column_complex.h | 3 +- be/src/vec/exec/vexchange_node.h | 1 - be/src/vec/exec/vpartition_sort_node.cpp | 6 +- be/src/vec/functions/match.h | 10 +- be/src/vec/olap/vertical_merge_iterator.cpp | 11 +- be/src/vec/sink/vdata_stream_sender.cpp | 16 +- be/src/vec/sink/vdata_stream_sender.h | 12 +- be/test/io/cache/file_block_cache_test.cpp | 144 +++++++++++++++ be/test/vec/exec/vtablet_sink_test.cpp | 2 - be/test/vec/runtime/vdata_stream_test.cpp | 2 - docs/en/docs/admin-manual/config/fe-config.md | 2 +- .../import/import-way/broker-load-manual.md | 2 +- .../import/import-way/stream-load-manual.md | 2 +- docs/zh-CN/docs/admin-manual/config/fe-config.md | 2 +- .../import/import-way/broker-load-manual.md | 2 +- .../import/import-way/stream-load-manual.md | 2 +- .../main/java/org/apache/doris/common/Config.java | 2 +- .../apache/doris/analysis/FunctionCallExpr.java | 5 +- .../apache/doris/analysis/NativeInsertStmt.java | 12 +- .../java/org/apache/doris/analysis/SelectStmt.java | 3 +- .../org/apache/doris/binlog/BinlogTombstone.java | 48 +++-- .../java/org/apache/doris/binlog/DBBinlog.java | 84 ++++----- .../java/org/apache/doris/binlog/TableBinlog.java | 35 ++-- .../apache/doris/catalog/ColocateGroupSchema.java | 5 + .../doris/nereids/jobs/executor/Rewriter.java | 3 + .../nereids/rules/rewrite/CheckMultiDistinct.java | 62 +++++++ .../trees/expressions/functions/scalar/Ceil.java | 2 - .../trees/expressions/functions/scalar/Dceil.java | 2 - .../trees/expressions/functions/scalar/Dfloor.java | 2 - .../trees/expressions/functions/scalar/Dround.java | 3 - .../trees/expressions/functions/scalar/Floor.java | 2 - .../trees/expressions/functions/scalar/Round.java | 3 - .../expressions/functions/scalar/RoundBankers.java | 3 - .../expressions/functions/scalar/Truncate.java | 2 - .../planner/external/iceberg/IcebergScanNode.java | 24 ++- .../java/org/apache/doris/qe/SessionVariable.java | 2 +- .../doris/rewrite/RewriteAliasFunctionRule.java | 2 +- .../org/apache/doris/analysis/InsertStmtTest.java | 8 +- .../doris/nereids/trees/expressions/UdfTest.java | 9 +- .../apache/doris/load/loadv2/dpp/ColumnParser.java | 6 +- .../org/apache/doris/load/loadv2/dpp/DppUtils.java | 4 + .../data/nereids_function_p0/scalar_function/D.out | 200 ++++++++++----------- .../data/nereids_function_p0/scalar_function/R.out | 192 ++++++++++---------- .../nereids_tpcds_shape_sf100_p0/shape/query44.out | 52 +++--- .../nereids_tpcds_shape_sf100_p0/shape/query67.out | 35 ++-- .../nereids_tpcds_shape_sf100_p0/shape/query70.out | 27 +-- .../sql_functions/math_functions/test_round.out | 13 +- .../test_partial_update_schema_change.out} | 12 +- .../index_change/test_index_change_7.groovy | 25 +-- .../suites/nereids_syntax_p0/analyze_agg.groovy | 5 + .../query_p0/sql_functions/test_in_expr.groovy | 85 +++++++++ .../test_partial_update_schema_change.groovy | 55 ++++++ 72 files changed, 938 insertions(+), 537 deletions(-) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/CheckMultiDistinct.java copy regression-test/data/{bitmap_functions/test_bitmap_intersect.out => unique_with_mow_p0/partial_update/test_partial_update_schema_change.out} (76%) create mode 100644 regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_schema_change.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org