This is an automated email from the ASF dual-hosted git repository. w41ter pushed a change to branch auto-pick-43827-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git
discard 62069e77ac1 [fix](binlog) add modify comment binlog when replaying journal (#43827) add a519702fac4 branch-2.1: [Bug](bitmap-filter) fix wrong type cast on BitmapFilterColumnPredicate::evaluate #43877 (#43886) add 74d87c9d4eb branch-2.1: [performance](load) fix broker load scan ranges for unsplittable files #43161 (#43976) add 5d5547803cc branch-2.1: [fix](datacheck) let count skip opt via meta #43743 (#43981) add 02bb36c2814 branch-2.1: [fix](regression)Fix unstable delta rows case. #43928 (#43988) add edd9015de37 [branch-2.1](function) fix error result in auto partition name (#41130) (#43977) add 72bfd1c7a41 [opt](binlog) Support modify comment binlog #39783 (#43821) add 7d43cc22741 [improve](load) show 99.99% instead of 100.00% in progess when load is not finished (#43224) (#44034) add 21b3e4bbf98 [Bug](runtime-filter) fix core dump on rf between varchar and char #43758 (#43934) add 75d4e2c5ada branch-2.1: [fix](case) fix replay_wal_restart_fe #43705 (#43897) add b3022df7169 [fix](inverted index) base compaction failed after restore indexes (#43962) add 91dcc0e1940 branch-2.1: [fix](mtmv) Fix generate hyper graph wrongly when has filter which can not push down #43539 (#43946) add 269c2c844b4 branch-2.1: [opt](paimon)Optimize the display of splitstate to prevent too many splits #43982 (#44060) add 48e33bfb2a0 branch-2.1: [fix](hive)Fixed the issue of reading hive table with empty lzo files #43979 (#44063) add d49ef5bf1c8 [branch-2.1](DDL) Fix wrong show create table stmt for auto list multi-columns partition (#43967) (#44007) add d1cc68a26a8 branch-2.1: [Fix](auto-increment) Fix duplicate auto-increment column value problem #43774 (#43984) add 42b190cfad0 branch-2.1: [fix](dynamic partition) data lost with very small dynamic_partition.start #43898 (#44033) add 03eae760c4a branch-2.1: [fix](catalog) rebuild idToCatalog map after replay #43772 (#43963) add 10009dc0620 [fix](variant) fix index in variant (#43375) (#43971) add b120e895f17 branch-2.1: [fix](test) fix mysql jdbc catalog test out #43867 (#43916) add 8fcce4f591c [improvement](nereids) support extract from disjunction in join on condition (#38479) (#43670) add 6fe00c7244a [fix](mtmv) fix mtmv deadlock issue (#43376) (#43428) add 90254d856d4 branch-2.1: [refactor](binlog) put recording dropped resource into a seperate method #43938 (#43966) add 261c65f72da [fix](pipeline) only sub_running_sink_operators in close #43500 (#43726) add 44ed5d61201 [fix](analyzer) fixed the NullPointerException (#43269) add ea61206233e [pick](branch-2.1) pick #43281 (#44020) add ea36a334e43 [fix](binlog) add modify comment binlog when replaying journal (#43827) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (62069e77ac1) \ N -- N -- N refs/heads/auto-pick-43827-branch-2.1 (ea36a334e43) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: be/src/common/config.cpp | 7 + be/src/common/config.h | 6 + be/src/exec/lzo_decompressor.cpp | 1 + be/src/exprs/create_predicate_function.h | 2 +- be/src/olap/bitmap_filter_predicate.h | 2 +- be/src/olap/bloom_filter_predicate.h | 4 +- be/src/olap/compaction.cpp | 9 + be/src/olap/rowset/segment_v2/segment_iterator.cpp | 7 + be/src/olap/rowset/segment_v2/segment_writer.cpp | 44 ++-- .../rowset/segment_v2/vertical_segment_writer.cpp | 42 ++- be/src/olap/tablet_schema.cpp | 12 +- be/src/olap/tablet_schema.h | 2 +- be/src/pipeline/exec/result_file_sink_operator.cpp | 2 +- be/src/pipeline/exec/result_sink_operator.cpp | 12 +- .../local_exchange_sink_operator.cpp | 16 +- .../local_exchange/local_exchange_sink_operator.h | 2 + be/src/runtime/buffer_control_block.cpp | 236 ++++++++++++++--- be/src/runtime/buffer_control_block.h | 79 +++++- be/src/runtime/result_buffer_mgr.cpp | 78 +++--- be/src/runtime/result_buffer_mgr.h | 29 +- .../arrow_flight/arrow_flight_batch_reader.cpp | 291 +++++++++++++++++++-- .../arrow_flight/arrow_flight_batch_reader.h | 69 ++++- be/src/service/arrow_flight/flight_sql_service.cpp | 57 ++-- be/src/service/internal_service.cpp | 60 ++++- be/src/service/internal_service.h | 5 + be/src/util/arrow/row_batch.cpp | 12 +- be/src/util/arrow/row_batch.h | 12 +- be/src/util/arrow/utils.cpp | 3 +- be/src/util/doris_metrics.h | 5 + be/src/vec/common/schema_util.cpp | 11 +- be/src/vec/common/schema_util.h | 2 + be/src/vec/functions/function_string.h | 63 +++-- be/src/vec/sink/autoinc_buffer.cpp | 31 ++- be/src/vec/sink/varrow_flight_result_writer.cpp | 64 ++--- be/src/vec/sink/varrow_flight_result_writer.h | 18 +- be/src/vec/sink/vmemory_scratch_sink.cpp | 2 +- be/src/vec/sink/vresult_file_sink.cpp | 2 +- be/src/vec/sink/vresult_sink.cpp | 11 +- be/test/common/schema_util_test.cpp | 109 ++++++++ .../olap/bitmap_filter_column_predicate_test.cpp | 4 +- be/test/runtime/result_buffer_mgr_test.cpp | 13 +- .../user_empty_lzo/part-m-00000.lzo | Bin 0 -> 42 bytes .../org/apache/doris/binlog/BinlogManager.java | 10 + .../java/org/apache/doris/binlog/DBBinlog.java | 110 ++++---- .../apache/doris/catalog/ListPartitionInfo.java | 33 +-- .../main/java/org/apache/doris/catalog/MTMV.java | 2 +- .../java/org/apache/doris/catalog/OlapTable.java | 8 +- .../doris/clone/DynamicPartitionScheduler.java | 9 + .../doris/common/proc/PartitionsProcDir.java | 31 ++- .../org/apache/doris/datasource/CatalogMgr.java | 13 +- .../org/apache/doris/datasource/FileGroupInfo.java | 98 +++++-- .../datasource/paimon/source/PaimonScanNode.java | 16 +- .../doris/job/extensions/insert/InsertJob.java | 3 +- .../java/org/apache/doris/load/loadv2/LoadJob.java | 3 +- .../apache/doris/load/loadv2/ProgressManager.java | 15 +- .../org/apache/doris/mtmv/MTMVPartitionUtil.java | 4 +- .../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 2 +- .../jobs/joinorder/hypergraph/HyperGraph.java | 2 +- .../mv/AbstractMaterializedViewRule.java | 45 +++- ...xtractSingleTableExpressionFromDisjunction.java | 54 ++-- .../functions/scalar/AutoPartitionName.java | 14 +- .../java/org/apache/doris/persist/EditLog.java | 4 +- .../doris/persist/ModifyCommentOperationLog.java | 4 + .../org/apache/doris/qe/cache/CacheAnalyzer.java | 19 +- .../arrowflight/DorisFlightSqlProducer.java | 26 +- .../arrowflight/FlightSqlConnectProcessor.java | 16 +- .../analysis/CreateTableAsSelectStmtTest.java | 2 +- .../doris/catalog/ListPartitionInfoTest.java | 25 ++ .../doris/catalog/RangePartitionInfoTest.java | 30 +++ .../apache/doris/datasource/FileGroupIntoTest.java | 66 +++++ ...ctSingleTableExpressionFromDisjunctionTest.java | 36 +++ gensrc/proto/internal_service.proto | 16 ++ gensrc/thrift/FrontendService.thrift | 1 + .../jdbc/test_mysql_jdbc_catalog.out | 73 ++---- .../test_auto_inc_fetch_fail.out | 10 + .../test_variant_bloom_filter.out | 40 +++ .../data/nereids_function_p0/scalar_function/A.out | 16 ++ .../mv/join/left_outer/outer_join.out | 48 ++++ .../extract_from_disjunction_in_join.out | 94 +++++++ .../push_down_filter_through_window.out | 0 .../test_dynamic_partition_small_start.out} | 0 .../suites/data_reliability/check_meta.groovy | 2 +- .../jdbc/test_mysql_jdbc_catalog.groovy | 28 +- .../paimon/paimon_tb_mix_format.groovy | 5 + .../tvf/test_user_empty_lzo.groovy | 41 +++ .../test_auto_inc_fetch_fail.groovy | 63 +++++ .../test_variant_bloom_filter.groovy | 140 ++++++++++ .../group_commit/replay_wal_restart_fe.groovy | 2 +- .../nereids_function_p0/scalar_function/A.groovy | 12 +- .../suites/nereids_p0/delta_row/delta_row.groovy | 36 ++- .../mv/join/left_outer/outer_join.groovy | 153 +++++++++++ .../extract_from_disjunction_in_join.groovy | 83 ++++++ .../push_down_filter_through_window.groovy | 0 .../test_dynamic_partition_small_start.groovy | 54 ++++ 94 files changed, 2465 insertions(+), 588 deletions(-) create mode 100644 be/test/common/schema_util_test.cpp create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/user_empty_lzo/part-m-00000.lzo create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/FileGroupIntoTest.java create mode 100644 regression-test/data/fault_injection_p0/test_auto_inc_fetch_fail.out create mode 100644 regression-test/data/fault_injection_p0/test_variant_bloom_filter.out create mode 100644 regression-test/data/nereids_rules_p0/push_down_filter/extract_from_disjunction_in_join.out rename regression-test/data/nereids_rules_p0/{push_down_filter_through_window => push_down_filter}/push_down_filter_through_window.out (100%) copy regression-test/data/{correctness/test_crossjoin_inlineview_slot.out => partition_p0/dynamic_partition/test_dynamic_partition_small_start.out} (100%) create mode 100644 regression-test/suites/external_table_p0/tvf/test_user_empty_lzo.groovy create mode 100644 regression-test/suites/fault_injection_p0/test_auto_inc_fetch_fail.groovy create mode 100644 regression-test/suites/fault_injection_p0/test_variant_bloom_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/push_down_filter/extract_from_disjunction_in_join.groovy rename regression-test/suites/nereids_rules_p0/{push_down_filter_through_window => push_down_filter}/push_down_filter_through_window.groovy (100%) create mode 100644 regression-test/suites/partition_p0/dynamic_partition/test_dynamic_partition_small_start.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org