This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a change to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 3ac73f32582 High priority queue and map. (#31509)
discard ae0db0a5140 Collect high priority columns. (#31235)
add 76992e6337c Add p1 debug log (#31560)
add f5ceffef57e [Bug](materialized-view) fix npe on create mv with star
(#31554)
add 3a0ba65fd15 [fix](Hive-Catalog) fix NPE when using jdbc to access Hive
metadata (#31559)
add 410ac50b206 [Improvement](materialized-view) add
approx_count_distinct/ndv to FunctionAlias rule (#31535)
add 65d998f1e92 [Fix](timezone) Introduce a config to use Doris tzdata
directly (#31561)
add 9dc9bf01027 [Bug](Func) Fix negative number in bitmap return error
result (#31563)
add ff96be1dcbf [fix](regression test)Make index compaction caset
nonCouncurrent (#31520)
add 3270830b32d [chore](docs) fix some typo in english docs in inverted
index (#31497)
add 59cdef96f6c [fix](Nereids) reorder join generate plan is not stable
(#31539)
add afbd44a63c5 [fix](statistics)Fix hms external table get row count bug
while analyze (#31557)
add 1569f2f4123 [fix](mtmv)fix getIdToItem cause
ConcurrentModificationException (#31511)
add 889ae216154 [fix](nereids) forbid create table with illegal auto
partition expr (#31498)
add 06a78d3428e [Fix](JNI) fix BE core when using JNI to query the empty
`map` type value (#31502)
add 399811bbc6a [docker][fix] update routine load cases (#31553)
add 554e942d27e [function](random_bytes)add random_bytes function (#31547)
add 5fb98d3543d fix total task exec time is far more than actual (#31273)
add 0adb0f045bc [fix](paimon) auto deplay paimon oss/s3 jar file (#31568)
add 8a07b5cf9c8 [chore](catalog recycle bin) Add option to ignore min
erase latency for testing (#31417)
add e7573ac16ec [fix](multi-catalog) add max compute custom odps and
tunnel url (#31390)
add bd4bb58e093 [fix](nereids) stats derive for "not equal“, avoid to
derive zero ndv (#31566)
add d61562486bd [fix](nereids) window function with grouping sets work not
well (#31475)
add 5918c522c1f [Fix](executor)Fix insert select forward carry
workload_group #31578
add ea36bcc1b47 [fix](test) fix error messages in fault injection tests
(follow-up) (#31577)
add 8ad022180c6 fix test_decimal256_index add wait build index (#31565)
add 453a899c02b [fix](Neredis) Fix npe when plan node doesn't have
expressions in materialized view (#31579)
add accfcfcae5a [enhancement](Nereids) New optimizer support check column
privileges (#31494)
add 71516ca1aa3 [fix](Nereids): AssertNumRowsElement shouldn't be
expression (#31581)
add 55d75e7f757 [improve](conf)refactor fuzzy mode in BE (#31412)
add bc78d93afb2 [cloud](topn-opt) support topn 2 phase read in cloud mode
(#31548)
add de23fde946e [refactor](raw ptr) disable some raw pointer usage and
some unused code (#31595)
add e84677fbe05 [enhancement](core) throw exception instead of core during
insert_range_from method (#31592)
add 31ad7a2ed4b [feature](invert index) match_phrase_edge feature added
(#31142)
add 95fc7a28d28 [fix](load) delete bytes_appended debug point which may
cause bad page (#31602)
add a15eef99919 [improvement](plsql) Select statement supports insert into
variables #31574
add e79462cdd80 [feature](sink) support paritition tablet sink shuffle
(#30914)
add b78839e3ccd Support analyze rollup. (#31576)
add bf2c9a545a8 [improve](export) Support partition data consistency
(#31290)
add 11b561b2b05 [pipelineX](bug) Fix core dump if union has no children
(#31611)
add d4b99f1bb19 [Fix](nereids) Only rewrite the slots that appear both in
trival-agg func and grouping sets (#31600)
add 9f6515f64bd [fix](test)Fix mtmv switch is false in incremtn case
(#31584)
add a81761f8040 [pipelineX](conf) enable pipelineX by default (#29894)
add 0caee35a05c [improvement](docs)add faq for flink-connector-doris
(#31426)
add 7190a2f465b Test the unique model by modify a value type from BOOLEAN
to other type (#31589)
add 24768e20f4e [doc](fix) add k8s operator doc for upgrade doris (#31586)
add 40fd775c798 [improvement](group_commit) Empty wal should be deleted
when replaying it (#31427)
add e149cfaf5da [fix](regression) set rf type to 4 to forbid fuzzy rf_type
in shape check #31567
add bf741a2b671 [Fix](Status) Handle returned Status correctly #31434
add d26bfe030a8 [nereids] explode function stats configurable (#31332)
add 98a9079b680 [pipelineX](bug) Fix aggregate crash if open failed
(#31625)
add e32c10d0f9e [FIX](regression cases) fix regress exception for
test_array_element_at_and_slice(#31621)
add c73b425c766 [feature](jdbc catalog) support db2 jdbc catalog (#31627)
add 6a5026fa032 [Bug](delete) ignore case on delete from command and add
check on deletejob dispatch (#31593)
add 6b04732366c [Fix](Variant) fix variant root may be emtpy in
`OlapColumnDataConvertorVariant::set_source_column` (#31572)
add 4c8fe107a7d [refactor](exception safe) Refactor delete handler and
block column predicates to make sure exception safe (#31618)
add 73991811f0e [Fix](merge-cloud) fix 2pc stream load of cloud mode
(#31629)
add e33d5a9d2e1 [fix](memory) jemalloc conf lg_tcache_max restore default
(#30848)
add 585d12431c3 [fix](planner) should not push down sink when last
exchange do limit (#31622)
add c8355e7c877 [Refactor](insert) refactor insert command to support
other type of table (#31610)
add 1f3daebd49a [chore](ci) support custom conf for ms and recycler
(#31558)
add 19c98d5fa35 [pipelineX](bug) cancel pipeline tasks if timeout (#31635)
add 6219acde244 [Fix](test)Fix query queue regression test #31633
add e75e209f720 [Chore](Docs)Update release guide (#31654)
new 44dab1abe46 Collect high priority columns. (#31235)
new 4dbd91fe989 High priority queue and map. (#31509)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3ac73f32582)
\
N -- N -- N refs/heads/high-priority-column (4dbd91fe989)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/task_worker_pool.cpp | 2 +-
be/src/cloud/cloud_storage_engine.cpp | 6 +
be/src/cloud/cloud_storage_engine.h | 1 -
be/src/common/config.cpp | 31 +-
be/src/common/config.h | 6 +-
be/src/exec/odbc_connector.cpp | 2 +-
be/src/exec/olap_common.h | 2 +
be/src/exec/olap_utils.h | 14 +-
be/src/exec/rowid_fetcher.cpp | 197 ++++++++++
be/src/exec/rowid_fetcher.h | 6 +
be/src/exprs/runtime_filter.cpp | 14 +-
be/src/exprs/runtime_filter.h | 2 +-
be/src/exprs/runtime_filter_slots.h | 2 +-
be/src/http/action/restore_tablet_action.cpp | 3 +-
be/src/http/action/tablet_migration_action.cpp | 8 +-
be/src/index-tools/index_tool.cpp | 7 +-
be/src/io/fs/file_writer.h | 5 +-
be/src/olap/block_column_predicate.cpp | 24 +-
be/src/olap/block_column_predicate.h | 25 +-
be/src/olap/data_dir.cpp | 1 -
be/src/olap/data_dir.h | 1 -
be/src/olap/delete_handler.cpp | 15 +-
be/src/olap/delete_handler.h | 7 +-
be/src/olap/iterators.h | 2 +-
be/src/olap/match_predicate.cpp | 6 +-
be/src/olap/olap_server.cpp | 6 +
be/src/olap/rowset/beta_rowset_reader.cpp | 12 +-
.../inverted_index/query/phrase_edge_query.cpp | 128 +++++++
.../inverted_index/query/phrase_edge_query.h | 52 +++
.../inverted_index/query/query_factory.h | 15 +-
.../rowset/segment_v2/inverted_index_query_type.h | 7 +-
.../rowset/segment_v2/inverted_index_reader.cpp | 5 +-
be/src/olap/rowset/segment_v2/segment.cpp | 9 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 4 +-
be/src/olap/storage_engine.cpp | 40 ++-
be/src/olap/storage_engine.h | 24 +-
be/src/olap/tablet_manager.cpp | 3 +-
be/src/olap/tablet_manager.h | 2 +-
be/src/olap/tablet_reader.cpp | 2 -
be/src/olap/utils.h | 5 -
be/src/olap/wal/wal_reader.cpp | 3 +
be/src/olap/wal/wal_table.cpp | 2 +-
be/src/pipeline/exec/aggregation_sink_operator.cpp | 1 +
be/src/pipeline/exec/analytic_source_operator.cpp | 7 +-
be/src/pipeline/exec/analytic_source_operator.h | 2 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 2 +-
.../exec/nested_loop_join_probe_operator.cpp | 6 +-
be/src/pipeline/exec/result_file_sink_operator.cpp | 4 +-
be/src/pipeline/exec/result_sink_operator.cpp | 4 +-
be/src/pipeline/exec/union_source_operator.cpp | 3 +-
be/src/pipeline/pipeline_fragment_context.cpp | 14 +
be/src/pipeline/pipeline_fragment_context.h | 5 +
be/src/pipeline/pipeline_x/dependency.h | 5 +-
be/src/pipeline/pipeline_x/operator.cpp | 2 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 4 +-
be/src/runtime/descriptors.cpp | 2 +
be/src/runtime/descriptors.h | 6 +
be/src/runtime/fragment_mgr.cpp | 10 +
be/src/runtime/plan_fragment_executor.cpp | 2 +-
be/src/runtime/query_statistics.cpp | 50 +--
be/src/runtime/query_statistics.h | 36 --
be/src/runtime/result_buffer_mgr.cpp | 5 +-
be/src/runtime/result_buffer_mgr.h | 2 +-
be/src/service/doris_main.cpp | 7 +-
be/src/service/internal_service.cpp | 214 +----------
be/src/service/internal_service.h | 25 +-
be/src/util/timezone_utils.cpp | 13 +-
be/src/vec/columns/column_array.cpp | 12 +-
be/src/vec/columns/column_decimal.cpp | 8 +-
be/src/vec/columns/column_fixed_length_object.h | 3 +-
be/src/vec/columns/column_map.cpp | 8 +-
be/src/vec/columns/column_string.cpp | 4 +-
be/src/vec/columns/column_vector.cpp | 8 +-
.../exec/format/table/max_compute_jni_reader.cpp | 2 +
be/src/vec/exec/jni_connector.cpp | 10 +-
be/src/vec/exec/join/vhash_join_node.cpp | 2 +-
be/src/vec/exec/join/vnested_loop_join_node.cpp | 4 +-
be/src/vec/exec/scan/new_olap_scanner.cpp | 23 +-
be/src/vec/exec/vanalytic_eval_node.cpp | 15 +-
be/src/vec/exec/vanalytic_eval_node.h | 2 +-
be/src/vec/exec/vsort_node.cpp | 2 +-
be/src/vec/exec/vunion_node.cpp | 2 +-
be/src/vec/functions/function_bitmap.cpp | 4 +-
be/src/vec/functions/function_rpc.cpp | 10 +-
be/src/vec/functions/function_rpc.h | 6 +-
be/src/vec/functions/function_string.cpp | 1 +
be/src/vec/functions/function_string.h | 58 +++
be/src/vec/functions/match.cpp | 1 +
be/src/vec/functions/match.h | 17 +
be/src/vec/olap/olap_data_convertor.cpp | 7 +
be/src/vec/olap/vertical_merge_iterator.cpp | 4 +-
be/src/vec/olap/vgeneric_iterators.cpp | 4 +-
be/src/vec/sink/async_writer_sink.h | 2 +-
be/src/vec/sink/autoinc_buffer.cpp | 10 +-
be/src/vec/sink/autoinc_buffer.h | 18 +-
be/src/vec/sink/vdata_stream_sender.cpp | 104 +++++-
be/src/vec/sink/vdata_stream_sender.h | 41 ++-
be/src/vec/sink/vresult_file_sink.cpp | 6 +-
be/src/vec/sink/vresult_sink.cpp | 6 +-
be/src/vec/sink/vrow_distribution.h | 3 +
be/src/vec/sink/vtablet_block_convertor.h | 2 +-
be/src/vec/sink/writer/async_result_writer.cpp | 8 +-
be/src/vec/sink/writer/async_result_writer.h | 2 +-
be/src/vec/sink/writer/vfile_result_writer.cpp | 5 +-
be/src/vec/sink/writer/vfile_result_writer.h | 2 +-
be/test/olap/block_column_predicate_test.cpp | 68 ++--
be/test/olap/delete_handler_test.cpp | 10 -
bin/run-fs-benchmark.sh | 2 +-
bin/start_be.sh | 2 +-
cloud/script/start.sh | 2 +-
docker/thirdparties/docker-compose/db2/db2.env | 19 +
.../thirdparties/docker-compose/db2/db2.yaml.tpl | 54 +++
.../docker-compose/db2/init/01-drop-schema.sql | 18 +
.../docker-compose/db2/init/02-create-schema.sql | 18 +
.../docker-compose/db2/init/03-create-table.sql | 40 +++
.../docker-compose/db2/init/04-insert.sql | 150 ++++++++
docker/thirdparties/run-thirdparties-docker.sh | 65 ++--
.../community/release-and-verify/release-verify.md | 15 +-
docs/en/docs/admin-manual/config/be-config.md | 10 +
docs/en/docs/advanced/time-zone.md | 4 +-
docs/en/docs/data-table/index/inverted-index.md | 10 +-
docs/en/docs/ecosystem/flink-doris-connector.md | 4 +
.../install/k8s-deploy/doris-cluster-upgrade.md | 286 +++++++++++++++
.../docs/install/k8s-deploy/persistent-volume.md | 4 +-
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 81 ++++-
.../en/docs/lakehouse/multi-catalog/max-compute.md | 25 ++
docs/en/docs/lakehouse/multi-catalog/paimon.md | 38 +-
.../string-functions/random_bytes.md} | 18 +-
docs/sidebars.json | 2 +
.../community/release-and-verify/release-verify.md | 16 +-
docs/zh-CN/docs/admin-manual/config/be-config.md | 10 +
docs/zh-CN/docs/advanced/time-zone.md | 4 +-
docs/zh-CN/docs/ecosystem/flink-doris-connector.md | 4 +
.../install/k8s-deploy/doris-cluster-upgrade.md | 291 +++++++++++++++
.../docs/install/k8s-deploy/persistent-volume.md | 4 +-
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 81 ++++-
.../docs/lakehouse/multi-catalog/max-compute.md | 26 ++
docs/zh-CN/docs/lakehouse/multi-catalog/paimon.md | 38 +-
.../{url-decode.md => random_bytes.md} | 20 +-
.../sql-functions/string-functions/url-decode.md | 2 +-
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 8 +
...racleJdbcExecutor.java => DB2JdbcExecutor.java} | 83 ++---
.../org/apache/doris/jdbc/JdbcExecutorFactory.java | 2 +
.../org/apache/doris/jdbc/OracleJdbcExecutor.java | 8 -
.../doris/maxcompute/MaxComputeJniScanner.java | 5 +-
.../doris/maxcompute/MaxComputeTableScan.java | 37 +-
fe/be-java-extensions/preload-extensions/pom.xml | 12 +
.../main/java/org/apache/doris/common/Config.java | 11 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 3 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 18 +-
.../antlr4/org/apache/doris/nereids/PLLexer.g4 | 2 -
.../antlr4/org/apache/doris/nereids/PLParser.g4 | 8 +-
fe/fe-core/src/main/cup/sql_parser.cup | 5 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 7 +-
.../java/org/apache/doris/analysis/ExportStmt.java | 15 +
.../org/apache/doris/analysis/MatchPredicate.java | 11 +
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../apache/doris/catalog/CatalogRecycleBin.java | 3 +-
.../org/apache/doris/catalog/JdbcResource.java | 6 +-
.../java/org/apache/doris/catalog/JdbcTable.java | 3 +
.../main/java/org/apache/doris/catalog/MTMV.java | 110 ++++--
.../java/org/apache/doris/catalog/OlapTable.java | 31 +-
.../java/org/apache/doris/catalog/TableIf.java | 54 ++-
.../transaction/CloudGlobalTransactionMgr.java | 38 +-
.../org/apache/doris/datasource/ExternalTable.java | 104 ------
.../apache/doris/datasource/InternalCatalog.java | 48 ++-
.../doris/datasource/hive/HMSExternalCatalog.java | 3 +-
.../doris/datasource/hive/HMSExternalTable.java | 6 +-
.../doris/datasource/jdbc/client/JdbcClient.java | 2 +
.../datasource/jdbc/client/JdbcDB2Client.java | 83 +++++
.../maxcompute/MaxComputeExternalCatalog.java | 41 ++-
.../maxcompute/MaxComputeExternalTable.java | 2 +
.../property/constants/MCProperties.java | 2 +
.../doris/job/extensions/insert/InsertJob.java | 2 +-
.../doris/job/extensions/insert/InsertTask.java | 2 +-
.../main/java/org/apache/doris/load/DeleteJob.java | 19 +
.../main/java/org/apache/doris/load/ExportJob.java | 87 +++--
.../main/java/org/apache/doris/load/ExportMgr.java | 1 +
.../org/apache/doris/load/ExportTaskExecutor.java | 5 +-
.../load/routineload/RoutineLoadTaskScheduler.java | 13 +-
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 39 +-
.../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 2 +-
.../org/apache/doris/nereids/CascadesContext.java | 43 +--
.../glue/translator/PhysicalPlanTranslator.java | 3 +
.../doris/nereids/jobs/executor/Rewriter.java | 17 +-
.../joinorder/hypergraph/node/StructInfoNode.java | 2 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 18 +-
.../DistributionSpecTabletIdShuffle.java} | 22 +-
.../nereids/properties/PhysicalProperties.java | 3 +
.../org/apache/doris/nereids/rules/RuleType.java | 5 +-
.../doris/nereids/rules/analysis/BindRelation.java | 34 +-
.../rules/analysis/EliminateLogicalSelectHint.java | 1 +
.../nereids/rules/analysis/NormalizeAggregate.java | 23 +-
.../nereids/rules/analysis/NormalizeRepeat.java | 91 ++++-
.../nereids/rules/analysis/UserAuthentication.java | 20 +-
.../nereids/rules/rewrite/CheckPrivileges.java | 87 +++++
....java => EliminateSortUnderSubqueryOrView.java} | 21 +-
...rtUnderSubquery.java => InlineLogicalView.java} | 11 +-
.../doris/nereids/rules/rewrite/ReorderJoin.java | 23 +-
.../doris/nereids/stats/FilterEstimation.java | 9 +-
.../doris/nereids/stats/StatsCalculator.java | 3 +-
.../trees/expressions/AssertNumRowsElement.java | 41 +--
.../nereids/trees/expressions/Expression.java | 3 +-
.../doris/nereids/trees/expressions/Match.java | 2 +
.../nereids/trees/expressions/MatchPhraseEdge.java | 49 +++
.../expressions/functions/scalar/RandomBytes.java | 71 ++++
.../expressions/visitor/ExpressionVisitor.java | 10 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../apache/doris/nereids/trees/plans/PlanType.java | 2 +
.../trees/plans/commands/CreateTableCommand.java | 3 +-
.../trees/plans/commands/DeleteFromCommand.java | 6 +-
.../plans/commands/DeleteFromUsingCommand.java | 4 +-
.../trees/plans/commands/ExportCommand.java | 13 +
.../plans/commands/InsertIntoTableCommand.java | 280 ---------------
.../nereids/trees/plans/commands/LoadCommand.java | 3 +-
.../trees/plans/commands/UpdateCommand.java | 4 +-
.../plans/commands/UpdateMvByPartitionCommand.java | 1 +
.../commands/insert/AbstractInsertExecutor.java | 179 ++++++++++
.../{ => insert}/BatchInsertIntoTableCommand.java | 22 +-
.../plans/commands/insert/GroupCommitInserter.java | 142 ++++++++
.../commands/insert/InsertCommandContext.java} | 19 +-
.../commands/insert/InsertIntoTableCommand.java | 190 ++++++++++
.../{ => insert}/InsertOverwriteTableCommand.java | 25 +-
.../InsertUtils.java} | 306 +---------------
.../commands/insert/OlapInsertCommandContext.java} | 24 +-
.../plans/commands/insert/OlapInsertExecutor.java | 258 +++++++++++++
.../trees/plans/logical/LogicalAssertNumRows.java | 2 +-
.../trees/plans/logical/LogicalTestScan.java | 71 ++++
.../nereids/trees/plans/logical/LogicalView.java | 143 ++++++++
.../plans/physical/PhysicalAssertNumRows.java | 2 +-
.../plans/physical/PhysicalOlapTableSink.java | 21 +-
.../trees/plans/visitor/CommandVisitor.java | 6 +-
.../nereids/trees/plans/visitor/PlanVisitor.java | 5 +
.../org/apache/doris/nereids/util/PlanUtils.java | 25 ++
.../org/apache/doris/planner/DataPartition.java | 34 +-
.../org/apache/doris/planner/DataStreamSink.java | 46 +++
.../org/apache/doris/planner/ExchangeNode.java | 7 +-
.../org/apache/doris/planner/OlapTableSink.java | 22 +-
.../org/apache/doris/planner/OriginalPlanner.java | 2 +-
.../src/main/java/org/apache/doris/plsql/Stmt.java | 49 ++-
.../java/org/apache/doris/qe/SessionVariable.java | 55 ++-
.../java/org/apache/doris/qe/ShowExecutor.java | 7 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 26 +-
.../org/apache/doris/rewrite/FunctionAlias.java | 7 +-
.../apache/doris/statistics/AnalysisManager.java | 10 +-
.../doris/statistics/ExternalAnalysisTask.java | 6 +-
.../apache/doris/statistics/HMSAnalysisTask.java | 30 +-
fe/fe-core/src/main/jflex/sql_scanner.flex | 1 +
.../routineload/RoutineLoadTaskSchedulerTest.java | 7 +-
.../apache/doris/mtmv/MTMVPartitionUtilTest.java | 4 +
.../nereids/privileges/TestCheckPrivileges.java | 397 +++++++++++++++++++++
.../doris/nereids/trees/expressions/ViewTest.java | 6 +-
.../apache/doris/nereids/util/ReadLockTest.java | 2 +-
.../org/apache/doris/qe/HmsQueryCacheTest.java | 6 -
.../org/apache/doris/qe/OlapQueryCacheTest.java | 4 +-
.../doris/statistics/HMSAnalysisTaskTest.java | 4 +-
.../apache/doris/utframe/TestWithFeService.java | 14 +-
gensrc/script/doris_builtins_functions.py | 4 +-
gensrc/thrift/DataSinks.thrift | 7 +-
gensrc/thrift/Descriptors.thrift | 2 +
gensrc/thrift/Opcodes.thrift | 1 +
gensrc/thrift/Types.thrift | 3 +-
regression-test/conf/regression-conf.groovy | 1 +
.../export_p0/test_export_data_consistency.out | 305 ++++++++++++++++
.../jdbc/test_db2_jdbc_catalog.out | 43 +++
.../jdbc/test_jni_complex_type.out | 24 ++
.../test_index_match_phrase_edge.out | 31 ++
.../test_approx_count_distinct.out} | 4 +
.../testNDVToHll.out => test_ndv/test_ndv.out} | 4 +
.../data/mv_p0/ut/testNDVToHll/testNDVToHll.out | 4 +
.../data/nereids_function_p0/scalar_function/R.out | 3 +
.../bitmap_functions/test_bitmap_function.out | 2 +-
...ot_both_appear_in_agg_fun_and_grouping_sets.out | 61 ++++
.../grouping_sets/window_agg_grouping_sets.out} | 10 +-
.../bitmap_functions/test_bitmap_function.out | 2 +-
regression-test/framework/pom.xml | 10 +
.../org/apache/doris/regression/suite/Suite.groovy | 9 +
.../doris/regression/suite/SuiteContext.groovy | 20 ++
.../pipeline/cloud_p0/conf/ms_custom.conf | 2 +
.../pipeline/cloud_p0/conf/recycler_custom.conf | 2 +
.../pipeline/cloud_p0/conf/session_variables.sql | 1 -
regression-test/pipeline/cloud_p0/deploy.sh | 9 +-
regression-test/pipeline/cloud_p0/run.sh | 6 +-
.../pipeline/cloud_p1/conf/ms_custom.conf | 1 +
.../pipeline/cloud_p1/conf/recycler_custom.conf | 2 +
regression-test/pipeline/common/doris-utils.sh | 13 +-
.../pipeline/external/conf/regression-conf.groovy | 1 +
regression-test/pipeline/p1/conf/be.conf | 1 +
regression-test/pipeline/p1/conf/fe.conf | 1 +
regression-test/pipeline/performance/deploy.sh | 2 +-
.../pipeline/performance/run-clickbench.sh | 2 +-
regression-test/pipeline/performance/run-load.sh | 2 +-
regression-test/pipeline/performance/run-tpcds.sh | 2 +-
regression-test/pipeline/performance/run-tpch.sh | 2 +-
.../account_p0/test_nereids_row_policy.groovy | 2 +-
.../decimalv3/test_decimal256_index.groovy | 28 +-
.../test_array_element_at_and_slice.groovy | 2 +-
.../export_p0/test_export_data_consistency.groovy | 210 +++++++++++
.../external_table_p0/hive/test_hive_other.groovy | 2 +-
.../jdbc/test_db2_jdbc_catalog.groovy | 253 +++++++++++++
.../jdbc/test_jni_complex_type.groovy | 72 ++++
.../test_load_stream_fault_injection.groovy | 2 -
.../test_load_stream_stub_failure_injection.groovy | 2 +-
.../test_index_compaction_dup_keys.groovy | 2 +-
.../test_index_compaction_null.groovy | 2 +-
.../test_index_compaction_unique_keys.groovy | 2 +-
.../test_index_match_phrase_edge.groovy | 69 ++++
regression-test/suites/mv_p0/k1s2m3/k1s2m3.groovy | 1 +
.../test_approx_count_distinct.groovy} | 10 +-
.../mv_p0/test_mv_useless/const_invalid.groovy | 5 +
.../test_ndv.groovy} | 10 +-
.../mv_p0/ut/testNDVToHll/testNDVToHll.groovy | 6 +
.../nereids_function_p0/scalar_function/R.groovy | 2 +
.../authorization/view_authorization.groovy | 4 +-
.../bitmap_functions/test_bitmap_function.groovy | 2 +-
...both_appear_in_agg_fun_and_grouping_sets.groovy | 30 ++
.../grouping_sets/window_agg_grouping_sets.groovy | 40 +++
.../cross_join_list_str_increment_create.groovy | 2 +-
.../cross_join_range_date_increment_create.groovy | 2 +-
...cross_join_range_number_increment_create.groovy | 2 +-
.../full_join_list_str_increment_create.groovy | 2 +-
.../full_join_range_date_increment_create.groovy | 2 +-
.../full_join_range_number_increment_create.groovy | 2 +-
.../inner_join_list_str_increment_create.groovy | 2 +-
.../inner_join_range_date_increment_create.groovy | 2 +-
...inner_join_range_number_increment_create.groovy | 2 +-
...left_anti_join_list_str_increment_create.groovy | 2 +-
...ft_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../left_join_list_str_increment_create.groovy | 2 +-
.../left_join_range_date_increment_create.groovy | 2 +-
.../left_join_range_number_increment_create.groovy | 2 +-
...left_semi_join_list_str_increment_create.groovy | 2 +-
...ft_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
...ight_anti_join_list_str_increment_create.groovy | 2 +-
...ht_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../right_join_list_str_increment_create.groovy | 2 +-
.../right_join_range_date_increment_create.groovy | 2 +-
...right_join_range_number_increment_create.groovy | 2 +-
...ight_semi_join_list_str_increment_create.groovy | 2 +-
...ht_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
.../self_conn_list_str_increment_create.groovy | 2 +-
.../self_conn_range_date_increment_create.groovy | 2 +-
.../self_conn_range_number_increment_create.groovy | 2 +-
.../reorder_join/more_than_one_cross_join.groovy | 77 ++++
.../suites/nereids_shape_check/load.groovy | 2 +-
.../auto_partition/test_auto_list_partition.groovy | 4 -
.../test_auto_partition_behavior.groovy | 54 ++-
.../auto_partition/sql/multi_thread_load.groovy | 5 -
.../stress_test_high_concurrency_load.groovy | 4 +-
.../bitmap_functions/test_bitmap_function.groovy | 2 +-
.../test_unique_model_schema_value_change.groovy | 151 +++++++-
.../suites/statistics/test_analyze_mv.groovy | 64 +++-
regression-test/suites/variant_p0/multi_var.groovy | 5 +
.../workload_manager_p0/test_curd_wlg.groovy | 4 +-
358 files changed, 6739 insertions(+), 2118 deletions(-)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query/phrase_edge_query.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query/phrase_edge_query.h
create mode 100644 docker/thirdparties/docker-compose/db2/db2.env
create mode 100644 docker/thirdparties/docker-compose/db2/db2.yaml.tpl
create mode 100644
docker/thirdparties/docker-compose/db2/init/01-drop-schema.sql
create mode 100644
docker/thirdparties/docker-compose/db2/init/02-create-schema.sql
create mode 100644
docker/thirdparties/docker-compose/db2/init/03-create-table.sql
create mode 100644 docker/thirdparties/docker-compose/db2/init/04-insert.sql
create mode 100644 docs/en/docs/install/k8s-deploy/doris-cluster-upgrade.md
copy docs/{zh-CN/docs/sql-manual/sql-functions/string-functions/url-decode.md
=> en/docs/sql-manual/sql-functions/string-functions/random_bytes.md} (67%)
create mode 100644 docs/zh-CN/docs/install/k8s-deploy/doris-cluster-upgrade.md
copy docs/zh-CN/docs/sql-manual/sql-functions/string-functions/{url-decode.md
=> random_bytes.md} (66%)
copy
fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/{OracleJdbcExecutor.java
=> DB2JdbcExecutor.java} (58%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/jdbc/client/JdbcDB2Client.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/{rules/rewrite/EliminateSortUnderSubquery.java
=> properties/DistributionSpecTabletIdShuffle.java} (62%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/CheckPrivileges.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/{EliminateSortUnderSubquery.java
=> EliminateSortUnderSubqueryOrView.java} (61%)
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/{EliminateSortUnderSubquery.java
=> InlineLogicalView.java} (74%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/MatchPhraseEdge.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/RandomBytes.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/InsertIntoTableCommand.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/AbstractInsertExecutor.java
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{ =>
insert}/BatchInsertIntoTableCommand.java (87%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/GroupCommitInserter.java
copy
fe/{be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/JdbcExecutorFactory.java
=>
fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/InsertCommandContext.java}
(62%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/InsertIntoTableCommand.java
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{ =>
insert}/InsertOverwriteTableCommand.java (90%)
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{InsertExecutor.java
=> insert/InsertUtils.java} (56%)
copy
fe/{be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/JdbcExecutorFactory.java
=>
fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/OlapInsertCommandContext.java}
(62%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/OlapInsertExecutor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalTestScan.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalView.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/privileges/TestCheckPrivileges.java
create mode 100644
regression-test/data/export_p0/test_export_data_consistency.out
create mode 100644
regression-test/data/external_table_p0/jdbc/test_db2_jdbc_catalog.out
create mode 100644
regression-test/data/external_table_p0/jdbc/test_jni_complex_type.out
create mode 100644
regression-test/data/inverted_index_p0/test_index_match_phrase_edge.out
copy regression-test/data/mv_p0/{ut/testNDVToHll/testNDVToHll.out =>
test_approx_count_distinct/test_approx_count_distinct.out} (88%)
copy regression-test/data/mv_p0/{ut/testNDVToHll/testNDVToHll.out =>
test_ndv/test_ndv.out} (88%)
copy regression-test/data/{mv_p0/ut/testNDVToHll/testNDVToHll.out =>
nereids_rules_p0/grouping_sets/window_agg_grouping_sets.out} (50%)
create mode 100644 regression-test/pipeline/cloud_p0/conf/ms_custom.conf
create mode 100644 regression-test/pipeline/cloud_p0/conf/recycler_custom.conf
create mode 100644 regression-test/pipeline/cloud_p1/conf/ms_custom.conf
create mode 100644 regression-test/pipeline/cloud_p1/conf/recycler_custom.conf
create mode 100644
regression-test/suites/export_p0/test_export_data_consistency.groovy
create mode 100644
regression-test/suites/external_table_p0/jdbc/test_db2_jdbc_catalog.groovy
create mode 100644
regression-test/suites/external_table_p0/jdbc/test_jni_complex_type.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_index_match_phrase_edge.groovy
copy regression-test/suites/mv_p0/{ut/testNDVToHll/testNDVToHll.groovy =>
test_approx_count_distinct/test_approx_count_distinct.groovy} (83%)
copy regression-test/suites/mv_p0/{ut/testNDVToHll/testNDVToHll.groovy =>
test_ndv/test_ndv.groovy} (85%)
create mode 100644
regression-test/suites/nereids_rules_p0/grouping_sets/window_agg_grouping_sets.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/reorder_join/more_than_one_cross_join.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
