This is an automated email from the ASF dual-hosted git repository.
caiconghui pushed a change to branch tablet_index
in repository https://gitbox.apache.org/repos/asf/doris.git
omit f9c609f3a9d [enhancement](random_sink) change tablet search algorithm
from random to round-robin for random distribution table
add b0788652bd5 [bugfix](clickhouse) fix datetime convert error. (#26128)
add ef95e962c7e [fix](timev2) fix Type not implemented in fold by be
(#26478)
add a404ff5ab99 [fix](regression) fix group commit regression test (#26519)
add 2feed57f47a [Fix](fs_benchmark_tools) Fix `run_fs_benchmark.sh`
classpath issue. (#26183)
add 38a14c3325e [docs](fix) add bitmap_remove in sidebars.json (#26523)
add ad1f6350701 [Feature](auditloader) Plugin auditloader use auth token
to avoid using cleartext passwords in config (#26278)
add d6eb3324a14 [cleanup](load) remove unused code in sink v2 header
(#26521)
add 2bb3ef19814 [refactor](scan) delete bloom_filter_predicate (#26499)
add 5e9a23e6439 [fix](prepare statement) Not supported such prepared
statement if prepare a forward master sql (#26512)
add 2be6c9ff7d8 [enhancement](Nereids): when the DPhyper failed, roll back
to cascades without join reorder (#26390)
add ceccc451faa [enhancement](Nereids): add LOG info to show the phase of
NereidsPlanner. (#26538)
add 5d80e7dc2fe [Improvement](pipelineX) Improve local exchange on
pipelineX engine (#26464)
add 3faf3b41187 [chore] Print FE version even if it has been started
(#26427)
add 32b36d3c9c7 [refactor](move-memtable) rename proto OpenStreamSink to
OpenLoadStream (#26527)
add 4995ca8fba6 [fix](move-memtable) ensure segment is flushed before add
segment (#26522)
add a6756b46609 [pipelineX](bug) Fix broadcast buffer reference count
(#26545)
add 70bc8600a9e [fix](regression) fix regression framework bug: if real
test result is negative, it will miss check test result (#25734)
add a354f87d2e0 [refactor](pipeline) simplify runtime state ctor (#26461)
add 607a5d25f18 [feature](streamload) support HTTP request with chunked
transfer (#26520)
add 519b48648e0 [fix](move-memtable) handle status when possible (#26526)
add 3cdbb6e6372 [Bug](materialized-view) fix some bugs on create mv with
percentile_approx (#26528)
add daea751a986 [Improvement](auditlog) add column catalog for audit log
and audit log table (#26403)
add b7c81bc7362 [Chore](ci)Temporarily cancel the mandatory restrictions
of ShellCheck (#26553)
add 806461721c8 [opt](Nereids) remove Nondeterministic trait from date
related functions (#26444)
add 1544110c1b9 [feature-wip](arrow-flight)(step4) Support other DML and
DDL statements, besides `Select` (#25919)
add 290070074a1 [refactor](stats) refactor collection logic and opt some
config (#26163)
add c93c8f6105b [opt](nereids) make AGG_SCALAR_SUBQUERY_TO_WINDOW_FUNCTION
rewrite rule #25969
add 47ba4aaf30b [Enhancement](load) add timer and partitions number limit
(#26549)
add f4cbbe64291 [chore](workflow) Fix security issues with
pull_request_target (#26525)
add 7bad2e1d9fa [opt](nereids) infer result column name in ctas and query
stmt (#26055)
add a2419a8eb40 [enhancement](sink) refactor code of auto partition and
where clause and enable them on sinkv2 (#26432)
add f8f3bc6a670 Revert "[Chore](ci)Temporarily cancel the mandatory
restrictions of ShellCheck (#26553)" (#26565)
add 9502cc758d0 [fix](regression) fix group commit regression test (#26557)
add 0f3e97f9c5b [regression-test][framework] support cases that can only
run in non-concurrent-mode. (#26487)
add 44b51bf0b9e [Feature](Variant) support variant load (#26572)
add fc304c0e7cd (metric) add histogramJsonMetric and nodeInfo (#26172)
add 5d4557938af [regression-test](fix) fix export_struct bug (#26561)
add f80495da837 [fix](Nereids) ban right outer, right anti, full outer
with bucket shuffle (#26529)
add be7d49cb9f4 [Fix](doc) Fixed some errors in the documentation (#26410)
add a3666aa87eb [feature](decimal) support decimal256 when creating table
(#26308)
add f018b00646e [ci](perf) add new pipeline of tpch-sf100 (#26334)
add 6637f9c15f9 Add enable_cgroup_cpu_soft_limit (#26510)
add 58bf79f79e6 [fix](move-memtable) pass load stream num to backends
(#26198)
add 96d2e3394a2 [opt](meta) Improve the performance of getting expr name
(#26341)
add a6d20138022 [opt](nereids) use 2 phase agg above union all (#26245)
add 45c2fa62a4a [pipeline](exec) disable shared scan in default and
disable shared scan in limit with where scan (#25952)
add 3bce6d38284 [Opt](orc-reader) Optimize orc string dict filter in
not_single_conjunct case. (#26386)
add ec874015813 Fix workload group regression test failed (#26579)
add 223be6947c4 [opt](Nereids) let DataType toSql same with legacy planner
(#26576)
add d0960bac561 [Fix](partial update) Fix partial update info loss when
the delete bitmaps of the committed transactions are calculated by the
compaction (#26556)
add d749d99fe29 [fix](nereids)don't normalize column name for base index
(#26476)
add 0c1458f21f6 [fix](planner)isnull predicate can't be safely constant
folded in inlineview (#25377)
add e718952e89b [fix](nereids)only enable colocate scan for one phase
global parttion topn in some condition (#26473)
add 06343e6d686 [opt](nereids)replace scan by empty relation when all
partitions are pruned (#26514)
add 1fc360df193 [ci](p0) support run p0 10 times (#26603)
add 5bcf6bfd468 [fix](jdbc catalog) fix mysql zero date (#26569)
add a6f9df70969 [LOG] Add fatal log in exchange sink buffer (#26594)
add e92d2fcb5a7 [improvement](group commit) Group commit insert into can
be executed on observer fe (#26589)
add b7a2c2e9c4c [chore](regression) Do stale resource reclaim before
executing cold heat separation p2 case(#26596)
new e45536fd1dc [enhancement](random_sink) change tablet search algorithm
from random to round-robin for random distribution table
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f9c609f3a9d)
\
N -- N -- N refs/heads/tablet_index (e45536fd1dc)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/actions/action-sh-checker | 1 -
.github/actions/clang-format-lint-action | 1 -
.github/actions/clang-tidy-review | 1 -
.github/workflows/auto_trigger_teamcity.yml | 8 +-
.github/workflows/clang-format.yml | 20 +-
.github/workflows/code-checks.yml | 33 +-
.github/workflows/license-eyes.yml | 3 -
.gitmodules | 9 -
be/src/agent/cgroup_cpu_ctl.cpp | 24 +-
be/src/agent/cgroup_cpu_ctl.h | 22 +-
be/src/common/config.cpp | 8 +-
be/src/common/config.h | 14 +-
be/src/exec/olap_common.h | 2 +-
be/src/exprs/create_predicate_function.h | 12 +-
be/src/exprs/json_functions.cpp | 31 +
be/src/exprs/json_functions.h | 7 +
be/src/gutil/endian.h | 3 +-
be/src/http/action/stream_load.cpp | 21 +-
be/src/io/fs/stream_load_pipe.cpp | 2 +-
be/src/olap/base_tablet.cpp | 11 +
be/src/olap/base_tablet.h | 2 +
be/src/olap/bloom_filter_predicate.h | 197 -
be/src/olap/compaction.cpp | 37 +-
be/src/olap/delta_writer_v2.cpp | 10 +-
be/src/olap/delta_writer_v2.h | 5 +-
be/src/olap/olap_common.h | 1 +
be/src/olap/predicate_creator.h | 1 -
be/src/olap/reader.cpp | 18 +-
be/src/olap/reader.h | 3 -
be/src/olap/rowset/beta_rowset_writer.cpp | 142 +-
be/src/olap/rowset/beta_rowset_writer.h | 12 +-
be/src/olap/rowset/beta_rowset_writer_v2.cpp | 4 +-
be/src/olap/rowset/beta_rowset_writer_v2.h | 4 +-
be/src/olap/rowset/rowset_writer.h | 5 +-
be/src/olap/rowset/rowset_writer_context.h | 9 +-
be/src/olap/rowset/segment_v2/column_writer.cpp | 7 +
be/src/olap/rowset/segment_v2/encoding_info.cpp | 4 +
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 3 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 71 +-
be/src/olap/rowset/vertical_beta_rowset_writer.h | 2 +
be/src/olap/rowset_builder.cpp | 9 +
be/src/olap/tablet.cpp | 19 +-
be/src/olap/tablet.h | 2 +-
be/src/olap/tablet_meta.cpp | 3 +-
be/src/olap/txn_manager.cpp | 7 +-
be/src/olap/txn_manager.h | 7 +-
be/src/olap/types.h | 13 +-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 33 +-
be/src/pipeline/exec/exchange_sink_buffer.h | 7 +-
be/src/pipeline/exec/exchange_sink_operator.cpp | 37 +-
be/src/pipeline/exec/exchange_sink_operator.h | 29 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 2 +
be/src/pipeline/exec/olap_scan_operator.h | 1 +
be/src/pipeline/exec/result_file_sink_operator.cpp | 2 +-
be/src/pipeline/exec/scan_operator.cpp | 20 -
be/src/pipeline/exec/scan_operator.h | 3 -
be/src/pipeline/pipeline_fragment_context.cpp | 11 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 11 +-
be/src/runtime/fold_constant_executor.cpp | 5 +
be/src/runtime/fragment_mgr.cpp | 21 +-
be/src/runtime/load_stream.cpp | 110 +-
be/src/runtime/load_stream.h | 28 +-
be/src/runtime/load_stream_mgr.cpp | 2 +-
be/src/runtime/load_stream_mgr.h | 2 +-
be/src/runtime/load_stream_writer.cpp | 16 +-
be/src/runtime/load_stream_writer.h | 2 +-
be/src/runtime/plan_fragment_executor.cpp | 2 +
be/src/runtime/result_buffer_mgr.cpp | 26 +-
be/src/runtime/result_buffer_mgr.h | 15 +-
be/src/runtime/runtime_state.cpp | 20 +-
be/src/runtime/runtime_state.h | 26 +-
be/src/runtime/stream_load/new_load_stream_mgr.h | 9 +-
be/src/runtime/stream_load/stream_load_context.h | 1 +
be/src/runtime/tablets_channel.cpp | 8 +-
be/src/runtime/tablets_channel.h | 1 +
be/src/runtime/task_group/task_group_manager.cpp | 12 +-
be/src/runtime/task_group/task_group_manager.h | 3 +-
be/src/runtime/type_limit.h | 4 +-
.../arrow_flight/arrow_flight_batch_reader.cpp | 16 +-
be/src/service/internal_service.cpp | 28 +-
be/src/service/internal_service.h | 2 +-
be/src/udf/udf.cpp | 2 +
be/src/udf/udf.h | 19 +
be/src/util/arrow/row_batch.cpp | 32 +-
be/src/util/arrow/row_batch.h | 7 +-
be/src/util/jsonb_document.h | 18 +-
be/src/util/string_parser.hpp | 4 +-
.../aggregate_function_approx_count_distinct.cpp | 1 +
.../aggregate_function_percentile_approx.cpp | 11 +-
.../aggregate_function_reader_first_last.h | 1 +
.../aggregate_function_simple_factory.cpp | 1 -
be/src/vec/columns/column.h | 22 +-
be/src/vec/columns/column_array.cpp | 4 +
be/src/vec/columns/column_array.h | 3 +-
be/src/vec/columns/column_complex.h | 2 -
be/src/vec/columns/column_decimal.h | 1 -
be/src/vec/columns/column_dictionary.h | 7 +-
be/src/vec/columns/column_dummy.h | 175 +
be/src/vec/columns/column_fixed_length_object.h | 2 -
be/src/vec/columns/column_impl.h | 29 +
be/src/vec/columns/column_map.h | 2 -
.../column_nothing.h} | 32 +-
be/src/vec/columns/column_nullable.cpp | 8 +-
be/src/vec/columns/column_nullable.h | 5 +
be/src/vec/columns/column_object.cpp | 1080 ++++--
be/src/vec/columns/column_object.h | 136 +-
be/src/vec/columns/column_set.h | 50 +
be/src/vec/columns/column_string.cpp | 13 +
be/src/vec/columns/column_string.h | 27 +-
be/src/vec/columns/column_struct.h | 1 -
be/src/vec/columns/column_vector.h | 6 +-
be/src/vec/columns/predicate_column.h | 9 +-
be/src/vec/columns/subcolumn_tree.h | 64 +-
be/src/vec/common/field_visitors.h | 2 +
be/src/vec/common/int_exp.h | 48 +-
be/src/vec/common/schema_util.cpp | 350 +-
be/src/vec/common/schema_util.h | 85 +-
be/src/vec/core/accurate_comparison.h | 12 +-
be/src/vec/core/decimal_comparison.h | 2 +-
be/src/vec/core/decomposed_float.h | 11 +-
be/src/vec/core/extended_types.h | 66 +-
be/src/vec/core/field.h | 71 +-
be/src/vec/core/types.h | 48 +-
be/src/vec/data_types/convert_field_to_type.cpp | 119 +-
be/src/vec/data_types/data_type.h | 5 +-
be/src/vec/data_types/data_type_agg_state.h | 4 +
be/src/vec/data_types/data_type_array.h | 6 +-
be/src/vec/data_types/data_type_bitmap.h | 6 +-
be/src/vec/data_types/data_type_date.h | 6 +-
be/src/vec/data_types/data_type_date_time.h | 4 +-
be/src/vec/data_types/data_type_decimal.h | 16 +-
.../vec/data_types/data_type_fixed_length_object.h | 4 +
be/src/vec/data_types/data_type_hll.h | 6 +-
be/src/vec/data_types/data_type_ipv4.h | 2 -
be/src/vec/data_types/data_type_ipv6.h | 2 -
be/src/vec/data_types/data_type_jsonb.h | 5 +-
be/src/vec/data_types/data_type_map.h | 6 +-
be/src/vec/data_types/data_type_nothing.cpp | 4 +-
be/src/vec/data_types/data_type_nothing.h | 5 +-
be/src/vec/data_types/data_type_nullable.cpp | 4 -
be/src/vec/data_types/data_type_nullable.h | 4 +
be/src/vec/data_types/data_type_number.h | 1 -
be/src/vec/data_types/data_type_number_base.h | 26 +
be/src/vec/data_types/data_type_object.cpp | 28 +-
be/src/vec/data_types/data_type_object.h | 28 +-
be/src/vec/data_types/data_type_quantilestate.h | 5 +-
be/src/vec/data_types/data_type_string.h | 4 +-
be/src/vec/data_types/data_type_struct.h | 4 +-
be/src/vec/data_types/data_type_time.h | 5 +-
be/src/vec/data_types/data_type_time_v2.h | 10 +-
be/src/vec/data_types/get_least_supertype.cpp | 271 +-
be/src/vec/data_types/get_least_supertype.h | 15 +-
.../vec/data_types/serde/data_type_array_serde.cpp | 29 +
.../vec/data_types/serde/data_type_array_serde.h | 5 +
.../vec/data_types/serde/data_type_jsonb_serde.cpp | 109 +
.../vec/data_types/serde/data_type_jsonb_serde.h | 4 +
.../data_types/serde/data_type_nullable_serde.cpp | 25 +
.../data_types/serde/data_type_nullable_serde.h | 5 +
.../vec/data_types/serde/data_type_number_serde.h | 59 +
.../data_types/serde/data_type_object_serde.cpp | 48 +-
.../vec/data_types/serde/data_type_object_serde.h | 8 +-
be/src/vec/data_types/serde/data_type_serde.cpp | 52 +
be/src/vec/data_types/serde/data_type_serde.h | 13 +
.../data_types/serde/data_type_string_serde.cpp | 24 +
.../vec/data_types/serde/data_type_string_serde.h | 4 +
be/src/vec/exec/format/json/new_json_reader.cpp | 21 +-
be/src/vec/exec/format/json/new_json_reader.h | 3 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 40 +-
be/src/vec/exec/format/orc/vorc_reader.h | 1 +
.../exec/format/parquet/vparquet_group_reader.cpp | 12 +-
be/src/vec/exec/scan/new_olap_scan_node.cpp | 2 +
be/src/vec/exec/scan/new_olap_scan_node.h | 1 +
be/src/vec/exec/scan/new_olap_scanner.cpp | 1 +
be/src/vec/exec/scan/vscan_node.cpp | 17 -
be/src/vec/exec/scan/vscan_node.h | 3 -
be/src/vec/exec/vexchange_node.cpp | 2 +
be/src/vec/functions/function.h | 1 +
be/src/vec/functions/function_binary_arithmetic.h | 3 +-
be/src/vec/functions/function_case.h | 2 +
be/src/vec/functions/function_cast.h | 269 +-
be/src/vec/json/json_parser.cpp | 115 +-
be/src/vec/json/json_parser.h | 43 +-
be/src/vec/json/parse2column.cpp | 101 +-
be/src/vec/json/parse2column.h | 9 +-
be/src/vec/olap/olap_data_convertor.cpp | 74 +-
be/src/vec/olap/olap_data_convertor.h | 19 +
be/src/vec/runtime/vdata_stream_recvr.cpp | 46 +-
be/src/vec/runtime/vdata_stream_recvr.h | 22 +-
be/src/vec/sink/delta_writer_v2_pool.cpp | 4 +-
be/src/vec/sink/delta_writer_v2_pool.h | 3 +-
be/src/vec/sink/load_stream_stub.cpp | 11 +-
be/src/vec/sink/load_stream_stub.h | 5 +-
be/src/vec/sink/load_stream_stub_pool.cpp | 4 +-
be/src/vec/sink/load_stream_stub_pool.h | 3 +-
be/src/vec/sink/varrow_flight_result_writer.cpp | 13 +-
be/src/vec/sink/varrow_flight_result_writer.h | 5 +-
be/src/vec/sink/vdata_stream_sender.cpp | 6 +-
be/src/vec/sink/vdata_stream_sender.h | 21 +-
be/src/vec/sink/vmemory_scratch_sink.cpp | 2 -
be/src/vec/sink/vmemory_scratch_sink.h | 2 -
be/src/vec/sink/vresult_sink.cpp | 12 +-
be/src/vec/sink/vrow_distribution.cpp | 306 ++
be/src/vec/sink/vrow_distribution.h | 160 +
be/src/vec/sink/vtablet_sink_v2.cpp | 126 +-
be/src/vec/sink/vtablet_sink_v2.h | 49 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 408 +-
be/src/vec/sink/writer/vtablet_writer.h | 37 +-
be/test/runtime/load_stream_test.cpp | 135 +-
be/test/vec/exec/delta_writer_v2_pool_test.cpp | 18 +-
be/test/vec/exec/load_stream_stub_pool_test.cpp | 6 +-
bin/run-fs-benchmark.sh | 24 +-
bin/start_fe.sh | 5 +-
.../docker-compose/mysql/init/03-create-table.sql | 5 +
.../docker-compose/mysql/init/04-insert.sql | 5 +
docs/en/docs/admin-manual/config/fe-config.md | 8 +-
.../update-delete/batch-delete-manual.md | 2 +-
docs/en/docs/ecosystem/audit-plugin.md | 2 +
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 132 +-
docs/en/docs/query-acceleration/statistics.md | 328 +-
docs/sidebars.json | 3 +-
docs/zh-CN/docs/admin-manual/config/fe-config.md | 10 +-
.../maint-monitor/monitor-metrics/metrics.md | 2 +-
.../update-delete/batch-delete-manual.md | 2 +-
docs/zh-CN/docs/ecosystem/audit-plugin.md | 2 +
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 52 +-
docs/zh-CN/docs/query-acceleration/statistics.md | 275 +-
.../java/org/apache/doris/catalog/ArrayType.java | 10 +-
.../java/org/apache/doris/catalog/MapType.java | 14 +-
.../java/org/apache/doris/catalog/ScalarType.java | 12 +-
.../java/org/apache/doris/catalog/StructType.java | 9 +-
.../org/apache/doris/catalog/TemplateType.java | 4 +-
.../main/java/org/apache/doris/catalog/Type.java | 29 +-
.../main/java/org/apache/doris/common/Config.java | 44 +-
.../src/main/java/org/apache/doris/DorisFE.java | 19 +-
.../org/apache/doris/analysis/AnalyticExpr.java | 12 +-
.../java/org/apache/doris/analysis/Analyzer.java | 9 +-
.../org/apache/doris/analysis/ArithmeticExpr.java | 11 +-
.../org/apache/doris/analysis/ArrayLiteral.java | 2 +-
.../org/apache/doris/analysis/BinaryPredicate.java | 7 +-
.../org/apache/doris/analysis/ColumnRefExpr.java | 9 +-
.../doris/analysis/CreateMaterializedViewStmt.java | 4 +
.../org/apache/doris/analysis/DateLiteral.java | 3 +-
.../org/apache/doris/analysis/DecimalLiteral.java | 1 +
.../main/java/org/apache/doris/analysis/Expr.java | 13 +-
.../apache/doris/analysis/ExpressionFunctions.java | 7 +-
.../apache/doris/analysis/FunctionCallExpr.java | 26 +-
.../org/apache/doris/analysis/IsNullPredicate.java | 2 +-
.../org/apache/doris/analysis/LargeIntLiteral.java | 16 +-
.../org/apache/doris/analysis/LiteralExpr.java | 8 +-
.../java/org/apache/doris/analysis/MapLiteral.java | 6 +-
.../apache/doris/analysis/NativeInsertStmt.java | 16 +-
.../java/org/apache/doris/analysis/SelectStmt.java | 8 +-
.../java/org/apache/doris/analysis/SlotRef.java | 8 +-
.../java/org/apache/doris/analysis/TypeDef.java | 11 +-
.../org/apache/doris/analysis/VirtualSlotRef.java | 2 +-
.../main/java/org/apache/doris/catalog/Env.java | 7 -
.../java/org/apache/doris/catalog/Function.java | 10 +-
.../java/org/apache/doris/catalog/FunctionSet.java | 16 +-
.../java/org/apache/doris/catalog/OlapTable.java | 11 +-
.../org/apache/doris/catalog/PartitionKey.java | 5 +-
.../java/org/apache/doris/common/ErrorCode.java | 5 +-
.../jdbc/client/JdbcClickHouseClient.java | 13 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 3 +
.../org/apache/doris/httpv2/rest/LoadAction.java | 112 +-
.../org/apache/doris/metric/JsonMetricVisitor.java | 88 +-
.../org/apache/doris/mysql/AcceptListener.java | 3 +-
.../java/org/apache/doris/mysql/MysqlCommand.java | 1 +
.../org/apache/doris/nereids/NereidsPlanner.java | 6 +
.../doris/nereids/analyzer/UnboundFunction.java | 8 +-
.../org/apache/doris/nereids/cost/CostModelV1.java | 6 +-
.../glue/translator/PhysicalPlanTranslator.java | 5 +-
.../doris/nereids/jobs/executor/Rewriter.java | 6 +-
.../doris/nereids/jobs/joinorder/JoinOrderJob.java | 26 +-
.../jobs/joinorder/hypergraph/GraphSimplifier.java | 30 +-
.../jobs/joinorder/hypergraph/HyperGraph.java | 6 +
.../joinorder/hypergraph/receiver/Counter.java | 4 +
.../hypergraph/receiver/PlanReceiver.java | 6 +-
.../properties/ChildrenPropertiesRegulator.java | 37 +-
.../nereids/rules/analysis/BindExpression.java | 17 +-
.../rules/rewrite/PruneOlapScanPartition.java | 7 +
.../mv/SelectMaterializedIndexWithAggregate.java | 17 +-
.../doris/nereids/stats/StatsCalculator.java | 4 +
.../trees/expressions/AggregateExpression.java | 8 +-
.../doris/nereids/trees/expressions/Alias.java | 4 +
.../trees/expressions/AssertNumRowsElement.java | 8 +-
.../nereids/trees/expressions/Expression.java | 10 +-
.../doris/nereids/trees/expressions/Multiply.java | 2 +-
.../nereids/trees/expressions/NamedExpression.java | 8 +-
.../nereids/trees/expressions/SubqueryExpr.java | 7 +-
.../trees/expressions/functions/BoundFunction.java | 8 +-
.../functions/ComputePrecisionForSum.java | 2 +-
.../functions/ImplicitlyCastableSignature.java | 4 +-
.../expressions/functions/Nondeterministic.java | 8 -
.../trees/expressions/functions/agg/Avg.java | 2 +-
.../functions/executable/DateTimeAcquire.java | 23 +-
.../trees/expressions/functions/scalar/Random.java | 5 +
.../functions/scalar/UnixTimestamp.java | 10 +-
.../trees/expressions/functions/scalar/Uuid.java | 5 +
.../expressions/functions/scalar/UuidNumeric.java | 5 +
.../nereids/trees/expressions/literal/Literal.java | 8 +-
.../trees/plans/logical/LogicalSetOperation.java | 4 +-
.../trees/plans/physical/PhysicalSetOperation.java | 4 +
.../trees/plans/visitor/InferPlanOutputAlias.java | 76 +
.../apache/doris/nereids/types/DecimalV3Type.java | 8 +-
.../org/apache/doris/nereids/types/MapType.java | 2 +-
.../org/apache/doris/nereids/types/StringType.java | 2 +-
.../apache/doris/nereids/types/StructField.java | 5 +-
.../org/apache/doris/nereids/types/StructType.java | 4 +-
.../org/apache/doris/planner/OlapScanNode.java | 10 +-
.../java/org/apache/doris/planner/ScanNode.java | 19 +-
.../apache/doris/planner/StreamLoadPlanner.java | 4 +
.../java/org/apache/doris/plugin/AuditEvent.java | 7 +
.../java/org/apache/doris/qe/AuditLogHelper.java | 5 +
.../java/org/apache/doris/qe/ConnectContext.java | 119 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 313 +-
.../java/org/apache/doris/qe/ConnectScheduler.java | 4 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 96 +-
.../org/apache/doris/qe/MysqlConnectProcessor.java | 272 ++
.../main/java/org/apache/doris/qe/QueryState.java | 1 +
.../java/org/apache/doris/qe/SessionVariable.java | 97 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 206 +-
.../apache/doris/rewrite/FoldConstantsRule.java | 6 +-
.../apache/doris/service/FrontendServiceImpl.java | 27 +-
.../arrowflight/DorisFlightSqlProducer.java | 140 +-
...xecutor.java => FlightSqlConnectProcessor.java} | 155 +-
.../arrowflight/results/FlightSqlChannel.java | 147 +
.../results/FlightSqlResultCacheEntry.java | 64 +
.../sessions/FlightSessionsManager.java | 4 +-
.../sessions/FlightSessionsWithTokenManager.java | 1 +
.../sessions/FlightSqlConnectContext.java | 104 +
.../org/apache/doris/statistics/AnalysisJob.java | 193 +
.../apache/doris/statistics/AnalysisManager.java | 90 +-
.../doris/statistics/AnalysisTaskExecutor.java | 28 +-
.../doris/statistics/AnalysisTaskWrapper.java | 16 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 110 +-
.../org/apache/doris/statistics/ColStatsData.java | 14 +
.../apache/doris/statistics/ColumnStatistic.java | 4 +-
.../apache/doris/statistics/HMSAnalysisTask.java | 135 +-
.../apache/doris/statistics/JdbcAnalysisTask.java | 34 +-
.../apache/doris/statistics/MVAnalysisTask.java | 152 -
.../apache/doris/statistics/OlapAnalysisTask.java | 138 +-
.../doris/statistics/StatisticConstants.java | 14 +-
.../doris/statistics/StatisticsAutoCollector.java | 9 +-
.../doris/statistics/StatisticsCollector.java | 11 +-
.../statistics/StatisticsPeriodCollector.java | 50 -
.../java/org/apache/doris/statistics/StatsId.java | 15 +-
.../doris/statistics/util/StatisticsUtil.java | 83 +-
.../java/org/apache/doris/task/LoadTaskInfo.java | 4 +
.../java/org/apache/doris/task/StreamLoadTask.java | 13 +
.../joinorder/hypergraph/GraphSimplifierTest.java | 17 +
.../nereids/rules/analysis/GenerateFunction.java | 2 +-
.../doris/nereids/sqltest/JoinOrderJobTest.java | 18 +
.../doris/nereids/trees/plans/PlanVisitorTest.java | 16 +-
.../apache/doris/nereids/types/DataTypeTest.java | 2 +-
.../org/apache/doris/qe/OlapQueryCacheTest.java | 22 +-
.../java/org/apache/doris/qe/StmtExecutorTest.java | 9 +
.../apache/doris/statistics/AnalysisJobTest.java | 233 +-
.../doris/statistics/AnalysisManagerTest.java | 37 +-
.../doris/statistics/AnalysisTaskExecutorTest.java | 16 +-
.../{AnalysisJobTest.java => AnalyzeTest.java} | 8 +-
.../org/apache/doris/statistics/CacheTest.java | 40 +-
.../doris/statistics/OlapAnalysisTaskTest.java | 74 +-
.../statistics/StatisticsAutoCollectorTest.java | 73 +
.../doris/statistics/util/StatisticsUtilTest.java | 46 +-
.../auditloader/src/main/assembly/plugin.conf | 3 +
.../doris/plugin/audit/AuditLoaderPlugin.java | 21 +-
.../doris/plugin/audit/DorisStreamLoader.java | 15 +-
gensrc/proto/internal_service.proto | 7 +-
gensrc/thrift/FrontendService.thrift | 1 +
gensrc/thrift/PaloInternalService.thrift | 8 +
pytest/deploy/start.py | 1 +
.../data/correctness/test_timev2_fold.out | 13 +
.../decimalv3/test_arithmetic_expressions.out | 177 +
.../datatype_p0/decimalv3/test_decimal256_cast.out | 25 +
.../decimalv3/test_decimal256_index.out | 259 ++
.../datatype_p0/decimalv3/test_decimal256_load.csv | 19 +
.../datatype_p0/decimalv3/test_decimal256_load.out | 664 ++++
.../decimalv3/test_decimal256_outfile_csv.out | 22 +
.../decimalv3/test_decimal256_predicate.out | 178 +
.../decimalv3/test_decimal256_zonemap_index.csv | 4096 ++++++++++++++++++++
.../data/datatype_p0/decimalv3/test_predicate.out | 34 +
.../data/empty_relation/eliminate_empty.out | 10 +
.../jdbc/test_mysql_jdbc_catalog.out | 4 +
..._phase_commit.csv => test_chunked_transfer.csv} | 0
.../data/load_p0/stream_load/test_stream_load.out | 4 +
.../test_user_activity/test_user_activity.out | 12 +
.../nereids_tpcds_shape_sf1000_p0/shape/query1.out | 13 +-
.../shape/query49.out | 132 +-
.../shape/query72.out | 5 +-
.../shape/query75.out | 90 +-
.../nereids_tpcds_shape_sf100_p0/shape/query1.out | 13 +-
.../nereids_tpcds_shape_sf100_p0/shape/query49.out | 132 +-
.../nereids_tpcds_shape_sf100_p0/shape/query72.out | 5 +-
.../nereids_tpcds_shape_sf100_p0/shape/query75.out | 90 +-
.../nereids_tpcds_shape_sf100_p0/shape/query80.out | 3 +-
.../test_agg_keys_schema_change_decimalv3.out | 2 +-
.../data/workload_manager_p0/test_curd_wlg.out | 3 -
.../apache/doris/regression/RegressionTest.groovy | 59 +-
.../doris/regression/util/OutputUtils.groovy | 2 +-
regression-test/pipeline/common/doris-utils.sh | 259 ++
regression-test/pipeline/common/github-utils.sh | 65 +
regression-test/pipeline/common/oss-utils.sh | 105 +
.../pipeline/p0/conf/regression-conf.groovy | 2 +-
.../pipeline/p1/conf/regression-conf.groovy | 2 +-
regression-test/pipeline/tpch/tpch-sf100/clean.sh | 40 +
.../pipeline/tpch/tpch-sf100/conf/be.conf | 85 +
.../{p0 => tpch/tpch-sf100}/conf/external.json | 0
.../pipeline/tpch/tpch-sf100/conf/fe.conf | 78 +
.../pipeline/tpch/tpch-sf100/conf}/odbcinst.ini | 0
.../tpch-sf100}/conf/regression-conf.groovy | 0
regression-test/pipeline/tpch/tpch-sf100/deploy.sh | 132 +
.../pipeline/tpch/tpch-sf100/prepare.sh | 71 +
regression-test/pipeline/tpch/tpch-sf100/run.sh | 143 +
.../suites/cold_heat_separation_p2/load.groovy | 65 +-
.../table_modify_resouce_and_policy.groovy | 4 +-
.../suites/correctness/test_timev2_fold.groovy | 35 +
.../decimalv3/test_arithmetic_expressions.groovy | 37 +-
.../decimalv3/test_decimal256_cast.groovy | 40 +
.../decimalv3/test_decimal256_index.groovy | 277 ++
.../decimalv3/test_decimal256_load.groovy | 345 ++
.../decimalv3/test_decimal256_outfile_csv.groovy | 135 +
.../decimalv3/test_decimal256_predicate.groovy | 128 +
.../datatype_p0/decimalv3/test_predicate.groovy | 46 +-
.../suites/empty_relation/eliminate_empty.groovy | 36 +
.../suites/export/test_struct_export.groovy | 1 +
.../jdbc/test_mysql_jdbc_catalog.groovy | 2 +
.../test_index_fault_injection.groovy | 2 +-
.../test_segcompaction_fault_injection.groovy | 2 +-
.../test_too_many_segments_fault_injection.groovy | 2 +-
.../load_p0/stream_load/test_stream_load.groovy | 30 +
.../test_user_activity/test_user_activity.groovy | 52 +
.../ut/testProjectionMV1/testProjectionMV1.groovy | 2 +-
.../nereids_p0/aggregate/agg_union_random.groovy | 54 +
.../nereids_p0/datatype/test_date_acquire.groovy | 2 +-
.../suites/nereids_p0/infer_expr_name/load.groovy | 821 ++++
.../nereids_p0/infer_expr_name/query13.groovy | 81 +
.../nereids_p0/infer_expr_name/query14.groovy | 137 +
.../nereids_p0/infer_expr_name/query15.groovy | 49 +
.../nereids_p0/infer_expr_name/query2.groovy | 94 +
.../nereids_p0/infer_expr_name/query23.groovy | 80 +
.../nereids_p0/infer_expr_name/query35.groovy | 102 +
.../nereids_p0/infer_expr_name/query38.groovy | 51 +
.../nereids_p0/infer_expr_name/query41.groovy | 80 +
.../nereids_p0/infer_expr_name/query42.groovy | 53 +
.../nereids_p0/infer_expr_name/query45.groovy | 50 +
.../nereids_p0/infer_expr_name/query59.groovy | 81 +
.../nereids_p0/infer_expr_name/query61.groovy | 74 +
.../nereids_p0/infer_expr_name/query62.groovy | 63 +
.../nereids_p0/infer_expr_name/query8.groovy | 136 +
.../nereids_p0/infer_expr_name/query85.groovy | 115 +
.../suites/nereids_p0/join/test_outer_join.groovy | 26 +
.../with/test_with_and_two_phase_agg.groovy | 10 +-
.../query_p0/literal_view/lietral_test.groovy | 6 +
.../show/test_nested_complex_switch.groovy | 6 +-
.../sql_block_rule_p0/test_sql_block_rule.groovy | 2 +-
.../suites/statistics/analyze_stats.groovy | 100 +-
.../suites/statistics/test_agg_complex_type.groovy | 53 +
.../workload_manager_p0/test_curd_wlg.groovy | 2 -
tools/tpch-tools/bin/create-tpch-tables.sh | 2 +-
tools/tpch-tools/bin/load-tpch-data.sh | 16 +-
tools/tpch-tools/bin/run-tpch-queries.sh | 1 +
461 files changed, 18331 insertions(+), 4705 deletions(-)
delete mode 160000 .github/actions/action-sh-checker
delete mode 160000 .github/actions/clang-format-lint-action
delete mode 160000 .github/actions/clang-tidy-review
delete mode 100644 be/src/olap/bloom_filter_predicate.h
create mode 100644 be/src/vec/columns/column_dummy.h
copy be/src/vec/{data_types/data_type_nothing.cpp => columns/column_nothing.h}
(57%)
create mode 100644 be/src/vec/columns/column_set.h
create mode 100644 be/src/vec/sink/vrow_distribution.cpp
create mode 100644 be/src/vec/sink/vrow_distribution.h
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/visitor/InferPlanOutputAlias.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/MysqlConnectProcessor.java
rename
fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/{FlightStatementExecutor.java
=> FlightSqlConnectProcessor.java} (65%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/results/FlightSqlChannel.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/results/FlightSqlResultCacheEntry.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/sessions/FlightSqlConnectContext.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisJob.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/MVAnalysisTask.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsPeriodCollector.java
copy
fe/fe-core/src/test/java/org/apache/doris/statistics/{AnalysisJobTest.java =>
AnalyzeTest.java} (97%)
create mode 100644 regression-test/data/correctness/test_timev2_fold.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_cast.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_index.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_load.csv
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_load.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_outfile_csv.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_predicate.out
create mode 100644
regression-test/data/datatype_p0/decimalv3/test_decimal256_zonemap_index.csv
copy regression-test/data/load_p0/stream_load/{test_two_phase_commit.csv =>
test_chunked_transfer.csv} (100%)
create mode 100644
regression-test/data/mv_p0/test_user_activity/test_user_activity.out
create mode 100644 regression-test/pipeline/common/doris-utils.sh
create mode 100644 regression-test/pipeline/common/github-utils.sh
create mode 100644 regression-test/pipeline/common/oss-utils.sh
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/clean.sh
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/be.conf
copy regression-test/pipeline/{p0 => tpch/tpch-sf100}/conf/external.json (100%)
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/fe.conf
copy {conf => regression-test/pipeline/tpch/tpch-sf100/conf}/odbcinst.ini
(100%)
copy regression-test/pipeline/{p0 =>
tpch/tpch-sf100}/conf/regression-conf.groovy (100%)
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/deploy.sh
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/prepare.sh
create mode 100644 regression-test/pipeline/tpch/tpch-sf100/run.sh
copy fe/fe-core/src/main/java/org/apache/doris/nereids/types/StringType.java
=> regression-test/suites/cold_heat_separation_p2/load.groovy (51%)
create mode 100644 regression-test/suites/correctness/test_timev2_fold.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_decimal256_cast.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_decimal256_index.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_decimal256_load.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_decimal256_outfile_csv.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv3/test_decimal256_predicate.groovy
create mode 100644
regression-test/suites/mv_p0/test_user_activity/test_user_activity.groovy
create mode 100644
regression-test/suites/nereids_p0/aggregate/agg_union_random.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/load.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query13.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query14.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query15.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query2.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query23.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query35.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query38.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query41.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query42.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query45.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query59.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query61.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query62.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query8.groovy
create mode 100644
regression-test/suites/nereids_p0/infer_expr_name/query85.groovy
create mode 100644
regression-test/suites/statistics/test_agg_complex_type.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
