This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 3358f76a7f6 [feature](spill) Implement spill to disk for hash join,
aggregation and sort for pipelineX (#31910)
new 24706348594 [RuntimeFilter] fix <=> runtime filter failed bug (#32003)
new b0b7161ad01 [feature](rf) add filter info profile when rf run as expr
(#31822)
new ab21d85e8c4 [nereids](topn-filter) support multi-topn filter (FE part)
(#31485)
new c0f2d0188bd [feature](pipelineX) add mem control in local exchange
sink (#31982)
new 31ee448c87d [test](fix) Fix one missing line of output in out file
(#32036)
new fe3988c6862 [fix](compile) fix BE compile failure on Mac (#32044)
new a7a85dd3300 [chore](config) support select experimental session
variable (#31837)
new 68a5319da36 [fix](pipelineX) _local_channel_dependency is null in non
pipelineX (#32054)
new 1509fbd5387 [feature](docker)Doris On Docker All In One (#31735)
new ccd21a6ea43 [Improve](InPredict) enhance in predict with array type
(#31828)
new 4268634115f [fix](memory) Fix Allocator cancel pipelinex query #32048
new 926908ece2a [fix](hive) fix spelling mistakes for "separatorChar"
#32061
new dc7d80860f6 [fix](case) fix export data consistency table key type
(#32045)
new aea9ddc3cb0 [Fix](Outfiel) fix be core when the open method of
vfile_result_writer failed #32042
new 2ee12b8678a [improvement](docker)Optimize Dockerfile content for FE
and BE (#32027)
new a937c54b2b4 [fix](docker)Fix the registration logic of Doris On Docker
(#32026)
new b41b17ad0a6 [fix](spill) fix storage engine type cast error (#32071)
new 194f3432ab8 [Improvement](executor)Routine load support workload group
#31671
new da60a111d02 [refactor](nereids) rename PlanNode.distributeExprLists to
childrenDistributeExprLists #32069
new 65835cdd2b8 [doc](sql-dialect) update sql convertor tool to 1.0.1
(#32077)
new ae206596c91 [DOC](Variant) add bloom filter description and correct
some benchmark results (#31998)
new 2ffcfb4bc50 [fix](doc) fix wrong download link (#32082)
new ffa904c4870 [enhance](Cooldown) Skip cooldown if the tablet is dropped
(#32079)
new 61928f7df53 [pipelineX](scanner) Use the actual instances num when
ignore data distribution (#32081)
The 24 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/exprs/bloom_filter_func.h | 68 +++---
be/src/exprs/runtime_filter.cpp | 49 ++--
be/src/exprs/runtime_filter.h | 8 +-
be/src/olap/tablet.cpp | 4 +
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 4 +-
be/src/runtime/memory/thread_mem_tracker_mgr.cpp | 13 +-
be/src/runtime/memory/thread_mem_tracker_mgr.h | 10 +-
be/src/runtime/thread_context.cpp | 7 +-
be/src/runtime/thread_context.h | 13 +-
be/src/vec/common/allocator.cpp | 4 +-
be/src/vec/exec/runtime_filter_consumer.cpp | 9 +-
be/src/vec/exec/runtime_filter_consumer.h | 6 +-
be/src/vec/exec/scan/new_olap_scan_node.cpp | 4 +-
be/src/vec/exec/scan/scanner_context.cpp | 3 +-
be/src/vec/exprs/vdirect_in_predicate.h | 7 +
be/src/vec/exprs/vin_predicate.cpp | 5 +-
be/src/vec/exprs/vruntimefilter_wrapper.cpp | 32 ++-
be/src/vec/exprs/vruntimefilter_wrapper.h | 19 +-
...on_struct_in.cpp => function_collection_in.cpp} | 8 +-
...nction_struct_in.h => function_collection_in.h} | 65 +++---
be/src/vec/functions/simple_function_factory.h | 4 +-
be/src/vec/runtime/vdata_stream_recvr.cpp | 31 ++-
be/src/vec/runtime/vdata_stream_recvr.h | 6 +-
be/src/vec/sink/writer/vfile_result_writer.cpp | 24 +-
be/src/vec/sink/writer/vfile_result_writer.h | 2 +-
be/src/vec/spill/spill_stream.cpp | 5 +-
be/src/vec/spill/spill_stream.h | 11 +-
be/src/vec/spill/spill_stream_manager.cpp | 46 +++-
be/src/vec/spill/spill_stream_manager.h | 43 +++-
be/src/vec/spill/spill_writer.cpp | 1 -
be/src/vec/spill/spill_writer.h | 6 +-
docker/runtime/{be => all-in-one}/Dockerfile | 8 +-
docker/runtime/all-in-one/resource/entry_point.sh | 248 +++++++++++++++++++++
docker/runtime/be/Dockerfile | 7 +-
docker/runtime/be/resource/entry_point.sh | 16 +-
docker/runtime/be/resource/init_be.sh | 96 ++++----
docker/runtime/fe/Dockerfile | 11 +-
.../hive/scripts/create_preinstalled_table.hql | 2 +-
docs/en/docs/lakehouse/sql-dialect.md | 2 +-
.../sql-manual/sql-reference/Data-Types/VARIANT.md | 22 +-
docs/zh-CN/docs/lakehouse/sql-dialect.md | 2 +-
.../sql-manual/sql-reference/Data-Types/VARIANT.md | 22 +-
.../doris/analysis/AlterRoutineLoadStmt.java | 8 +
.../doris/analysis/CreateRoutineLoadStmt.java | 14 ++
.../doris/datasource/hive/source/HiveScanNode.java | 6 +-
.../doris/load/routineload/KafkaTaskInfo.java | 27 +++
.../doris/load/routineload/RoutineLoadJob.java | 14 ++
.../org/apache/doris/nereids/CascadesContext.java | 6 +
.../glue/translator/PhysicalPlanTranslator.java | 63 ++++--
.../glue/translator/PlanTranslatorContext.java | 9 +-
.../doris/nereids/processor/post/TopNScanOpt.java | 117 ++++------
.../nereids/processor/post/TopnFilterContext.java | 93 ++++++++
.../nereids/trees/expressions/InPredicate.java | 12 +
.../nereids/trees/plans/physical/PhysicalTopN.java | 39 ++--
.../doris/nereids/util/TypeCoercionUtils.java | 10 +-
.../org/apache/doris/planner/OlapScanNode.java | 25 ++-
.../java/org/apache/doris/planner/PlanNode.java | 14 +-
.../java/org/apache/doris/planner/SortNode.java | 2 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 11 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 26 ++-
.../resource/workloadgroup/WorkloadGroupMgr.java | 39 +++-
.../nereids/postprocess/TopNRuntimeFilterTest.java | 24 +-
gensrc/proto/internal_service.proto | 3 +
.../jdbc/test_mysql_jdbc_driver5_catalog.out | 1 +
.../nereids_syntax_p0/inpredicate_with_list.out | 19 ++
.../data/nereids_tpch_p0/tpch/topn-filter.out | 29 +++
.../data/query_p0/sql_functions/test_in_expr.out | 3 +
regression-test/pipeline/p0/conf/fe.conf | 1 +
.../export_p0/test_export_data_consistency.groovy | 2 +
.../load_p0/routine_load/test_routine_load.groovy | 8 +-
.../nereids_syntax_p0/inpredicate_with_list.groovy | 60 +++++
.../suites/nereids_syntax_p0/system_var.groovy | 5 +
.../suites/nereids_tpch_p0/tpch/topn-filter.groovy | 120 ++++++++++
regression-test/suites/point_query_p0/load.groovy | 4 +-
.../query_p0/sql_functions/test_in_expr.groovy | 5 +-
.../workload_manager_p0/test_curd_wlg.groovy | 12 +-
76 files changed, 1341 insertions(+), 443 deletions(-)
rename be/src/vec/functions/{function_struct_in.cpp =>
function_collection_in.cpp} (79%)
rename be/src/vec/functions/{function_struct_in.h => function_collection_in.h}
(75%)
copy docker/runtime/{be => all-in-one}/Dockerfile (89%)
create mode 100644 docker/runtime/all-in-one/resource/entry_point.sh
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/TopnFilterContext.java
create mode 100644
regression-test/data/nereids_syntax_p0/inpredicate_with_list.out
create mode 100644 regression-test/data/nereids_tpch_p0/tpch/topn-filter.out
create mode 100644
regression-test/suites/nereids_syntax_p0/inpredicate_with_list.groovy
create mode 100644
regression-test/suites/nereids_tpch_p0/tpch/topn-filter.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
