This is an automated email from the ASF dual-hosted git repository.
jacktengg pushed a change to branch branch-4.0-preview
in repository https://gitbox.apache.org/repos/asf/doris.git
from f42ce3f0965 [chore](build) Build cloud module by default #34143
new 8b3eefac075 [improvement](spill) improve spill directory and fix bugs
(#33900)
new b3b13d27993 [chore](session_variable) Add 'data_queue_max_blocks' to
prevent the DataQueue from occupying too much memory. (#34017)
new 2c6809df05c [improvement](spill) improve config of spill thread pool
(#33992)
new fbdd1f05f33 [fix](pipeline_x) Crc32HashPartitioner should use
ShuffleChannelIds (#34147)
new dca623a58fe [fix](spill) use different algorithm to avoid partition
data skew (#34162)
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/config.cpp | 15 ++-
be/src/common/config.h | 4 +-
be/src/pipeline/exec/data_queue.cpp | 8 +-
be/src/pipeline/exec/data_queue.h | 4 +
be/src/pipeline/exec/exchange_sink_operator.cpp | 8 +-
.../exec/partitioned_aggregation_sink_operator.cpp | 2 +-
.../exec/partitioned_aggregation_sink_operator.h | 46 +++----
.../partitioned_aggregation_source_operator.cpp | 2 +-
.../exec/partitioned_hash_join_probe_operator.cpp | 22 ++--
.../exec/partitioned_hash_join_probe_operator.h | 3 +-
.../exec/partitioned_hash_join_sink_operator.cpp | 16 ++-
.../exec/partitioned_hash_join_sink_operator.h | 3 +-
be/src/pipeline/exec/spill_sort_sink_operator.cpp | 144 ++++++++++-----------
be/src/pipeline/exec/spill_sort_sink_operator.h | 1 -
.../pipeline/exec/spill_sort_source_operator.cpp | 3 +-
be/src/pipeline/exec/union_sink_operator.cpp | 1 +
be/src/pipeline/pipeline_fragment_context.cpp | 5 +
be/src/pipeline/pipeline_x/dependency.cpp | 1 -
be/src/pipeline/pipeline_x/dependency.h | 6 +-
.../local_exchange/local_exchange_sink_operator.h | 4 +-
be/src/runtime/query_context.cpp | 4 +
be/src/runtime/runtime_state.h | 5 +
.../workload_group/workload_group_manager.cpp | 2 +-
be/src/service/doris_main.cpp | 3 +
be/src/vec/runtime/partitioner.cpp | 2 +-
be/src/vec/runtime/partitioner.h | 7 +
be/src/vec/spill/spill_stream.cpp | 69 ++--------
be/src/vec/spill/spill_stream.h | 12 +-
be/src/vec/spill/spill_stream_manager.cpp | 56 ++++----
be/src/vec/spill/spill_stream_manager.h | 12 +-
.../java/org/apache/doris/qe/SessionVariable.java | 9 ++
gensrc/thrift/PaloInternalService.thrift | 3 +
32 files changed, 232 insertions(+), 250 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
