This is an automated email from the ASF dual-hosted git repository.
gavinchou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 99dce148593 Revert "[scan](improvement) Adjust parallel scanners num
(#38430)" (#39046)
99dce148593 is described below
commit 99dce1485939ec1b8476a3f442948d5fa419350a
Author: HappenLee <happen...@hotmail.com>
AuthorDate: Wed Aug 7 22:51:33 2024 +0800
Revert "[scan](improvement) Adjust parallel scanners num (#38430)" (#39046)
This reverts commit 11b332fd90eadeff78d120db2b51abc6b7b44d35.
---
be/src/pipeline/exec/scan_operator.cpp | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
diff --git a/be/src/pipeline/exec/scan_operator.cpp
b/be/src/pipeline/exec/scan_operator.cpp
index 3f1db6a180d..647acb95166 100644
--- a/be/src/pipeline/exec/scan_operator.cpp
+++ b/be/src/pipeline/exec/scan_operator.cpp
@@ -1222,8 +1222,9 @@ Status ScanLocalState<Derived>::_start_scanners(
state(), this, p._output_tuple_desc, p.output_row_descriptor(),
scanners, p.limit(),
state()->scan_queue_mem_limit(), _scan_dependency,
// 1. If data distribution is ignored , we use 1 instance to scan.
- // 2. Else, file scanner will consume much memory so we use
config::doris_scanner_thread_pool_thread_num / query_parallel_instance_num
scanners to scan.
- p.ignore_data_distribution() && !p.is_file_scan_operator()
+ // 2. Else if this operator is not file scan operator, we use
config::doris_scanner_thread_pool_thread_num scanners to scan.
+ // 3. Else, file scanner will consume much memory so we use
config::doris_scanner_thread_pool_thread_num / query_parallel_instance_num
scanners to scan.
+ p.ignore_data_distribution() || !p.is_file_scan_operator()
? 1
: state()->query_parallel_instance_num());
return Status::OK();
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
