Gabriel39 closed pull request #32789: [PipelineX](improvement) Prepare tasks in
parallel
URL: https://github.com/apache/doris/pull/32789
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
Gabriel39 merged PR #40844:
URL: https://github.com/apache/doris/pull/40844
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.ap
github-actions[bot] commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350880758
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
github-actions[bot] commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350880763
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
UR
doris-robot commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350834904
ClickBench: Total hot run time: 31.27 s
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
doris-robot commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350833738
TPC-DS: Total hot run time: 197950 ms
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS
doris-robot commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350830608
TPC-H: Total hot run time: 42005 ms
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100
Gabriel39 commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350819280
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
Gabriel39 commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350804679
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
Gabriel39 opened a new pull request, #40844:
URL: https://github.com/apache/doris/pull/40844
## Proposed changes
Issue Number: close #xxx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
doris-robot commented on PR #40844:
URL: https://github.com/apache/doris/pull/40844#issuecomment-2350802853
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y
yiguolei merged PR #40270:
URL: https://github.com/apache/doris/pull/40270
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apa
github-actions[bot] commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1756430774
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -511,11 +515,17 @@ Status
PipelineXFragmentContext::_create_data_sink(ObjectPool* pool
Gabriel39 commented on PR #40270:
URL: https://github.com/apache/doris/pull/40270#issuecomment-2345651135
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
yiguolei commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1756226243
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -693,6 +701,36 @@ Status PipelineXFragmentContext::_build_pipeline_tasks(
std::lock_g
yiguolei commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1756222810
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -693,6 +701,36 @@ Status PipelineXFragmentContext::_build_pipeline_tasks(
std::lock_g
yiguolei commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1756223374
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -693,6 +701,36 @@ Status PipelineXFragmentContext::_build_pipeline_tasks(
std::lock_g
github-actions[bot] commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1741378369
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -511,11 +515,17 @@ Status
PipelineXFragmentContext::_create_data_sink(ObjectPool* pool
Gabriel39 commented on PR #40270:
URL: https://github.com/apache/doris/pull/40270#issuecomment-2325528222
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #40270:
URL: https://github.com/apache/doris/pull/40270#discussion_r1740694453
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -511,11 +515,17 @@
return Status::OK();
}
-Status PipelineXFragmentContext::_bu
Gabriel39 commented on PR #40270:
URL: https://github.com/apache/doris/pull/40270#issuecomment-2324391212
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
doris-robot commented on PR #40270:
URL: https://github.com/apache/doris/pull/40270#issuecomment-2324391101
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y
Gabriel39 opened a new pull request, #40270:
URL: https://github.com/apache/doris/pull/40270
## Proposed changes
Issue Number: close #xxx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
Gabriel39 opened a new pull request, #32789:
URL: https://github.com/apache/doris/pull/32789
## Proposed changes
Now pipeline tasks are prepared in serial mode which has high overhead for
short queries. This PR change it to parallel preparation.
## Further comments
Gabriel39 closed pull request #32789: [PipelineX](improvement) Prepare tasks in
parallel
URL: https://github.com/apache/doris/pull/32789
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
doris-robot commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2066200305
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a018575f4cf3da1a5f4d7309606077cdb9e9191b with
default session variables
Stream
doris-robot commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2066195258
ClickBench: Total hot run time: 30.21 s
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
doris-robot commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2066186330
TPC-DS: Total hot run time: 183049 ms
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS
doris-robot commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2066167002
TPC-H: Total hot run time: 38130 ms
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1572037934
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -486,11 +490,17 @@
return Status::OK();
}
-Status PipelineXFragmentContext::_bu
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2066105062
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1571767655
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -486,11 +491,14 @@ Status
PipelineXFragmentContext::_create_data_sink(ObjectPool* pool
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2065729884
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1571764476
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -486,11 +491,14 @@ Status
PipelineXFragmentContext::_create_data_sink(ObjectPool* pool
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2065721549
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1571730569
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -164,7 +166,8 @@ void PipelineXFragmentContext::cancel(const
PPlanFragmentCancelReason
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2065690370
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1571726545
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -486,11 +491,14 @@ Status
PipelineXFragmentContext::_create_data_sink(ObjectPool* pool
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1560485756
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -164,7 +166,8 @@ void PipelineXFragmentContext::cancel(const
PPlanFragmentCancelReason
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2048991928
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2020557488
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2019215717
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1538459381
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -162,7 +164,8 @@ void PipelineXFragmentContext::cancel(const
PPlanFragmentCancelReason
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2019201006
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2017989399
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
github-actions[bot] commented on code in PR #32789:
URL: https://github.com/apache/doris/pull/32789#discussion_r1537419225
##
be/src/pipeline/pipeline_x/pipeline_x_fragment_context.cpp:
##
@@ -479,11 +480,14 @@
return Status::OK();
}
-Status PipelineXFragmentContext::_bu
Gabriel39 commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2017746557
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
doris-robot commented on PR #32789:
URL: https://github.com/apache/doris/pull/32789#issuecomment-2017745893
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y
Gabriel39 opened a new pull request, #32789:
URL: https://github.com/apache/doris/pull/32789
## Proposed changes
Issue Number: close #xxx
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailt
49 matches
Mail list logo
