Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-20 Thread via GitHub
wangbo merged PR #37559: URL: https://github.com/apache/doris/pull/37559 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apach

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-19 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2239737293 ClickBench: Total hot run time: 30.41 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-19 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2239729767 TPC-DS: Total hot run time: 173405 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-19 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2239715126 TPC-H: Total hot run time: 40399 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-19 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2238553499 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-18 Thread via GitHub
yiguolei commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2238247885 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-18 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2238089189 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-18 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2238086614 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-18 Thread via GitHub
wangbo commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1683757683 ## fe/fe-common/src/main/java/org/apache/doris/common/Config.java: ## @@ -1759,6 +1759,15 @@ public class Config extends ConfigBase { @ConfField(mutable = true, var

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-18 Thread via GitHub
morningman commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1682632878 ## fe/fe-common/src/main/java/org/apache/doris/common/Config.java: ## @@ -1759,6 +1759,15 @@ public class Config extends ConfigBase { @ConfField(mutable = true,

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-223272 ClickBench: Total hot run time: 29.98 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232788571 TPC-DS: Total hot run time: 172958 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232766147 TPC-H: Total hot run time: 40268 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232665185 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232661733 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-17 Thread via GitHub
wangbo commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232655697 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-16 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232554156 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-16 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2232554119 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-15 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2228225986 ClickBench: Total hot run time: 31.16 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-15 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2228216699 TPC-DS: Total hot run time: 174090 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-15 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2228198306 TPC-H: Total hot run time: 40375 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-15 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2228073682 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-15 Thread via GitHub
wangbo commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2228062650 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-14 Thread via GitHub
wangbo commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1677351108 ## fe/fe-core/src/main/java/org/apache/doris/resource/AdmissionControl.java: ## @@ -0,0 +1,156 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or m

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-14 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1677304027 ## fe/fe-core/src/main/java/org/apache/doris/resource/AdmissionControl.java: ## @@ -0,0 +1,156 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2225560749 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
wangbo commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2225553523 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
wangbo commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2225549189 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
wangbo commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675653391 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -126,30 +138,47 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675411516 ## fe/fe-core/src/main/java/org/apache/doris/resource/AdmissionControl.java: ## @@ -0,0 +1,158 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-12 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675407840 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -126,30 +138,47 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675405258 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -126,30 +138,47 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675404264 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -126,30 +138,47 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675373545 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -105,18 +104,31 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675374613 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -105,18 +104,31 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1675373545 ## fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/QueryQueue.java: ## @@ -105,18 +104,31 @@ public QueueToken getToken() throws UserException {

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2224526633 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-11 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2224525268 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-10 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1671808009 ## fe/fe-core/src/main/java/org/apache/doris/tablefunction/MetadataGenerator.java: ## @@ -598,6 +598,8 @@ private static TFetchSchemaTableDataResult queriesMetadataRe

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-10 Thread via GitHub
yiguolei commented on code in PR #37559: URL: https://github.com/apache/doris/pull/37559#discussion_r1671799610 ## fe/fe-common/src/main/java/org/apache/doris/common/Config.java: ## @@ -1759,6 +1759,14 @@ public class Config extends ConfigBase { @ConfField(mutable = true, v

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-09 Thread via GitHub
github-actions[bot] commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2217469357 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-09 Thread via GitHub
doris-robot commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2217458956 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y

Re: [PR] [Improment]Query queued by be memory [doris]

2024-07-09 Thread via GitHub
wangbo commented on PR #37559: URL: https://github.com/apache/doris/pull/37559#issuecomment-2217459691 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[PR] [Improment]Query queued by be memory [doris]

2024-07-09 Thread via GitHub
wangbo opened a new pull request, #37559: URL: https://github.com/apache/doris/pull/37559 ## Proposed changes Add a mechanism of back pressure based on memory usage. when any BE's mem usage bigger than ```query_queue_by_be_used_memory```, query could queue in FE. -- This i