Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
morningman merged PR #30202: URL: https://github.com/apache/doris/pull/30202 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
morrySnow merged PR #30144: URL: https://github.com/apache/doris/pull/30144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903149248 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 69f7746ce91e1924b348a277132f3f5ed02551f9 with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903142055 ClickBench: Total hot run time: 31.54 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903129897 TPC-DS: Total hot run time: 235096 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903097484 TPC-H: Total hot run time: 50221 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1903095244 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit c1a745e978e3d6730638d60df4fc275641b7944b with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1903088346 ClickBench: Total hot run time: 29.74 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1903076305 TPC-DS: Total hot run time: 176724 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
github-actions[bot] commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903058062 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
github-actions[bot] commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903057958 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1903049287 TPC-H: Total hot run time: 38662 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
Jibing-Li commented on PR #30202: URL: https://github.com/apache/doris/pull/30202#issuecomment-1903044628 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
Jibing-Li opened a new pull request, #30202: URL: https://github.com/apache/doris/pull/30202 Before, drop stats operation need to call columns * followers times of isMaster() function and the same times of rpc to drop remote column stats. This pr is to reduce the rpc calls and use more effi

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
github-actions[bot] commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1903015175 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
Jibing-Li commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902972121 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902696558 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 5e9dd6cce1a35aedc83c03c5957f43401968e2af with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902695738 ClickBench: Total hot run time: 30.27 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902694440 TPC-DS: Total hot run time: 176354 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
github-actions[bot] commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902691708 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
github-actions[bot] commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902691699 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902691183 TPC-H: Total hot run time: 38562 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
Jibing-Li commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1902682674 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-21 Thread via GitHub
morningman commented on code in PR #30144: URL: https://github.com/apache/doris/pull/30144#discussion_r1460770805 ## fe/fe-core/src/main/java/org/apache/doris/statistics/InvalidateStatsTarget.java: ## @@ -0,0 +1,40 @@ +// Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-20 Thread via GitHub
xiaokang merged PR #30158: URL: https://github.com/apache/doris/pull/30158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1901836061 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 4652ecf23b306ab84acef046e0c421a65e9910d9 with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1901831555 ClickBench: Total hot run time: 31.29 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1901823812 TPC-DS: Total hot run time: 239700 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1901804008 TPC-H: Total hot run time: 49820 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
Jibing-Li commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1901783348 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1900413362 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit ba9d703bd6d2ec714f1a92f8b2d0a87ef6877460 with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1900409104 ClickBench: Total hot run time: 31.19 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1900401717 TPC-DS: Total hot run time: 238132 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1900364642 TPC-H: Total hot run time: 49931 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
Jibing-Li commented on PR #30158: URL: https://github.com/apache/doris/pull/30158#issuecomment-1900311907 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
Jibing-Li opened a new pull request, #30158: URL: https://github.com/apache/doris/pull/30158 Before, drop stats operation need to call columns * followers times of isMaster() function and the same times of rpc to drop remote column stats. This pr is to reduce the rpc calls and use more effi

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1900172887 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 94cb81318a5c9b692962e41a10a4c62f2818f151 with default session variables Stream

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1900168448 ClickBench: Total hot run time: 30.25 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1900160420 TPC-DS: Total hot run time: 176178 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
doris-robot commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1900141800 TPC-H: Total hot run time: 39200 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
Jibing-Li commented on PR #30144: URL: https://github.com/apache/doris/pull/30144#issuecomment-1900093702 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] [improvement](statistics)Optimize drop stats operation. [doris]

2024-01-19 Thread via GitHub
Jibing-Li opened a new pull request, #30144: URL: https://github.com/apache/doris/pull/30144 Before, drop stats operation need to call columns * followers times of isMaster() function and the same times of rpc to drop remote column stats. This pr is to reduce the rpc calls and use more effi