Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-14 Thread via GitHub
dataroaring merged PR #35856: URL: https://github.com/apache/doris/pull/35856 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-14 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167813467 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-14 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167813422 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-14 Thread via GitHub
zhannngchen commented on code in PR #35856: URL: https://github.com/apache/doris/pull/35856#discussion_r1639503215 ## be/src/cloud/cloud_meta_mgr.cpp: ## @@ -546,6 +548,36 @@ Status CloudMetaMgr::sync_tablet_rowsets(CloudTablet* tablet, bool warmup_delta_ } } +bool Clou

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-14 Thread via GitHub
zhannngchen commented on code in PR #35856: URL: https://github.com/apache/doris/pull/35856#discussion_r1639503215 ## be/src/cloud/cloud_meta_mgr.cpp: ## @@ -546,6 +548,36 @@ Status CloudMetaMgr::sync_tablet_rowsets(CloudTablet* tablet, bool warmup_delta_ } } +bool Clou

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167267679 ClickBench: Total hot run time: 30.58 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167262653 TPC-DS: Total hot run time: 172534 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167252532 TPC-H: Total hot run time: 40248 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167238861 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
hust-hhb commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2167234504 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
hust-hhb commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2165211051 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-13 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2165224051 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2147006742 ClickBench: Total hot run time: 29.95 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146995092 TPC-DS: Total hot run time: 171359 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146972122 TPC-H: Total hot run time: 41494 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146885213 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
github-actions[bot] commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146880701 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
hust-hhb commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146873315 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
doris-robot commented on PR #35856: URL: https://github.com/apache/doris/pull/35856#issuecomment-2146867052 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y

[PR] [improve](cloud) use delete bitmap cache to reduce sync rowset time [doris]

2024-06-04 Thread via GitHub
hust-hhb opened a new pull request, #35856: URL: https://github.com/apache/doris/pull/35856 ## Proposed changes Issue Number: close #xxx My test show that get_delete_bitmap from metaservice may cost too much time while doing sync_rowset in cloud mode, which may lead to