Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-24 Thread via GitHub
ByteYue commented on code in PR #35396: URL: https://github.com/apache/doris/pull/35396#discussion_r1650948661 ## be/src/io/fs/s3_file_reader.cpp: ## @@ -113,23 +120,85 @@ Status S3FileReader::read_at_impl(size_t offset, Slice result, size_t* bytes_rea if (!client) {

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-24 Thread via GitHub
morningman commented on code in PR #35396: URL: https://github.com/apache/doris/pull/35396#discussion_r1650677371 ## be/src/io/fs/s3_file_reader.cpp: ## @@ -44,13 +45,18 @@ bvar::Adder s3_file_reader_read_counter("s3_file_reader", "read_at"); bvar::Adder s3_file_reader_total("

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-23 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2185729753 ClickBench: Total hot run time: 31.11 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-23 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2185722191 TPC-DS: Total hot run time: 175217 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-23 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2185707967 TPC-H: Total hot run time: 39925 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-23 Thread via GitHub
github-actions[bot] commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2185607170 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-23 Thread via GitHub
morningman commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2185602325 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-06-02 Thread via GitHub
ByteYue commented on code in PR #35396: URL: https://github.com/apache/doris/pull/35396#discussion_r1623719888 ## be/src/io/fs/s3_file_reader.cpp: ## @@ -44,13 +45,18 @@ bvar::Adder s3_file_reader_read_counter("s3_file_reader", "read_at"); bvar::Adder s3_file_reader_total("s3_

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-30 Thread via GitHub
AshinGau commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2138829921 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-29 Thread via GitHub
github-actions[bot] commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2138661374 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-29 Thread via GitHub
github-actions[bot] commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2138661340 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135717934 TeamCity be ut coverage result: Function Coverage: 35.78% (9011/25185) Line Coverage: 27.39% (74588/272333) Region Coverage: 26.61% (38600/145047) Branch Coverage: 23.4

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135712099 ClickBench: Total hot run time: 30.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135703170 TPC-DS: Total hot run time: 169215 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135684204 TPC-H: Total hot run time: 41184 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
github-actions[bot] commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135482374 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
morningman commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2135475376 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
morningman merged PR #35397: URL: https://github.com/apache/doris/pull/35397 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2134675055 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
gavinchou commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2134673297 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2134612476 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-28 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2134601584 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-27 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2133795692 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-27 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2133783013 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-26 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2132703700 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
github-actions[bot] commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2132044278 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
doris-robot commented on PR #35397: URL: https://github.com/apache/doris/pull/35397#issuecomment-2132043179 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y

[PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
morningman opened a new pull request, #35397: URL: https://github.com/apache/doris/pull/35397 bp #35396 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
github-actions[bot] commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2132004448 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
doris-robot commented on PR #35396: URL: https://github.com/apache/doris/pull/35396#issuecomment-2131994856 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y

[PR] [opt](s3) auto retry when meeting 429 error [doris]

2024-05-25 Thread via GitHub
morningman opened a new pull request, #35396: URL: https://github.com/apache/doris/pull/35396 ## Proposed changes Sometime the s3 sdk will return error like: ``` QpsLimitExceeded Unable to parse ExceptionName: QpsLimitExceeded Message: Please reduce your request rate. code=429 t