Re: [PR] [fix](be-ut) fix compile warning: declaration shadows a local variable [doris]
hello-stephen merged PR #45204: URL: https://github.com/apache/doris/pull/45204 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] (inverted index) Disallow variant columns from using inverted index format v1 (#43599) [doris]
csun5285 commented on PR #45179: URL: https://github.com/apache/doris/pull/45179#issuecomment-2527601451 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement showTableCreationCommand in nereids #42776 [doris]
rijeshkp commented on PR #44703: URL: https://github.com/apache/doris/pull/44703#issuecomment-2527575147 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improve](docker) add disable query and load for be restart [doris]
catpineapple opened a new pull request, #45208: URL: https://github.com/apache/doris/pull/45208 ### What problem does this PR solve? add disable query and load for be restart - disable query and load before stop be - enable query and load before start be when the be is not first started ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support auto analyze columns that haven't been analyzed for a long time. [doris]
doris-robot commented on PR #42399: URL: https://github.com/apache/doris/pull/42399#issuecomment-2527608805 TPC-DS: Total hot run time: 197674 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4fde56054bffbc8e3900284c2a25b03486e2c177, data reload: false query1 1273963 986 963 query2 6234213320432043 query3 10959 441144114411 query4 67346 28623 23490 23490 query5 4959465 471 465 query6 424 187 184 184 query7 5587313 299 299 query8 323 240 236 236 query9 9253273927192719 query10 442 255 238 238 query11 17374 15265 15795 15265 query12 144 113 107 107 query13 1546425 414 414 query14 10909 734972697269 query15 215 183 208 183 query16 7514506 482 482 query17 1066590 596 590 query18 1657310 315 310 query19 209 161 158 158 query20 121 114 111 111 query21 221 101 105 101 query22 4727447346784473 query23 34882 34832 34480 34480 query24 5406259724652465 query25 489 391 389 389 query26 666 154 156 154 query27 1903300 294 294 query28 4463250224632463 query29 681 471 411 411 query30 205 153 154 153 query31 1023832 828 828 query32 64 53 53 53 query33 446 287 288 287 query34 938 515 547 515 query35 851 782 764 764 query36 1108969 959 959 query37 123 71 75 71 query38 4518443946164439 query39 1521145914591459 query40 203 106 97 97 query41 45 43 42 42 query42 109 102 102 102 query43 543 485 481 481 query44 1208846 849 846 query45 193 168 166 166 query46 1166737 725 725 query47 2074197819181918 query48 434 324 328 324 query49 730 391 394 391 query50 849 388 416 388 query51 7341709671837096 query52 98 90 86 86 query53 259 185 183 183 query54 507 406 388 388 query55 80 78 79 78 query56 249 248 250 248 query57 1253109411221094 query58 214 206 210 206 query59 3262300529462946 query60 264 243 249 243 query61 109 150 102 102 query62 773 679 662 662 query63 215 184 188 184 query64 1398679 629 629 query65 3305317732213177 query66 757 297 288 288 query67 16335 15642 15681 15642 query68 4004589 561 561 query69 431 266 256 256 query70 1206117611551155 query71 359 252 246 246 query72 6458408841194088 query73 771 368 358 358 query74 9509928390529052 query75 3398263526602635 query76 1780111710891089 query77 473 270 264 264 query78 10409 952094229422 query79 2291620 621 620 query80 1439433 429 429 query81 509 231 235 231 query82 1287122 111 111 query83 165 157 138 138 query84 290 74 74 74 query85 1005304 289 289 query86 413 280 298 280 query87 4700466646044604 query88 3424223321782178 query89 422 295 304 295 query90 1962189 187 187 query91 142 103 101 101 query92 63 50 50 50 query93 2860548 547 547 query94 881 296 293 293 query95 348 266 249 249 query96 625 278 276 276 query97 2860267026782670 query98 216 198 194 194 query99 1635130813051305 Total cold run time: 322098 ms Total hot run time: 197674 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [improve](docker) add disable query and load for be restart [doris]
catpineapple commented on PR #45208: URL: https://github.com/apache/doris/pull/45208#issuecomment-2527609484 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](mtmv)Paimon queries the data in the cache instead of querying the latest data [doris]
zddr commented on PR #44911: URL: https://github.com/apache/doris/pull/44911#issuecomment-2527591078 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids) push down encode slot [doris]
englefly commented on PR #44748: URL: https://github.com/apache/doris/pull/44748#issuecomment-2527603215 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](docker) add disable query and load for be restart [doris]
doris-robot commented on PR #45208: URL: https://github.com/apache/doris/pull/45208#issuecomment-2527602534 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](docker) add disable query and load for be restart [doris]
catpineapple commented on PR #45208: URL: https://github.com/apache/doris/pull/45208#issuecomment-2527604908 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support auto analyze columns that haven't been analyzed for a long time. [doris]
doris-robot commented on PR #42399: URL: https://github.com/apache/doris/pull/42399#issuecomment-2527620990 ClickBench: Total hot run time: 33.3 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4fde56054bffbc8e3900284c2a25b03486e2c177, data reload: false query1 0.030.030.03 query2 0.060.040.03 query3 0.230.070.07 query4 1.630.100.10 query5 0.460.390.40 query6 1.140.660.65 query7 0.020.020.02 query8 0.040.040.04 query9 0.570.530.50 query10 0.550.540.54 query11 0.140.100.11 query12 0.140.110.12 query13 0.610.610.62 query14 2.812.742.74 query15 0.900.830.83 query16 0.390.380.38 query17 1.001.101.05 query18 0.230.210.22 query19 2.001.732.03 query20 0.010.010.01 query21 15.41 0.590.55 query22 2.701.882.40 query23 17.03 1.180.82 query24 2.481.752.03 query25 0.420.190.08 query26 0.500.140.14 query27 0.040.050.04 query28 9.931.111.08 query29 12.56 3.243.25 query30 0.250.060.07 query31 2.880.390.39 query32 3.230.480.47 query33 3.003.063.04 query34 17.05 4.414.46 query35 4.514.434.49 query36 0.690.500.51 query37 0.090.060.05 query38 0.050.030.03 query39 0.030.020.03 query40 0.180.120.13 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.030.02 Total cold run time: 106.14 s Total hot run time: 33.3 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](lambda) let lambda expression support refer outer slot [doris]
github-actions[bot] commented on PR #45186: URL: https://github.com/apache/doris/pull/45186#issuecomment-2527646533 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](lambda) let lambda expression support refer outer slot [doris]
github-actions[bot] commented on PR #45186: URL: https://github.com/apache/doris/pull/45186#issuecomment-2527646435 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances #44913 [doris]
yiguolei merged PR #44951: URL: https://github.com/apache/doris/pull/44951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improment]Add workload group resource usage metrics [doris]
wangbo commented on PR #44870: URL: https://github.com/apache/doris/pull/44870#issuecomment-2527652145 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-44145-branch-3.0 deleted (was 4b15e08355a)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-44145-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git was 4b15e08355a [Audit](fix) fix audit log lost for npe (#44145) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Job](Fix)Improve Event Publishing with Timeout [doris]
CalvinKirs commented on PR #45103: URL: https://github.com/apache/doris/pull/45103#issuecomment-2527574942 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [update] Update auth docs [doris-website]
KassieZ opened a new pull request, #1485: URL: https://github.com/apache/doris-website/pull/1485 ## Versions - [ ] dev - [ ] 3.0 - [ ] 2.1 - [ ] 2.0 ## Languages - [ ] Chinese - [ ] English ## Docs Checklist - [ ] Checked by AI - [ ] Test Cases Built -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](pipeline) set wake_up_early when pipeline task's sink not executed with eos [doris]
github-actions[bot] commented on code in PR #45207:
URL: https://github.com/apache/doris/pull/45207#discussion_r1875777521
##
be/src/pipeline/pipeline_task.cpp:
##
@@ -289,12 +290,17 @@ bool PipelineTask::_is_blocked() {
}
Status PipelineTask::execute(bool* eos) {
Review Comment:
warning: function 'execute' has cognitive complexity of 65 (threshold 50)
[readability-function-cognitive-complexity]
```cpp
Status PipelineTask::execute(bool* eos) {
^
```
Additional context
**be/src/pipeline/pipeline_task.cpp:297:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_sink->is_finished(_state)) {
^
```
**be/src/pipeline/pipeline_task.cpp:302:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (*eos) {
^
```
**be/src/pipeline/pipeline_task.cpp:307:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
DBUG_EXECUTE_IF("fault_inject::PipelineXTask::execute", {
^
```
**be/src/util/debug_points.h:36:** expanded from macro 'DBUG_EXECUTE_IF'
```cpp
if (UNLIKELY(config::enable_debug_points)) {
\
^
```
**be/src/pipeline/pipeline_task.cpp:307:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
DBUG_EXECUTE_IF("fault_inject::PipelineXTask::execute", {
^
```
**be/src/util/debug_points.h:38:** expanded from macro 'DBUG_EXECUTE_IF'
```cpp
if (dp) {
\
^
```
**be/src/pipeline/pipeline_task.cpp:325:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_wait_to_start()) {
^
```
**be/src/pipeline/pipeline_task.cpp:328:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_wake_up_early) {
^
```
**be/src/pipeline/pipeline_task.cpp:333:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (!_opened && !_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:333:** +1
```cpp
if (!_opened && !_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:334:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
RETURN_IF_ERROR(_open());
^
```
**be/src/common/status.h:632:** expanded from macro 'RETURN_IF_ERROR'
```cpp
do {\
^
```
**be/src/pipeline/pipeline_task.cpp:334:** +3, including nesting penalty of
2, nesting level increased to 3
```cpp
RETURN_IF_ERROR(_open());
^
```
**be/src/common/status.h:634:** expanded from macro 'RETURN_IF_ERROR'
```cpp
if (UNLIKELY(!_status_.ok())) { \
^
```
**be/src/pipeline/pipeline_task.cpp:339:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
while (!_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:340:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_is_blocked()) {
^
```
**be/src/pipeline/pipeline_task.cpp:343:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_wake_up_early) {
^
```
**be/src/pipeline/pipeline_task.cpp:351:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:355:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (time_spent > THREAD_TIME_SLICE) {
^
```
**be/src/pipeline/pipeline_task.cpp:363:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (should_revoke_memory(_state, sink_revocable_mem_size)) {
^
```
**be/src/pipeline/pipeline_task.cpp:364:** +3, including nesting penalty of
2, nesting level increased to 3
```cpp
RETURN_IF_ERROR(_sink->revoke_memory(_state));
^
```
**be/src/common/status.h:632:** expanded from macro 'RETURN_IF_ERROR'
```cpp
do {\
^
```
**be/src/pipeline/pipeline_task.cpp:364:** +4, including nesting penalty of
3, nesting level increased to 4
```cpp
RETURN_IF_ERROR(_sink->revoke_memory(_state));
^
```
**be/src/common/status.h:634:** expanded from macro 'RETURN_IF_ERROR'
```cpp
if (UNLIKELY(!_status_.ok())) { \
^
```
**be/src/pipeline/pipeline_task.cpp:367:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
DBUG_EXECUTE_IF("fault_inj
[PR] [Bug](pipeline) set wake_up_early when pipeline task's sink not executed with eos [doris]
BiteThet opened a new pull request, #45207: URL: https://github.com/apache/doris/pull/45207 ### What problem does this PR solve? set wake_up_early when pipeline task's sink not executed with eos to avoid logic dead lock and build_sink operator's error Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](pipeline) set wake_up_early when pipeline task's sink not executed with eos [doris]
BiteThet commented on PR #45207: URL: https://github.com/apache/doris/pull/45207#issuecomment-2527578664 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support ShowTabletStorageFormat command in nereids [doris]
rijeshkp commented on PR #43295: URL: https://github.com/apache/doris/pull/43295#issuecomment-2527576036 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) ignore null values when the literals of in_predicate contains [doris]
suxiaogang223 commented on PR #45104: URL: https://github.com/apache/doris/pull/45104#issuecomment-2527624314 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](nereids) optimize insert into values [doris]
924060929 commented on PR #40202: URL: https://github.com/apache/doris/pull/40202#issuecomment-2527495215 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (0a0c5025364 -> 0a73618313c)
This is an automated email from the ASF dual-hosted git repository.
zhangstar333 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 0a0c5025364 [fix](be-ut) fix compile warning: declaration shadows a
local variable (#45204)
add 0a73618313c [feature](udf) Support for IP types in Java UDF. (#44871)
No new revisions were added by this update.
Summary of changes:
be/src/vec/exec/jni_connector.cpp | 12 +-
.../doris/common/jni/utils/JavaUdfDataType.java| 8 ++
.../doris/common/jni/utils/TypeNativeBytes.java| 16 +++
.../apache/doris/common/jni/utils/UdfUtils.java| 6 +
.../apache/doris/common/jni/vec/ColumnType.java| 20 +++
.../apache/doris/common/jni/vec/VectorColumn.java | 79 +++
.../main/java/org/apache/doris/catalog/Type.java | 4 +-
.../data/nereids_p0/javaudf/test_javaudf_ip.out| 42 ++
.../java/org/apache/doris/udf/IPV4TypeTest.java| 74 +++
.../java/org/apache/doris/udf/IPV6TypeTest.java| 73 +++
.../doris/udf/{MySumArrayInt.java => MySumIP.java} | 48 ---
.../nereids_p0/javaudf/test_javaudf_ip.groovy | 146 +
12 files changed, 508 insertions(+), 20 deletions(-)
create mode 100644 regression-test/data/nereids_p0/javaudf/test_javaudf_ip.out
create mode 100644
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/IPV4TypeTest.java
create mode 100644
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/IPV6TypeTest.java
copy
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/{MySumArrayInt.java
=> MySumIP.java} (60%)
create mode 100644
regression-test/suites/nereids_p0/javaudf/test_javaudf_ip.groovy
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](udf) Support for IP types in Java UDF. [doris]
zhangstar333 merged PR #44871: URL: https://github.com/apache/doris/pull/44871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) lock table in ascending order of table IDs [doris]
morrySnow commented on PR #45045: URL: https://github.com/apache/doris/pull/45045#issuecomment-2527629851 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ip)fix default value for ip [doris]
yiguolei commented on code in PR #45194:
URL: https://github.com/apache/doris/pull/45194#discussion_r1875802538
##
regression-test/suites/datatype_p0/ip/test_ip_basic.groovy:
##
@@ -160,4 +160,11 @@ suite("test_ip_basic") {
qt_sql """ select * from table_ip where col0 = 1"""
sql """ Update table_ip set col25 =
':::::::' where col0 = 1 """
qt_sql """ select * from table_ip where col0 = 1"""
+
+// test ip with default value
+sql """ DROP TABLE IF EXISTS table_ip_default """
+sql """ CREATE TABLE IF NOT EXISTS `table_ip_default` (`col0` bigint NOT
NULL, `col4` ipv6 NULL DEFAULT "::", `col24` ipv4 NULL DEFAULT "127.0.0.1")
ENGINE=OLAP UNIQUE KEY(`col0`) DISTRIBUTED BY HASH(`col0`) BUCKETS 4 PROPERTIES
("replication_allocation" = "tag.location.default: 1") """
Review Comment:
add more
test:
1. show create table
2. desc table
3. create table like
to make sure in all cases, the default value is not lost.
##
regression-test/suites/datatype_p0/ip/test_ip_basic.groovy:
##
@@ -160,4 +160,11 @@ suite("test_ip_basic") {
qt_sql """ select * from table_ip where col0 = 1"""
sql """ Update table_ip set col25 =
':::::::' where col0 = 1 """
qt_sql """ select * from table_ip where col0 = 1"""
+
+// test ip with default value
+sql """ DROP TABLE IF EXISTS table_ip_default """
+sql """ CREATE TABLE IF NOT EXISTS `table_ip_default` (`col0` bigint NOT
NULL, `col4` ipv6 NULL DEFAULT "::", `col24` ipv4 NULL DEFAULT "127.0.0.1")
ENGINE=OLAP UNIQUE KEY(`col0`) DISTRIBUTED BY HASH(`col0`) BUCKETS 4 PROPERTIES
("replication_allocation" = "tag.location.default: 1") """
Review Comment:
add more test:
1. show create table
2. desc table
3. create table like
to make sure in all cases, the default value is not lost.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) ignore null values when the literals of in_predicate contains [doris]
github-actions[bot] commented on PR #45104: URL: https://github.com/apache/doris/pull/45104#issuecomment-2527633030 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](be-ut) fix compile warning: declaration shadows a local variable [doris]
shuke987 commented on PR #45204: URL: https://github.com/apache/doris/pull/45204#issuecomment-2527553135 skip buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-44913-branch-2.1 deleted (was 1b3e825c0d0)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-44913-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 1b3e825c0d0 Merge branch 'branch-2.1' into auto-pick-44913-branch-2.1 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances #44913 (#44951)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new a8b5125a258 branch-2.1: [fix](third party) fix hang when destroy of
rdkafka instances #44913 (#44951)
a8b5125a258 is described below
commit a8b5125a258cfcccbeec4258c82321768cad3e0a
Author: github-actions[bot]
<41898282+github-actions[bot]@users.noreply.github.com>
AuthorDate: Mon Dec 9 19:20:52 2024 +0800
branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances
#44913 (#44951)
Cherry-picked from #44913
Co-authored-by: hui lai
Co-authored-by: Dongyang Li
---
thirdparty/patches/librdkafka-1.9.2.patch | 111 +-
1 file changed, 110 insertions(+), 1 deletion(-)
diff --git a/thirdparty/patches/librdkafka-1.9.2.patch
b/thirdparty/patches/librdkafka-1.9.2.patch
index b13e740bc5c..3caac08f79d 100644
--- a/thirdparty/patches/librdkafka-1.9.2.patch
+++ b/thirdparty/patches/librdkafka-1.9.2.patch
@@ -67,7 +67,19 @@
--- src/rdkafka_broker.c
+++ src/rdkafka_broker.c
-@@ -5461,7 +5461,9 @@ static int rd_kafka_broker_thread_main(void *arg) {
+@@ -3288,6 +3288,11 @@ rd_kafka_broker_op_serve(rd_kafka_broker_t *rkb,
rd_kafka_op_t *rko) {
+ : (topic_err
+? topic_err
+:
RD_KAFKA_RESP_ERR__UNKNOWN_PARTITION));
++
++if (rkb->rkb_rk->rk_type == RD_KAFKA_CONSUMER) {
++
rd_kafka_toppar_purge_internal_fetch_queue_maybe(
++rktp);
++}
+ }
+
+ rd_kafka_toppar_unlock(rktp);
+@@ -5461,7 +5466,9 @@ static int rd_kafka_broker_thread_main(void *arg) {
*/
void rd_kafka_broker_destroy_final(rd_kafka_broker_t *rkb) {
@@ -78,3 +90,100 @@
rd_assert(TAILQ_EMPTY(&rkb->rkb_monitors));
rd_assert(TAILQ_EMPTY(&rkb->rkb_outbufs.rkbq_bufs));
rd_assert(TAILQ_EMPTY(&rkb->rkb_waitresps.rkbq_bufs));
+--- src/rdkafka_cgrp.c
src/rdkafka_cgrp.c
+@@ -2734,6 +2734,9 @@ static void rd_kafka_cgrp_partition_del(rd_kafka_cgrp_t
*rkcg,
+ rd_kafka_toppar_lock(rktp);
+ rd_assert(rktp->rktp_flags & RD_KAFKA_TOPPAR_F_ON_CGRP);
+ rktp->rktp_flags &= ~RD_KAFKA_TOPPAR_F_ON_CGRP;
++
++rd_kafka_toppar_purge_internal_fetch_queue_maybe(rktp);
++
+ rd_kafka_toppar_unlock(rktp);
+
+ rd_list_remove(&rkcg->rkcg_toppars, rktp);
+--- src/rdkafka_partition.c
src/rdkafka_partition.c
+@@ -959,7 +959,71 @@ void rd_kafka_toppar_insert_msgq(rd_kafka_toppar_t *rktp,
+ rd_kafka_toppar_unlock(rktp);
+ }
+
++/**
++ * @brief Purge internal fetch queue if toppar is stopped
++ * (RD_KAFKA_TOPPAR_FETCH_STOPPED) and removed from the cluster
++ * (RD_KAFKA_TOPPAR_F_REMOVE). Will be called from different places as it's
++ * removed starting from a metadata response and stopped from a rebalance or a
++ * consumer close.
++ *
++ * @remark Avoids circular dependencies in from `rktp_fetchq` ops to the same
++ * toppar that stop destroying a consumer.
++ *
++ * @locks rd_kafka_toppar_lock() MUST be held
++ */
++void rd_kafka_toppar_purge_internal_fetch_queue_maybe(rd_kafka_toppar_t
*rktp) {
++rd_kafka_q_t *rkq;
++rkq = rktp->rktp_fetchq;
++mtx_lock(&rkq->rkq_lock);
++if (rktp->rktp_flags & RD_KAFKA_TOPPAR_F_REMOVE &&
++!rktp->rktp_fetchq->rkq_fwdq) {
++rd_kafka_op_t *rko;
++int cnt = 0, barrier_cnt = 0, message_cnt = 0, other_cnt = 0;
++
++/* Partition is being removed from the cluster and it's
stopped,
++ * so rktp->rktp_fetchq->rkq_fwdq is NULL.
++ * Purge remaining operations in rktp->rktp_fetchq->rkq_q,
++ * while holding lock, to avoid circular references */
++rko = TAILQ_FIRST(&rkq->rkq_q);
++while (rko) {
++if (rko->rko_type != RD_KAFKA_OP_BARRIER &&
++rko->rko_type != RD_KAFKA_OP_FETCH) {
++rd_kafka_log(
++rktp->rktp_rkt->rkt_rk, LOG_WARNING,
++"PARTDEL",
++"Purging toppar fetch queue buffer op"
++"with unexpected type: %s",
++rd_kafka_op2str(rko->rko_type));
++}
++
++if (rko->rko_type == RD_KAFKA_OP_BARRIER)
++barrier_cnt++;
++else if (rko->rko_type == RD_KAFKA_OP_FETCH)
++message_cnt++;
++else
++
Re: [PR] [Improment]Add workload group resource usage metrics [doris]
github-actions[bot] commented on code in PR #44870: URL: https://github.com/apache/doris/pull/44870#discussion_r1875819562 ## be/src/runtime/workload_group/workload_group.h: ## @@ -17,7 +17,6 @@ #pragma once -#include #include Review Comment: warning: 'gen_cpp/BackendService_types.h' file not found [clang-diagnostic-error] ```cpp #include ^ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) not rewrite first_value when first_value ignore nulls [doris]
feiniaofeiafei commented on PR #45065: URL: https://github.com/apache/doris/pull/45065#issuecomment-2527661435 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) not rewrite first_value when first_value ignore nulls [doris]
morrySnow commented on code in PR #45065:
URL: https://github.com/apache/doris/pull/45065#discussion_r1875827867
##
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/WindowFunctionChecker.java:
##
@@ -315,6 +316,14 @@ public Lead visitLead(Lead lead, Void ctx) {
*/
@Override
public FirstOrLastValue visitFirstValue(FirstValue firstValue, Void ctx) {
+if (2 == firstValue.arity()) {
+if (!firstValue.child(1).isConstant()) {
+throw new AnalysisException("The second parameter of
first_value must be constant");
+}
Review Comment:
maybe we should add this check in
`org.apache.doris.nereids.trees.expressions.functions.window.FirstOrLastValue`.
let impl `checkLegalityBeforeTypeCoercion`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] Cant export temporary partition [doris]
zxealous closed issue #45120: [Enhancement] Cant export temporary partition URL: https://github.com/apache/doris/issues/45120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) lock table in ascending order of table IDs [doris]
doris-robot commented on PR #45045: URL: https://github.com/apache/doris/pull/45045#issuecomment-2527671344 TPC-H: Total hot run time: 40053 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a8a2891995bb45d4f185844b526340ce8bdaa1b6, data reload: false -- Round 1 -- q1 17592 750473297329 q2 2040205 171 171 q3 10688 115712031157 q4 10540 723 732 723 q5 7590268626152615 q6 237 149 149 149 q7 1042613 622 613 q8 9244186319081863 q9 6573645764606457 q10 7048231023482310 q11 466 250 263 250 q12 414 219 220 219 q13 17768 301429972997 q14 245 216 216 216 q15 581 548 527 527 q16 635 605 599 599 q17 964 574 568 568 q18 7333671367016701 q19 13391050952 952 q20 473 179 180 179 q21 4119314531643145 q22 384 313 322 313 Total cold run time: 107315 ms Total hot run time: 40053 ms - Round 2, with runtime_filter_mode=off - q1 7260725272517251 q2 326 235 223 223 q3 2903280430652804 q4 2081184417621762 q5 5536571056685668 q6 224 146 146 146 q7 2269177118381771 q8 3347356134663466 q9 8946898090358980 q10 3575353735493537 q11 620 514 509 509 q12 830 669 629 629 q13 12360 320631183118 q14 301 288 271 271 q15 577 524 548 524 q16 657 634 633 633 q17 1792156615591559 q18 7799739173727372 q19 1633148015371480 q20 2064185818131813 q21 5452527052995270 q22 641 561 580 561 Total cold run time: 71193 ms Total hot run time: 59347 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Job](Fix)Improve Event Publishing with Timeout [doris]
doris-robot commented on PR #45103: URL: https://github.com/apache/doris/pull/45103#issuecomment-2527673581 TPC-H: Total hot run time: 39932 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 56234593e352031d99ac4810a715317ff8db67b8, data reload: false -- Round 1 -- q1 17579 748773087308 q2 2044182 159 159 q3 10873 107412241074 q4 10547 737 752 737 q5 7612268326682668 q6 237 148 149 148 q7 1006630 607 607 q8 9251179718521797 q9 6667635464516354 q10 6978230023312300 q11 490 257 259 257 q12 420 215 219 215 q13 17768 304531053045 q14 225 210 205 205 q15 585 530 519 519 q16 644 595 603 595 q17 957 581 604 581 q18 7363666267686662 q19 1341107210061006 q20 469 182 182 182 q21 4057329932033203 q22 380 310 311 310 Total cold run time: 107493 ms Total hot run time: 39932 ms - Round 2, with runtime_filter_mode=off - q1 7216721371957195 q2 321 227 236 227 q3 2906284928952849 q4 2090180018251800 q5 5676566256365636 q6 224 139 141 139 q7 2258183118241824 q8 3379349634413441 q9 8866907890459045 q10 3590355435663554 q11 626 519 492 492 q12 840 578 612 578 q13 9717328732013201 q14 310 270 271 270 q15 575 518 532 518 q16 679 629 636 629 q17 1848161016361610 q18 8162763675877587 q19 1674142015371420 q20 2108187818961878 q21 5660557054825482 q22 636 612 601 601 Total cold run time: 69361 ms Total hot run time: 59976 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](compaction)Optimize compaction task permit allocation [doris]
Yukang-Lian commented on PR #45197: URL: https://github.com/apache/doris/pull/45197#issuecomment-2527677216 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exec)Optimize SetOperator by removing unnecessary maintained elements. [doris]
doris-robot commented on PR #45195: URL: https://github.com/apache/doris/pull/45195#issuecomment-2527681390 TeamCity be ut coverage result: Function Coverage: 38.83% (10102/26019) Line Coverage: 29.70% (84685/285162) Region Coverage: 28.78% (43482/151100) Branch Coverage: 25.33% (22091/87210) Coverage Report: http://coverage.selectdb-in.cc/coverage/d14fb30a9b111aa8c9e13386d936e05e498e9391_d14fb30a9b111aa8c9e13386d936e05e498e9391/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
github-actions[bot] commented on PR #44929: URL: https://github.com/apache/doris/pull/44929#issuecomment-2527684345 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](mtmv)Paimon queries the data in the cache instead of querying the latest data [doris]
doris-robot commented on PR #44911: URL: https://github.com/apache/doris/pull/44911#issuecomment-2527684876 TPC-H: Total hot run time: 39776 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1de646f5174a149c70c6f94640df38f22b1dc79e, data reload: false -- Round 1 -- q1 17593 740772577257 q2 2048171 169 169 q3 10683 109311631093 q4 10541 698 796 698 q5 7605272326832683 q6 234 149 148 148 q7 1006616 614 614 q8 9239188519431885 q9 6713656665016501 q10 7040224422812244 q11 490 256 252 252 q12 424 216 217 216 q13 17770 306230043004 q14 254 203 211 203 q15 577 532 519 519 q16 658 570 606 570 q17 981 670 549 549 q18 7211663567686635 q19 1356111310091009 q20 462 180 176 176 q21 4016319130413041 q22 373 310 314 310 Total cold run time: 107274 ms Total hot run time: 39776 ms - Round 2, with runtime_filter_mode=off - q1 7243724272037203 q2 327 234 231 231 q3 2879276429242764 q4 2062182618051805 q5 5705566656595659 q6 222 142 144 142 q7 2197176918101769 q8 3376356534913491 q9 8933911490059005 q10 3605355235403540 q11 629 508 522 508 q12 812 609 621 609 q13 11284 327432113211 q14 317 273 265 265 q15 579 503 514 503 q16 698 630 644 630 q17 1842164216301630 q18 8317770575877587 q19 1671150415621504 q20 2125184319381843 q21 5618537555205375 q22 643 598 552 552 Total cold run time: 71084 ms Total hot run time: 59826 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](binlog) Add Support recover binlog [doris]
github-actions[bot] commented on PR #44818: URL: https://github.com/apache/doris/pull/44818#issuecomment-2527688140 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor]refactor log workload group when query arrives be [doris]
github-actions[bot] commented on PR #45034: URL: https://github.com/apache/doris/pull/45034#issuecomment-2527676819 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement showTableCreationCommand in nereids #42776 [doris]
doris-robot commented on PR #44703: URL: https://github.com/apache/doris/pull/44703#issuecomment-2527672863 TPC-H: Total hot run time: 39806 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9da83fe1e7395c11fa68efaaf9cc0128828c9cbd, data reload: false -- Round 1 -- q1 17587 763873057305 q2 2066182 171 171 q3 10675 107411101074 q4 10571 746 695 695 q5 7887279727162716 q6 239 149 149 149 q7 989 645 609 609 q8 9219182819421828 q9 6656660564446444 q10 6970229523142295 q11 466 264 266 264 q12 427 229 221 221 q13 1 303830673038 q14 250 209 213 209 q15 562 537 513 513 q16 650 577 570 570 q17 992 544 588 544 q18 7215673565806580 q19 13441012947 947 q20 480 182 182 182 q21 4126330331333133 q22 381 319 324 319 Total cold run time: 107529 ms Total hot run time: 39806 ms - Round 2, with runtime_filter_mode=off - q1 7242722172967221 q2 323 231 224 224 q3 2911282629552826 q4 2088182518381825 q5 5696569956485648 q6 226 143 149 143 q7 2250182618121812 q8 3367352934723472 q9 9045912790489048 q10 3601357335273527 q11 626 512 496 496 q12 801 601 621 601 q13 9452324231973197 q14 300 272 270 270 q15 578 523 531 523 q16 710 629 661 629 q17 1834162615811581 q18 8281760576377605 q19 1686159315741574 q20 2128187318761873 q21 5585556355715563 q22 637 569 561 561 Total cold run time: 69367 ms Total hot run time: 60219 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](binlog) Add Support recover binlog [doris]
Vallishp commented on PR #44818: URL: https://github.com/apache/doris/pull/44818#issuecomment-2527679573 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) lock table in ascending order of table IDs [doris]
doris-robot commented on PR #45045: URL: https://github.com/apache/doris/pull/45045#issuecomment-2527696087 TPC-DS: Total hot run time: 191636 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a8a2891995bb45d4f185844b526340ce8bdaa1b6, data reload: false query1 965 382 382 382 query2 6524207220662066 query3 6707228 214 214 query4 33954 26291 23440 23440 query5 4383476 452 452 query6 276 188 190 188 query7 4645313 321 313 query8 301 243 239 239 query9 9614272127122712 query10 489 271 276 271 query11 18073 15375 15381 15375 query12 155 104 113 104 query13 1651419 428 419 query14 10364 692671016926 query15 274 190 187 187 query16 7535422 434 422 query17 1624603 543 543 query18 1933293 290 290 query19 363 153 156 153 query20 119 120 115 115 query21 207 104 100 100 query22 4563414243834142 query23 35230 34353 34493 34353 query24 11507 259825832583 query25 681 377 384 377 query26 1864155 151 151 query27 2884284 278 278 query28 8364243824282428 query29 983 409 407 407 query30 301 155 157 155 query31 1048831 847 831 query32 92 55 56 55 query33 771 303 322 303 query34 950 511 547 511 query35 874 748 748 748 query36 1086957 968 957 query37 218 73 71 71 query38 4581436643324332 query39 1476141914281419 query40 293 103 103 103 query41 49 44 48 44 query42 110 102 101 101 query43 540 500 500 500 query44 1345818 823 818 query45 188 172 179 172 query46 1174748 720 720 query47 1928183618391836 query48 428 312 311 311 query49 1293407 391 391 query50 812 370 394 370 query51 7281705571207055 query52 104 94 93 93 query53 272 190 187 187 query54 1194397 403 397 query55 82 90 82 82 query56 269 249 254 249 query57 1257111410981098 query58 232 217 218 217 query59 3096304829422942 query60 279 245 263 245 query61 111 106 125 106 query62 891 683 679 679 query63 218 197 187 187 query64 5195668 637 637 query65 3346322933593229 query66 1482345 337 337 query67 15965 15511 15468 15468 query68 5386556 553 553 query69 416 256 256 256 query70 1203115411501150 query71 338 253 247 247 query72 6410385140323851 query73 794 362 372 362 query74 10507 901289758975 query75 3465269126862686 query76 3205104511371045 query77 494 274 285 274 query78 10289 971794319431 query79 1638620 621 620 query80 1159447 451 447 query81 530 239 237 237 query82 741 116 121 116 query83 243 156 140 140 query84 232 72 72 72 query85 1400316 312 312 query86 433 306 303 303 query87 4826465246024602 query88 3606221121772177 query89 402 295 298 295 query90 2154190 189 189 query91 139 100 105 100 query92 61 54 50 50 query93 1391546 553 546 query94 1127289 303 289 query95 364 247 259 247 query96 617 279 294 279 query97 2864269526922692 query98 226 197 197 197 query99 1570131013181310 Total cold run time: 305293 ms Total hot run time: 191636 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement] (nereids)implement showTableCreationCommand in nereids #42776 [doris]
doris-robot commented on PR #44703: URL: https://github.com/apache/doris/pull/44703#issuecomment-2527698609 TPC-DS: Total hot run time: 197721 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9da83fe1e7395c11fa68efaaf9cc0128828c9cbd, data reload: false query1 1263960 954 954 query2 6231208020212021 query3 11097 451044554455 query4 67613 28594 23559 23559 query5 4926499 454 454 query6 424 196 181 181 query7 5514306 299 299 query8 326 243 251 243 query9 8448274427242724 query10 448 249 272 249 query11 17358 15325 15887 15325 query12 150 109 117 109 query13 1452460 428 428 query14 10677 729477197294 query15 224 197 187 187 query16 6949467 489 467 query17 1404576 590 576 query18 1800291 292 291 query19 216 152 155 152 query20 117 112 114 112 query21 213 114 102 102 query22 4793445944834459 query23 34909 34715 34573 34573 query24 5493248025082480 query25 489 399 381 381 query26 636 153 156 153 query27 1878292 286 286 query28 4513247824992478 query29 669 432 430 430 query30 209 159 185 159 query31 1043865 839 839 query32 68 65 54 54 query33 499 288 308 288 query34 932 525 529 525 query35 901 762 774 762 query36 1115933 966 933 query37 120 68 76 68 query38 4546442944334429 query39 1512150814551455 query40 204 96 98 96 query41 44 41 46 41 query42 119 97 100 97 query43 535 499 496 496 query44 1221840 834 834 query45 202 172 173 172 query46 1188739 752 739 query47 2049190619481906 query48 418 328 339 328 query49 746 383 390 383 query50 851 406 415 406 query51 7356714670277027 query52 98 88 94 88 query53 255 173 187 173 query54 513 387 394 387 query55 77 77 79 77 query56 254 237 229 229 query57 1253112211281122 query58 216 212 213 212 query59 3112291830452918 query60 277 255 254 254 query61 146 100 104 100 query62 783 679 673 673 query63 221 187 196 187 query64 1360663 630 630 query65 3313320731933193 query66 706 302 291 291 query67 15950 15720 15629 15629 query68 4051582 559 559 query69 419 257 257 257 query70 1201110611271106 query71 366 249 244 244 query72 6356419640434043 query73 762 358 356 356 query74 10316 917390379037 query75 3405263626722636 query76 1923108711381087 query77 470 297 267 267 query78 10466 943194579431 query79 1441610 608 608 query80 872 438 420 420 query81 501 341 236 236 query82 1277119 119 119 query83 254 149 149 149 query84 285 71 68 68 query85 879 295 303 295 query86 337 288 302 288 query87 4673458745394539 query88 3679220421752175 query89 419 300 299 299 query90 2000190 190 190 query91 183 104 102 102 query92 62 50 49 49 query93 1771545 540 540 query94 798 283 303 283 query95 349 252 249 249 query96 635 273 275 273 query97 2881268126632663 query98 218 202 202 202 query99 1770132913461329 Total cold run time: 319661 ms Total hot run time: 197721 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [opt](exec)Optimize SetOperator by removing unnecessary maintained elements. [doris]
doris-robot commented on PR #45195: URL: https://github.com/apache/doris/pull/45195#issuecomment-2527697329 TPC-H: Total hot run time: 40045 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d14fb30a9b111aa8c9e13386d936e05e498e9391, data reload: false -- Round 1 -- q1 17585 744673087308 q2 2050189 180 180 q3 10695 106911681069 q4 10565 790 719 719 q5 7591273927222722 q6 239 154 156 154 q7 1003627 626 626 q8 9248181119561811 q9 6646648164316431 q10 6992233623292329 q11 481 269 262 262 q12 421 221 229 221 q13 17752 302030413020 q14 242 212 212 212 q15 580 530 526 526 q16 638 594 586 586 q17 983 623 554 554 q18 7335667566256625 q19 13351035962 962 q20 483 188 184 184 q21 4009322632843226 q22 387 321 318 318 Total cold run time: 107260 ms Total hot run time: 40045 ms - Round 2, with runtime_filter_mode=off - q1 7271720472167204 q2 333 232 233 232 q3 2915284129732841 q4 2093182718681827 q5 5668569856505650 q6 229 148 148 148 q7 2252181018021802 q8 3395356335183518 q9 8979905590399039 q10 3602354935833549 q11 602 498 512 498 q12 865 589 615 589 q13 11750 320032293200 q14 303 277 287 277 q15 576 534 539 534 q16 676 653 671 653 q17 1885165116251625 q18 8355783476067606 q19 2550156616811566 q20 2111187118711871 q21 5498540253335333 q22 669 569 629 569 Total cold run time: 72577 ms Total hot run time: 60131 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Job](Fix)Improve Event Publishing with Timeout [doris]
doris-robot commented on PR #45103: URL: https://github.com/apache/doris/pull/45103#issuecomment-2527699147 TPC-DS: Total hot run time: 197458 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 56234593e352031d99ac4810a715317ff8db67b8, data reload: false query1 1260960 943 943 query2 6236208920292029 query3 11002 447744674467 query4 66950 28635 23572 23572 query5 4903446 449 446 query6 411 186 181 181 query7 5519301 297 297 query8 321 239 245 239 query9 8594271027132710 query10 432 247 242 242 query11 17114 15351 15875 15351 query12 150 109 108 108 query13 1430429 419 419 query14 9924801170527052 query15 234 191 200 191 query16 7123446 503 446 query17 1427617 592 592 query18 1831327 318 318 query19 220 164 161 161 query20 124 116 111 111 query21 209 106 106 106 query22 4669452144874487 query23 34696 34353 34438 34353 query24 5869249125572491 query25 487 377 386 377 query26 696 153 149 149 query27 2061277 299 277 query28 4377251025112510 query29 689 445 408 408 query30 218 150 155 150 query31 1032840 859 840 query32 75 55 55 55 query33 460 287 304 287 query34 977 532 553 532 query35 914 800 770 770 query36 1088945 968 945 query37 123 74 79 74 query38 4563448344804480 query39 1569147414911474 query40 199 104 103 103 query41 44 45 44 44 query42 120 99 104 99 query43 542 499 503 499 query44 1198838 856 838 query45 214 173 179 173 query46 1178744 757 744 query47 2004193919171917 query48 443 322 325 322 query49 741 392 394 392 query50 848 410 396 396 query51 7441724470317031 query52 101 89 93 89 query53 271 177 179 177 query54 521 398 387 387 query55 76 76 78 76 query56 256 236 249 236 query57 1255108211011082 query58 209 205 207 205 query59 3167300029932993 query60 270 243 250 243 query61 119 106 108 106 query62 806 659 671 659 query63 214 191 200 191 query64 1446671 641 641 query65 3277327532553255 query66 721 291 310 291 query67 15960 15686 15653 15653 query68 3706590 562 562 query69 488 253 250 250 query70 1190118111411141 query71 354 254 250 250 query72 6386409840584058 query73 791 356 374 356 query74 10348 897891678978 query75 3389263526902635 query76 1823108311221083 query77 458 268 267 267 query78 10574 947293949394 query79 1147602 610 602 query80 839 426 491 426 query81 486 243 225 225 query82 1342121 120 120 query83 254 146 146 146 query84 278 70 69 69 query85 870 298 311 298 query86 343 293 299 293 query87 4664451846144518 query88 3285219321582158 query89 421 299 302 299 query90 2067188 187 187 query91 142 102 101 101 query92 67 52 52 52 query93 1342530 536 530 query94 769 297 288 288 query95 350 250 242 242 query96 612 277 284 277 query97 2798267626572657 query98 224 208 187 187 query99 1614132713291327 Total cold run time: 317039 ms Total hot run time: 197458 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Feat](nereids) support ShowTabletStorageFormat command in nereids [doris]
doris-robot commented on PR #43295: URL: https://github.com/apache/doris/pull/43295#issuecomment-2527681774 TPC-H: Total hot run time: 39667 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 115dd25b173b26a0a6a72e650cb3501cd58ae619, data reload: false -- Round 1 -- q1 17635 739272647264 q2 2041181 171 171 q3 10584 106412031064 q4 10555 767 732 732 q5 7636265926002600 q6 238 144 146 144 q7 977 624 630 624 q8 9251183119281831 q9 6618650464176417 q10 7032225823052258 q11 457 263 262 262 q12 409 220 226 220 q13 17776 305230103010 q14 245 207 213 207 q15 569 540 523 523 q16 655 592 597 592 q17 966 522 558 522 q18 7264663467546634 q19 13311056956 956 q20 470 180 184 180 q21 3990313832173138 q22 388 318 324 318 Total cold run time: 107087 ms Total hot run time: 39667 ms - Round 2, with runtime_filter_mode=off - q1 7221725972167216 q2 329 238 233 233 q3 2917280529582805 q4 2040181817701770 q5 5709565356115611 q6 226 141 141 141 q7 2217182118331821 q8 3354354434503450 q9 8962905789658965 q10 3613357535813575 q11 599 507 495 495 q12 830 642 616 616 q13 11882 331032633263 q14 308 276 270 270 q15 580 533 529 529 q16 695 667 648 648 q17 1858161815841584 q18 8302777676477647 q19 1680148415531484 q20 2168189218741874 q21 5573538454345384 q22 661 592 556 556 Total cold run time: 71724 ms Total hot run time: 59937 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) lock table in ascending order of table IDs [doris]
doris-robot commented on PR #45045: URL: https://github.com/apache/doris/pull/45045#issuecomment-2527707018 ClickBench: Total hot run time: 32.73 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a8a2891995bb45d4f185844b526340ce8bdaa1b6, data reload: false query1 0.030.030.04 query2 0.070.030.04 query3 0.230.080.07 query4 1.620.110.10 query5 0.420.410.41 query6 1.160.660.67 query7 0.020.020.01 query8 0.050.030.03 query9 0.590.500.50 query10 0.570.550.57 query11 0.140.100.12 query12 0.130.110.11 query13 0.620.600.60 query14 2.792.872.84 query15 0.920.840.83 query16 0.380.400.36 query17 1.071.011.01 query18 0.220.210.21 query19 1.971.822.05 query20 0.020.010.01 query21 15.48 0.570.58 query22 2.783.062.60 query23 17.19 0.860.73 query24 2.860.910.44 query25 0.230.040.11 query26 0.420.130.14 query27 0.060.040.03 query28 11.72 1.091.08 query29 12.52 3.183.18 query30 0.250.070.06 query31 2.890.390.39 query32 3.250.470.45 query33 2.963.123.05 query34 16.85 4.454.44 query35 4.534.494.49 query36 0.670.470.48 query37 0.080.060.06 query38 0.040.030.04 query39 0.030.020.02 query40 0.150.130.12 query41 0.080.020.02 query42 0.030.020.02 query43 0.030.040.03 Total cold run time: 108.12 s Total hot run time: 32.73 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support ShowTabletStorageFormat command in nereids [doris]
doris-robot commented on PR #43295: URL: https://github.com/apache/doris/pull/43295#issuecomment-2527706700 TPC-DS: Total hot run time: 197033 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 115dd25b173b26a0a6a72e650cb3501cd58ae619, data reload: false query1 1234969 946 946 query2 6258208120192019 query3 10957 438644384386 query4 33192 23546 23668 23546 query5 3597481 462 462 query6 295 184 178 178 query7 3981296 313 296 query8 307 232 234 232 query9 9536271827112711 query10 445 237 255 237 query11 17896 15276 15343 15276 query12 157 107 104 104 query13 1577407 396 396 query14 9698684370896843 query15 251 192 205 192 query16 8045469 468 468 query17 1591590 583 583 query18 2141310 299 299 query19 340 145 146 145 query20 123 115 119 115 query21 207 104 107 104 query22 4868449046174490 query23 35265 34410 34642 34410 query24 10492 251024792479 query25 608 415 402 402 query26 1241157 147 147 query27 2517291 290 290 query28 7361248524712471 query29 828 423 397 397 query30 245 154 151 151 query31 1052888 834 834 query32 99 56 51 51 query33 760 292 298 292 query34 1021495 515 495 query35 901 783 773 773 query36 1131968 974 968 query37 159 75 76 75 query38 4560436344324363 query39 1523146415001464 query40 206 98 98 98 query41 44 41 43 41 query42 114 97 100 97 query43 526 480 492 480 query44 1242851 849 849 query45 187 171 169 169 query46 1188739 738 738 query47 2014195719501950 query48 428 321 330 321 query49 910 379 416 379 query50 840 392 393 392 query51 7412714972787149 query52 107 98 91 91 query53 271 192 187 187 query54 1109422 411 411 query55 83 76 80 76 query56 254 241 234 234 query57 1277117811711171 query58 231 213 211 211 query59 3241288629082886 query60 266 240 231 231 query61 105 101 113 101 query62 877 663 683 663 query63 210 187 183 183 query64 4017647 665 647 query65 3262318031953180 query66 844 307 306 306 query67 16389 15737 15628 15628 query68 4809572 567 567 query69 422 258 259 258 query70 1209115211671152 query71 345 262 288 262 query72 6334404840064006 query73 760 347 359 347 query74 10475 921789898989 query75 3442267326872673 query76 2715103510371035 query77 374 275 258 258 query78 10397 957895159515 query79 1763596 606 596 query80 1190426 429 426 query81 560 235 228 228 query82 811 124 117 117 query83 237 136 144 136 query84 227 65 68 65 query85 1436287 290 287 query86 459 302 283 283 query87 4772462345734573 query88 3826218921632163 query89 429 289 281 281 query90 2119185 182 182 query91 131 98 103 98 query92 59 49 48 48 query93 2285546 539 539 query94 1036293 294 293 query95 344 254 253 253 query96 623 273 290 273 query97 2872268326722672 query98 221 198 191 191 query99 1551130813251308 Total cold run time: 302346 ms Total hot run time: 197033 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Enhancement] (nereids)implement showTableCreationCommand in nereids #42776 [doris]
doris-robot commented on PR #44703: URL: https://github.com/apache/doris/pull/44703#issuecomment-2527709669 ClickBench: Total hot run time: 32.76 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9da83fe1e7395c11fa68efaaf9cc0128828c9cbd, data reload: false query1 0.030.030.04 query2 0.060.040.03 query3 0.230.060.07 query4 1.630.100.10 query5 0.420.420.40 query6 1.160.640.66 query7 0.020.010.01 query8 0.040.040.03 query9 0.590.510.50 query10 0.550.560.55 query11 0.140.100.11 query12 0.140.110.12 query13 0.620.610.61 query14 2.702.862.72 query15 0.960.920.82 query16 0.380.390.37 query17 1.081.061.05 query18 0.220.210.21 query19 2.001.852.01 query20 0.010.010.01 query21 15.36 0.590.58 query22 2.412.501.91 query23 17.01 0.950.82 query24 2.970.791.07 query25 0.140.320.18 query26 0.330.130.14 query27 0.040.040.05 query28 11.13 1.101.06 query29 12.65 3.313.29 query30 0.250.070.06 query31 2.860.390.38 query32 3.300.460.47 query33 3.003.083.09 query34 17.23 4.504.48 query35 4.544.504.58 query36 0.670.500.49 query37 0.090.060.06 query38 0.040.030.03 query39 0.040.020.02 query40 0.170.130.13 query41 0.080.030.02 query42 0.040.020.03 query43 0.040.030.03 Total cold run time: 107.37 s Total hot run time: 32.76 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](mtmv)Paimon queries the data in the cache instead of querying the latest data [doris]
doris-robot commented on PR #44911: URL: https://github.com/apache/doris/pull/44911#issuecomment-2527710224 TPC-DS: Total hot run time: 196514 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1de646f5174a149c70c6f94640df38f22b1dc79e, data reload: false query1 1244965 913 913 query2 6236208120462046 query3 10925 442143224322 query4 66334 28857 23567 23567 query5 4940461 444 444 query6 407 173 168 168 query7 5541302 292 292 query8 323 234 231 231 query9 8821270026982698 query10 425 260 242 242 query11 17272 15180 15947 15180 query12 143 102 101 101 query13 1483419 405 405 query14 10353 675274626752 query15 207 185 195 185 query16 7041463 457 457 query17 1234580 609 580 query18 1789306 308 306 query19 201 151 148 148 query20 116 109 108 108 query21 216 100 101 100 query22 4679465346584653 query23 34986 34905 34366 34366 query24 5421248025672480 query25 484 379 381 379 query26 646 147 147 147 query27 1959282 293 282 query28 4368247624722472 query29 701 425 412 412 query30 205 148 147 147 query31 944 815 843 815 query32 66 53 58 53 query33 423 299 288 288 query34 920 499 537 499 query35 874 779 775 775 query36 1102938 968 938 query37 124 77 78 77 query38 4513434445494344 query39 1544150814831483 query40 197 99 107 99 query41 43 41 41 41 query42 114 100 108 100 query43 522 501 485 485 query44 1216841 839 839 query45 193 177 177 177 query46 1169729 730 729 query47 2031192519411925 query48 424 317 322 317 query49 741 389 384 384 query50 856 402 423 402 query51 7491714870817081 query52 98 88 87 87 query53 252 177 171 171 query54 501 393 380 380 query55 76 73 74 73 query56 249 238 242 238 query57 1231112111221121 query58 212 213 202 202 query59 3038299831252998 query60 259 241 243 241 query61 107 105 103 103 query62 822 684 646 646 query63 201 179 184 179 query64 1369660 623 623 query65 3309318031603160 query66 696 294 289 289 query67 15964 15642 15572 15572 query68 3865576 560 560 query69 420 244 245 244 query70 1194109511381095 query71 341 243 253 243 query72 6380401640074007 query73 761 353 348 348 query74 10089 908090259025 query75 3395264527112645 query76 1878105310891053 query77 477 280 258 258 query78 10529 947894749474 query79 1164594 606 594 query80 739 424 427 424 query81 488 239 235 235 query82 1331118 119 118 query83 168 150 151 150 query84 281 74 76 74 query85 843 362 385 362 query86 328 291 296 291 query87 4665457945394539 query88 3386219421532153 query89 419 284 289 284 query90 2079184 179 179 query91 130 103 99 99 query92 56 48 51 48 query93 1310523 528 523 query94 748 290 310 290 query95 344 249 252 249 query96 604 274 281 274 query97 2825266826972668 query98 215 203 196 196 query99 1570130712951295 Total cold run time: 315613 ms Total hot run time: 196514 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Job](Fix)Improve Event Publishing with Timeout [doris]
doris-robot commented on PR #45103: URL: https://github.com/apache/doris/pull/45103#issuecomment-2527710163 ClickBench: Total hot run time: 32.36 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 56234593e352031d99ac4810a715317ff8db67b8, data reload: false query1 0.030.030.05 query2 0.080.030.03 query3 0.230.070.07 query4 1.630.100.10 query5 0.430.410.41 query6 1.140.650.65 query7 0.020.010.02 query8 0.040.040.03 query9 0.590.500.50 query10 0.550.570.60 query11 0.140.100.10 query12 0.140.110.11 query13 0.610.610.60 query14 2.832.742.75 query15 0.910.820.82 query16 0.380.380.38 query17 1.061.061.05 query18 0.230.210.21 query19 1.861.762.04 query20 0.010.010.01 query21 15.38 0.560.58 query22 2.512.431.53 query23 17.13 0.890.69 query24 2.901.471.19 query25 0.250.230.17 query26 0.460.130.13 query27 0.040.040.04 query28 10.42 1.101.07 query29 12.57 3.223.24 query30 0.240.060.06 query31 2.860.380.38 query32 3.290.470.46 query33 2.982.983.14 query34 16.97 4.444.48 query35 4.544.494.48 query36 0.680.480.48 query37 0.090.060.06 query38 0.050.030.04 query39 0.030.020.02 query40 0.160.120.12 query41 0.070.030.02 query42 0.030.030.02 query43 0.040.030.03 Total cold run time: 106.6 s Total hot run time: 32.36 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support auto analyze columns that haven't been analyzed for a long time. [doris]
doris-robot commented on PR #42399: URL: https://github.com/apache/doris/pull/42399#issuecomment-2527711725 TPC-H: Total hot run time: 39880 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9cb6827dd47fde8bd54e1ecd5dd2aa86454a5a66, data reload: false -- Round 1 -- q1 17589 743672777277 q2 2035178 165 165 q3 10612 109411731094 q4 10547 729 745 729 q5 7617267926512651 q6 245 147 143 143 q7 1018627 605 605 q8 9248188519161885 q9 6581641364466413 q10 7021228922992289 q11 465 265 261 261 q12 421 223 231 223 q13 17790 302430813024 q14 232 220 215 215 q15 583 532 521 521 q16 675 615 600 600 q17 980 518 572 518 q18 7122672866376637 q19 1334938 976 938 q20 460 185 181 181 q21 4006319632203196 q22 375 320 315 315 Total cold run time: 106956 ms Total hot run time: 39880 ms - Round 2, with runtime_filter_mode=off - q1 7247722872637228 q2 325 233 232 232 q3 2932281829692818 q4 2097184718241824 q5 5629564056605640 q6 223 145 141 141 q7 2269179018031790 q8 3384356634823482 q9 8973903089598959 q10 3588355835663558 q11 604 509 519 509 q12 800 607 618 607 q13 12028 321532263215 q14 306 272 289 272 q15 564 543 549 543 q16 699 652 640 640 q17 1868165116301630 q18 8294772573737373 q19 1689157015561556 q20 2105190619191906 q21 5559548555445485 q22 674 569 569 569 Total cold run time: 71857 ms Total hot run time: 59977 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Enhancement](cloud) Add concurrency for tablet stats processing #43903 [doris]
Yukang-Lian commented on PR #44763: URL: https://github.com/apache/doris/pull/44763#issuecomment-2527712220 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures #42949 [doris]
gavinchou merged PR #43970: URL: https://github.com/apache/doris/pull/43970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-3.0 updated (ae3f4fe7fe5 -> 0964b6dcde4)
This is an automated email from the ASF dual-hosted git repository. gavinchou pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from ae3f4fe7fe5 branch-3.0: [Audit](fix) fix audit log lost for npe #44145 (#45188) add 0964b6dcde4 branch-3.0: [Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures #42949 (#43970) No new revisions were added by this update. Summary of changes: be/src/common/config.cpp | 1 + be/src/common/config.h| 1 + be/src/olap/olap_common.h | 10 +- be/src/olap/rowset/unique_rowset_id_generator.cpp | 9 + 4 files changed, 20 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-42949-branch-3.0 deleted (was ab072829fba)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-42949-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git was ab072829fba [Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures (#42949) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support auto analyze columns that haven't been analyzed for a long time. [doris]
Jibing-Li commented on PR #42399: URL: https://github.com/apache/doris/pull/42399#issuecomment-2527637217 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
github-actions[bot] commented on PR #44929: URL: https://github.com/apache/doris/pull/44929#issuecomment-2527684263 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support ShowTabletStorageFormat command in nereids [doris]
doris-robot commented on PR #43295: URL: https://github.com/apache/doris/pull/43295#issuecomment-2527718691 ClickBench: Total hot run time: 32.22 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 115dd25b173b26a0a6a72e650cb3501cd58ae619, data reload: false query1 0.030.030.02 query2 0.070.030.03 query3 0.240.070.07 query4 1.620.100.11 query5 0.430.430.41 query6 1.150.660.66 query7 0.020.010.02 query8 0.040.030.03 query9 0.610.490.48 query10 0.550.550.57 query11 0.140.100.10 query12 0.140.110.12 query13 0.600.600.61 query14 2.722.752.85 query15 0.910.830.83 query16 0.370.400.37 query17 1.021.081.06 query18 0.230.200.20 query19 1.901.831.96 query20 0.010.010.01 query21 15.36 0.610.57 query22 2.461.981.62 query23 17.18 0.880.80 query24 3.200.721.54 query25 0.300.140.23 query26 0.330.140.14 query27 0.030.050.05 query28 10.35 1.091.07 query29 12.54 3.273.26 query30 0.240.060.06 query31 2.860.400.37 query32 3.260.490.46 query33 3.003.083.03 query34 17.23 4.444.50 query35 4.614.484.52 query36 0.660.470.48 query37 0.080.060.06 query38 0.040.040.04 query39 0.030.030.02 query40 0.160.130.13 query41 0.080.030.02 query42 0.030.030.02 query43 0.030.030.03 Total cold run time: 106.86 s Total hot run time: 32.22 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor]refactor log workload group when query arrives be [doris]
wangbo commented on PR #45034: URL: https://github.com/apache/doris/pull/45034#issuecomment-2527720944 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](compaction)Optimize compaction task permit allocation [doris]
doris-robot commented on PR #45197: URL: https://github.com/apache/doris/pull/45197#issuecomment-2527766736 TPC-H: Total hot run time: 39867 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1084df50d9f01420ec9bb1be037012e453fc8e5e, data reload: false -- Round 1 -- q1 17602 754273237323 q2 2050182 168 168 q3 10625 110211541102 q4 10574 743 739 739 q5 7610272425932593 q6 239 149 147 147 q7 1002630 606 606 q8 9261185919271859 q9 6639646964616461 q10 7026232123482321 q11 466 255 253 253 q12 431 232 224 224 q13 17769 306530543054 q14 246 208 206 206 q15 578 552 526 526 q16 653 591 591 591 q17 969 573 565 565 q18 7236667367606673 q19 13451057975 975 q20 467 192 184 184 q21 4132314329762976 q22 390 322 321 321 Total cold run time: 107310 ms Total hot run time: 39867 ms - Round 2, with runtime_filter_mode=off - q1 7223726272397239 q2 340 233 229 229 q3 2917278529452785 q4 2057181418041804 q5 5663565356385638 q6 229 147 141 141 q7 2241176517961765 q8 3379357034833483 q9 9080903890739038 q10 3595355135653551 q11 601 501 507 501 q12 791 603 604 603 q13 10159 324531933193 q14 321 270 267 267 q15 575 534 535 534 q16 668 666 635 635 q17 1878162216291622 q18 8226768874737473 q19 1705156315881563 q20 2119190918641864 q21 5717554654235423 q22 683 573 560 560 Total cold run time: 70167 ms Total hot run time: 59911 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test Pr/englefly/45196] [doris]
Mryange commented on PR #45198: URL: https://github.com/apache/doris/pull/45198#issuecomment-2527801029 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.1) Pick "[Fix](Rowset Id) Use a randomly generated rowset ID to handle memory write failures (#42949)" [doris]
github-actions[bot] commented on PR #44086: URL: https://github.com/apache/doris/pull/44086#issuecomment-2527765224 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) not rewrite first_value when first_value ignore nulls [doris]
doris-robot commented on PR #45065: URL: https://github.com/apache/doris/pull/45065#issuecomment-2527782200 TPC-DS: Total hot run time: 197688 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 286d2c8887b1c87eb90514d90973127662fa9b72, data reload: false query1 1251934 944 934 query2 6245205020412041 query3 10964 442246304422 query4 33028 23494 23500 23494 query5 3555488 475 475 query6 278 189 185 185 query7 3974302 319 302 query8 307 244 233 233 query9 9696270627022702 query10 470 259 259 259 query11 17968 15207 15181 15181 query12 158 101 102 101 query13 1546421 394 394 query14 9691720372417203 query15 285 205 188 188 query16 8048457 475 457 query17 1605579 605 579 query18 2183300 319 300 query19 300 161 166 161 query20 118 116 118 116 query21 202 108 108 108 query22 4780460344484448 query23 35266 34721 34908 34721 query24 10451 254225022502 query25 620 389 384 384 query26 1221167 155 155 query27 2605290 290 290 query28 7927247824542454 query29 824 432 409 409 query30 237 153 160 153 query31 1061852 829 829 query32 97 57 61 57 query33 786 310 311 310 query34 1093534 540 534 query35 921 770 782 770 query36 1139964 977 964 query37 146 80 80 80 query38 4566432944184329 query39 1532146514511451 query40 220 109 112 109 query41 47 48 48 48 query42 119 103 101 101 query43 581 491 483 483 query44 1275855 850 850 query45 194 169 187 169 query46 1182741 750 741 query47 2032191019411910 query48 439 318 329 318 query49 956 394 380 380 query50 871 403 406 403 query51 7496726172627261 query52 101 87 93 87 query53 266 183 187 183 query54 1335440 407 407 query55 80 81 81 81 query56 261 249 252 249 query57 1341113111621131 query58 228 219 215 215 query59 3248310129872987 query60 265 238 232 232 query61 107 103 105 103 query62 884 669 660 660 query63 219 188 182 182 query64 4077663 636 636 query65 3289317831983178 query66 830 302 294 294 query67 16019 15607 15546 15546 query68 4850544 557 544 query69 436 254 260 254 query70 1170113611421136 query71 340 248 262 248 query72 6323409740484048 query73 772 351 355 351 query74 10664 914491679144 query75 3424269126722672 query76 2835102612071026 query77 422 276 279 276 query78 10426 947993349334 query79 1216600 614 600 query80 999 453 446 446 query81 514 240 232 232 query82 1305124 112 112 query83 221 154 145 145 query84 238 69 69 69 query85 1316303 291 291 query86 386 300 314 300 query87 4750453345414533 query88 3060223221792179 query89 422 298 291 291 query90 1941188 182 182 query91 138 99 101 99 query92 66 50 49 49 query93 1190534 535 534 query94 877 291 296 291 query95 349 252 248 248 query96 609 272 277 272 query97 2847267326662666 query98 219 192 201 192 query99 1573130513181305 Total cold run time: 301004 ms Total hot run time: 197688 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement](compaction)Optimize compaction task permit allocation [doris]
doris-robot commented on PR #45197: URL: https://github.com/apache/doris/pull/45197#issuecomment-2527792750 TPC-DS: Total hot run time: 197678 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1084df50d9f01420ec9bb1be037012e453fc8e5e, data reload: false query1 1237969 950 950 query2 6250202519651965 query3 10967 458546694585 query4 33584 23682 23431 23431 query5 3502473 448 448 query6 293 198 179 179 query7 3984298 313 298 query8 297 241 249 241 query9 9596273127312731 query10 478 253 253 253 query11 17730 15379 15263 15263 query12 156 102 102 102 query13 1556423 400 400 query14 9506728973697289 query15 251 212 189 189 query16 8006470 474 470 query17 1538590 597 590 query18 2173326 303 303 query19 358 159 159 159 query20 117 109 112 109 query21 212 111 103 103 query22 4973436543194319 query23 35906 34506 34770 34506 query24 10964 253924332433 query25 638 427 420 420 query26 1247207 157 157 query27 2437302 292 292 query28 7484250524492449 query29 836 418 407 407 query30 237 153 152 152 query31 1041878 818 818 query32 100 55 54 54 query33 775 292 301 292 query34 1049536 552 536 query35 875 768 781 768 query36 1129964 965 964 query37 149 81 74 74 query38 4501449744624462 query39 1513146914821469 query40 207 108 104 104 query41 48 44 43 43 query42 117 100 95 95 query43 539 491 504 491 query44 1322849 837 837 query45 198 170 172 170 query46 1200728 750 728 query47 2057191319541913 query48 419 320 327 320 query49 927 423 397 397 query50 842 416 404 404 query51 7679725472517251 query52 105 93 91 91 query53 259 188 198 188 query54 1207408 427 408 query55 86 85 77 77 query56 291 245 244 244 query57 1237109111091091 query58 231 205 199 199 query59 3120297629502950 query60 268 246 238 238 query61 110 110 105 105 query62 849 658 670 658 query63 214 198 187 187 query64 3964661 629 629 query65 3302325932373237 query66 735 309 299 299 query67 16037 15765 15503 15503 query68 4519555 555 555 query69 415 250 255 250 query70 1183116211301130 query71 371 252 250 250 query72 6379416240864086 query73 779 365 366 365 query74 10216 899990858999 query75 3352269126912691 query76 2561111210501050 query77 419 294 288 288 query78 10374 954194239423 query79 1114596 613 596 query80 883 437 442 437 query81 557 234 238 234 query82 544 122 117 117 query83 241 145 149 145 query84 231 75 70 70 query85 1229303 372 303 query86 371 287 293 287 query87 4713471645334533 query88 3271224121952195 query89 424 299 292 292 query90 1879192 188 188 query91 138 104 101 101 query92 61 51 51 51 query93 1679551 536 536 query94 689 298 299 298 query95 345 252 254 252 query96 629 279 288 279 query97 2871267227012672 query98 211 202 201 201 query99 1539131713291317 Total cold run time: 299402 ms Total hot run time: 197678 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement](compaction)Optimize compaction task permit allocation [doris]
doris-robot commented on PR #45197: URL: https://github.com/apache/doris/pull/45197#issuecomment-2527805022 ClickBench: Total hot run time: 32.72 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1084df50d9f01420ec9bb1be037012e453fc8e5e, data reload: false query1 0.030.030.03 query2 0.070.030.04 query3 0.230.070.07 query4 1.620.100.11 query5 0.430.400.40 query6 1.160.660.65 query7 0.020.020.01 query8 0.050.040.02 query9 0.570.520.51 query10 0.550.540.54 query11 0.140.100.11 query12 0.140.110.12 query13 0.610.610.60 query14 2.722.872.76 query15 0.920.830.83 query16 0.380.380.39 query17 1.061.031.05 query18 0.230.210.21 query19 1.961.882.02 query20 0.010.010.01 query21 15.36 0.580.58 query22 2.511.641.47 query23 17.07 0.940.84 query24 3.081.511.39 query25 0.230.180.07 query26 0.520.130.13 query27 0.050.050.04 query28 10.33 1.101.08 query29 12.55 3.203.18 query30 0.250.060.07 query31 2.870.390.37 query32 3.260.480.46 query33 3.013.043.04 query34 16.81 4.494.45 query35 4.524.494.51 query36 0.650.490.48 query37 0.090.060.06 query38 0.040.030.03 query39 0.030.030.03 query40 0.170.130.13 query41 0.080.020.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 106.46 s Total hot run time: 32.72 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) not rewrite first_value when first_value ignore nulls [doris]
doris-robot commented on PR #45065: URL: https://github.com/apache/doris/pull/45065#issuecomment-2527793897 ClickBench: Total hot run time: 32.63 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 286d2c8887b1c87eb90514d90973127662fa9b72, data reload: false query1 0.040.030.03 query2 0.070.030.03 query3 0.230.070.07 query4 1.610.110.10 query5 0.430.430.42 query6 1.170.670.65 query7 0.020.010.01 query8 0.040.030.04 query9 0.610.520.51 query10 0.550.540.57 query11 0.150.100.11 query12 0.150.120.10 query13 0.610.620.59 query14 2.822.762.86 query15 0.910.830.83 query16 0.380.400.40 query17 1.071.071.00 query18 0.240.210.21 query19 1.991.822.01 query20 0.020.010.01 query21 15.37 0.580.59 query22 3.071.731.22 query23 17.10 0.960.82 query24 2.881.571.68 query25 0.270.110.14 query26 0.500.140.13 query27 0.040.040.04 query28 9.691.111.07 query29 12.57 3.243.22 query30 0.240.060.06 query31 2.880.380.37 query32 3.260.470.47 query33 2.983.033.04 query34 16.96 4.464.48 query35 4.524.574.48 query36 0.650.490.48 query37 0.090.060.06 query38 0.040.040.04 query39 0.040.030.02 query40 0.160.120.12 query41 0.090.020.02 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 106.58 s Total hot run time: 32.63 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch master updated: [doc](update) rewrite update overview doc (#1393)
This is an automated email from the ASF dual-hosted git repository. zhangchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 13936a420d6 [doc](update) rewrite update overview doc (#1393) 13936a420d6 is described below commit 13936a420d6443551c23317d0151d7724306dc9d Author: zhannngchen AuthorDate: Mon Dec 9 20:42:31 2024 +0800 [doc](update) rewrite update overview doc (#1393) # Versions - [x] dev - [x] 3.0 - [x] 2.1 - [x] 2.0 # Languages - [x] Chinese - [x] English --- docs/data-operate/update/update-overview.md| 81 ++- .../current/data-operate/update/update-overview.md | 86 - .../data-operate/update/update-overview.md | 88 - .../data-operate/update/update-overview.md | 90 -- .../data-operate/update/update-overview.md | 88 - .../data-operate/update/update-overview.md | 80 +++ .../data-operate/update/update-overview.md | 80 +++ .../data-operate/update/update-overview.md | 82 +++- 8 files changed, 385 insertions(+), 290 deletions(-) diff --git a/docs/data-operate/update/update-overview.md b/docs/data-operate/update/update-overview.md index aff46a96c55..1515852091d 100644 --- a/docs/data-operate/update/update-overview.md +++ b/docs/data-operate/update/update-overview.md @@ -23,8 +23,33 @@ KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> +Data update refers to modifying the value columns in data records with the same key. The handling of data updates varies for different data models: -Data update primarily refers to the modification of the value column of data with the same key. For the primary(unique) key model, this update involves replacing the existing value, while for the aggregate model, it involves aggregating the values in the value column. +- **Primary Key (Unique) Model**: The primary key model is specifically designed for data updates. Doris supports two storage implementations: Merge-on-Read (MoR) and Merge-on-Write (MoW). MoR optimizes write performance, while MoW provides better analytical performance. From Doris version 2.1, the default storage method is MoW. The primary key model supports using the `UPDATE` statement for small data updates and also supports batch updates through data loading. Loading methods include [...] + +- **Aggregate Model**: In the aggregate model, data update is a special use case. When the aggregate function is set to REPLACE or REPLACE_IF_NOT_NULL, data updates can be achieved. The aggregate model only supports updates based on data loading and does not support using the `UPDATE` statement. By setting the aggregate function to REPLACE_IF_NOT_NULL, partial column update capability can be achieved. + +By understanding the data update methods of different models, you can better choose the appropriate update strategy to meet specific business needs. + +## Comparison of Update Capabilities for Different Models/Implementations + +### Performance Comparison +|| Unique Key MoW | Unique Key MoR [...] +||---|-- [...] +| Import Speed | Deduplication is performed during import. Small-batch real-time writes incur approximately 10%-20% performance loss compared to MoR, while large-batch imports (e.g., tens or hundreds of millions of records) have about 30%-50% performance loss compared to MoR. | Similar to Duplicate Key [...] +| Query Speed| Similar to Duplicate Key
Re: [PR] [doc](update) rewrite update overview doc [doris-website]
zhannngchen merged PR #1393: URL: https://github.com/apache/doris-website/pull/1393 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Enhancement](cloud) Add concurrency for tablet stats processing #43903 [doris]
doris-robot commented on PR #44763: URL: https://github.com/apache/doris/pull/44763#issuecomment-2527814083 TPC-H: Total hot run time: 40922 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 35652d1634f7ffced8841cdde1478b380919fb2e, data reload: false -- Round 1 -- q1 17904 748973537353 q2 2062169 163 163 q3 10630 112611891126 q4 10251 759 720 720 q5 7721288327642764 q6 240 146 144 144 q7 972 614 602 602 q8 9356194820201948 q9 6729684564686468 q10 7023230123322301 q11 462 262 268 262 q12 447 214 217 214 q13 17792 300430023002 q14 235 206 212 206 q15 565 513 538 513 q16 685 607 597 597 q17 992 573 616 573 q18 7455669766846684 q19 2938104810091009 q20 470 199 196 196 q21 3875317331163116 q22 1090961 965 961 Total cold run time: 109894 ms Total hot run time: 40922 ms - Round 2, with runtime_filter_mode=off - q1 7471723572577235 q2 323 227 223 223 q3 2936274528342745 q4 2048173817731738 q5 5729565057305650 q6 224 143 141 141 q7 2124170417441704 q8 3379362135123512 q9 8957858588608585 q10 3569353535613535 q11 606 503 495 495 q12 835 628 602 602 q13 17660 308930753075 q14 289 270 284 270 q15 567 531 506 506 q16 682 667 675 667 q17 1860163716191619 q18 8205789177577757 q19 4388163316481633 q20 2092182818421828 q21 5449529051945194 q22 11521003997 997 Total cold run time: 80545 ms Total hot run time: 59711 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [update] Update auth docs [doris-website]
KassieZ merged PR #1485: URL: https://github.com/apache/doris-website/pull/1485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch master updated: [update] Update auth docs (#1485)
This is an automated email from the ASF dual-hosted git repository.
kassiez pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new a02c7841854 [update] Update auth docs (#1485)
a02c7841854 is described below
commit a02c7841854b63a412730fc2d62dc427a60d2b57
Author: KassieZ <139741991+kass...@users.noreply.github.com>
AuthorDate: Mon Dec 9 20:44:19 2024 +0800
[update] Update auth docs (#1485)
## Versions
- [x] dev
- [x] 3.0
- [x] 2.1
- [ ] 2.0
## Languages
- [x] Chinese
- [x] English
## Docs Checklist
- [ ] Checked by AI
- [ ] Test Cases Built
---
.../auth/authentication-and-authorization.md | 502 ++---
.../admin-manual/auth}/encryption-function.md | 2 +-
.../admin-manual/auth}/encryption-function.md | 4 +-
.../admin-manual/auth}/encryption-function.md | 4 +-
.../admin-manual/auth}/encryption-function.md | 4 +-
sidebars.json | 6 +-
.../auth}/encryption-function.md | 2 +-
.../admin-manual/auth}/encryption-function.md | 2 +-
versioned_sidebars/version-2.1-sidebars.json | 6 +-
versioned_sidebars/version-3.0-sidebars.json | 6 +-
10 files changed, 269 insertions(+), 269 deletions(-)
diff --git a/docs/admin-manual/auth/authentication-and-authorization.md
b/docs/admin-manual/auth/authentication-and-authorization.md
index 093c32ac5c6..977680bec39 100644
--- a/docs/admin-manual/auth/authentication-and-authorization.md
+++ b/docs/admin-manual/auth/authentication-and-authorization.md
@@ -1,7 +1,7 @@
---
{
- "title": "Workload Group",
- "language": "en"
+"title": "Authentication and Authorization",
+"language": "en"
}
---
@@ -24,336 +24,336 @@ specific language governing permissions and limitations
under the License.
-->
-You can use Workload Groups to manage the CPU, memory, and I/O resources used
by queries and imports in the Doris cluster, and to control the maximum
concurrency of queries in the cluster. Permissions for Workload Groups can be
granted to specific roles and users.
+The Doris permission management system is modeled after the MySQL permission
management mechanism. It supports fine-grained permission control at the row
and column level, role-based access control, and also supports a whitelist
mechanism.
-Workload Groups are particularly effective in the following scenarios:
-1. For scenarios where performance stability is preferred, and it is not
required for query load to utilize all cluster resources, but stable query
latency is desired. In such cases, you can set hard limits on CPU/I/O for
Workload Groups.
-2. When overall cluster load is high and availability decreases, you can
restore cluster availability by degrading Workload Groups that consume
excessive resources. For example, reduce the maximum query concurrency and I/O
throughput for these Workload Groups.
+## Glossary
-Using hard limits for resource management usually results in better stability
and performance, such as configuring maximum concurrency for FE and setting
hard limits on CPU. Soft limits on CPU typically only have an effect when the
CPU is fully utilized, which can lead to increased latency due to resource
contention with other Doris components (RPC) and the operating system.
Configuring hard limits for Doris query loads can effectively mitigate this
issue. Additionally, setting maximum c [...]
+1. User Identity
-## Version Description
-Workload Group is a feature that has been supported since version 2.0. The
main difference between version 2.0 and 2.1 is that the 2.0 version of Workload
Group does not rely on CGroup, while the 2.1 version of Workload Group depends
on CGroup. Therefore, when using the 2.1 version of Workload Group, the
environment of CGroup needs to be configured.
+ Within a permission system, a user is identified as a User Identity. A User
Identity consists of two parts: `username` and `host`. The `username` is the
user's name, consisting of English letters (both uppercase and lowercase).
`host` represents the IP from which the user connection originates. User
Identity is represented as `username@'host'`, indicating `username` from `host`.
- Upgrade to version 2.0
-If upgrading from version 1.2 to version 2.0, it is recommended to enable the
WorkloadGroup after the overall upgrade of the Doris cluster is completed.
Because if you only upgrade a single Follower and enable this feature, as the
FE code of the Master has not been updated yet, there is no metadata
information for Workload Group in the Doris cluster, which may cause queries
for the upgraded Follower nodes to fail. The recommended upgrade process is as
follows:
-* First, upgrade the overall code of the Doris cluster to version 2.0.
-* Start u
Re: [PR] [fix](nereids) not rewrite first_value when first_value ignore nulls [doris]
feiniaofeiafei commented on PR #45065: URL: https://github.com/apache/doris/pull/45065#issuecomment-2527825940 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](pipeline) set wake_up_early when pipeline task's sink not executed with eos [doris]
github-actions[bot] commented on code in PR #45207:
URL: https://github.com/apache/doris/pull/45207#discussion_r1875936801
##
be/src/pipeline/pipeline_task.cpp:
##
@@ -289,12 +290,17 @@ bool PipelineTask::_is_blocked() {
}
Status PipelineTask::execute(bool* eos) {
Review Comment:
warning: function 'execute' has cognitive complexity of 61 (threshold 50)
[readability-function-cognitive-complexity]
```cpp
Status PipelineTask::execute(bool* eos) {
^
```
Additional context
**be/src/pipeline/pipeline_task.cpp:297:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_sink->is_finished(_state)) {
^
```
**be/src/pipeline/pipeline_task.cpp:302:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (*eos) {
^
```
**be/src/pipeline/pipeline_task.cpp:307:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
DBUG_EXECUTE_IF("fault_inject::PipelineXTask::execute", {
^
```
**be/src/util/debug_points.h:36:** expanded from macro 'DBUG_EXECUTE_IF'
```cpp
if (UNLIKELY(config::enable_debug_points)) {
\
^
```
**be/src/pipeline/pipeline_task.cpp:307:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
DBUG_EXECUTE_IF("fault_inject::PipelineXTask::execute", {
^
```
**be/src/util/debug_points.h:38:** expanded from macro 'DBUG_EXECUTE_IF'
```cpp
if (dp) {
\
^
```
**be/src/pipeline/pipeline_task.cpp:325:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_wait_to_start()) {
^
```
**be/src/pipeline/pipeline_task.cpp:328:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (_wake_up_early) {
^
```
**be/src/pipeline/pipeline_task.cpp:333:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
if (!_opened && !_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:333:** +1
```cpp
if (!_opened && !_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:334:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
RETURN_IF_ERROR(_open());
^
```
**be/src/common/status.h:632:** expanded from macro 'RETURN_IF_ERROR'
```cpp
do {\
^
```
**be/src/pipeline/pipeline_task.cpp:334:** +3, including nesting penalty of
2, nesting level increased to 3
```cpp
RETURN_IF_ERROR(_open());
^
```
**be/src/common/status.h:634:** expanded from macro 'RETURN_IF_ERROR'
```cpp
if (UNLIKELY(!_status_.ok())) { \
^
```
**be/src/pipeline/pipeline_task.cpp:339:** +1, including nesting penalty of
0, nesting level increased to 1
```cpp
while (!_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:340:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_is_blocked()) {
^
```
**be/src/pipeline/pipeline_task.cpp:343:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_wake_up_early) {
^
```
**be/src/pipeline/pipeline_task.cpp:351:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (_fragment_context->is_canceled()) {
^
```
**be/src/pipeline/pipeline_task.cpp:355:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (time_spent > THREAD_TIME_SLICE) {
^
```
**be/src/pipeline/pipeline_task.cpp:363:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
if (should_revoke_memory(_state, sink_revocable_mem_size)) {
^
```
**be/src/pipeline/pipeline_task.cpp:364:** +3, including nesting penalty of
2, nesting level increased to 3
```cpp
RETURN_IF_ERROR(_sink->revoke_memory(_state));
^
```
**be/src/common/status.h:632:** expanded from macro 'RETURN_IF_ERROR'
```cpp
do {\
^
```
**be/src/pipeline/pipeline_task.cpp:364:** +4, including nesting penalty of
3, nesting level increased to 4
```cpp
RETURN_IF_ERROR(_sink->revoke_memory(_state));
^
```
**be/src/common/status.h:634:** expanded from macro 'RETURN_IF_ERROR'
```cpp
if (UNLIKELY(!_status_.ok())) { \
^
```
**be/src/pipeline/pipeline_task.cpp:367:** +2, including nesting penalty of
1, nesting level increased to 2
```cpp
DBUG_EXECUTE_IF("fault_inj
Re: [PR] [Refactor]refactor log workload group when query arrives be [doris]
doris-robot commented on PR #45034: URL: https://github.com/apache/doris/pull/45034#issuecomment-2527837274 TeamCity be ut coverage result: Function Coverage: 38.79% (10101/26037) Line Coverage: 29.70% (84692/285197) Region Coverage: 28.76% (43476/151146) Branch Coverage: 25.32% (22084/87230) Coverage Report: http://coverage.selectdb-in.cc/coverage/29a39d5ff20c7a5075f98eed3d6ab57c0d8aa36f_29a39d5ff20c7a5075f98eed3d6ab57c0d8aa36f/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Enhancement](cloud) Add concurrency for tablet stats processing #43903 [doris]
doris-robot commented on PR #44763: URL: https://github.com/apache/doris/pull/44763#issuecomment-2527840751 TPC-DS: Total hot run time: 191013 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 35652d1634f7ffced8841cdde1478b380919fb2e, data reload: false query1 967 398 366 366 query2 6504212219851985 query3 6698210 211 210 query4 34267 23452 23449 23449 query5 4236432 433 432 query6 276 164 166 164 query7 4620308 296 296 query8 282 215 211 211 query9 9510268026852680 query10 485 256 257 256 query11 18085 15122 15253 15122 query12 151 97 102 97 query13 1630426 398 398 query14 9796740672927292 query15 237 174 176 174 query16 7572456 482 456 query17 1597590 572 572 query18 2066309 326 309 query19 219 165 153 153 query20 118 122 115 115 query21 204 99 102 99 query22 4888459546114595 query23 35123 34684 34187 34187 query24 10021 285428062806 query25 575 372 372 372 query26 722 168 163 163 query27 2148291 289 289 query28 6469245724662457 query29 712 428 418 418 query30 321 173 155 155 query31 1073769 783 769 query32 88 58 52 52 query33 637 294 286 286 query34 889 499 498 498 query35 812 722 715 715 query36 1098935 936 935 query37 115 77 71 71 query38 3905390138833883 query39 1467140914351409 query40 209 98 104 98 query41 49 50 48 48 query42 105 97 91 91 query43 521 478 480 478 query44 1185779 781 779 query45 182 165 166 165 query46 1128690 705 690 query47 1917183017991799 query48 477 368 366 366 query49 1026379 372 372 query50 834 417 402 402 query51 7423698071526980 query52 102 96 86 86 query53 255 175 181 175 query54 886 458 467 458 query55 78 80 79 79 query56 269 238 242 238 query57 1203112611121112 query58 231 204 207 204 query59 3257293427642764 query60 291 255 254 254 query61 129 130 125 125 query62 814 667 663 663 query63 214 183 180 180 query64 3787734 707 707 query65 3249316131413141 query66 737 307 312 307 query67 15865 15458 15392 15392 query68 4463573 575 573 query69 457 254 254 254 query70 1164112111431121 query71 344 248 248 248 query72 6811390438433843 query73 759 335 354 335 query74 9976888788998887 query75 3353259325992593 query76 2354976 1017976 query77 395 262 263 262 query78 10598 962194539453 query79 9399586 590 586 query80 2333409 411 409 query81 582 234 239 234 query82 1694118 115 115 query83 259 136 140 136 query84 295 79 78 78 query85 2253294 279 279 query86 488 292 297 292 query87 4513425342374237 query88 5793245524512451 query89 565 284 289 284 query90 2230182 181 181 query91 181 143 146 143 query92 61 49 47 47 query93 6862543 541 541 query94 1117258 283 258 query95 335 243 240 240 query96 630 286 280 280 query97 3342313331773133 query98 251 201 199 199 query99 1714130012961296 Total cold run time: 312577 ms Total hot run time: 191013 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [Bug](pipeline) set wake_up_early when pipeline task's sink not executed with eos [doris]
BiteThet commented on PR #45207: URL: https://github.com/apache/doris/pull/45207#issuecomment-2527839047 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](catalog) opt the count pushdown rule for iceberg/paimon/hive scan node [doris]
github-actions[bot] commented on PR #44038: URL: https://github.com/apache/doris/pull/44038#issuecomment-2527774016 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](show_data) test the correctness of data statistics in cloud mode [doris]
morningman commented on code in PR #44947:
URL: https://github.com/apache/doris/pull/44947#discussion_r1875581404
##
regression-test/plugins/aliyunOssSdk.groovy:
##
@@ -0,0 +1,169 @@
+
+
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+import org.apache.doris.regression.suite.Suite;
+import org.apache.doris.regression.Config;
+
+import java.io.ByteArrayInputStream;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+
+import com.aliyun.oss.ClientException;
+import com.aliyun.oss.OSS;
+import com.aliyun.oss.OSSClientBuilder;
+import com.aliyun.oss.OSSException;
+import com.aliyun.oss.model.DeleteObjectsRequest;
+import com.aliyun.oss.model.DeleteObjectsResult;
+import com.aliyun.oss.model.ListObjectsRequest;
+import com.aliyun.oss.model.OSSObjectSummary;
+import com.aliyun.oss.model.ObjectListing;
+
+import org.slf4j.Logger
+import org.slf4j.LoggerFactory
+import groovy.util.logging.Slf4j
+
+Suite.metaClass.initOssClient = { String accessKeyId, String accessKeySecret,
String endpoint ->
+return new OSSClientBuilder().build(endpoint, accessKeyId, accessKeySecret)
+}
+
+Suite.metaClass.listOssObjectWithPrefix = { OSS client, String bucketName,
String prefix="" ->
+try {
+ObjectListing objectListing = null;
+String nextMarker = null;
+final int maxKeys = 500;
+List sums = null;
+
+if (!client.doesBucketExist(bucketName)) {
+logger.info("no bucket named ${bucketName} in ${endpoint}")
+return
+}
+
+// Gets all object with specified marker by paging. Each page will
have up to 100 entries.
+logger.info("List all objects with prefix:");
+nextMarker = null;
+do {
+objectListing = client.listObjects(new
ListObjectsRequest(bucketName).
+
withPrefix(prefix).withMarker(nextMarker).withMaxKeys(maxKeys));
+
+sums = objectListing.getObjectSummaries();
+for (OSSObjectSummary s : sums) {
+logger.info("\t" + s.getKey());
+}
+
+nextMarker = objectListing.getNextMarker();
+
+} while (objectListing.isTruncated());
+} catch (OSSException oe) {
+logger.error("Caught an OSSException, which means your request made it
to OSS, "
++ "but was rejected with an error response for some reason.");
+logger.error("Error Message: " + oe.getErrorMessage());
+logger.error("Error Code: " + oe.getErrorCode());
+logger.error("Request ID: " + oe.getRequestId());
+logger.error("Host ID: " + oe.getHostId());
+} catch (ClientException ce) {
+logger.error("Caught an ClientException, which means the client
encountered "
++ "a serious internal problem while trying to communicate with
OSS, "
++ "such as not being able to access the network.");
+logger.error("Error Message: " + ce.getMessage());
+} finally {
+/*
+* Do not forget to shut down the client finally to release all
allocated resources.
+*/
+//client.shutdown();
+logger.info("Done!")
+}
+
+}
+
+// 获取某个存储空间下指定目录（文件夹）下的文件大小。
Review Comment:
English
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) ignore null values when the literals of in_predicate contains [doris]
github-actions[bot] commented on PR #45104: URL: https://github.com/apache/doris/pull/45104#issuecomment-2527282884 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
kaijchen commented on PR #44929: URL: https://github.com/apache/doris/pull/44929#issuecomment-2527280584 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](nereids) optimize insert into values [doris]
924060929 commented on PR #40202: URL: https://github.com/apache/doris/pull/40202#issuecomment-2527285356 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](logstash) add test cases [doris]
joker-star-l commented on PR #45152: URL: https://github.com/apache/doris/pull/45152#issuecomment-2527283439 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exec)Optimize SetOperator by removing unnecessary maintained elements. [doris]
github-actions[bot] commented on PR #45195: URL: https://github.com/apache/doris/pull/45195#issuecomment-2527265653 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement showTableCreationCommand in nereids #42776 [doris]
doris-robot commented on PR #44703: URL: https://github.com/apache/doris/pull/44703#issuecomment-2527292008 TPC-H: Total hot run time: 40350 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c19a011f8e72548a19fdb8c12a90736a20b3d820, data reload: false -- Round 1 -- q1 17795 753673407340 q2 2049176 162 162 q3 10640 115413111154 q4 10286 746 742 742 q5 7619271427502714 q6 238 149 146 146 q7 1011628 616 616 q8 9246186019401860 q9 6841656065576557 q10 6970233823312331 q11 457 269 256 256 q12 410 218 218 218 q13 17781 299231602992 q14 240 206 208 206 q15 566 518 518 518 q16 642 583 591 583 q17 976 528 551 528 q18 7460678768006787 q19 1355996 928 928 q20 483 180 178 178 q21 4018322132903221 q22 373 313 317 313 Total cold run time: 107456 ms Total hot run time: 40350 ms - Round 2, with runtime_filter_mode=off - q1 7273730472757275 q2 325 236 232 232 q3 2957291630542916 q4 2126179118121791 q5 5629570356795679 q6 219 139 136 136 q7 2185178318071783 q8 3419357035493549 q9 8942903490319031 q10 3593359635403540 q11 601 497 525 497 q12 824 605 607 605 q13 12956 315030813081 q14 284 257 252 252 q15 557 519 518 518 q16 702 631 628 628 q17 1810162415611561 q18 7897753973877387 q19 1676160515741574 q20 2028183918451839 q21 5375539853205320 q22 673 561 591 561 Total cold run time: 72051 ms Total hot run time: 59755 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support ShowTabletStorageFormat command in nereids [doris]
doris-robot commented on PR #43295: URL: https://github.com/apache/doris/pull/43295#issuecomment-2527291936 TPC-H: Total hot run time: 40380 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit abae22306c7037c5f196c6a661694e912930b3c3, data reload: false -- Round 1 -- q1 17593 744373147314 q2 2056176 167 167 q3 10624 117811641164 q4 10455 748 725 725 q5 7618282127852785 q6 240 149 151 149 q7 1016632 636 632 q8 9266189519551895 q9 6694656064856485 q10 7052231923452319 q11 483 268 259 259 q12 412 221 224 221 q13 17772 302430563024 q14 238 212 204 204 q15 558 538 532 532 q16 684 578 575 575 q17 1002544 571 544 q18 7281676865786578 q19 1334104910481048 q20 475 182 188 182 q21 4228326832873268 q22 376 310 318 310 Total cold run time: 107457 ms Total hot run time: 40380 ms - Round 2, with runtime_filter_mode=off - q1 7269724072397239 q2 330 239 240 239 q3 2876296730942967 q4 2103185317991799 q5 5661573457125712 q6 220 136 141 136 q7 2172181018851810 q8 3421385435113511 q9 9045914290759075 q10 3666357235483548 q11 606 509 516 509 q12 797 641 616 616 q13 11334 318332713183 q14 296 279 273 273 q15 583 519 511 511 q16 656 636 655 636 q17 1836158215781578 q18 7875754073977397 q19 1649149315411493 q20 2060185518021802 q21 5544531053355310 q22 638 611 570 570 Total cold run time: 70637 ms Total hot run time: 59914 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
kaijchen commented on PR #44929: URL: https://github.com/apache/doris/pull/44929#issuecomment-2527275774 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](index compaction)Add index compaction exception fault injection cases [doris]
github-actions[bot] commented on PR #45127: URL: https://github.com/apache/doris/pull/45127#issuecomment-2527301219 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
kaijchen commented on PR #44929: URL: https://github.com/apache/doris/pull/44929#issuecomment-2527270996 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) increase max_broker_concurrency to 100 [doris]
kaijchen commented on code in PR #44929:
URL: https://github.com/apache/doris/pull/44929#discussion_r1875574361
##
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##
@@ -780,7 +780,7 @@ public class Config extends ConfigBase {
@ConfField(mutable = true, masterOnly = true, description = {
"单个 broker scanner 的最大并发数。", "Maximal concurrency of broker
scanners."})
-public static int max_broker_concurrency = 10;
+public static int max_broker_concurrency = 24;
Review Comment:
```suggestion
public static int max_broker_concurrency = 100;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) ignore null values when the literals of in_predicate contains [doris]
suxiaogang223 commented on PR #45104: URL: https://github.com/apache/doris/pull/45104#issuecomment-2527276502 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) ignore null values when the literals of in_predicate contains [doris]
suxiaogang223 commented on PR #45104: URL: https://github.com/apache/doris/pull/45104#issuecomment-2527193371 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) lock table in ascending order of table IDs [doris]
doris-robot commented on PR #45045: URL: https://github.com/apache/doris/pull/45045#issuecomment-2527309095 TPC-H: Total hot run time: 40179 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1ae9827944ac2bd62e021a7bffe6e41bfb981c12, data reload: false -- Round 1 -- q1 17595 771374247424 q2 2047174 166 166 q3 10699 111211971112 q4 10581 721 673 673 q5 7621278426672667 q6 242 147 144 144 q7 993 637 608 608 q8 9243190819321908 q9 6748647765306477 q10 6996232322692269 q11 458 276 267 267 q12 426 215 218 215 q13 17763 300030433000 q14 245 224 208 208 q15 582 529 539 529 q16 646 595 590 590 q17 990 507 603 507 q18 7433669167436691 q19 1350103610311031 q20 468 179 187 179 q21 4358321431983198 q22 386 321 316 316 Total cold run time: 107870 ms Total hot run time: 40179 ms - Round 2, with runtime_filter_mode=off - q1 7264724172597241 q2 326 231 228 228 q3 2884287429472874 q4 2058187518971875 q5 5673567656695669 q6 224 139 141 139 q7 2240187117801780 q8 3421354135533541 q9 9050905090279027 q10 3598359535543554 q11 593 512 505 505 q12 812 625 593 593 q13 10923 324331923192 q14 301 271 277 271 q15 577 533 533 533 q16 696 637 637 637 q17 1868165816391639 q18 8356778276487648 q19 1769165014931493 q20 2123187118771871 q21 5644554055155515 q22 654 591 592 591 Total cold run time: 71054 ms Total hot run time: 60416 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feat](nereids) add is_merge tag for data sink [doris]
englefly opened a new pull request, #45196: URL: https://github.com/apache/doris/pull/45196 ### What problem does this PR solve? set is_merge true, if its corresponding exchange node contains sortInfo. BE use this flag to accelerate data transferring. Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids) add is_merge tag for data sink [doris]
doris-robot commented on PR #45196: URL: https://github.com/apache/doris/pull/45196#issuecomment-2527307542 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
