Re: [PR] branch-3.0-pick: [Opt](profile) Add profile for `sync_rowsets` (#49864) [doris]
doris-robot commented on PR #49926: URL: https://github.com/apache/doris/pull/49926#issuecomment-2791788745 TPC-H: Total hot run time: 39827 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9b02fdc0305f7623c0ee854bb2455d7294638f16, data reload: false -- Round 1 -- q1 17585 675665796579 q2 2070172 170 170 q3 10645 106512371065 q4 10571 771 682 682 q5 7759287028572857 q6 217 134 131 131 q7 977 600 605 600 q8 9358195119991951 q9 6613637764126377 q10 6998226523152265 q11 462 265 260 260 q12 401 214 211 211 q13 17947 296430132964 q14 244 211 211 211 q15 518 481 456 456 q16 664 595 571 571 q17 980 576 549 549 q18 7225667465906590 q19 1439112910811081 q20 480 205 209 205 q21 4030307430953074 q22 1104989 978 978 Total cold run time: 108287 ms Total hot run time: 39827 ms - Round 2, with runtime_filter_mode=off - q1 6548653165466531 q2 333 235 228 228 q3 2877272628712726 q4 1998176917351735 q5 5770572857345728 q6 213 125 127 125 q7 2233184318681843 q8 3363358734983498 q9 8827888788458845 q10 3583352735303527 q11 596 520 492 492 q12 810 633 616 616 q13 8317323131563156 q14 326 273 276 273 q15 524 477 455 455 q16 684 669 648 648 q17 1846160216111602 q18 8240775376677667 q19 1651156215231523 q20 2117188418921884 q21 5625546252845284 q22 1115104610201020 Total cold run time: 67596 ms Total hot run time: 59406 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (197a7fd5407 -> 14c4945664b)
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 197a7fd5407 [opt](nereids) do not throw exception in fold const rule (#49802) add 14c4945664b [UT](pipeline) Test pipeline tasks (#49940) No new revisions were added by this update. Summary of changes: be/src/pipeline/exec/operator.h | 6 +- be/src/pipeline/pipeline_task.cpp | 3 +- be/test/pipeline/pipeline_task_test.cpp | 132 +++- 3 files changed, 137 insertions(+), 4 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feat](test)add some be ut for orc/parquet reader (#49418) [doris]
hubgeter opened a new pull request, #49948: URL: https://github.com/apache/doris/pull/49948 Problem Summary: This PR adds unit tests for the existing parquet_reader and orc_reader, and removes some useless code. ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Test pipeline tasks [doris]
Gabriel39 merged PR #49940: URL: https://github.com/apache/doris/pull/49940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] set-filter-fe-part [doris]
doris-robot commented on PR #49947: URL: https://github.com/apache/doris/pull/49947#issuecomment-2791803309 TPC-H: Total hot run time: 34107 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 697891e3de6b79aacc0feb7717bb651fc223a69e, data reload: false -- Round 1 -- q1 26170 508349804980 q2 2064276 189 189 q3 10403 1212687 687 q4 10235 1013523 523 q5 7538232723402327 q6 190 168 134 134 q7 930 739 617 617 q8 9304127011021102 q9 6745520550885088 q10 6885230818711871 q11 488 308 276 276 q12 353 354 225 225 q13 17783 369330943094 q14 251 229 210 210 q15 531 484 480 480 q16 648 633 567 567 q17 620 857 391 391 q18 7753710171037101 q19 1523950 576 576 q20 339 338 234 234 q21 4011347724822482 q22 10551016953 953 Total cold run time: 115819 ms Total hot run time: 34107 ms - Round 2, with runtime_filter_mode=off - q1 5150512251045104 q2 242 328 232 232 q3 2157264422832283 q4 1451179514061406 q5 4531449443674367 q6 217 167 129 129 q7 2008193017961796 q8 2579256025592559 q9 7098711171487111 q10 2975320427852785 q11 574 492 495 492 q12 690 772 625 625 q13 3565385932943294 q14 280 286 269 269 q15 517 470 469 469 q16 638 681 634 634 q17 1122158013341334 q18 7734757272747274 q19 843 832 985 832 q20 1947193117881788 q21 5074469746764676 q22 10511013995 995 Total cold run time: 52443 ms Total hot run time: 50454 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](dialect) add starrocks dialect [doris]
hello-stephen commented on PR #49951: URL: https://github.com/apache/doris/pull/49951#issuecomment-2791809582 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feat](dialect) add starrocks dialect [doris]
liujiwen-up opened a new pull request, #49951: URL: https://github.com/apache/doris/pull/49951 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Opt](profile) Add profile for `sync_rowsets` (#49864) [doris]
doris-robot commented on PR #49926: URL: https://github.com/apache/doris/pull/49926#issuecomment-2791817241 TPC-DS: Total hot run time: 198661 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9b02fdc0305f7623c0ee854bb2455d7294638f16, data reload: false query1 1312940 943 940 query2 6247207320162016 query3 10801 432643944326 query4 65538 28219 23871 23871 query5 5040442 441 441 query6 413 170 190 170 query7 5499323 303 303 query8 305 237 227 227 query9 8729261626072607 query10 459 271 254 254 query11 17305 15375 15590 15375 query12 166 110 110 110 query13 1495435 440 435 query14 9745756876497568 query15 202 196 187 187 query16 7274463 517 463 query17 1104585 579 579 query18 1866315 319 315 query19 205 164 164 164 query20 120 113 108 108 query21 208 104 102 102 query22 4743464445374537 query23 34352 34084 34111 34084 query24 6202291829322918 query25 520 401 408 401 query26 662 163 164 163 query27 2163359 359 359 query28 4495245924592459 query29 697 459 433 433 query30 236 161 163 161 query31 1007849 791 791 query32 71 53 57 53 query33 409 291 318 291 query34 907 507 526 507 query35 863 789 736 736 query36 1101948 972 948 query37 116 70 69 69 query38 4134411339863986 query39 1528148116401481 query40 221 95 96 95 query41 50 49 47 47 query42 112 98 101 98 query43 526 501 486 486 query44 1191847 838 838 query45 185 172 163 163 query46 1156723 742 723 query47 2075189420211894 query48 462 384 392 384 query49 742 394 395 394 query50 842 433 416 416 query51 7493725170937093 query52 96 88 87 87 query53 255 182 191 182 query54 557 470 461 461 query55 76 76 81 76 query56 254 231 249 231 query57 1228113110741074 query58 202 200 215 200 query59 3091289629362896 query60 282 257 263 257 query61 110 105 125 105 query62 787 678 672 672 query63 215 192 186 186 query64 1344670 623 623 query65 3304318331993183 query66 704 301 299 299 query67 16019 15541 15727 15541 query68 3674603 569 569 query69 424 271 262 262 query70 1185113811411138 query71 350 259 262 259 query72 6157400441044004 query73 750 351 356 351 query74 10095 924992079207 query75 3381283226892689 query76 1895103010931030 query77 539 283 287 283 query78 10946 964196229622 query79 1361590 596 590 query80 904 451 451 451 query81 513 240 236 236 query82 127194 96 94 query83 247 154 144 144 query84 291 87 87 87 query85 983 295 281 281 query86 347 291 290 290 query87 4395435043484348 query88 3959241523592359 query89 418 303 284 284 query90 2008186 188 186 query91 185 151 146 146 query92 67 51 51 51 query93 1671547 550 547 query94 770 295 303 295 query95 363 257 260 257 query96 615 280 282 280 query97 3322316031893160 query98 215 207 201 201 query99 1558131813191318 Total cold run time: 316677 ms Total hot run time: 198661 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Enhancement] (nereids)implement CreateUserCommand in nereids [doris]
starocean999 commented on code in PR #47554:
URL: https://github.com/apache/doris/pull/47554#discussion_r2036690143
##
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java:
##
@@ -6468,5 +6473,115 @@ public LogicalPlan
visitKillAnalyzeJob(DorisParser.KillAnalyzeJobContext ctx) {
long jobId = Long.parseLong(ctx.jobId.getText());
return new KillAnalyzeJobCommand(jobId);
}
+
+/**
+ * PasswordOption
+ */
+public PasswordOptions
visitPasswordOption(DorisParser.PasswordOptionContext ctx) {
+int historyPolicy = -2;
+long expirePolicySecond = -2;
+int reusePolicy = -2;
+int loginAttempts = -2;
+long passwordLockSecond = -2;
+int accountUnlocked = -2;
+
+if (ctx.historyDefault != null) {
+historyPolicy = -1;
+} else if (ctx.historyValue != null) {
+historyPolicy = Integer.parseInt(ctx.historyValue.getText());
+}
+
+if (ctx.expireDefault != null) {
+expirePolicySecond = -1;
+} else if (ctx.expireNever != null) {
+expirePolicySecond = 0;
+} else if (ctx.expireValue != null) {
+long value = Long.parseLong(ctx.expireValue.getText());
+expirePolicySecond = getSecond(value,
ctx.expireTimeUnit.getText());
+}
+
+if (ctx.reuseValue != null) {
+reusePolicy = Integer.parseInt(ctx.reuseValue.getText());
+}
+
+if (ctx.attemptsValue != null) {
+loginAttempts = Integer.parseInt(ctx.attemptsValue.getText());
+}
+
+if (ctx.lockUnbounded != null) {
+passwordLockSecond = -1;
+} else if (ctx.lockValue != null) {
+long value = Long.parseLong(ctx.lockValue.getText());
+passwordLockSecond = getSecond(value, ctx.lockTimeUint.getText());
+}
+
+if (ctx.ACCOUNT_LOCK() != null) {
+accountUnlocked = -1;
+} else if (ctx.ACCOUNT_UNLOCK() != null) {
+accountUnlocked = 1;
+}
+
+if (expirePolicySecond == -2 && historyPolicy == -2 && reusePolicy ==
-2
+&& loginAttempts == -2 && passwordLockSecond == -2 &&
accountUnlocked == -2) {
+return PasswordOptions.UNSET_OPTION;
Review Comment:
```suggestion
```
looks like PasswordOptions.UNSET_OPTION is actually all options are
PasswordOptions.UNSET. So we can just remove this if(){...} block
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](dialect) add starrocks dialect [doris]
github-actions[bot] commented on PR #49951: URL: https://github.com/apache/doris/pull/49951#issuecomment-2791818027 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
BiteThet commented on PR #49837: URL: https://github.com/apache/doris/pull/49837#issuecomment-2791822335 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]
doris-robot commented on PR #49905: URL: https://github.com/apache/doris/pull/49905#issuecomment-2791821224 TPC-DS: Total hot run time: 193940 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a35583ee6359a5e15003e0405d16676d37085346, data reload: false query1 1425106410551055 query2 6175195319561953 query3 11151 462645624562 query4 25391 23854 23341 23341 query5 5230614 448 448 query6 293 196 193 193 query7 3985492 283 283 query8 302 250 247 247 query9 8542257725752575 query10 512 326 293 293 query11 15527 15010 14809 14809 query12 162 114 109 109 query13 1557541 402 402 query14 8934620861546154 query15 220 190 178 178 query16 7671638 463 463 query17 1173789 633 633 query18 2027414 306 306 query19 195 188 165 165 query20 130 122 111 111 query21 207 125 109 109 query22 4562451442974297 query23 34577 33817 33559 33559 query24 8626243724302430 query25 535 469 400 400 query26 1229279 157 157 query27 2867509 335 335 query28 4942246124262426 query29 713 559 465 465 query30 285 233 198 198 query31 892 881 869 869 query32 78 60 66 60 query33 567 371 324 324 query34 794 872 517 517 query35 815 869 749 749 query36 951 1002910 910 query37 122 99 78 78 query38 4393422542474225 query39 1548143814881438 query40 221 123 120 120 query41 54 52 52 52 query42 115 105 111 105 query43 516 531 494 494 query44 1376824 827 824 query45 176 177 168 168 query46 873 1025647 647 query47 1842188918361836 query48 387 431 305 305 query49 768 551 433 433 query50 685 709 411 411 query51 4317423942324232 query52 107 107 99 99 query53 234 273 191 191 query54 606 595 511 511 query55 86 78 86 78 query56 314 307 304 304 query57 1185116610711071 query58 269 268 283 268 query59 2811285827742774 query60 326 325 334 325 query61 138 128 124 124 query62 764 738 687 687 query63 227 190 183 183 query64 39921243839 839 query65 4428440343834383 query66 966 479 307 307 query67 16113 15607 15309 15309 query68 9060893 522 522 query69 510 303 275 275 query70 1213113411261126 query71 473 316 299 299 query72 5565479750334797 query73 754 667 351 351 query74 9241909290689068 query75 4287321426662666 query76 38311207754 754 query77 814 379 285 285 query78 997710289 93019301 query79 4290794 553 553 query80 686 527 441 441 query81 483 250 223 223 query82 369 123 95 95 query83 336 252 233 233 query84 294 102 88 88 query85 748 354 317 317 query86 345 321 276 276 query87 4441451444064406 query88 2879222822032203 query89 431 313 281 281 query90 2064215 220 215 query91 145 142 110 110 query92 79 61 55 55 query93 2734975 594 594 query94 693 420 321 321 query95 378 299 293 293 query96 496 555 270 270 query97 3110327831303130 query98 225 227 196 196 query99 1421140712901290 Total cold run time: 285573 ms Total hot run time: 193940 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [improve](performance) replace serialized_sparse_column->insert_many_… [doris]
hello-stephen commented on PR #49952: URL: https://github.com/apache/doris/pull/49952#issuecomment-2791823670 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](SetOperator) refine some SetOperator code. [doris]
hello-stephen commented on PR #49772: URL: https://github.com/apache/doris/pull/49772#issuecomment-2791826945 # BE UT Coverage Report Increment line coverage `86.79% (46/53)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/9f8e71c4e093f080b3f8f618fb8f342f84e82f4c_9f8e71c4e093f080b3f8f618fb8f342f84e82f4c/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/9f8e71c4e093f080b3f8f618fb8f342f84e82f4c_9f8e71c4e093f080b3f8f618fb8f342f84e82f4c/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.35% (14073/26881) | | Line Coverage | 41.14% (121565/295499) | | Region Coverage | 39.87% (61855/155146) | | Branch Coverage | 34.53% (30972/89686) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] set-filter-fe-part [doris]
doris-robot commented on PR #49947: URL: https://github.com/apache/doris/pull/49947#issuecomment-2791828983 TPC-DS: Total hot run time: 185973 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 697891e3de6b79aacc0feb7717bb651fc223a69e, data reload: false query1 992 498 466 466 query2 6564196819671967 query3 6764224 222 222 query4 26189 23376 23512 23376 query5 4309631 491 491 query6 312 208 199 199 query7 4618503 281 281 query8 303 259 252 252 query9 8624259325942593 query10 466 338 264 264 query11 15587 15350 14779 14779 query12 184 110 110 110 query13 1658521 386 386 query14 9921582058965820 query15 207 184 185 184 query16 7637608 466 466 query17 1175732 543 543 query18 2021401 292 292 query19 185 184 151 151 query20 118 117 117 117 query21 209 120 109 109 query22 4081415240334033 query23 33794 32687 33062 32687 query24 8352237723792377 query25 521 442 382 382 query26 1232272 147 147 query27 3031499 330 330 query28 4350243224102410 query29 711 561 425 425 query30 285 227 198 198 query31 973 845 769 769 query32 74 65 68 65 query33 555 368 311 311 query34 789 860 526 526 query35 802 839 743 743 query36 949 982 871 871 query37 120 99 79 79 query38 4137424240864086 query39 1492141114001400 query40 213 118 107 107 query41 57 54 58 54 query42 118 111 106 106 query43 503 519 475 475 query44 1321817 809 809 query45 178 172 169 169 query46 833 1016619 619 query47 1770179517171717 query48 376 426 296 296 query49 794 529 429 429 query50 642 671 405 405 query51 4121416040684068 query52 105 107 106 106 query53 235 263 184 184 query54 580 572 493 493 query55 87 82 82 82 query56 352 310 288 288 query57 1114115610661066 query58 266 259 275 259 query59 2647276926132613 query60 329 322 312 312 query61 130 128 126 126 query62 782 745 658 658 query63 231 190 191 190 query64 42721018692 692 query65 4351424242714242 query66 1100437 363 363 query67 15843 15444 15389 15389 query68 7849888 532 532 query69 460 302 270 270 query70 1184116610731073 query71 409 333 291 291 query72 5513473748474737 query73 655 616 351 351 query74 9040917188778877 query75 3260320727012701 query76 33661182742 742 query77 533 385 301 301 query78 996410064 92879287 query79 2249837 559 559 query80 568 517 437 437 query81 508 264 227 227 query82 462 135 101 101 query83 256 255 249 249 query84 250 112 80 80 query85 776 351 306 306 query86 373 300 285 285 query87 4523455143824382 query88 3705225022292229 query89 385 310 284 284 query90 1940216 229 216 query91 192 144 118 118 query92 79 61 63 61 query93 1808938 582 582 query94 699 398 304 304 query95 373 290 290 290 query96 484 570 279 279 query97 3167323331493149 query98 230 204 200 200 query99 1326144312491249 Total cold run time: 274227 ms Total hot run time: 185973 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]
doris-robot commented on PR #49905: URL: https://github.com/apache/doris/pull/49905#issuecomment-2791833128 ClickBench: Total hot run time: 31.16 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a35583ee6359a5e15003e0405d16676d37085346, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.280.190.19 query4 1.590.190.19 query5 0.580.560.59 query6 1.190.720.71 query7 0.030.020.02 query8 0.040.030.03 query9 0.560.510.50 query10 0.590.590.57 query11 0.160.100.10 query12 0.140.110.11 query13 0.610.600.61 query14 2.812.692.80 query15 0.910.850.84 query16 0.380.380.38 query17 1.021.011.02 query18 0.210.200.19 query19 1.851.901.92 query20 0.010.010.02 query21 15.36 0.890.55 query22 0.761.170.70 query23 14.91 1.390.66 query24 7.650.770.73 query25 0.450.190.08 query26 0.710.160.13 query27 0.050.050.05 query28 9.260.900.46 query29 12.52 3.983.30 query30 0.260.080.06 query31 2.840.590.39 query32 3.240.560.48 query33 3.013.043.03 query34 15.85 5.144.48 query35 4.554.524.63 query36 0.660.500.49 query37 0.080.060.06 query38 0.050.040.04 query39 0.020.020.02 query40 0.160.130.14 query41 0.090.020.02 query42 0.030.030.02 query43 0.030.030.03 Total cold run time: 105.66 s Total hot run time: 31.16 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Opt](profile) Add profile for `sync_rowsets` (#49864) [doris]
doris-robot commented on PR #49926: URL: https://github.com/apache/doris/pull/49926#issuecomment-2791829227 ClickBench: Total hot run time: 31.91 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9b02fdc0305f7623c0ee854bb2455d7294638f16, data reload: false query1 0.030.030.03 query2 0.070.030.04 query3 0.240.060.06 query4 1.630.100.10 query5 0.520.500.52 query6 1.130.730.74 query7 0.020.010.01 query8 0.050.030.04 query9 0.560.500.50 query10 0.560.550.54 query11 0.140.100.10 query12 0.140.120.11 query13 0.610.590.59 query14 2.712.722.81 query15 0.900.840.83 query16 0.370.400.38 query17 1.031.001.01 query18 0.240.220.23 query19 1.981.882.03 query20 0.020.010.01 query21 15.36 0.570.56 query22 2.481.982.04 query23 17.03 1.080.72 query24 2.670.571.28 query25 0.220.070.06 query26 0.470.140.13 query27 0.050.050.05 query28 11.02 0.560.46 query29 12.55 3.263.25 query30 0.240.060.06 query31 2.880.390.39 query32 3.230.460.46 query33 2.963.043.03 query34 17.09 4.494.50 query35 4.534.554.54 query36 0.690.490.48 query37 0.090.060.07 query38 0.050.040.03 query39 0.030.020.02 query40 0.150.130.13 query41 0.090.020.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 106.91 s Total hot run time: 31.91 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-spark-connector) branch master updated: [fix](connector) Fixed the issue where the loading task got stuck when stream load ended unexpectedly (#305)
This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-spark-connector.git
The following commit(s) were added to refs/heads/master by this push:
new 5150d77 [fix](connector) Fixed the issue where the loading task got
stuck when stream load ended unexpectedly (#305)
5150d77 is described below
commit 5150d7780dfcd0bfd5b113325267fa3bffcdd0be
Author: gnehil
AuthorDate: Thu Apr 10 15:36:19 2025 +0800
[fix](connector) Fixed the issue where the loading task got stuck when
stream load ended unexpectedly (#305)
---
.../client/write/AbstractStreamLoadProcessor.java | 181 +
.../apache/doris/spark/config/DorisOptions.java| 4 +-
.../spark/sql/DorisWriterFailoverITCase.scala | 41 -
.../apache/doris/spark/write/DorisDataWriter.scala | 4 +-
4 files changed, 151 insertions(+), 79 deletions(-)
diff --git
a/spark-doris-connector/spark-doris-connector-base/src/main/java/org/apache/doris/spark/client/write/AbstractStreamLoadProcessor.java
b/spark-doris-connector/spark-doris-connector-base/src/main/java/org/apache/doris/spark/client/write/AbstractStreamLoadProcessor.java
index 169f5a8..eec3f73 100644
---
a/spark-doris-connector/spark-doris-connector-base/src/main/java/org/apache/doris/spark/client/write/AbstractStreamLoadProcessor.java
+++
b/spark-doris-connector/spark-doris-connector-base/src/main/java/org/apache/doris/spark/client/write/AbstractStreamLoadProcessor.java
@@ -17,12 +17,6 @@
package org.apache.doris.spark.client.write;
-import com.fasterxml.jackson.core.JsonProcessingException;
-import com.fasterxml.jackson.databind.DeserializationFeature;
-import com.fasterxml.jackson.databind.ObjectMapper;
-import com.fasterxml.jackson.databind.json.JsonMapper;
-import java.io.PipedInputStream;
-import java.io.PipedOutputStream;
import org.apache.doris.spark.client.DorisBackendHttpClient;
import org.apache.doris.spark.client.DorisFrontendClient;
import org.apache.doris.spark.client.entity.Backend;
@@ -36,6 +30,10 @@ import org.apache.doris.spark.util.EscapeHandler;
import org.apache.doris.spark.util.HttpUtils;
import org.apache.doris.spark.util.URLs;
+import com.fasterxml.jackson.core.JsonProcessingException;
+import com.fasterxml.jackson.databind.DeserializationFeature;
+import com.fasterxml.jackson.databind.ObjectMapper;
+import com.fasterxml.jackson.databind.json.JsonMapper;
import org.apache.http.HttpEntity;
import org.apache.http.HttpHeaders;
import org.apache.http.HttpStatus;
@@ -51,6 +49,8 @@ import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import java.io.IOException;
+import java.io.PipedInputStream;
+import java.io.PipedOutputStream;
import java.nio.charset.StandardCharsets;
import java.util.Arrays;
import java.util.HashSet;
@@ -66,56 +66,39 @@ import java.util.stream.Collectors;
public abstract class AbstractStreamLoadProcessor extends DorisWriter
implements DorisCommitter {
-protected final Logger logger =
LoggerFactory.getLogger(this.getClass().getName().replaceAll("\\$", ""));
-
-protected static final JsonMapper MAPPER =
JsonMapper.builder().configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES,
false).build();
-
+protected static final JsonMapper MAPPER =
+
JsonMapper.builder().configure(DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES,
false).build();
private static final String PARTIAL_COLUMNS = "partial_columns";
private static final String GROUP_COMMIT = "group_commit";
-private static final Set VALID_GROUP_MODE = new
HashSet<>(Arrays.asList("sync_mode", "async_mode", "off_mode"));
-
+private static final Set VALID_GROUP_MODE =
+new HashSet<>(Arrays.asList("sync_mode", "async_mode",
"off_mode"));
+private static final int arrowBufferSize = 1000;
+protected final Logger logger =
LoggerFactory.getLogger(this.getClass().getName().replaceAll("\\$", ""));
protected final DorisConfig config;
-
private final DorisFrontendClient frontend;
private final DorisBackendHttpClient backendHttpClient;
-
private final String database;
private final String table;
-
private final boolean autoRedirect;
-
private final boolean isHttpsEnabled;
-
private final boolean isTwoPhaseCommitEnabled;
-
private final Map properties;
-
private final DataFormat format;
-
+private final boolean isGzipCompressionEnabled;
+private final boolean isPassThrough;
+private final List recordBuffer = new LinkedList<>();
+private final int pipeSize;
protected String columnSeparator;
-
private byte[] lineDelimiter;
-
-private final boolean isGzipCompressionEnabled;
-
private String groupCommit;
-
-private final boolean isPassThrough;
-
private PipedOutputStream output;
-
private boolean createNewBatch = true;
-
private boolean isFirstRecordOfBatch = true;
-
-privat
Re: [PR] [Fix](compaction) Only print delete compaction log when there is a delete rowset [doris]
Thearas commented on PR #49953: URL: https://github.com/apache/doris/pull/49953#issuecomment-2791843135 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](compaction) Only print delete compaction log when there is a delete rowset [doris]
Yukang-Lian opened a new pull request, #49953: URL: https://github.com/apache/doris/pull/49953 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](metrics) add some table metrics [doris]
yagagagaga commented on PR #49930: URL: https://github.com/apache/doris/pull/49930#issuecomment-2792623919 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
KeeProMise commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2792622538 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [only test] [doris]
Mryange opened a new pull request, #49971: URL: https://github.com/apache/doris/pull/49971 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] [doris]
Mryange commented on PR #49971: URL: https://github.com/apache/doris/pull/49971#issuecomment-2792669024 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (b05cb2e9782 -> 840d186edbf)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard b05cb2e9782 Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f new 840d186edbf Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (b05cb2e9782) \ N -- N -- N refs/heads/asf-site (840d186edbf) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [doc](function) fix some not suitable description about lead/lag function [doris-website]
zhangstar333 opened a new pull request, #2282: URL: https://github.com/apache/doris-website/pull/2282 ## Versions - [x] dev - [x] 3.0 - [x] 2.1 - [ ] 2.0 ## Languages - [x] Chinese - [x] English ## Docs Checklist - [ ] Checked by AI - [ ] Test Cases Built -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](metrics) add some table metrics [doris]
yagagagaga commented on PR #49930: URL: https://github.com/apache/doris/pull/49930#issuecomment-2792683141 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 01/01: [fix](compile) fix typo
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch hello-stephen-patch-3
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 0a7092e5c8379e9531519af3cc7d050a554c1806
Author: Dongyang Li
AuthorDate: Thu Apr 10 17:26:09 2025 +0800
[fix](compile) fix typo
cp: cannot stat
'/home/zcp/repo_center/doris_master/doris/thirdparty/installed/jindofs_libs/jindo-core-linux-el7-aarch64-[0-9]*.jar':
No such file or directory
---
build.sh | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/build.sh b/build.sh
index 659b7bce9f8..98297745b32 100755
--- a/build.sh
+++ b/build.sh
@@ -928,8 +928,8 @@ EOF
cp -r -p
"${DORIS_THIRDPARTY}"/installed/jindofs_libs/jindo-core-linux-ubuntu22-x86_64-[0-9]*.jar
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
cp -r -p
"${DORIS_THIRDPARTY}"/installed/jindofs_libs/jindo-sdk-[0-9]*.jar
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
elif [[ "${TARGET_SYSTEM}" == 'Linux' ]] && [[ "$TARGET_ARCH" == 'aarch64'
]]; then
-cp -r -p
"${DORIS_THIRDPARTY}/installed/jindofs_libs/jindo-core-linux-el7-aarch64-[0-9]*.jar"
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
-cp -r -p
"${DORIS_THIRDPARTY}/installed/jindofs_libs/jindo-sdk-[0-9]*.jar"
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
+cp -r -p
"${DORIS_THIRDPARTY}"/installed/jindofs_libs/jindo-core-linux-el7-aarch64-[0-9]*.jar
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
+cp -r -p
"${DORIS_THIRDPARTY}"/installed/jindofs_libs/jindo-sdk-[0-9]*.jar
"${DORIS_OUTPUT}/be/lib/java_extensions/preload-extensions"/
fi
cp -r -p "${DORIS_THIRDPARTY}/installed/webroot"/*
"${DORIS_OUTPUT}/be/www"/
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](cloud) Refactor `OlapScanLocalState::hold_tablets` [doris]
bobhan1 commented on PR #49945: URL: https://github.com/apache/doris/pull/49945#issuecomment-2792121626 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud-mow) Should erase initiator when upgrading MS [doris]
zhannngchen commented on code in PR #49716:
URL: https://github.com/apache/doris/pull/49716#discussion_r2037362424
##
cloud/src/meta-service/meta_service_job.cpp:
##
@@ -587,7 +642,10 @@ static void
remove_delete_bitmap_update_lock(std::unique_ptr& txn,
mow_tablet_compaction_key({instance_id, table_id,
lock_initiator});
std::string tablet_compaction_val;
TxnErrorCode err = txn->get(tablet_compaction_key,
&tablet_compaction_val);
-if (err != TxnErrorCode::TXN_OK) {
+if (err == TxnErrorCode::TXN_KEY_NOT_FOUND) {
+remove_delete_bitmap_update_lock_v1(txn, instance_id, table_id,
tablet_id, lock_id,
+lock_initiator);
+} else if (err != TxnErrorCode::TXN_OK) {
Review Comment:
should add a `else` at L654
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](hive) support skip.header.line.count [doris]
github-actions[bot] commented on PR #49929: URL: https://github.com/apache/doris/pull/49929#issuecomment-2793775351 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](hive) support skip.header.line.count [doris]
github-actions[bot] commented on PR #49929: URL: https://github.com/apache/doris/pull/49929#issuecomment-2793774736 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [doc] permission issues when adding and inserting data into Hive. [doris-website]
morningman merged PR #2271: URL: https://github.com/apache/doris-website/pull/2271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48673-branch-3.0 created (now 3de3682a9fd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48673-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at 3de3682a9fd branch-3.0: [Fix](full compaction) Fix problems for full compaction #49825 (#49917) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](dialect) add starrocks dialect [doris]
morningman merged PR #49951: URL: https://github.com/apache/doris/pull/49951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (c3633686a5b -> f8120348e5e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard c3633686a5b Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f new f8120348e5e Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (c3633686a5b) \ N -- N -- N refs/heads/asf-site (f8120348e5e) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](Exchange) do exchange sink buffer refactor [doris]
HappenLee merged PR #49335: URL: https://github.com/apache/doris/pull/49335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Refactor](Exchange) do exchange sink buffer refactor (#49335)
This is an automated email from the ASF dual-hosted git repository.
lihaopeng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 55dd58d8994 [Refactor](Exchange) do exchange sink buffer refactor
(#49335)
55dd58d8994 is described below
commit 55dd58d8994bdd28ee560ad6c2b6788ce63aafdc
Author: HappenLee
AuthorDate: Thu Apr 10 22:30:52 2025 +0800
[Refactor](Exchange) do exchange sink buffer refactor (#49335)
Do exchange refactor
* remove unless check
* change muti map to one struct map, only search one time
* rename some variables to match code style
---
be/src/pipeline/exec/exchange_sink_buffer.cpp | 240 +++-
be/src/pipeline/exec/exchange_sink_buffer.h | 130 +++--
be/src/pipeline/exec/exchange_sink_operator.cpp | 32 ++--
be/src/pipeline/exec/exchange_sink_operator.h | 8 +-
be/src/vec/sink/vdata_stream_sender.cpp | 2 +-
be/src/vec/sink/vdata_stream_sender.h | 4 +-
be/test/pipeline/pipeline_test.cpp | 2 +-
be/test/vec/exec/exchange_sink_test.cpp | 58 +++---
be/test/vec/exec/exchange_sink_test.h | 6 +-
9 files changed, 241 insertions(+), 241 deletions(-)
diff --git a/be/src/pipeline/exec/exchange_sink_buffer.cpp
b/be/src/pipeline/exec/exchange_sink_buffer.cpp
index 90d54a35aa0..95a5a00f68a 100644
--- a/be/src/pipeline/exec/exchange_sink_buffer.cpp
+++ b/be/src/pipeline/exec/exchange_sink_buffer.cpp
@@ -100,12 +100,7 @@ ExchangeSinkBuffer::ExchangeSinkBuffer(PUniqueId query_id,
PlanNodeId dest_node_
_node_id(node_id),
_state(state),
_context(state->get_query_ctx()),
- _exchange_sink_num(sender_ins_ids.size()) {
-for (auto sender_ins_id : sender_ins_ids) {
-_queue_deps.emplace(sender_ins_id, nullptr);
-_parents.emplace(sender_ins_id, nullptr);
-}
-}
+ _exchange_sink_num(sender_ins_ids.size()) {}
void ExchangeSinkBuffer::close() {
// Could not clear the queue here, because there maybe a running rpc want
to
@@ -121,29 +116,34 @@ void ExchangeSinkBuffer::construct_request(TUniqueId
fragment_instance_id) {
return;
}
auto low_id = fragment_instance_id.lo;
-if (_instance_to_package_queue_mutex.count(low_id)) {
+if (_rpc_instances.contains(low_id)) {
return;
}
-_instance_to_package_queue_mutex[low_id] = std::make_unique();
-_instance_to_seq[low_id] = 0;
-_instance_to_package_queue[low_id] = std::queue>();
-_instance_to_broadcast_package_queue[low_id] =
+
+// Initialize the instance data
+auto instance_data = std::make_unique(low_id);
+instance_data->mutex = std::make_unique();
+instance_data->seq = 0;
+instance_data->package_queue = std::queue>();
+instance_data->broadcast_package_queue =
std::queue>();
-_queue_capacity =
-config::exchg_buffer_queue_capacity_factor *
_instance_to_package_queue.size();
+_queue_capacity = config::exchg_buffer_queue_capacity_factor *
_rpc_instances.size();
+
PUniqueId finst_id;
finst_id.set_hi(fragment_instance_id.hi);
finst_id.set_lo(fragment_instance_id.lo);
-_rpc_channel_is_idle[low_id] = true;
-_rpc_channel_is_turn_off[low_id] = false;
-
_instance_to_rpc_stats_vec.emplace_back(std::make_shared(low_id));
-_instance_to_rpc_stats[low_id] = _instance_to_rpc_stats_vec.back().get();
-_instance_to_request[low_id] = std::make_shared();
-_instance_to_request[low_id]->mutable_finst_id()->CopyFrom(finst_id);
-_instance_to_request[low_id]->mutable_query_id()->CopyFrom(_query_id);
-
-_instance_to_request[low_id]->set_node_id(_dest_node_id);
-_running_sink_count[low_id] = _exchange_sink_num;
+
+instance_data->rpc_channel_is_idle = true;
+instance_data->rpc_channel_is_turn_off = false;
+
+// Initialize request
+instance_data->request = std::make_shared();
+instance_data->request->mutable_finst_id()->CopyFrom(finst_id);
+instance_data->request->mutable_query_id()->CopyFrom(_query_id);
+instance_data->request->set_node_id(_dest_node_id);
+instance_data->running_sink_count = _exchange_sink_num;
+
+_rpc_instances[low_id] = std::move(instance_data);
}
Status ExchangeSinkBuffer::add_block(TransmitInfo&& request) {
@@ -151,20 +151,21 @@ Status ExchangeSinkBuffer::add_block(TransmitInfo&&
request) {
return Status::OK();
}
auto ins_id = request.channel->dest_ins_id();
-if (!_instance_to_package_queue_mutex.contains(ins_id)) {
+if (!_rpc_instances.contains(ins_id)) {
return Status::InternalError("fragment_instance_id {} not do
register_sink",
print_id(request.channel->_fragment_instance_id));
}
-if (_rpc_channel_is_turn_off[ins_id]) {
+auto& instance_data = *_rpc_instances[in
Re: [PR] [feature](nereids)support stream load, routine load and broker load in nereids [doris]
starocean999 commented on PR #49116: URL: https://github.com/apache/doris/pull/49116#issuecomment-2793651959 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
BiteThet commented on PR #49837: URL: https://github.com/apache/doris/pull/49837#issuecomment-2793842052 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](hive) support skip.header.line.count [doris]
morningman merged PR #49929: URL: https://github.com/apache/doris/pull/49929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (55dd58d8994 -> 105b6585ee1)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 55dd58d8994 [Refactor](Exchange) do exchange sink buffer refactor
(#49335)
add 105b6585ee1 [enhance](hive) support skip.header.line.count (#49929)
No new revisions were added by this update.
Summary of changes:
.../scripts/create_preinstalled_scripts/run76.hql | 21 +
.../text_table_compressed_skip_header/00_0.gz | Bin 0 -> 149 bytes
.../text/text_table_normal_skip_header/00_0| 20
.../doris/datasource/hive/HiveProperties.java | 22 -
.../doris/datasource/hive/source/HiveScanNode.java | 3 ++
.../hive/test_text_skip_header.out | Bin 0 -> 755 bytes
.../test_text_skip_header.groovy} | 35 ++---
7 files changed, 81 insertions(+), 20 deletions(-)
create mode 100755
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run76.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_compressed_skip_header/00_0.gz
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_normal_skip_header/00_0
create mode 100644
regression-test/data/external_table_p0/hive/test_text_skip_header.out
copy
regression-test/suites/external_table_p0/{dialect_compatible/sql/test_hive_view_rewrite.groovy
=> hive/test_text_skip_header.groovy} (64%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
hello-stephen commented on PR #49975: URL: https://github.com/apache/doris/pull/49975#issuecomment-2793977173 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49929-branch-3.0 updated (3de3682a9fd -> ad51f5bd48f)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch auto-pick-49929-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 3de3682a9fd branch-3.0: [Fix](full compaction) Fix problems for full
compaction #49825 (#49917)
add ad51f5bd48f [enhance](hive) support skip.header.line.count (#49929)
No new revisions were added by this update.
Summary of changes:
.../scripts/create_preinstalled_scripts/run76.hql | 21
.../text_table_compressed_skip_header/00_0.gz | Bin 0 -> 149 bytes
.../text/text_table_normal_skip_header/00_0| 20 +++
.../doris/datasource/hive/HiveProperties.java | 22 -
.../doris/datasource/hive/source/HiveScanNode.java | 3 +++
.../hive/test_text_skip_header.out | Bin 0 -> 755 bytes
...to_date.groovy => test_text_skip_header.groovy} | 27 +
7 files changed, 76 insertions(+), 17 deletions(-)
create mode 100755
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run76.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_compressed_skip_header/00_0.gz
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_normal_skip_header/00_0
create mode 100644
regression-test/data/external_table_p0/hive/test_text_skip_header.out
copy regression-test/suites/external_table_p0/hive/{test_hive_to_date.groovy
=> test_text_skip_header.groovy} (62%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
github-actions[bot] opened a new pull request, #49975: URL: https://github.com/apache/doris/pull/49975 Cherry-picked from #49929 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
dataroaring closed pull request #49975: branch-3.0: [enhance](hive) support skip.header.line.count #49929 URL: https://github.com/apache/doris/pull/49975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](regression-tests) add tests for `SELECT INTO OUTFILE` [doris]
BePPPower opened a new pull request, #49949: URL: https://github.com/apache/doris/pull/49949 Problem Summary: Add a regression test: 1. export data using Doris on an x86 machine. 2. read data using Doris on an arm machine. ### Release note None ### Check List (For Author) - Test - [x] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [x] No. - [ ] Yes. - Does this need documentation? - [x] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](metrics) add some table metrics [doris]
yagagagaga commented on code in PR #49930:
URL: https://github.com/apache/doris/pull/49930#discussion_r2037257339
##
fe/fe-core/src/main/java/org/apache/doris/catalog/TabletStatMgr.java:
##
@@ -236,8 +262,21 @@ protected void runAfterCatalogReady() {
} finally {
table.readUnlock();
}
+totalTableSize += tableDataSize;
}
}
+MetricRepo.GAUGE_MAX_TABLE_SIZE_BYTES.setValue(maxTableSize);
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](metrics) add some table metrics [doris]
yagagagaga commented on PR #49930: URL: https://github.com/apache/doris/pull/49930#issuecomment-2792668639 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mv) Add sync mv test that had been commented [doris]
hello-stephen commented on PR #49970: URL: https://github.com/apache/doris/pull/49970#issuecomment-2792573167 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]
zclllyybb opened a new pull request, #49972: URL: https://github.com/apache/doris/pull/49972 ### What problem does this PR solve? Issue Number: close #xxx Related PR: https://github.com/apache/doris/pull/49872 Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [x] No need to test or manual test. Explain why: - [x] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [x] No. - [ ] Yes. - Does this need documentation? - [x] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]
Thearas commented on PR #49972: URL: https://github.com/apache/doris/pull/49972#issuecomment-2792958480 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]
zclllyybb commented on PR #49972: URL: https://github.com/apache/doris/pull/49972#issuecomment-2792959437 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) fix orc push down and materialization for hive acid table [doris]
doris-robot commented on PR #49927: URL: https://github.com/apache/doris/pull/49927#issuecomment-2792131726 TPC-H: Total hot run time: 34597 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e64d277a7ce5f2b96966431bef2df90408ed6a31, data reload: false -- Round 1 -- q1 27648 560251645164 q2 2087292 185 185 q3 10377 1278751 751 q4 10237 1055536 536 q5 7574241023622362 q6 189 162 134 134 q7 938 752 608 608 q8 9320132311651165 q9 6823511251405112 q10 6833232418861886 q11 469 283 281 281 q12 349 361 228 228 q13 17755 372930843084 q14 226 224 215 215 q15 534 499 477 477 q16 635 620 574 574 q17 593 873 374 374 q18 7673729871907190 q19 1075962 579 579 q20 331 326 232 232 q21 4384340324972497 q22 10771055963 963 Total cold run time: 117127 ms Total hot run time: 34597 ms - Round 2, with runtime_filter_mode=off - q1 5156513851515138 q2 235 322 228 228 q3 2186282522962296 q4 1492196914871487 q5 4606441643874387 q6 219 170 130 130 q7 2021195517801780 q8 2511267425622562 q9 7289716871157115 q10 2961316527812781 q11 575 518 517 517 q12 693 773 634 634 q13 3595399432743274 q14 278 288 273 273 q15 523 468 477 468 q16 650 701 671 671 q17 1189155714261426 q18 7735749873407340 q19 843 928 1101928 q20 1962200318841884 q21 5442494448664866 q22 1131106410281028 Total cold run time: 53292 ms Total hot run time: 51213 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (27ca0040ed4 -> c3633686a5b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 27ca0040ed4 Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f new c3633686a5b Automated deployment with doris branch @ c472d83054b75643e518018dfcfc35413cc1e44f This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (27ca0040ed4) \ N -- N -- N refs/heads/asf-site (c3633686a5b) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) fix orc push down and materialization for hive acid table [doris]
doris-robot commented on PR #49927: URL: https://github.com/apache/doris/pull/49927#issuecomment-2792236494 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.10% (18170/27489) Region Coverage: 65.54% (8951/13657) Branch Coverage: 55.37% (4822/8708) Coverage Report: http://coverage.selectdb-in.cc/coverage/98115993f1fe4bb35576b1283c4bc05e541dbfb7_98115993f1fe4bb35576b1283c4bc05e541dbfb7_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](metrics) add some table metrics [doris]
doris-robot commented on PR #49930: URL: https://github.com/apache/doris/pull/49930#issuecomment-2793484856 ClickBench: Total hot run time: 31 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ae62e32e53035b299e04298c3c55b26d40066e91, data reload: false query1 0.040.040.02 query2 0.120.100.11 query3 0.250.200.19 query4 1.590.190.20 query5 0.580.570.57 query6 1.170.710.72 query7 0.020.020.02 query8 0.040.030.04 query9 0.580.530.53 query10 0.560.600.56 query11 0.160.120.11 query12 0.150.110.11 query13 0.610.600.60 query14 2.812.742.72 query15 0.930.840.86 query16 0.390.380.38 query17 1.041.011.02 query18 0.200.200.19 query19 1.952.001.80 query20 0.020.010.01 query21 15.35 0.910.55 query22 0.741.210.62 query23 14.93 1.370.66 query24 8.010.880.79 query25 0.520.230.11 query26 0.660.160.13 query27 0.060.050.04 query28 9.330.850.43 query29 12.53 4.033.30 query30 0.250.090.06 query31 2.810.580.38 query32 3.230.550.46 query33 3.023.093.07 query34 15.62 5.124.43 query35 4.554.524.49 query36 0.670.500.47 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.020.03 query40 0.170.130.12 query41 0.090.030.03 query42 0.040.030.02 query43 0.030.030.03 Total cold run time: 105.99 s Total hot run time: 31 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) (#49911)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new bfe74695603 branch-2.1: [fix](oss) the write to hive table on oss-hdfs
may fail (#49754) (#49911)
bfe74695603 is described below
commit bfe7469560302b55a42284ba766c1d8454b38a61
Author: Mingyu Chen (Rayner)
AuthorDate: Thu Apr 10 07:01:42 2025 -0700
branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail
(#49754) (#49911)
bp #49754
---
.../org/apache/doris/common/util/LocationPath.java | 5 ++--
.../doris/datasource/hive/HiveMetaStoreCache.java | 13 +
.../doris/fs/remote/SwitchingFileSystem.java | 2 +-
.../apache/doris/common/util/LocationPathTest.java | 33 +++---
4 files changed, 34 insertions(+), 19 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/common/util/LocationPath.java
b/fe/fe-core/src/main/java/org/apache/doris/common/util/LocationPath.java
index 4ca8f9605a0..7e8b357395c 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/common/util/LocationPath.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/common/util/LocationPath.java
@@ -203,8 +203,9 @@ public class LocationPath {
// Return the file system type and the file system identity.
// The file system identity is the scheme and authority of the URI, eg.
"hdfs://host:port" or "s3://bucket".
-public static Pair getFSIdentity(String location,
String bindBrokerName) {
-LocationPath locationPath = new LocationPath(location,
Collections.emptyMap(), true);
+public static Pair getFSIdentity(String location,
+Map properties, String bindBrokerName) {
+LocationPath locationPath = new LocationPath(location, properties,
true);
FileSystemType fsType = (bindBrokerName != null) ?
FileSystemType.BROKER : locationPath.getFileSystemType();
URI uri = locationPath.getPath().toUri();
String fsIdent = Strings.nullToEmpty(uri.getScheme()) + "://" +
Strings.nullToEmpty(uri.getAuthority());
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveMetaStoreCache.java
b/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveMetaStoreCache.java
index 751919e85f4..ecb0fa60693 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveMetaStoreCache.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveMetaStoreCache.java
@@ -349,10 +349,11 @@ public class HiveMetaStoreCache {
List partitionValues,
String bindBrokerName) throws UserException {
FileCacheValue result = new FileCacheValue();
+Map properties =
catalog.getCatalogProperty().getProperties();
RemoteFileSystem fs =
Env.getCurrentEnv().getExtMetaCacheMgr().getFsCache().getRemoteFileSystem(
new
FileSystemCache.FileSystemCacheKey(LocationPath.getFSIdentity(
-location, bindBrokerName),
-catalog.getCatalogProperty().getProperties(),
+location, properties, bindBrokerName),
+properties,
bindBrokerName, jobConf));
result.setSplittable(HiveUtil.isSplittable(fs, inputFormat, location));
// For Tez engine, it may generate subdirectoies for "union" query.
@@ -737,8 +738,8 @@ public class HiveMetaStoreCache {
boolean isFullAcid, boolean skipCheckingAcidVersionFile, long
tableId, String bindBrokerName) {
List fileCacheValues = Lists.newArrayList();
try {
+Map properties =
catalog.getCatalogProperty().getProperties();
for (HivePartition partition : partitions) {
-
AuthenticationConfig authenticationConfig =
AuthenticationConfig.getKerberosConfig(jobConf);
HadoopAuthenticator hadoopAuthenticator =
HadoopAuthenticator.getHadoopAuthenticator(authenticationConfig);
@@ -771,7 +772,7 @@ public class HiveMetaStoreCache {
RemoteFileSystem fs =
Env.getCurrentEnv().getExtMetaCacheMgr().getFsCache().getRemoteFileSystem(
new FileSystemCache.FileSystemCacheKey(
LocationPath.getFSIdentity(baseOrDeltaPath.toUri().toString(),
-bindBrokerName),
+properties, bindBrokerName),
catalog.getCatalogProperty().getProperties(),
bindBrokerName, jobConf));
Status status = fs.exists(acidVersionPath);
@@ -798,7 +799,7 @@ public class HiveMetaStoreCache {
String location = delta.getPath().toString();
RemoteF
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
doris-robot commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2793462567 ClickBench: Total hot run time: 31.04 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 739473fca38cf9e122611079e54f3401c0f4fd81, data reload: false query1 0.040.040.03 query2 0.120.110.11 query3 0.250.190.19 query4 1.590.190.20 query5 0.580.560.59 query6 1.160.720.72 query7 0.030.020.02 query8 0.040.030.03 query9 0.580.520.52 query10 0.570.580.56 query11 0.150.100.11 query12 0.150.110.11 query13 0.610.600.61 query14 2.682.802.73 query15 0.910.840.84 query16 0.390.380.38 query17 1.021.021.02 query18 0.210.190.19 query19 1.831.881.88 query20 0.010.010.01 query21 15.35 0.890.55 query22 0.771.160.64 query23 14.99 1.350.65 query24 7.630.670.75 query25 0.500.130.17 query26 0.680.170.15 query27 0.050.040.05 query28 8.880.850.42 query29 12.58 3.963.33 query30 0.250.090.06 query31 2.840.580.38 query32 3.220.550.46 query33 3.023.013.06 query34 15.73 5.064.47 query35 4.514.504.50 query36 0.650.490.48 query37 0.090.060.06 query38 0.060.040.04 query39 0.040.020.02 query40 0.160.130.12 query41 0.080.020.02 query42 0.030.020.02 query43 0.030.040.03 Total cold run time: 105.06 s Total hot run time: 31.04 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [opt](connection) add connection num in error msg (#49471) [doris]
yiguolei merged PR #49910: URL: https://github.com/apache/doris/pull/49910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1: [opt](connection) add connection num in error msg (#49471) (#49910)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 4ae9451b637 branch-2.1: [opt](connection) add connection num in error
msg (#49471) (#49910)
4ae9451b637 is described below
commit 4ae9451b63744b938ae7d3959efbf310bba85803
Author: Mingyu Chen (Rayner)
AuthorDate: Thu Apr 10 07:00:51 2025 -0700
branch-2.1: [opt](connection) add connection num in error msg (#49471)
(#49910)
bp #49471
---
.../java/org/apache/doris/mysql/AcceptListener.java | 11 +++
.../java/org/apache/doris/qe/ConnectScheduler.java | 14 ++
.../sessions/FlightSessionsWithTokenManager.java | 20 ++--
3 files changed, 31 insertions(+), 14 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/mysql/AcceptListener.java
b/fe/fe-core/src/main/java/org/apache/doris/mysql/AcceptListener.java
index 3d783f28cb3..0388a532efd 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/mysql/AcceptListener.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/mysql/AcceptListener.java
@@ -89,15 +89,18 @@ public class AcceptListener implements
ChannelListener
connectScheduler.unregisterConnection(context));
} else {
-
context.getState().setError(ErrorCode.ERR_TOO_MANY_USER_CONNECTIONS,
-"Reach limit of connections");
+long userConnLimit =
context.getEnv().getAuth().getMaxConn(context.getQualifiedUser());
+String errMsg = String.format("Reach limit of
connections. Total: %, User: %d, Current: %d",
+connectScheduler.getMaxConnections(),
userConnLimit, res);
+
context.getState().setError(ErrorCode.ERR_TOO_MANY_USER_CONNECTIONS, errMsg);
MysqlProto.sendResponsePacket(context);
-throw new AfterConnectedException("Reach limit of
connections");
+throw new AfterConnectedException(errMsg);
}
context.setStartTime();
int userQueryTimeout =
context.getEnv().getAuth().getQueryTimeout(context.getQualifiedUser());
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectScheduler.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectScheduler.java
index e4626a0d215..1618ca2dd43 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectScheduler.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectScheduler.java
@@ -90,10 +90,12 @@ public class ConnectScheduler {
}
// Register one connection with its connection id.
-public boolean registerConnection(ConnectContext ctx) {
+// Return -1 means register OK
+// Return >=0 means register failed, and return value is current
connection num.
+public int registerConnection(ConnectContext ctx) {
if (numberConnection.incrementAndGet() > maxConnections) {
numberConnection.decrementAndGet();
-return false;
+return numberConnection.get();
}
// Check user
connByUser.putIfAbsent(ctx.getQualifiedUser(), new AtomicInteger(0));
@@ -101,13 +103,13 @@ public class ConnectScheduler {
if (conns.incrementAndGet() >
ctx.getEnv().getAuth().getMaxConn(ctx.getQualifiedUser())) {
conns.decrementAndGet();
numberConnection.decrementAndGet();
-return false;
+return numberConnection.get();
}
connectionMap.put(ctx.getConnectionId(), ctx);
if (ctx.getConnectType().equals(ConnectType.ARROW_FLIGHT_SQL)) {
flightToken2ConnectionId.put(ctx.getPeerIdentity(),
ctx.getConnectionId());
}
-return true;
+return -1;
}
public void unregisterConnection(ConnectContext ctx) {
@@ -202,4 +204,8 @@ public class ConnectScheduler {
public Map getConnectionMap() {
return connectionMap;
}
+
+public int getMaxConnections() {
+return maxConnections;
+}
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/sessions/FlightSessionsWithTokenManager.java
b/fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/sessions/FlightSessionsWithTokenManager.java
index 75d7ff1b334..a495b02c393 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/sessions/FlightSessionsWithTokenManager.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/service/arrowflight/sessions/FlightSessionsWithTokenManager.java
@@ -20,6 +20,7 @@ package org.apache.doris.service.arrowflight.sessions;
import org.apache.doris.common.ErrorCode;
import org.apache.doris.common.util.Util;
import org.apache.doris.qe.ConnectC
Re: [PR] [enhance] delete temporary files and disk detection [doris]
Thearas commented on PR #49962: URL: https://github.com/apache/doris/pull/49962#issuecomment-2792119724 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]
zclllyybb commented on PR #49972: URL: https://github.com/apache/doris/pull/49972#issuecomment-2793003387 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
doris-robot commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2792107237 TPC-H: Total hot run time: 34497 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 129657ff6063033e6147db3dce0f53c1e0c3bade, data reload: false -- Round 1 -- q1 26294 510051785100 q2 2078300 201 201 q3 10586 1304725 725 q4 10277 1032525 525 q5 7913248023752375 q6 205 164 130 130 q7 912 739 594 594 q8 9316136911341134 q9 6893515551575155 q10 6810233518881888 q11 499 288 266 266 q12 346 361 217 217 q13 17783 367530813081 q14 225 232 205 205 q15 536 484 490 484 q16 626 630 578 578 q17 634 886 393 393 q18 7701726471677167 q19 1658982 562 562 q20 344 344 240 240 q21 4516341825082508 q22 10651032969 969 Total cold run time: 117217 ms Total hot run time: 34497 ms - Round 2, with runtime_filter_mode=off - q1 5212515851575157 q2 245 335 235 235 q3 2162267222892289 q4 1463186714231423 q5 4252417741274127 q6 211 163 122 122 q7 1865181216221622 q8 2515245525572455 q9 6939683468046804 q10 2900309326562656 q11 579 495 476 476 q12 646 720 579 579 q13 3320370930763076 q14 273 281 255 255 q15 515 465 469 465 q16 648 684 629 629 q17 1122159013121312 q18 7382707369836983 q19 803 817 1014817 q20 1930196418191819 q21 5179474945444544 q22 10481035975 975 Total cold run time: 51209 ms Total hot run time: 48820 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Test pipeline tasks [doris]
doris-robot commented on PR #49940: URL: https://github.com/apache/doris/pull/49940#issuecomment-2791548391 ClickBench: Total hot run time: 31.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit aa3a931f5de9c025addb75119fadbfc5a49c4515, data reload: false query1 0.040.030.03 query2 0.130.110.10 query3 0.250.190.20 query4 1.580.200.19 query5 0.600.570.58 query6 1.230.710.72 query7 0.020.020.01 query8 0.040.040.03 query9 0.600.530.51 query10 0.570.600.58 query11 0.160.110.11 query12 0.140.110.12 query13 0.620.610.61 query14 2.732.702.71 query15 0.930.870.85 query16 0.380.390.38 query17 1.011.011.05 query18 0.210.200.20 query19 1.982.051.78 query20 0.010.010.01 query21 15.40 0.910.54 query22 0.771.340.74 query23 14.74 1.410.61 query24 6.791.301.05 query25 0.500.270.12 query26 0.680.160.14 query27 0.050.040.05 query28 9.460.900.45 query29 12.56 4.023.34 query30 0.250.090.06 query31 2.830.590.39 query32 3.240.560.49 query33 3.023.133.06 query34 15.81 5.164.52 query35 4.524.534.50 query36 0.680.500.49 query37 0.090.060.07 query38 0.050.040.04 query39 0.030.020.03 query40 0.170.140.13 query41 0.080.030.03 query42 0.040.020.03 query43 0.030.030.03 Total cold run time: 105.02 s Total hot run time: 31.55 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](Nereids) cse extract wrong expression from lambda expressions (#49166) [doris]
github-actions[bot] commented on PR #49942: URL: https://github.com/apache/doris/pull/49942#issuecomment-2791874735 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49951-branch-2.1 created (now bfe74695603)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49951-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at bfe74695603 branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) (#49911) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (a13d8a94375 -> 1f56e2e90b0)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from a13d8a94375 [Refactor](lock) Remove SpinLock compeletely (#49872) add 1f56e2e90b0 [feat](dialect) add starrocks dialect (#49951) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/doris/nereids/parser/Dialect.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49951-branch-3.0 updated (3de3682a9fd -> de3f511878b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49951-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from 3de3682a9fd branch-3.0: [Fix](full compaction) Fix problems for full compaction #49825 (#49917) add de3f511878b [feat](dialect) add starrocks dialect (#49951) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/doris/nereids/parser/Dialect.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [feat](dialect) add starrocks dialect #49951 [doris]
github-actions[bot] opened a new pull request, #49973: URL: https://github.com/apache/doris/pull/49973 Cherry-picked from #49951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-2.1: [feat](dialect) add starrocks dialect #49951 [doris]
github-actions[bot] opened a new pull request, #49974: URL: https://github.com/apache/doris/pull/49974 Cherry-picked from #49951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49951-branch-3.0 created (now 3de3682a9fd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49951-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at 3de3682a9fd branch-3.0: [Fix](full compaction) Fix problems for full compaction #49825 (#49917) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49951-branch-2.1 updated (bfe74695603 -> 8fead283a34)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49951-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from bfe74695603 branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) (#49911) add 8fead283a34 [feat](dialect) add starrocks dialect (#49951) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/doris/nereids/parser/Dialect.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [feat](dialect) add starrocks dialect #49951 [doris]
hello-stephen commented on PR #49974: URL: https://github.com/apache/doris/pull/49974#issuecomment-2793709667 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [feat](dialect) add starrocks dialect #49951 [doris]
dataroaring closed pull request #49974: branch-2.1: [feat](dialect) add starrocks dialect #49951 URL: https://github.com/apache/doris/pull/49974 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [feat](dialect) add starrocks dialect #49951 [doris]
hello-stephen commented on PR #49974: URL: https://github.com/apache/doris/pull/49974#issuecomment-2793710598 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](UT) Fix UT failure [doris]
doris-robot commented on PR #49969: URL: https://github.com/apache/doris/pull/49969#issuecomment-2793161993 TPC-H: Total hot run time: 34583 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 02dd33e31d465a519ef48e71c818e9d29cd73763, data reload: false -- Round 1 -- q1 27115 507651125076 q2 2078301 202 202 q3 10349 1259692 692 q4 10225 1015519 519 q5 8128243024012401 q6 192 170 137 137 q7 927 756 605 605 q8 9315130311571157 q9 6837514652035146 q10 6807232819141914 q11 496 282 280 280 q12 352 358 223 223 q13 17762 371330713071 q14 247 222 207 207 q15 538 484 488 484 q16 617 631 586 586 q17 598 887 374 374 q18 7812726371937193 q19 1240965 558 558 q20 348 336 229 229 q21 4491350725492549 q22 10531031980 980 Total cold run time: 117527 ms Total hot run time: 34583 ms - Round 2, with runtime_filter_mode=off - q1 5143513951595139 q2 237 330 232 232 q3 2204266522702270 q4 1504194414751475 q5 4537447243314331 q6 220 175 129 129 q7 2042193918261826 q8 2655270526202620 q9 7158724371827182 q10 2976315127692769 q11 589 517 490 490 q12 691 777 621 621 q13 3609398033093309 q14 287 323 262 262 q15 532 480 473 473 q16 641 681 652 652 q17 1174155114061406 q18 8008758972337233 q19 830 825 917 825 q20 1982208618921892 q21 5417493147504750 q22 1105106110511051 Total cold run time: 53541 ms Total hot run time: 50937 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feat](dialect) add starrocks dialect #49951 [doris]
doris-robot commented on PR #49973: URL: https://github.com/apache/doris/pull/49973#issuecomment-2794132175 TPC-H: Total hot run time: 39945 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit de3f511878b79b54050238cc23951fb6d4a6e7eb, data reload: false -- Round 1 -- q1 17580 675065766576 q2 2051170 192 170 q3 10545 108511661085 q4 10550 760 737 737 q5 7831285028092809 q6 219 134 130 130 q7 980 615 594 594 q8 9357195219931952 q9 6682642264176417 q10 6991225522892255 q11 453 258 268 258 q12 400 214 212 212 q13 18033 301329972997 q14 231 210 239 210 q15 524 475 461 461 q16 657 584 589 584 q17 964 686 580 580 q18 7407666565886588 q19 14031083994 994 q20 489 204 206 204 q21 4014318831543154 q22 1075995 978 978 Total cold run time: 108436 ms Total hot run time: 39945 ms - Round 2, with runtime_filter_mode=off - q1 6682667366276627 q2 349 242 243 242 q3 3052296631532966 q4 2123184118851841 q5 5895601759875987 q6 221 132 146 132 q7 2290190318881888 q8 3473360736403607 q9 9028885488818854 q10 3534351535023502 q11 579 496 494 494 q12 817 610 590 590 q13 14996 315232183152 q14 311 262 277 262 q15 514 469 443 443 q16 674 637 651 637 q17 1803161716061606 q18 8349775677087708 q19 1667150015631500 q20 2087184819001848 q21 5566536153645361 q22 1161103710461037 Total cold run time: 75171 ms Total hot run time: 60284 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](nereids)support stream load, routine load and broker load in nereids [doris]
doris-robot commented on PR #49116: URL: https://github.com/apache/doris/pull/49116#issuecomment-2794163546 TPC-DS: Total hot run time: 193588 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d85450055444bb8be2f4fbf329efef5e2d46cf6e, data reload: false query1 1395108510561056 query2 6483193819361936 query3 11034 461245574557 query4 25810 23802 23442 23442 query5 4929652 470 470 query6 328 209 204 204 query7 3988500 284 284 query8 311 256 240 240 query9 8521261426002600 query10 521 319 269 269 query11 16127 14981 14744 14744 query12 174 109 113 109 query13 1582521 395 395 query14 9770644161936193 query15 209 195 171 171 query16 7609662 478 478 query17 1145751 611 611 query18 2035431 363 363 query19 201 204 169 169 query20 131 123 125 123 query21 211 127 105 105 query22 4522462042714271 query23 34659 33627 33471 33471 query24 8283248324452445 query25 504 469 406 406 query26 725 272 153 153 query27 3080515 344 344 query28 4671243223962396 query29 660 566 454 454 query30 279 233 199 199 query31 931 871 810 810 query32 76 68 67 67 query33 545 376 330 330 query34 817 893 523 523 query35 804 857 797 797 query36 1010987 884 884 query37 129 105 80 80 query38 4273422741444144 query39 1498147314601460 query40 230 121 118 118 query41 54 51 52 51 query42 134 108 113 108 query43 519 531 493 493 query44 1378815 833 815 query45 188 178 173 173 query46 857 1036655 655 query47 1790185117671767 query48 390 419 319 319 query49 737 541 427 427 query50 700 697 404 404 query51 4244449443164316 query52 109 110 100 100 query53 238 272 191 191 query54 593 593 523 523 query55 85 87 83 83 query56 327 314 281 281 query57 1185118811351135 query58 272 261 275 261 query59 2588281427392739 query60 337 353 315 315 query61 156 153 129 129 query62 801 731 710 710 query63 234 192 188 188 query64 31741050696 696 query65 4420432544174325 query66 801 418 327 327 query67 15860 15424 15313 15313 query68 8387905 510 510 query69 481 298 276 276 query70 1148115611171117 query71 472 334 291 291 query72 5800477746724672 query73 671 602 352 352 query74 9116883190738831 query75 3909318627082708 query76 37151181788 788 query77 792 377 285 285 query78 10095 10299 93309330 query79 1991825 573 573 query80 593 524 450 450 query81 582 257 223 223 query82 440 127 100 100 query83 259 271 247 247 query84 251 109 92 92 query85 800 354 314 314 query86 340 309 298 298 query87 4413451243864386 query88 3469225522312231 query89 415 321 287 287 query90 1900218 222 218 query91 152 149 112 112 query92 80 62 60 60 query93 1215962 576 576 query94 677 436 319 319 query95 379 306 289 289 query96 517 563 335 335 query97 3173327431033103 query98 246 213 209 209 query99 1411142412911291 Total cold run time: 280270 ms Total hot run time: 193588 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] branch-3.0: [feat](dialect) add starrocks dialect #49951 [doris]
doris-robot commented on PR #49973: URL: https://github.com/apache/doris/pull/49973#issuecomment-2794198618 TPC-DS: Total hot run time: 196538 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit de3f511878b79b54050238cc23951fb6d4a6e7eb, data reload: false query1 1288900 900 900 query2 6231207420582058 query3 10815 429543314295 query4 60647 29163 23295 23295 query5 5249449 445 445 query6 405 186 175 175 query7 5475315 302 302 query8 308 231 228 228 query9 8546260525962596 query10 461 264 255 255 query11 17382 15526 15773 15526 query12 156 107 108 107 query13 1425452 443 443 query14 10684 670574986705 query15 202 183 168 168 query16 7155468 492 468 query17 1135594 572 572 query18 1871324 330 324 query19 214 163 168 163 query20 119 120 110 110 query21 199 107 110 107 query22 4614434445594344 query23 34536 33902 34243 33902 query24 6273293729782937 query25 555 414 458 414 query26 656 163 160 160 query27 1845353 348 348 query28 4052242823702370 query29 691 434 442 434 query30 252 170 166 166 query31 1011840 844 840 query32 76 61 56 56 query33 401 297 313 297 query34 902 513 514 513 query35 852 731 731 731 query36 1078975 981 975 query37 115 64 67 64 query38 4149399839883988 query39 1493148314591459 query40 196 101 101 101 query41 50 48 50 48 query42 120 102 100 100 query43 528 494 483 483 query44 1173798 822 798 query45 182 169 164 164 query46 1167702 749 702 query47 2057192919661929 query48 465 382 399 382 query49 729 402 392 392 query50 824 439 438 438 query51 7412732272347234 query52 107 88 89 88 query53 262 188 183 183 query54 559 468 465 465 query55 76 76 78 76 query56 265 261 255 255 query57 1308117911921179 query58 219 215 209 209 query59 3208293329792933 query60 279 260 253 253 query61 121 138 115 115 query62 770 671 664 664 query63 211 185 184 184 query64 1398680 660 660 query65 3235320832033203 query66 700 302 304 302 query67 15970 15594 15464 15464 query68 4186567 564 564 query69 440 265 256 256 query70 1180112310591059 query71 356 255 259 255 query72 6389402241114022 query73 748 346 346 346 query74 10519 882189008821 query75 3384266126302630 query76 2104101311291013 query77 494 262 264 262 query78 10483 962695659565 query79 1888589 604 589 query80 1410430 416 416 query81 529 248 243 243 query82 122490 87 87 query83 267 153 144 144 query84 290 84 79 79 query85 1010298 317 298 query86 376 274 306 274 query87 4420435443084308 query88 3907240323682368 query89 431 292 296 292 query90 2016190 189 189 query91 200 162 159 159 query92 69 84 49 49 query93 2196544 544 544 query94 799 300 303 300 query95 359 252 255 252 query96 611 286 293 286 query97 3335315431983154 query98 207 198 192 192 query99 1613130112781278 Total cold run time: 314549 ms Total hot run time: 196538 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement](compaction) Try get galobal lock when execute compaction [doris]
doris-robot commented on PR #49882: URL: https://github.com/apache/doris/pull/49882#issuecomment-2794316979 TPC-DS: Total hot run time: 193259 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit db4adce4281035815cd5ca27b67293ab51163add, data reload: false query1 1397107610861076 query2 6098195919411941 query3 11160 473745504550 query4 25506 23721 22907 22907 query5 4870596 454 454 query6 291 206 199 199 query7 3995491 292 292 query8 336 257 240 240 query9 8533262225952595 query10 489 312 263 263 query11 15707 15095 14861 14861 query12 162 110 120 110 query13 1561544 398 398 query14 9472615164016151 query15 203 185 174 174 query16 7628670 466 466 query17 1172806 608 608 query18 2024427 342 342 query19 218 195 176 176 query20 131 131 125 125 query21 206 125 112 112 query22 4378441643634363 query23 34578 6 33548 6 query24 8421249724632463 query25 508 446 418 418 query26 1180276 151 151 query27 2666508 336 336 query28 4401247724252425 query29 690 586 441 441 query30 275 224 219 219 query31 929 846 810 810 query32 73 62 66 62 query33 564 369 324 324 query34 803 872 569 569 query35 798 878 771 771 query36 939 989 909 909 query37 125 99 83 83 query38 4298422142354221 query39 1496145915031459 query40 211 119 105 105 query41 53 55 52 52 query42 119 104 107 104 query43 511 519 491 491 query44 1355821 840 821 query45 190 176 166 166 query46 845 1016679 679 query47 1852188017801780 query48 371 411 328 328 query49 804 508 440 440 query50 664 704 422 422 query51 4315425741924192 query52 109 104 97 97 query53 242 262 185 185 query54 617 574 512 512 query55 89 83 86 83 query56 313 316 316 316 query57 1203118311071107 query58 268 268 260 260 query59 2847296528092809 query60 346 317 303 303 query61 133 138 131 131 query62 782 758 666 666 query63 237 196 209 196 query64 40131018695 695 query65 4329421542424215 query66 1000404 317 317 query67 16044 15463 15305 15305 query68 8884899 517 517 query69 485 312 268 268 query70 1238109411031094 query71 459 323 297 297 query72 5893474347714743 query73 717 596 353 353 query74 8937927790349034 query75 4181325527192719 query76 38551199766 766 query77 805 384 296 296 query78 10035 10144 93009300 query79 2509816 587 587 query80 754 507 486 486 query81 478 264 225 225 query82 453 127 94 94 query83 282 258 240 240 query84 290 98 90 90 query85 793 351 317 317 query86 337 329 262 262 query87 4540461944204420 query88 2888228322562256 query89 427 308 289 289 query90 1983219 221 219 query91 149 143 114 114 query92 142 65 57 57 query93 1651958 574 574 query94 686 425 308 308 query95 371 292 290 290 query96 490 568 277 277 query97 3160321031423142 query98 222 199 195 195 query99 1417141312531253 Total cold run time: 281654 ms Total hot run time: 193259 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Fix](compaction) Only print delete compaction log when there is a delete rowset [doris]
Yukang-Lian commented on PR #49953: URL: https://github.com/apache/doris/pull/49953#issuecomment-2792001180 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Agg table set preagg on when doing sample analyzing. [doris]
doris-robot commented on PR #49918: URL: https://github.com/apache/doris/pull/49918#issuecomment-2794365928 TPC-H: Total hot run time: 33836 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit b9f90f95611005381621404526a5c79eee145886, data reload: false -- Round 1 -- q1 28293 501850865018 q2 2043273 190 190 q3 10396 1213680 680 q4 10222 986 532 532 q5 7546231023322310 q6 184 162 133 133 q7 904 729 600 600 q8 9309121610641064 q9 6754508350735073 q10 6857228418801880 q11 492 284 268 268 q12 347 341 219 219 q13 18096 370330883088 q14 223 243 218 218 q15 523 479 486 479 q16 623 614 580 580 q17 583 842 377 377 q18 7637716770077007 q19 1979957 541 541 q20 324 325 216 216 q21 4006339824012401 q22 10931019962 962 Total cold run time: 118434 ms Total hot run time: 33836 ms - Round 2, with runtime_filter_mode=off - q1 5253509451555094 q2 237 329 245 245 q3 2146267522932293 q4 1464194414781478 q5 4487438243674367 q6 221 171 128 128 q7 1987190017701770 q8 2612257825322532 q9 7302710375387103 q10 2994322728592859 q11 600 526 521 521 q12 719 792 665 665 q13 3677414836773677 q14 294 317 289 289 q15 531 474 488 474 q16 663 718 655 655 q17 1176155414031403 q18 7884761174507450 q19 816 803 864 803 q20 2004199918671867 q21 5239485248184818 q22 1136106810381038 Total cold run time: 53442 ms Total hot run time: 51529 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
hello-stephen commented on PR #49975: URL: https://github.com/apache/doris/pull/49975#issuecomment-2793976369 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
Gabriel39 merged PR #49939: URL: https://github.com/apache/doris/pull/49939 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](task) Do some refactor [doris]
Gabriel39 commented on PR #49950: URL: https://github.com/apache/doris/pull/49950#issuecomment-2791805044 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feat](dialect) add starrocks dialect #49951 [doris]
doris-robot commented on PR #49973: URL: https://github.com/apache/doris/pull/49973#issuecomment-2794224052 ClickBench: Total hot run time: 31.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit de3f511878b79b54050238cc23951fb6d4a6e7eb, data reload: false query1 0.030.030.03 query2 0.070.020.04 query3 0.240.070.06 query4 1.630.100.11 query5 0.520.510.50 query6 1.140.730.74 query7 0.020.010.03 query8 0.040.030.03 query9 0.570.500.49 query10 0.560.550.55 query11 0.140.100.10 query12 0.140.120.11 query13 0.610.600.58 query14 2.822.772.86 query15 0.920.820.84 query16 0.390.390.41 query17 1.081.021.01 query18 0.240.220.20 query19 1.991.812.03 query20 0.020.010.01 query21 15.37 0.560.58 query22 2.292.741.81 query23 17.10 1.010.77 query24 3.350.661.16 query25 0.160.260.13 query26 0.440.140.14 query27 0.040.040.03 query28 10.32 0.540.45 query29 12.61 3.203.17 query30 0.240.060.06 query31 2.860.390.38 query32 3.260.450.45 query33 3.002.992.97 query34 17.05 4.504.48 query35 4.514.494.47 query36 0.690.470.48 query37 0.090.060.06 query38 0.050.030.03 query39 0.030.030.02 query40 0.160.120.12 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 106.94 s Total hot run time: 31.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner) fix fallback to legacy planner compute wrong result [doris]
yiguolei merged PR #49913: URL: https://github.com/apache/doris/pull/49913 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1-pick: [Fix](full compaction) Fix problems for full compaction #49825 (#49919)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 308ede0657e branch-2.1-pick: [Fix](full compaction) Fix problems for
full compaction #49825 (#49919)
308ede0657e is described below
commit 308ede0657effcf94927e860ea103c540efabb8e
Author: bobhan1
AuthorDate: Thu Apr 10 23:26:39 2025 +0800
branch-2.1-pick: [Fix](full compaction) Fix problems for full compaction
#49825 (#49919)
pick https://github.com/apache/doris/pull/49825
---
be/src/olap/full_compaction.cpp| 98 ++---
be/src/olap/full_compaction.h | 5 +-
.../test_full_compaction_mow.out | Bin 0 -> 181 bytes
.../test_full_compaction_mow.groovy| 98 +
4 files changed, 146 insertions(+), 55 deletions(-)
diff --git a/be/src/olap/full_compaction.cpp b/be/src/olap/full_compaction.cpp
index 74bad632250..04efe95132e 100644
--- a/be/src/olap/full_compaction.cpp
+++ b/be/src/olap/full_compaction.cpp
@@ -35,6 +35,7 @@
#include "olap/schema_change.h"
#include "olap/tablet_meta.h"
#include "runtime/thread_context.h"
+#include "util/debug_points.h"
#include "util/thread.h"
#include "util/trace.h"
@@ -112,13 +113,46 @@ Status FullCompaction::pick_rowsets_to_compact() {
}
Status FullCompaction::modify_rowsets(const Merger::Statistics* stats) {
+std::vector output_rowsets {_output_rowset};
if (_tablet->keys_type() == KeysType::UNIQUE_KEYS &&
_tablet->enable_unique_key_merge_on_write()) {
-RETURN_IF_ERROR(
-_full_compaction_update_delete_bitmap(_output_rowset,
_output_rs_writer.get()));
-}
-std::vector output_rowsets(1, _output_rowset);
-{
+std::vector tmp_rowsets {};
+
+// tablet is under alter process. The delete bitmap will be calculated
after conversion.
+if (_tablet->tablet_state() == TABLET_NOTREADY) {
+LOG(INFO) << "tablet is under alter process, update delete bitmap
later, tablet_id="
+ << _tablet->tablet_id();
+return Status::OK();
+}
+
+int64_t max_version = _tablet->max_version().second;
+DCHECK(max_version >= _output_rowset->version().second);
+if (max_version > _output_rowset->version().second) {
+RETURN_IF_ERROR(_tablet->capture_consistent_rowsets(
+{_output_rowset->version().second + 1, max_version},
&tmp_rowsets));
+}
+
+for (const auto& it : tmp_rowsets) {
+const int64_t& cur_version = it->rowset_meta()->start_version();
+RETURN_IF_ERROR(_full_compaction_calc_delete_bitmap(it,
_output_rowset, cur_version,
+
_output_rs_writer.get()));
+}
+DBUG_EXECUTE_IF("FullCompaction.modify_rowsets.before.block",
DBUG_BLOCK);
+std::lock_guard rowset_update_lock(_tablet->get_rowset_update_lock());
+std::lock_guard header_lock(_tablet->get_header_lock());
+SCOPED_SIMPLE_TRACE_IF_TIMEOUT(TRACE_TABLET_LOCK_THRESHOLD);
+for (const auto& it : _tablet->rowset_map()) {
+const int64_t& cur_version = it.first.first;
+const RowsetSharedPtr& published_rowset = it.second;
+if (cur_version > max_version) {
+RETURN_IF_ERROR(_full_compaction_calc_delete_bitmap(
+published_rowset, _output_rowset, cur_version,
_output_rs_writer.get()));
+}
+}
+RETURN_IF_ERROR(_tablet->modify_rowsets(output_rowsets,
_input_rowsets, true));
+DBUG_EXECUTE_IF("FullCompaction.modify_rowsets.sleep", { sleep(5); })
+_tablet->save_meta();
+} else {
std::lock_guard
rowset_update_wlock(_tablet->get_rowset_update_lock());
std::lock_guard
meta_wlock(_tablet->get_header_lock());
RETURN_IF_ERROR(_tablet->modify_rowsets(output_rowsets,
_input_rowsets, true));
@@ -148,55 +182,16 @@ Status FullCompaction::_check_all_version(const
std::vector& ro
return Status::OK();
}
-Status FullCompaction::_full_compaction_update_delete_bitmap(const
RowsetSharedPtr& rowset,
- RowsetWriter*
rowset_writer) {
-std::vector tmp_rowsets {};
-
-// tablet is under alter process. The delete bitmap will be calculated
after conversion.
-if (_tablet->tablet_state() == TABLET_NOTREADY) {
-LOG(INFO) << "tablet is under alter process, update delete bitmap
later, tablet_id="
- << _tablet->tablet_id();
-return Status::OK();
-}
-
-int64_t max_version = _tablet->max_version().second;
-DCHECK(max_version >= rowset->version().second);
-if (max_version > rowset->version().second) {
-
Re: [PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
doris-robot commented on PR #49975: URL: https://github.com/apache/doris/pull/49975#issuecomment-2794240916 TPC-H: Total hot run time: 40108 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ad51f5bd48f6a1829c099003125cb453ef353eb7, data reload: false -- Round 1 -- q1 17572 672766256625 q2 2055167 180 167 q3 10735 108611791086 q4 10526 701 694 694 q5 7718286228502850 q6 219 133 131 131 q7 959 621 603 603 q8 9747197620771976 q9 6686646064186418 q10 7011227923062279 q11 474 259 261 259 q12 389 214 210 210 q13 17797 301530363015 q14 234 207 213 207 q15 513 463 460 460 q16 655 596 577 577 q17 971 555 520 520 q18 7155681366706670 q19 1397100210081002 q20 483 201 203 201 q21 4280337031533153 q22 1110102210051005 Total cold run time: 108686 ms Total hot run time: 40108 ms - Round 2, with runtime_filter_mode=off - q1 6594652170776521 q2 335 235 231 231 q3 2906275328952753 q4 2059183518441835 q5 5747570157375701 q6 213 128 124 124 q7 2166182118471821 q8 3391352934903490 q9 8713881388388813 q10 3570355035413541 q11 595 486 487 486 q12 815 616 620 616 q13 7630325631503150 q14 305 265 282 265 q15 509 463 462 462 q16 699 643 670 643 q17 1819160415931593 q18 8162782675897589 q19 1658154216581542 q20 2091186119041861 q21 5527531553415315 q22 1162106610511051 Total cold run time: 6 ms Total hot run time: 59403 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Agg table set preagg on when doing sample analyzing. [doris]
Jibing-Li commented on PR #49918: URL: https://github.com/apache/doris/pull/49918#issuecomment-2794240713 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](inverted_index) add ik analyzer for chinese language [doris]
Ryan19929 commented on PR #49519: URL: https://github.com/apache/doris/pull/49519#issuecomment-2794260897 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1: [fix](Nereids) cse extract wrong expression from lambda expressions (#49166) (#49942)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new e4d0c672a30 branch-2.1: [fix](Nereids) cse extract wrong expression
from lambda expressions (#49166) (#49942)
e4d0c672a30 is described below
commit e4d0c672a3083006ab4ba090258b862240c8265f
Author: 924060929
AuthorDate: Thu Apr 10 23:22:55 2025 +0800
branch-2.1: [fix](Nereids) cse extract wrong expression from lambda
expressions (#49166) (#49942)
cherry pick from #49166
Co-authored-by: morrySnow
---
.../post/CommonSubExpressionCollector.java | 24 ---
.../processor/post/CommonSubExpressionOpt.java | 2 +-
.../postprocess/CommonSubExpressionTest.java | 46 --
.../suites/nereids_rules_p0/cse/cse.groovy | 39 ++
4 files changed, 92 insertions(+), 19 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionCollector.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionCollector.java
index 877e411a539..520902c0439 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionCollector.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionCollector.java
@@ -17,7 +17,10 @@
package org.apache.doris.nereids.processor.post;
+import org.apache.doris.nereids.trees.expressions.ArrayItemReference;
+import
org.apache.doris.nereids.trees.expressions.ArrayItemReference.ArrayItemSlot;
import org.apache.doris.nereids.trees.expressions.Expression;
+import org.apache.doris.nereids.trees.expressions.functions.scalar.Lambda;
import org.apache.doris.nereids.trees.expressions.visitor.ExpressionVisitor;
import java.util.HashMap;
@@ -28,29 +31,38 @@ import java.util.Set;
/**
* collect common expr
*/
-public class CommonSubExpressionCollector extends ExpressionVisitor {
+public class CommonSubExpressionCollector extends ExpressionVisitor {
public final Map> commonExprByDepth = new
HashMap<>();
private final Map> expressionsByDepth = new
HashMap<>();
+public int collect(Expression expr) {
+return expr.accept(this, expr instanceof Lambda);
+}
+
@Override
-public Integer visit(Expression expr, Void context) {
+public Integer visit(Expression expr, Boolean inLambda) {
if (expr.children().isEmpty()) {
return 0;
}
return collectCommonExpressionByDepth(
expr.children()
.stream()
-.map(child -> child.accept(this, context))
+.map(child -> child.accept(this, inLambda == null ||
inLambda || child instanceof Lambda))
.reduce(Math::max)
.map(m -> m + 1)
.orElse(1),
-expr
+expr,
+inLambda == null || inLambda
);
}
-private int collectCommonExpressionByDepth(int depth, Expression expr) {
+private int collectCommonExpressionByDepth(int depth, Expression expr,
boolean inLambda) {
Set expressions = getExpressionsFromDepthMap(depth,
expressionsByDepth);
-if (expressions.contains(expr)) {
+// ArrayItemSlot and ArrayItemReference could not be common expressions
+// TODO: could not extract common expression when expression contains
same lambda expression
+// because ArrayItemSlot in Lambda are not same.
+if (expressions.contains(expr)
+&& !(inLambda && expr.containsType(ArrayItemSlot.class,
ArrayItemReference.class))) {
Set commonExpression =
getExpressionsFromDepthMap(depth, commonExprByDepth);
commonExpression.add(expr);
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionOpt.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionOpt.java
index fca84167994..82239f2c2c9 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionOpt.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/CommonSubExpressionOpt.java
@@ -65,7 +65,7 @@ public class CommonSubExpressionOpt extends PlanPostProcessor
{
List> multiLayers = Lists.newArrayList();
CommonSubExpressionCollector collector = new
CommonSubExpressionCollector();
for (Expression expr : projects) {
-expr.accept(collector, null);
+collector.collect(expr);
}
Map aliasMap = new HashMap<>();
if (!collector.commonExprByDepth.isEmpty()) {
diff --git
a/fe/fe-core/src/test/java/org/apache/doris/nereids/postprocess/CommonSubExpressionTes
[PR] [fix](compile) fix typo [doris]
hello-stephen opened a new pull request, #49963: URL: https://github.com/apache/doris/pull/49963 cp: cannot stat '/home/zcp/repo_center/doris_master/doris/thirdparty/installed/jindofs_libs/jindo-core-linux-el7-aarch64-[0-9]*.jar': No such file or directory ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](Nereids) cse extract wrong expression from lambda expressions (#49166) [doris]
yiguolei merged PR #49942: URL: https://github.com/apache/doris/pull/49942 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](beut) add pipeline TableFunction Operator beut [doris]
github-actions[bot] commented on PR #49880: URL: https://github.com/apache/doris/pull/49880#issuecomment-2791682682 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](group commit) group commit use selected be for cloud mode [doris]
mymeiyi commented on PR #49967: URL: https://github.com/apache/doris/pull/49967#issuecomment-2792318415 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [enhance](hive) support skip.header.line.count #49929 [doris]
doris-robot commented on PR #49975: URL: https://github.com/apache/doris/pull/49975#issuecomment-2794287258 TPC-DS: Total hot run time: 196622 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ad51f5bd48f6a1829c099003125cb453ef353eb7, data reload: false query1 1314944 945 944 query2 6268208920782078 query3 10921 429346264293 query4 65526 28554 23550 23550 query5 5034473 457 457 query6 422 178 180 178 query7 5653311 305 305 query8 319 225 221 221 query9 9204258825792579 query10 487 277 276 276 query11 17983 15228 16073 15228 query12 155 111 104 104 query13 1566453 447 447 query14 10462 677968356779 query15 211 199 176 176 query16 7152441 484 441 query17 1056547 577 547 query18 1876320 303 303 query19 245 152 160 152 query20 121 110 107 107 query21 201 101 101 101 query22 4926472143124312 query23 34436 34109 33808 33808 query24 6245288128932881 query25 503 388 406 388 query26 664 168 162 162 query27 2015342 366 342 query28 3970244724192419 query29 688 437 432 432 query30 243 163 165 163 query31 986 822 833 822 query32 63 54 54 54 query33 413 327 305 305 query34 905 527 510 510 query35 838 717 727 717 query36 1063968 981 968 query37 122 74 72 72 query38 4067408939693969 query39 1536147814731473 query40 211 101 105 101 query41 51 50 51 50 query42 113 104 99 99 query43 536 487 496 487 query44 1164823 841 823 query45 192 170 168 168 query46 1163722 733 722 query47 1982194219641942 query48 461 397 393 393 query49 756 400 417 400 query50 854 427 443 427 query51 7393732670667066 query52 101 90 91 90 query53 255 186 187 186 query54 568 447 454 447 query55 83 79 77 77 query56 275 253 261 253 query57 1239109711141097 query58 221 213 214 213 query59 3187306331023063 query60 297 262 259 259 query61 131 130 130 130 query62 775 661 674 661 query63 216 196 197 196 query64 1513668 628 628 query65 3286317632353176 query66 705 293 301 293 query67 15910 15577 15721 15577 query68 3985571 578 571 query69 428 263 275 263 query70 1156109311351093 query71 356 255 265 255 query72 6411412440344034 query73 758 341 349 341 query74 10161 918391659165 query75 3258262826372628 query76 1842101710941017 query77 456 266 259 259 query78 10404 960495049504 query79 1496587 596 587 query80 888 423 423 423 query81 512 241 243 241 query82 129791 86 86 query83 240 146 143 143 query84 279 85 77 77 query85 878 325 291 291 query86 380 289 296 289 query87 4440424643164246 query88 3816236223502350 query89 411 299 290 290 query90 1991184 184 184 query91 183 151 149 149 query92 74 47 51 47 query93 1880550 549 549 query94 824 292 291 291 query95 352 257 253 253 query96 606 276 276 276 query97 3339316531823165 query98 219 203 198 198 query99 1558130612701270 Total cold run time: 318375 ms Total hot run time: 196622 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] branch-2.1: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) [doris]
yiguolei merged PR #49911: URL: https://github.com/apache/doris/pull/49911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](nereids)support stream load, routine load and broker load in nereids [doris]
doris-robot commented on PR #49116: URL: https://github.com/apache/doris/pull/49116#issuecomment-2794094081 TPC-H: Total hot run time: 34256 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d85450055444bb8be2f4fbf329efef5e2d46cf6e, data reload: false -- Round 1 -- q1 25845 513250705070 q2 2065285 187 187 q3 10381 1251676 676 q4 10220 1014524 524 q5 7538243723822382 q6 186 171 132 132 q7 914 738 608 608 q8 9305127811271127 q9 7113523452665234 q10 6876227918671867 q11 479 281 286 281 q12 347 354 215 215 q13 17786 367830663066 q14 220 221 204 204 q15 527 470 474 470 q16 627 615 580 580 q17 611 851 366 366 q18 7555715570747074 q19 1785977 564 564 q20 338 332 231 231 q21 4381343424522452 q22 1036973 946 946 Total cold run time: 116135 ms Total hot run time: 34256 ms - Round 2, with runtime_filter_mode=off - q1 5242550751525152 q2 234 321 229 229 q3 2121262622732273 q4 1418186414721472 q5 4434448343714371 q6 227 172 128 128 q7 1977191117191719 q8 2608262525792579 q9 7245704771937047 q10 2944317327502750 q11 596 516 492 492 q12 687 766 615 615 q13 3568388533713371 q14 293 279 267 267 q15 522 460 462 460 q16 644 696 655 655 q17 1144154414021402 q18 7748751173507350 q19 810 793 794 793 q20 1929194518651865 q21 5265491848064806 q22 10811043993 993 Total cold run time: 52737 ms Total hot run time: 50789 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
