Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


hubgeter commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796078451

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


hubgeter commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796083402

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](ut) add cases about hash join [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49803:
URL: https://github.com/apache/doris/pull/49803#issuecomment-2796085627

   
   
   TPC-DS: Total hot run time: 193254 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 07a95114e49761de827284fdfb42fb13fbaacd76, 
data reload: false
   
   query1   1388106810701068
   query2   6139192119101910
   query3   3   457447354574
   query4   25439   23959   23375   23375
   query5   4989635 471 471
   query6   310 226 198 198
   query7   3999491 283 283
   query8   287 236 218 218
   query9   8518258625942586
   query10  502 313 266 266
   query11  15471   15060   14863   14863
   query12  164 121 109 109
   query13  1573531 395 395
   query14  9042624263296242
   query15  198 190 172 172
   query16  7580637 485 485
   query17  1154800 595 595
   query18  2056416 347 347
   query19  191 190 161 161
   query20  133 124 121 121
   query21  208 130 108 108
   query22  4379457943084308
   query23  34566   33702   33326   33326
   query24  8577244024022402
   query25  524 478 399 399
   query26  1163275 154 154
   query27  2913507 338 338
   query28  4741245124352435
   query29  677 570 468 468
   query30  270 227 196 196
   query31  926 898 805 805
   query32  78  69  65  65
   query33  568 376 340 340
   query34  787 862 528 528
   query35  806 863 753 753
   query36  974 1013917 917
   query37  122 103 81  81
   query38  4263431042344234
   query39  1501143714601437
   query40  224 135 118 118
   query41  61  57  57  57
   query42  123 114 111 111
   query43  524 508 489 489
   query44  1331838 834 834
   query45  189 177 173 173
   query46  842 1045674 674
   query47  1897187617741774
   query48  389 420 325 325
   query49  778 509 439 439
   query50  676 714 399 399
   query51  4269430642814281
   query52  114 110 108 108
   query53  247 256 185 185
   query54  586 595 519 519
   query55  82  88  84  84
   query56  326 309 297 297
   query57  1203119411181118
   query58  263 264 259 259
   query59  2776278126952695
   query60  342 335 305 305
   query61  139 131 128 128
   query62  761 734 693 693
   query63  235 191 189 189
   query64  42721090735 735
   query65  4421439043524352
   query66  949 399 306 306
   query67  15581   15302   15153   15153
   query68  8393886 504 504
   query69  485 293 274 274
   query70  1203109811241098
   query71  488 320 294 294
   query72  5840485349914853
   query73  723 748 352 352
   query74  9153907289078907
   query75  3947319226972697
   query76  38001192757 757
   query77  796 358 284 284
   query78  10043   10221   92619261
   query79  2385818 557 557
   query80  723 516 440 440
   query81  485 257 277 257
   query82  479 126 97  97
   query83  259 261 231 231
   query84  244 108 84  84
   query85  782 358 314 314
   query86  373 299 293 293
   query87  4545451043184318
   query88  3567221122022202
   query89  399 314 285 285
   query90  1884211 216 211
   query91  146 144 109 109
   query92  76  63  54  54
   query93  1830955 567 567
   query94  662 410 301 301
   query95  366 306 281 281
   query96  482 561 272 272
   query97  3141324731143114
   query98  244 214 201 201
   query99  1419139912521252
   Total cold run time: 281251 ms
   Total hot run time: 193254 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49904:
URL: https://github.com/apache/doris/pull/49904#issuecomment-2796093809

   
   
   TPC-DS: Total hot run time: 193356 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, 
data reload: false
   
   query1   1376107110481048
   query2   6299194819241924
   query3   11035   449044984490
   query4   53293   25699   23411   23411
   query5   4950573 446 446
   query6   328 205 189 189
   query7   4869504 291 291
   query8   327 249 251 249
   query9   5277258725952587
   query10  413 316 270 270
   query11  14997   14959   14813   14813
   query12  163 110 108 108
   query13  1046503 387 387
   query14  10157   629364566293
   query15  207 195 180 180
   query16  7102660 493 493
   query17  1132757 606 606
   query18  1570419 328 328
   query19  205 190 176 176
   query20  134 128 129 128
   query21  216 139 110 110
   query22  4320448743314331
   query23  34151   33472   33609   33472
   query24  6669242224592422
   query25  453 481 407 407
   query26  712 275 150 150
   query27  2461503 325 325
   query28  3129247924272427
   query29  602 573 423 423
   query30  294 229 199 199
   query31  873 869 785 785
   query32  76  63  63  63
   query33  463 357 299 299
   query34  777 882 526 526
   query35  793 845 772 772
   query36  940 1039916 916
   query37  115 104 78  78
   query38  4257433141014101
   query39  1538144715831447
   query40  221 135 113 113
   query41  54  51  50  50
   query42  125 110 109 109
   query43  488 493 490 490
   query44  1318822 825 822
   query45  180 187 176 176
   query46  844 1049648 648
   query47  1840185117891789
   query48  404 416 313 313
   query49  717 521 455 455
   query50  668 698 404 404
   query51  4222431742604260
   query52  107 104 102 102
   query53  223 261 202 202
   query54  587 581 508 508
   query55  85  88  82  82
   query56  311 314 303 303
   query57  1174117911801179
   query58  288 264 283 264
   query59  2785286326852685
   query60  333 330 310 310
   query61  131 142 137 137
   query62  730 751 709 709
   query63  228 186 186 186
   query64  20281030691 691
   query65  4342426342264226
   query66  767 399 305 305
   query67  15756   15676   15337   15337
   query68  7416883 510 510
   query69  547 294 259 259
   query70  1187110110991099
   query71  499 319 305 305
   query72  5954495448954895
   query73  1507665 350 350
   query74  9077894589308930
   query75  3974320126882688
   query76  43061180741 741
   query77  699 383 287 287
   query78  10010   10154   93009300
   query79  3064816 560 560
   query80  685 502 440 440
   query81  479 268 216 216
   query82  454 126 99  99
   query83  314 254 239 239
   query84  293 98  83  83
   query85  784 363 322 322
   query86  345 286 295 286
   query87  4457443843364336
   query88  3063222821972197
   query89  404 309 280 280
   query90  1979206 202 202
   query91  145 148 115 115
   query92  77  60  57  57
   query93  1301928 580 580
   query94  685 409 310 310
   query95  425 292 285 285
   query96  475 556 277 277
   query97  3167320831113111
   query98  224 204 203 203
   query99  1441141012691269
   Total cold run time: 298112 ms
   Total hot run time: 193356 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [minor](task) Complete debug string if task is finalized [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49950:
URL: https://github.com/apache/doris/pull/49950#issuecomment-2796095226

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [draft](nereids) Add constant propagation [doris]

2025-04-11 Thread via GitHub


yujun777 commented on PR #49982:
URL: https://github.com/apache/doris/pull/49982#issuecomment-2796097520

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](task) Complete debug string if task is finalized [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49950:
URL: https://github.com/apache/doris/pull/49950#issuecomment-2796095139

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](ut) add cases about hash join [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49803:
URL: https://github.com/apache/doris/pull/49803#issuecomment-2796095921

   
   
   ClickBench: Total hot run time: 31.15 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 07a95114e49761de827284fdfb42fb13fbaacd76, 
data reload: false
   
   query1   0.040.030.04
   query2   0.120.100.10
   query3   0.250.200.20
   query4   1.600.200.19
   query5   0.610.590.62
   query6   1.190.720.73
   query7   0.030.010.02
   query8   0.040.030.03
   query9   0.570.530.54
   query10  0.570.580.56
   query11  0.150.110.12
   query12  0.150.120.11
   query13  0.620.600.60
   query14  2.662.802.68
   query15  0.930.850.86
   query16  0.390.380.39
   query17  1.041.060.98
   query18  0.210.200.20
   query19  1.841.961.82
   query20  0.020.010.01
   query21  15.35   0.910.55
   query22  0.751.120.69
   query23  15.06   1.400.64
   query24  6.931.820.70
   query25  0.490.120.20
   query26  0.620.170.13
   query27  0.060.060.05
   query28  9.130.890.44
   query29  12.53   4.043.34
   query30  0.250.090.06
   query31  2.830.610.39
   query32  3.230.540.46
   query33  3.073.023.03
   query34  15.73   5.134.52
   query35  4.564.574.52
   query36  0.690.490.49
   query37  0.080.060.07
   query38  0.060.040.04
   query39  0.030.020.02
   query40  0.180.140.14
   query41  0.070.020.03
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 104.8 s
   Total hot run time: 31.15 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [draft](nereids) Add constant propagation [doris]

2025-04-11 Thread via GitHub


yujun777 commented on PR #49982:
URL: https://github.com/apache/doris/pull/49982#issuecomment-2796098356

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49904:
URL: https://github.com/apache/doris/pull/49904#issuecomment-2796104076

   
   
   ClickBench: Total hot run time: 31.66 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, 
data reload: false
   
   query1   0.040.030.03
   query2   0.130.110.11
   query3   0.240.200.19
   query4   1.600.200.20
   query5   0.610.580.60
   query6   1.200.730.72
   query7   0.020.020.02
   query8   0.040.040.03
   query9   0.590.520.52
   query10  0.570.600.57
   query11  0.150.110.11
   query12  0.140.110.11
   query13  0.600.610.60
   query14  2.772.672.72
   query15  0.940.860.84
   query16  0.380.390.40
   query17  1.021.021.05
   query18  0.210.200.19
   query19  1.871.871.86
   query20  0.010.010.02
   query21  15.38   0.900.55
   query22  0.751.250.69
   query23  14.85   1.400.64
   query24  7.021.301.19
   query25  0.450.190.06
   query26  0.630.160.15
   query27  0.060.050.04
   query28  9.710.890.43
   query29  12.55   4.013.33
   query30  0.260.090.06
   query31  2.820.590.39
   query32  3.230.550.47
   query33  3.113.113.11
   query34  15.74   5.084.51
   query35  4.494.534.46
   query36  0.670.490.47
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.020.02
   query40  0.160.140.14
   query41  0.080.030.03
   query42  0.040.030.02
   query43  0.030.030.03
   Total cold run time: 105.32 s
   Total hot run time: 31.66 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix hint existing using problems [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49987:
URL: https://github.com/apache/doris/pull/49987#issuecomment-2796109825

   
   
   TPC-H: Total hot run time: 34963 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ae8c7515292bb6c1445e6739659e31a14079, 
data reload: false
   
   -- Round 1 --
   q1   26033   504749884988
   q2   2060293 186 186
   q3   10374   1237689 689
   q4   10237   1037545 545
   q5   7528233123752331
   q6   189 167 135 135
   q7   942 749 618 618
   q8   9331130911701170
   q9   6841511150855085
   q10  6809232318861886
   q11  481 281 280 280
   q12  345 353 221 221
   q13  17752   367931343134
   q14  246 233 204 204
   q15  536 490 487 487
   q16  637 610 589 589
   q17  580 858 375 375
   q18  7573724970367036
   q19  1216949 584 584
   q20  344 325 234 234
   q21  4407339032193219
   q22  1048990 967 967
   Total cold run time: 115509 ms
   Total hot run time: 34963 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5169504050265026
   q2   238 332 248 248
   q3   2104263023072307
   q4   1395181815121512
   q5   4542441143454345
   q6   212 166 124 124
   q7   1944190817611761
   q8   2590263025452545
   q9   7111724670447044
   q10  3006319227202720
   q11  567 497 485 485
   q12  657 772 617 617
   q13  3551395132533253
   q14  273 300 263 263
   q15  508 479 479 479
   q16  647 696 666 666
   q17  1119153513481348
   q18  7665748975937489
   q19  800 789 948 789
   q20  1960193117951795
   q21  5124470647204706
   q22  10351020988 988
   Total cold run time: 52217 ms
   Total hot run time: 50510 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49984:
URL: https://github.com/apache/doris/pull/49984#issuecomment-2796112496

   
   
   TPC-H: Total hot run time: 34057 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, 
data reload: false
   
   -- Round 1 --
   q1   26130   499250124992
   q2   2069276 180 180
   q3   10406   1256715 715
   q4   10227   1007525 525
   q5   7526232523322325
   q6   188 162 132 132
   q7   898 730 607 607
   q8   9304127310861086
   q9   6908509950675067
   q10  6804231618891889
   q11  473 283 278 278
   q12  346 356 224 224
   q13  17760   370330653065
   q14  237 225 215 215
   q15  534 483 498 483
   q16  640 626 574 574
   q17  599 838 369 369
   q18  7412723470777077
   q19  1356959 576 576
   q20  327 335 231 231
   q21  3965338924672467
   q22  1050980 981 980
   Total cold run time: 115159 ms
   Total hot run time: 34057 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5140509550375037
   q2   240 344 233 233
   q3   2166264522722272
   q4   1488186714281428
   q5   4400440243644364
   q6   220 170 132 132
   q7   2001189217711771
   q8   2582254225002500
   q9   7243728071277127
   q10  2974320927172717
   q11  570 509 491 491
   q12  677 731 611 611
   q13  3483391333853385
   q14  304 285 271 271
   q15  514 477 474 474
   q16  635 689 642 642
   q17  1145151914191419
   q18  7732761675927592
   q19  803 809 832 809
   q20  1943195718041804
   q21  5320490848814881
   q22  10901032977 977
   Total cold run time: 52670 ms
   Total hot run time: 50937 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]

2025-04-11 Thread via GitHub


KeeProMise commented on PR #49852:
URL: https://github.com/apache/doris/pull/49852#issuecomment-2796117640

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix hint existing using problems [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49987:
URL: https://github.com/apache/doris/pull/49987#issuecomment-2796133742

   
   
   TPC-DS: Total hot run time: 186245 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ae8c7515292bb6c1445e6739659e31a14079, 
data reload: false
   
   query1   1033503 469 469
   query2   6570191019681910
   query3   6751222 216 216
   query4   26132   23640   23542   23542
   query5   4771619 473 473
   query6   316 217 198 198
   query7   4639490 274 274
   query8   289 238 229 229
   query9   8649258025822580
   query10  503 332 282 282
   query11  15352   14999   14889   14889
   query12  156 111 106 106
   query13  1645496 399 399
   query14  9329610561096105
   query15  216 186 174 174
   query16  7273662 468 468
   query17  1124707 559 559
   query18  1974388 307 307
   query19  185 186 156 156
   query20  124 121 119 119
   query21  218 119 100 100
   query22  3957409339973997
   query23  33832   32989   32977   32977
   query24  8421237523842375
   query25  529 450 383 383
   query26  1230265 147 147
   query27  2759503 326 326
   query28  4336239623982396
   query29  761 538 423 423
   query30  278 215 190 190
   query31  942 846 762 762
   query32  72  65  66  65
   query33  564 372 311 311
   query34  786 871 505 505
   query35  778 822 726 726
   query36  943 987 910 910
   query37  122 101 80  80
   query38  4200419240804080
   query39  1473139513811381
   query40  218 120 107 107
   query41  57  54  51  51
   query42  120 101 107 101
   query43  504 516 487 487
   query44  1310811 808 808
   query45  221 177 162 162
   query46  829 1019627 627
   query47  1731178417181718
   query48  375 409 294 294
   query49  775 482 415 415
   query50  621 671 406 406
   query51  4138408441614084
   query52  110 107 100 100
   query53  221 263 182 182
   query54  578 566 515 515
   query55  86  86  88  86
   query56  299 284 286 284
   query57  1105112510671067
   query58  275 264 259 259
   query59  2666266925612561
   query60  327 312 310 310
   query61  129 130 128 128
   query62  784 718 657 657
   query63  219 184 186 184
   query64  43731063673 673
   query65  4367420742534207
   query66  1137417 306 306
   query67  15746   15368   15219   15219
   query68  4313897 527 527
   query69  465 304 263 263
   query70  1169111010641064
   query71  406 316 306 306
   query72  5739471246794679
   query73  616 585 342 342
   query74  8952913387658765
   query75  3193322826872687
   query76  32201193772 772
   query77  502 382 299 299
   query78  991610063   92649264
   query79  1826816 582 582
   query80  673 555 453 453
   query81  499 266 232 232
   query82  196 129 99  99
   query83  266 260 239 239
   query84  265 109 90  90
   query85  827 414 483 414
   query86  377 311 310 310
   query87  4395449843694369
   query88  2824226322592259
   query89  384 310 285 285
   query90  1812212 214 212
   query91  144 141 115 115
   query92  66  63  56  56
   query93  1239936 580 580
   query94  633 424 279 279
   query95  371 295 283 283
   query96  482 579 272 272
   query97  3131320831063106
   query98  228 218 204 204
   query99  1325143212511251
   Total cold run time: 267007 ms
   Total hot run time: 186245 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49984:
URL: https://github.com/apache/doris/pull/49984#issuecomment-2796138575

   
   
   TPC-DS: Total hot run time: 193670 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, 
data reload: false
   
   query1   1400104410291029
   query2   6110189919101899
   query3   10984   452844584458
   query4   53739   25327   23597   23597
   query5   5090517 465 465
   query6   371 207 200 200
   query7   4990508 277 277
   query8   296 249 231 231
   query9   5885258825872587
   query10  429 312 260 260
   query11  15088   15109   15131   15109
   query12  166 115 105 105
   query13  1121494 413 413
   query14  10097   620062046200
   query15  189 202 185 185
   query16  7093635 504 504
   query17  1122801 598 598
   query18  1572410 316 316
   query19  199 190 164 164
   query20  134 125 123 123
   query21  213 126 105 105
   query22  4336455442984298
   query23  34188   33563   33487   33487
   query24  6919241124162411
   query25  466 476 457 457
   query26  668 285 162 162
   query27  2216508 345 345
   query28  3125244524452445
   query29  613 603 443 443
   query30  272 224 192 192
   query31  889 857 807 807
   query32  71  63  73  63
   query33  474 366 309 309
   query34  768 873 532 532
   query35  811 874 780 780
   query36  941 989 940 940
   query37  121 143 87  87
   query38  4155418441344134
   query39  1485147614421442
   query40  211 123 105 105
   query41  57  54  51  51
   query42  121 113 109 109
   query43  512 504 473 473
   query44  1347828 814 814
   query45  186 175 171 171
   query46  833 1024640 640
   query47  1885190618281828
   query48  397 442 320 320
   query49  690 544 456 456
   query50  668 695 408 408
   query51  4228424542174217
   query52  110 115 103 103
   query53  231 266 200 200
   query54  580 597 518 518
   query55  87  86  87  86
   query56  316 311 300 300
   query57  1218123111351135
   query58  277 260 274 260
   query59  2791285828382838
   query60  334 351 336 336
   query61  155 158 155 155
   query62  722 746 673 673
   query63  232 191 198 191
   query64  15691073701 701
   query65  4301423342564233
   query66  729 405 316 316
   query67  15894   15736   15363   15363
   query68  6382871 512 512
   query69  555 290 268 268
   query70  1232111510691069
   query71  445 314 280 280
   query72  5686486447334733
   query73  1231621 341 341
   query74  9205906086248624
   query75  3387322027302730
   query76  38671188741 741
   query77  543 406 282 282
   query78  10013   997792759275
   query79  2169812 567 567
   query80  604 516 456 456
   query81  488 255 220 220
   query82  468 132 109 109
   query83  252 252 241 241
   query84  293 111 89  89
   query85  780 360 324 324
   query86  385 301 291 291
   query87  4482454443874387
   query88  3481225122442244
   query89  407 312 289 289
   query90  1786210 212 210
   query91  147 149 112 112
   query92  74  60  54  54
   query93  1843959 575 575
   query94  703 396 304 304
   query95  362 288 287 287
   query96  488 570 280 280
   query97  3164322431323132
   query98  231 227 201 201
   query99  1340139812841284
   Total cold run time: 295980 ms
   Total hot run time: 193670 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go

Re: [PR] [ut](column_variant)update ut cases and some fix [doris]

2025-04-11 Thread via GitHub


amorynan commented on PR #49776:
URL: https://github.com/apache/doris/pull/49776#issuecomment-2796146004

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix hint existing using problems [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49987:
URL: https://github.com/apache/doris/pull/49987#issuecomment-2796145411

   
   
   ClickBench: Total hot run time: 30.83 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ae8c7515292bb6c1445e6739659e31a14079, 
data reload: false
   
   query1   0.030.040.03
   query2   0.120.100.11
   query3   0.250.190.19
   query4   1.600.180.19
   query5   0.600.580.58
   query6   1.180.720.73
   query7   0.020.020.02
   query8   0.040.030.03
   query9   0.580.530.53
   query10  0.570.610.57
   query11  0.160.110.11
   query12  0.140.110.11
   query13  0.610.600.59
   query14  2.802.842.69
   query15  0.920.850.85
   query16  0.370.380.40
   query17  1.001.011.00
   query18  0.200.190.20
   query19  1.951.971.83
   query20  0.020.010.01
   query21  15.35   0.940.55
   query22  0.751.190.63
   query23  15.05   1.360.64
   query24  6.971.640.60
   query25  0.500.150.08
   query26  0.660.160.14
   query27  0.050.050.05
   query28  8.980.880.44
   query29  12.57   3.913.27
   query30  0.240.080.07
   query31  2.820.580.38
   query32  3.220.540.47
   query33  3.083.023.08
   query34  15.58   5.024.50
   query35  4.524.524.48
   query36  0.670.490.48
   query37  0.080.060.06
   query38  0.050.040.04
   query39  0.030.020.02
   query40  0.170.140.13
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.030.030.03
   Total cold run time: 104.65 s
   Total hot run time: 30.83 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](group commit) reduce cpu cost for group_commit get_block [doris]

2025-04-11 Thread via GitHub


mymeiyi commented on PR #49822:
URL: https://github.com/apache/doris/pull/49822#issuecomment-2796146897

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49984:
URL: https://github.com/apache/doris/pull/49984#issuecomment-2796149425

   
   
   ClickBench: Total hot run time: 31.2 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.110.11
   query3   0.260.200.19
   query4   1.600.170.19
   query5   0.590.580.58
   query6   1.210.720.72
   query7   0.030.020.01
   query8   0.040.040.03
   query9   0.590.520.54
   query10  0.570.590.58
   query11  0.150.100.11
   query12  0.150.110.12
   query13  0.610.600.60
   query14  2.782.712.83
   query15  0.940.860.85
   query16  0.380.370.38
   query17  1.061.001.04
   query18  0.210.200.20
   query19  1.892.001.80
   query20  0.020.010.01
   query21  15.36   0.960.57
   query22  0.751.260.71
   query23  14.76   1.410.64
   query24  7.041.320.83
   query25  0.520.340.07
   query26  0.550.160.15
   query27  0.050.060.06
   query28  9.360.890.44
   query29  12.53   3.933.29
   query30  0.250.080.06
   query31  2.820.600.39
   query32  3.230.560.50
   query33  3.083.053.05
   query34  15.98   5.074.46
   query35  4.514.514.48
   query36  0.660.480.48
   query37  0.090.060.06
   query38  0.050.030.04
   query39  0.030.030.03
   query40  0.170.140.13
   query41  0.080.030.03
   query42  0.040.030.02
   query43  0.030.030.03
   Total cold run time: 105.19 s
   Total hot run time: 31.2 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796149544

   
   
   TPC-H: Total hot run time: 34240 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, 
data reload: false
   
   -- Round 1 --
   q1   25757   512350505050
   q2   2070278 185 185
   q3   10391   1258689 689
   q4   10239   1008533 533
   q5   7517239822832283
   q6   186 161 129 129
   q7   917 732 600 600
   q8   9305124110931093
   q9   6709510151415101
   q10  6867230418981898
   q11  509 300 265 265
   q12  346 349 221 221
   q13  17760   377730373037
   q14  222 221 206 206
   q15  534 484 486 484
   q16  627 601 586 586
   q17  589 839 383 383
   q18  7551714071377137
   q19  1981970 606 606
   q20  351 338 227 227
   q21  3965273025292529
   q22  10661057998 998
   Total cold run time: 115459 ms
   Total hot run time: 34240 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5267513551625135
   q2   248 335 248 248
   q3   2161270522742274
   q4   1412184514041404
   q5   4451442443754375
   q6   218 173 132 132
   q7   1973195017651765
   q8   2553252824732473
   q9   7245720670757075
   q10  2983319027412741
   q11  572 523 521 521
   q12  683 762 621 621
   q13  3572396633223322
   q14  309 307 281 281
   q15  519 483 465 465
   q16  665 690 641 641
   q17  1180158013701370
   q18  7607748674347434
   q19  842 850 935 850
   q20  2023194918691869
   q21  5194488748524852
   q22  11061066989 989
   Total cold run time: 52783 ms
   Total hot run time: 50837 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796149451

   TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311) 
Line Coverage: 66.10% (18170/27489)
Region Coverage: 65.53% (8950/13657)
Branch Coverage: 55.40% (4824/8708)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/9f9079846d169698cdfd684ab14638827fae02b8_9f9079846d169698cdfd684ab14638827fae02b8_cloud/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[I] Issue on docs [doris-website]

2025-04-11 Thread via GitHub


footmanai opened a new issue, #2285:
URL: https://github.com/apache/doris-website/issues/2285

   
Path:/zh-CN/docs/3.0/sql-manual/sql-statements/table-and-view/table/SHOW-TABLE-STATUS
   
   环境情况:
doris 3.0、mysql 8.0、
创建与 mysql 关联的 category,category 名称为 dit;
mysql 下有一个 schema 名为 base,还有一张表 t_yardage
查询驱动使用 jdbc:arrow-flight-sql 版本 0.12.0
   
   2)在mysql下执行的SQL
   
   `SELECT
   table_name,
   table_comment
   FROM
   information_schema.TABLES
   WHERE
   table_schema = 'base' and table_name='t_yardage'`
   
   结果:
   table_name,table_comment
   t_yardage,全码谱明细值
   
   3)在 doris 下采用下面3种方式查询结果 
   
   1. 方式1:
   
   `use dit.base;
   show table status like 't_yardage';`
   
   结果:
   comment 列为空白
   
   2. 方式2:
   
   `show table status from dit.base.t_yardage;`
   
   结果:
   执行错误
   
   3. 方式3:
   
   `SELECT
   table_name,
   table_comment
   FROM
   dit.information_schema.TABLES
   WHERE
   table_schema = 'base' where table_name = 't_yardage'`
   
   结果:
   comment 列为空白
   
   通过 category 获取表 comment 都是空白。
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix unix_timestamp [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49686:
URL: https://github.com/apache/doris/pull/49686#issuecomment-2796153405

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49852:
URL: https://github.com/apache/doris/pull/49852#issuecomment-2796159076

   
   
   TPC-H: Total hot run time: 34851 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, 
data reload: false
   
   -- Round 1 --
   q1   26404   506350085008
   q2   2079289 181 181
   q3   10415   1226678 678
   q4   10217   1005512 512
   q5   7531235223292329
   q6   190 166 131 131
   q7   911 743 593 593
   q8   9319129511171117
   q9   6935519750945094
   q10  6798230319001900
   q11  475 306 289 289
   q12  352 348 216 216
   q13  17799   364530703070
   q14  225 233 210 210
   q15  540 491 479 479
   q16  609 622 578 578
   q17  592 831 390 390
   q18  7712729671857185
   q19  1223953 553 553
   q20  342 349 229 229
   q21  4196335331533153
   q22  10531006956 956
   Total cold run time: 115917 ms
   Total hot run time: 34851 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5128503650675036
   q2   227 328 227 227
   q3   2126263123012301
   q4   1446183615201520
   q5   4478441843204320
   q6   203 161 122 122
   q7   1930193717121712
   q8   2572246125182461
   q9   7255716171597159
   q10  2957317926982698
   q11  564 511 476 476
   q12  720 760 646 646
   q13  3540389132333233
   q14  275 311 268 268
   q15  528 479 474 474
   q16  661 688 637 637
   q17  1117149014041404
   q18  7832753174247424
   q19  803 809 798 798
   q20  1996199018651865
   q21  5159471546094609
   q22  10741032975 975
   Total cold run time: 52591 ms
   Total hot run time: 50365 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" [doris]

2025-04-11 Thread via GitHub


yiguolei merged PR #49986:
URL: https://github.com/apache/doris/pull/49986


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch branch-2.1 updated: Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986)

2025-04-11 Thread yiguolei
This is an automated email from the ASF dual-hosted git repository.

yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/branch-2.1 by this push:
 new b9d447741e8 Revert "branch-2.1: [Fix](Serde) Support hive compatible 
output format #49036" (#49986)
b9d447741e8 is described below

commit b9d447741e8fe3b050673491f77042bfb1611d46
Author: Mingyu Chen (Rayner) 
AuthorDate: Fri Apr 11 01:08:02 2025 -0700

Revert "branch-2.1: [Fix](Serde) Support hive compatible output format 
#49036" (#49986)

Reverts apache/doris#49831
---
 .../vec/data_types/serde/data_type_array_serde.cpp |   5 +-
 .../vec/data_types/serde/data_type_map_serde.cpp   |   7 +-
 .../data_types/serde/data_type_number_serde.cpp|   9 +-
 be/src/vec/data_types/serde/data_type_serde.h  |  20 
 .../data_types/serde/data_type_struct_serde.cpp|   5 +-
 be/src/vec/sink/vmysql_result_writer.cpp   |  16 ---
 .../org/apache/doris/nereids/NereidsPlanner.java   |   1 -
 .../java/org/apache/doris/qe/SessionVariable.java  |  10 +-
 gensrc/thrift/PaloInternalService.thrift   |   3 +-
 .../datatype_p0/serde/test_serde_dialect_hive.out  | Bin 2029 -> 0 bytes
 .../serde/test_serde_dialect_hive.groovy   | 107 -
 11 files changed, 8 insertions(+), 175 deletions(-)

diff --git a/be/src/vec/data_types/serde/data_type_array_serde.cpp 
b/be/src/vec/data_types/serde/data_type_array_serde.cpp
index e5fc7461e45..872dd84d8c7 100644
--- a/be/src/vec/data_types/serde/data_type_array_serde.cpp
+++ b/be/src/vec/data_types/serde/data_type_array_serde.cpp
@@ -336,8 +336,7 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const 
IColumn& column,
 const auto end_arr_element = offsets[row_idx_of_col_arr];
 for (int j = begin_arr_element; j < end_arr_element; ++j) {
 if (j != begin_arr_element) {
-if (0 != result.push_string(options.mysql_collection_delim.c_str(),
-
options.mysql_collection_delim.size())) {
+if (0 != result.push_string(", ", 2)) {
 return Status::InternalError("pack mysql buffer failed.");
 }
 }
@@ -346,7 +345,6 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const 
IColumn& column,
 return Status::InternalError("pack mysql buffer failed.");
 }
 } else {
-++options.level;
 if (is_nested_string && options.wrapper_len > 0) {
 if (0 != result.push_string(options.nested_string_wrapper, 
options.wrapper_len)) {
 return Status::InternalError("pack mysql buffer failed.");
@@ -360,7 +358,6 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const 
IColumn& column,
 RETURN_IF_ERROR(
 nested_serde->write_column_to_mysql(data, result, j, 
false, options));
 }
---options.level;
 }
 }
 if (0 != result.push_string("]", 1)) {
diff --git a/be/src/vec/data_types/serde/data_type_map_serde.cpp 
b/be/src/vec/data_types/serde/data_type_map_serde.cpp
index bf018ce3a80..2140885942d 100644
--- a/be/src/vec/data_types/serde/data_type_map_serde.cpp
+++ b/be/src/vec/data_types/serde/data_type_map_serde.cpp
@@ -418,8 +418,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const 
IColumn& column,
 auto& offsets = map_column.get_offsets();
 for (auto j = offsets[col_index - 1]; j < offsets[col_index]; ++j) {
 if (j != offsets[col_index - 1]) {
-if (0 != result.push_string(options.mysql_collection_delim.c_str(),
-
options.mysql_collection_delim.size())) {
+if (0 != result.push_string(", ", 2)) {
 return Status::InternalError("pack mysql buffer failed.");
 }
 }
@@ -428,7 +427,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const 
IColumn& column,
 return Status::InternalError("pack mysql buffer failed.");
 }
 } else {
-++options.level;
 if (is_key_string && options.wrapper_len > 0) {
 if (0 != result.push_string(options.nested_string_wrapper, 
options.wrapper_len)) {
 return Status::InternalError("pack mysql buffer failed.");
@@ -442,7 +440,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const 
IColumn& column,
 
RETURN_IF_ERROR(key_serde->write_column_to_mysql(nested_keys_column, result, j,
  false, 
options));
 }
---options.level;
 }
 if (0 != result.push_string(&options.map_key_delim, 1)) {
 return Status::InternalError("pack mysql buffer failed.");
@@ -452,7 +449,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const 
IColumn& column,
 return Status::I

Re: [PR] [test](ut) add cases about hash join [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49803:
URL: https://github.com/apache/doris/pull/49803#issuecomment-2796167609

   # BE UT Coverage Report
   Increment line coverage `87.50% (7/8)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/07a95114e49761de827284fdfb42fb13fbaacd76_07a95114e49761de827284fdfb42fb13fbaacd76/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/07a95114e49761de827284fdfb42fb13fbaacd76_07a95114e49761de827284fdfb42fb13fbaacd76/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.38% (14083/26887) |
   | Line Coverage | 41.31% (122084/295537) |
   | Region Coverage   | 40.02% (62105/155184) |
   | Branch Coverage   | 34.70% (31120/89694) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Improve] add retry strategy [doris-kafka-connector]

2025-04-11 Thread via GitHub


JNSimba merged PR #67:
URL: https://github.com/apache/doris-kafka-connector/pull/67


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-kafka-connector) branch master updated: [Improve] add retry strategy (#67)

2025-04-11 Thread diwu
This is an automated email from the ASF dual-hosted git repository.

diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-kafka-connector.git


The following commit(s) were added to refs/heads/master by this push:
 new 8d81331  [Improve] add retry strategy (#67)
8d81331 is described below

commit 8d81331fc5bfe752c41f9ff0dbb64bc36c5a91f5
Author: wudi <676366...@qq.com>
AuthorDate: Fri Apr 11 16:11:58 2025 +0800

[Improve] add retry strategy (#67)
---
 .../doris/kafka/connector/DorisSinkTask.java   |  22 ++-
 .../doris/kafka/connector/cfg/DorisOptions.java|  21 +++
 .../connector/cfg/DorisSinkConnectorConfig.java|  23 +++-
 .../doris/kafka/connector/model/RespContent.java   |   4 +
 .../kafka/connector/utils/ConfigCheckUtils.java|  16 +++
 .../doris/kafka/connector/writer/DorisWriter.java  |   3 +-
 .../connector/writer/load/DorisStreamLoad.java |   3 +
 .../cfg/TestDorisSinkConnectorConfig.java  |  14 ++
 .../e2e/doris/DorisContainerServiceImpl.java   |  14 +-
 .../e2e/sink/AbstractKafka2DorisSink.java  |  55 
 .../stringconverter/DorisSinkFailoverSinkTest.java | 149 +
 src/test/resources/docker/doris/be.conf|  99 ++
 src/test/resources/docker/doris/fe.conf|  74 ++
 .../string_msg_failover_connector.json |  25 
 .../string_converter/string_msg_tab_failover.sql   |  12 ++
 15 files changed, 528 insertions(+), 6 deletions(-)

diff --git a/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java 
b/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java
index f793d26..e83f033 100644
--- a/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java
+++ b/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java
@@ -22,6 +22,7 @@ package org.apache.doris.kafka.connector;
 import java.util.Collection;
 import java.util.HashMap;
 import java.util.Map;
+import org.apache.doris.kafka.connector.cfg.DorisOptions;
 import org.apache.doris.kafka.connector.service.DorisSinkService;
 import org.apache.doris.kafka.connector.service.DorisSinkServiceFactory;
 import org.apache.doris.kafka.connector.utils.Version;
@@ -37,6 +38,8 @@ import org.slf4j.LoggerFactory;
 public class DorisSinkTask extends SinkTask {
 private static final Logger LOG = 
LoggerFactory.getLogger(DorisSinkTask.class);
 private DorisSinkService sink = null;
+private DorisOptions options;
+private int remainingRetries;
 
 /** default constructor, invoked by kafka connect framework */
 public DorisSinkTask() {}
@@ -49,7 +52,9 @@ public class DorisSinkTask extends SinkTask {
  */
 @Override
 public void start(final Map parsedConfig) {
-LOG.info("kafka doris sink task start");
+LOG.info("kafka doris sink task start with {}", parsedConfig);
+this.options = new DorisOptions(parsedConfig);
+this.remainingRetries = options.getMaxRetries();
 this.sink = DorisSinkServiceFactory.getDorisSinkService(parsedConfig);
 }
 
@@ -94,7 +99,20 @@ public class DorisSinkTask extends SinkTask {
 @Override
 public void put(final Collection records) {
 LOG.info("Read {} records from Kafka", records.size());
-sink.insert(records);
+try {
+sink.insert(records);
+} catch (Exception ex) {
+LOG.error("Error inserting records to Doris", ex);
+if (remainingRetries > 0) {
+LOG.info(
+"Retrying to insert records to Doris, remaining 
retries: {}",
+remainingRetries);
+remainingRetries--;
+context.timeout(options.getRetryIntervalMs());
+throw new RetriableException(ex);
+}
+throw ex;
+}
 }
 
 /**
diff --git 
a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java 
b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
index 9afd9cb..c1a2cbd 100644
--- a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
+++ b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
@@ -66,6 +66,8 @@ public class DorisOptions {
 private final DeliveryGuarantee deliveryGuarantee;
 private final ConverterMode converterMode;
 private final SchemaEvolutionMode schemaEvolutionMode;
+private final int maxRetries;
+private final int retryIntervalMs;
 
 public DorisOptions(Map config) {
 this.name = config.get(DorisSinkConnectorConfig.NAME);
@@ -127,6 +129,17 @@ public class DorisOptions {
 }
 this.streamLoadProp = getStreamLoadPropFromConfig(config);
 this.enableGroupCommit = 
ConfigCheckUtils.validateGroupCommitMode(this);
+this.maxRetries =
+Integer.parseInt(
+config.getOrDefault(
+DorisSinkConnectorConfig.MAX_RE

Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


Thearas commented on PR #49988:
URL: https://github.com/apache/doris/pull/49988#issuecomment-2796171517

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796176437

   
   
   TPC-DS: Total hot run time: 193350 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, 
data reload: false
   
   query1   1409104910701049
   query2   6400190919241909
   query3   10988   441145924411
   query4   51039   24990   23210   23210
   query5   5326586 483 483
   query6   390 224 184 184
   query7   5054506 282 282
   query8   315 244 227 227
   query9   6400258025902580
   query10  423 310 251 251
   query11  15196   15032   14920   14920
   query12  171 115 106 106
   query13  1141516 397 397
   query14  10108   630163856301
   query15  212 182 178 178
   query16  7135648 506 506
   query17  1083761 594 594
   query18  1539429 331 331
   query19  200 203 178 178
   query20  132 129 125 125
   query21  211 127 103 103
   query22  4405444242754275
   query23  34127   33463   33421   33421
   query24  7038247024402440
   query25  502 510 497 497
   query26  703 286 155 155
   query27  2286516 333 333
   query28  3065242724242424
   query29  594 554 447 447
   query30  279 232 200 200
   query31  845 887 807 807
   query32  72  69  61  61
   query33  472 376 319 319
   query34  815 860 533 533
   query35  799 856 784 784
   query36  939 1036925 925
   query37  127 105 82  82
   query38  4174433742924292
   query39  1498144114491441
   query40  220 124 104 104
   query41  52  58  49  49
   query42  129 111 117 111
   query43  503 513 492 492
   query44  1387827 821 821
   query45  185 179 168 168
   query46  885 1076647 647
   query47  1830185317831783
   query48  391 427 318 318
   query49  686 523 462 462
   query50  670 681 405 405
   query51  4274432742414241
   query52  118 109 110 109
   query53  245 261 184 184
   query54  598 578 516 516
   query55  88  84  80  80
   query56  314 305 298 298
   query57  1168118311381138
   query58  268 283 282 282
   query59  2658277926732673
   query60  337 314 318 314
   query61  134 134 145 134
   query62  722 791 668 668
   query63  225 192 189 189
   query64  17791099757 757
   query65  4341426642544254
   query66  737 391 309 309
   query67  15775   15476   15246   15246
   query68  7040882 523 523
   query69  536 296 264 264
   query70  1226112311141114
   query71  496 331 298 298
   query72  5576480149444801
   query73  1300694 349 349
   query74  8938890888478847
   query75  3936317626572657
   query76  43371199738 738
   query77  697 368 344 344
   query78  10072   10145   92439243
   query79  2309817 562 562
   query80  614 513 440 440
   query81  481 264 232 232
   query82  454 136 96  96
   query83  345 252 226 226
   query84  288 114 86  86
   query85  781 353 384 353
   query86  379 282 297 282
   query87  4553451744364436
   query88  3415227822262226
   query89  401 308 286 286
   query90  1948208 212 208
   query91  142 142 117 117
   query92  76  61  57  57
   query93  1634922 576 576
   query94  676 425 309 309
   query95  365 300 288 288
   query96  483 559 274 274
   query97  3220328331173117
   query98  224 199 207 199
   query99  1424139112891289
   Total cold run time: 296697 ms
   Total hot run time: 193350 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49925:
URL: https://github.com/apache/doris/pull/49925#issuecomment-2796179805

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49925:
URL: https://github.com/apache/doris/pull/49925#issuecomment-2796179882

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49837:
URL: https://github.com/apache/doris/pull/49837#issuecomment-2796182079

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](schema) add column comment length limit [doris]

2025-04-11 Thread via GitHub


Thearas commented on PR #49989:
URL: https://github.com/apache/doris/pull/49989#issuecomment-2796182260

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]

2025-04-11 Thread via GitHub


Jibing-Li commented on PR #49984:
URL: https://github.com/apache/doris/pull/49984#issuecomment-2796180941

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49837:
URL: https://github.com/apache/doris/pull/49837#issuecomment-2796182003

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [improve](schema) add column comment length limit [doris]

2025-04-11 Thread via GitHub


cambyzju opened a new pull request, #49989:
URL: https://github.com/apache/doris/pull/49989

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   1. add a config `column_comment_length_limit` to limit the max column 
comment length;
   2. Mysql already enlarge this limit from 255 to 1024, after MySQL 5.5.3;
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49852:
URL: https://github.com/apache/doris/pull/49852#issuecomment-2796183905

   
   
   TPC-DS: Total hot run time: 186339 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, 
data reload: false
   
   query1   1019466 473 466
   query2   6542194919361936
   query3   6750215 219 215
   query4   26224   23595   23618   23595
   query5   4804611 482 482
   query6   311 221 221 221
   query7   4629489 278 278
   query8   310 247 240 240
   query9   8685259025862586
   query10  499 318 262 262
   query11  15824   15694   14837   14837
   query12  174 111 109 109
   query13  1647522 393 393
   query14  11172   612761836127
   query15  236 194 161 161
   query16  7765649 450 450
   query17  1546730 559 559
   query18  2013423 300 300
   query19  259 178 179 178
   query20  124 115 112 112
   query21  215 120 103 103
   query22  4140412239193919
   query23  33934   33099   33011   33011
   query24  8032234323332333
   query25  497 468 388 388
   query26  1215271 147 147
   query27  2705499 326 326
   query28  4420244123842384
   query29  712 556 425 425
   query30  288 223 195 195
   query31  970 847 790 790
   query32  75  68  61  61
   query33  601 370 309 309
   query34  787 863 497 497
   query35  787 796 732 732
   query36  959 1026885 885
   query37  119 103 77  77
   query38  4195419940774077
   query39  1624139514061395
   query40  210 121 107 107
   query41  89  57  52  52
   query42  118 102 99  99
   query43  494 506 497 497
   query44  1334795 797 795
   query45  175 173 169 169
   query46  837 1019614 614
   query47  1753177117191719
   query48  366 415 299 299
   query49  758 518 459 459
   query50  627 672 405 405
   query51  4161415840974097
   query52  109 101 99  99
   query53  222 254 180 180
   query54  572 570 536 536
   query55  84  83  83  83
   query56  293 322 292 292
   query57  1127114310791079
   query58  273 257 257 257
   query59  2620272025612561
   query60  338 341 328 328
   query61  151 152 154 152
   query62  783 736 666 666
   query63  223 186 185 185
   query64  43921134688 688
   query65  4383424942444244
   query66  1059413 311 311
   query67  15834   15725   15275   15275
   query68  7882864 507 507
   query69  450 303 267 267
   query70  11441144
   query71  463 307 294 294
   query72  5481479046934693
   query73  635 577 344 344
   query74  9134909387218721
   query75  3842319626762676
   query76  35431187752 752
   query77  796 369 301 301
   query78  10043   10221   93429342
   query79  2285809 566 566
   query80  575 513 440 440
   query81  493 253 224 224
   query82  477 128 98  98
   query83  256 250 235 235
   query84  250 105 82  82
   query85  790 351 327 327
   query86  388 308 268 268
   query87  4478451143584358
   query88  3859224422562244
   query89  397 309 280 280
   query90  1936220 212 212
   query91  145 148 116 116
   query92  80  65  61  61
   query93  1970941 564 564
   query94  673 425 289 289
   query95  372 293 292 292
   query96  484 566 274 274
   query97  3142320631303130
   query98  230 216 204 204
   query99  1408139712581258
   Total cold run time: 278294 ms
   Total hot run time: 186339 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to t

[PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


LiBinfeng-01 opened a new pull request, #49988:
URL: https://github.com/apache/doris/pull/49988

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   change result of sql:
   select initcap('ärger');
   from:
   äRger
   to:
   Ärger
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


LiBinfeng-01 commented on PR #49988:
URL: https://github.com/apache/doris/pull/49988#issuecomment-2796186311

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796187637

   
   
   ClickBench: Total hot run time: 31.75 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.100.10
   query3   0.240.190.19
   query4   1.600.180.19
   query5   0.600.580.58
   query6   1.180.720.73
   query7   0.020.020.02
   query8   0.050.040.04
   query9   0.580.500.52
   query10  0.610.590.57
   query11  0.160.100.11
   query12  0.150.110.12
   query13  0.610.590.60
   query14  2.822.722.70
   query15  0.940.850.84
   query16  0.380.380.36
   query17  1.011.001.04
   query18  0.220.190.19
   query19  1.831.911.87
   query20  0.010.010.02
   query21  15.38   0.940.56
   query22  0.761.150.62
   query23  15.04   1.400.67
   query24  6.911.631.51
   query25  0.470.210.12
   query26  0.570.170.14
   query27  0.050.050.05
   query28  10.38   0.800.42
   query29  12.60   3.923.25
   query30  0.250.090.06
   query31  2.820.570.40
   query32  3.220.530.46
   query33  3.013.083.01
   query34  15.71   5.124.49
   query35  4.524.494.54
   query36  0.680.500.48
   query37  0.100.060.07
   query38  0.040.040.04
   query39  0.040.020.02
   query40  0.160.130.13
   query41  0.080.030.02
   query42  0.040.020.02
   query43  0.040.030.03
   Total cold run time: 106.05 s
   Total hot run time: 31.75 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](schema) add column comment length limit [doris]

2025-04-11 Thread via GitHub


morrySnow commented on code in PR #49989:
URL: https://github.com/apache/doris/pull/49989#discussion_r2039049832


##
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##
@@ -1765,6 +1765,12 @@ public class Config extends ConfigBase {
 @ConfField(mutable = true, masterOnly = true)
 public static int table_name_length_limit = 64;
 
+@ConfField(mutable = true, description = {
+"用于限制列注释长度;如果存量的列注释超长,则显示时进行截断",
+"Used to limit the length of column comment; "
++ "If the existing column comment is too long, it will be 
truncated when displayed."})
+public static int column_comment_length_limit = 1024;

Review Comment:
   maybe default value should be `-1` to avoid some ddl that could run on 
privous version, failed after upgrade



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49852:
URL: https://github.com/apache/doris/pull/49852#issuecomment-2796197442

   
   
   ClickBench: Total hot run time: 31.01 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, 
data reload: false
   
   query1   0.040.030.03
   query2   0.110.110.10
   query3   0.240.190.19
   query4   1.600.180.20
   query5   0.610.600.59
   query6   1.190.720.73
   query7   0.020.020.02
   query8   0.040.040.03
   query9   0.580.530.52
   query10  0.570.580.57
   query11  0.150.110.11
   query12  0.150.120.11
   query13  0.620.600.60
   query14  2.792.702.71
   query15  0.900.860.85
   query16  0.390.390.39
   query17  1.011.011.02
   query18  0.210.190.20
   query19  1.881.901.92
   query20  0.020.010.00
   query21  15.35   0.870.57
   query22  0.771.210.68
   query23  14.92   1.420.68
   query24  6.872.140.56
   query25  0.490.110.14
   query26  0.600.160.13
   query27  0.050.040.05
   query28  10.16   0.880.43
   query29  12.56   3.973.27
   query30  0.250.090.07
   query31  2.820.620.38
   query32  3.220.540.47
   query33  3.053.033.08
   query34  15.67   5.124.51
   query35  4.504.534.48
   query36  0.680.500.48
   query37  0.080.060.06
   query38  0.060.040.04
   query39  0.030.020.02
   query40  0.180.130.13
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.030.020.02
   Total cold run time: 105.58 s
   Total hot run time: 31.01 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mv) Add sync mv test that had been commented [doris]

2025-04-11 Thread via GitHub


seawinde commented on PR #49970:
URL: https://github.com/apache/doris/pull/49970#issuecomment-2796209064

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (3c6ad1d0083 -> 918dbff46f4)

2025-04-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 3c6ad1d0083 Automated deployment with doris branch @ 
e311ae6cc1e209c9ac32b84b29e13eaeea920398
 new 918dbff46f4 Automated deployment with doris branch @ 
e311ae6cc1e209c9ac32b84b29e13eaeea920398

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (3c6ad1d0083)
\
 N -- N -- N   refs/heads/asf-site (918dbff46f4)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49988:
URL: https://github.com/apache/doris/pull/49988#issuecomment-2796242008

   
   
   TPC-H: Total hot run time: 34215 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, 
data reload: false
   
   -- Round 1 --
   q1   26067   509450085008
   q2   2066285 191 191
   q3   10394   1240703 703
   q4   10238   1002537 537
   q5   7768238923462346
   q6   193 170 133 133
   q7   918 735 621 621
   q8   9318132111641164
   q9   6861518450965096
   q10  6817228519081908
   q11  483 283 270 270
   q12  350 357 223 223
   q13  17780   367930543054
   q14  222 219 205 205
   q15  536 478 473 473
   q16  612 631 579 579
   q17  591 845 375 375
   q18  7566721770987098
   q19  1834942 562 562
   q20  330 325 224 224
   q21  4066337724842484
   q22  10561002961 961
   Total cold run time: 116066 ms
   Total hot run time: 34215 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5193510050965096
   q2   232 329 227 227
   q3   2133266822792279
   q4   1408180214971497
   q5   4529446643704370
   q6   207 162 122 122
   q7   1939190817041704
   q8   2583247324962473
   q9   7241705372677053
   q10  2987317826982698
   q11  601 493 488 488
   q12  670 764 606 606
   q13  3502391232223222
   q14  280 286 271 271
   q15  513 476 469 469
   q16  667 694 635 635
   q17  1140151313771377
   q18  7556744674247424
   q19  821 837 971 837
   q20  1941197418051805
   q21  5133476546944694
   q22  10021015989 989
   Total cold run time: 52278 ms
   Total hot run time: 50336 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](binlog) add modify distribution bucket num binlog [doris]

2025-04-11 Thread via GitHub


koarz commented on PR #49894:
URL: https://github.com/apache/doris/pull/49894#issuecomment-2796258600

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49988:
URL: https://github.com/apache/doris/pull/49988#issuecomment-2796267686

   
   
   TPC-DS: Total hot run time: 186559 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, 
data reload: false
   
   query1   1019459 476 459
   query2   6560195618961896
   query3   6744234 209 209
   query4   26192   23417   23222   23222
   query5   4409637 465 465
   query6   312 208 216 208
   query7   4620487 279 279
   query8   291 250 239 239
   query9   8654260825982598
   query10  475 307 257 257
   query11  16011   15018   14904   14904
   query12  175 108 105 105
   query13  1662493 374 374
   query14  9531612961226122
   query15  203 182 166 166
   query16  7292599 480 480
   query17  1189727 546 546
   query18  1964389 290 290
   query19  186 170 149 149
   query20  119 116 113 113
   query21  207 125 107 107
   query22  3935415740204020
   query23  33874   33155   32967   32967
   query24  8489236523752365
   query25  564 473 419 419
   query26  1239272 153 153
   query27  2750504 332 332
   query28  4353244824342434
   query29  785 529 424 424
   query30  283 217 217 217
   query31  953 839 778 778
   query32  72  68  66  66
   query33  557 371 300 300
   query34  774 855 510 510
   query35  776 816 740 740
   query36  951 1001877 877
   query37  118 101 77  77
   query38  4166418141294129
   query39  1496140114151401
   query40  210 117 111 111
   query41  59  54  52  52
   query42  123 102 108 102
   query43  496 497 477 477
   query44  1283806 797 797
   query45  180 172 164 164
   query46  826 1013626 626
   query47  1751179617381738
   query48  370 401 291 291
   query49  788 495 418 418
   query50  624 678 396 396
   query51  4086418140984098
   query52  111 109 100 100
   query53  224 250 183 183
   query54  575 561 499 499
   query55  84  83  82  82
   query56  307 295 279 279
   query57  1126114310821082
   query58  270 257 266 257
   query59  2584279527132713
   query60  326 319 306 306
   query61  132 129 128 128
   query62  780 736 677 677
   query63  233 183 184 183
   query64  43111012686 686
   query65  4297418743014187
   query66  1139415 302 302
   query67  15953   15323   15227   15227
   query68  5286891 527 527
   query69  482 305 276 276
   query70  1143109110951091
   query71  407 320 295 295
   query72  5531480048624800
   query73  667 638 341 341
   query74  9188902189918991
   query75  3198317326492649
   query76  32251175748 748
   query77  474 371 335 335
   query78  9871999092779277
   query79  1939797 566 566
   query80  662 515 441 441
   query81  499 273 220 220
   query82  407 125 94  94
   query83  261 245 239 239
   query84  248 102 84  84
   query85  755 346 305 305
   query86  374 312 303 303
   query87  4453457044594459
   query88  2881224822482248
   query89  373 307 343 307
   query90  1784211 213 211
   query91  139 142 109 109
   query92  71  60  56  56
   query93  1397931 583 583
   query94  641 410 300 300
   query95  364 296 281 281
   query96  488 554 275 275
   query97  3139321931013101
   query98  226 209 201 201
   query99  1321141112881288
   Total cold run time: 269092 ms
   Total hot run time: 186559 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [minor](task) Complete debug string if task is finalized [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49950:
URL: https://github.com/apache/doris/pull/49950#issuecomment-2796274109

   # BE UT Coverage Report
   Increment line coverage `100.00% (25/25)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/84bf3f2ea4375acd57776d7d0551152d011ea40c_84bf3f2ea4375acd57776d7d0551152d011ea40c/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/84bf3f2ea4375acd57776d7d0551152d011ea40c_84bf3f2ea4375acd57776d7d0551152d011ea40c/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.49% (14117/26895) |
   | Line Coverage | 41.28% (121983/295525) |
   | Region Coverage   | 40.03% (62111/155180) |
   | Branch Coverage   | 34.67% (31091/89678) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49988:
URL: https://github.com/apache/doris/pull/49988#issuecomment-2796279637

   
   
   ClickBench: Total hot run time: 31.36 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.110.10
   query3   0.250.180.19
   query4   1.580.190.18
   query5   0.600.570.58
   query6   1.190.710.72
   query7   0.020.020.01
   query8   0.040.040.03
   query9   0.580.530.53
   query10  0.580.590.58
   query11  0.150.100.10
   query12  0.140.110.12
   query13  0.600.600.60
   query14  2.662.832.82
   query15  0.920.860.86
   query16  0.390.400.37
   query17  1.041.061.04
   query18  0.210.200.19
   query19  1.921.971.83
   query20  0.010.010.00
   query21  15.35   0.920.57
   query22  0.751.200.70
   query23  14.90   1.390.64
   query24  7.021.021.37
   query25  0.470.270.06
   query26  0.600.160.14
   query27  0.050.060.05
   query28  8.890.830.46
   query29  12.59   3.893.25
   query30  0.250.090.07
   query31  2.820.580.39
   query32  3.220.530.46
   query33  3.083.013.17
   query34  15.70   5.084.47
   query35  4.574.524.45
   query36  0.660.480.48
   query37  0.080.060.06
   query38  0.050.040.03
   query39  0.030.020.03
   query40  0.180.140.12
   query41  0.080.020.02
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 104.45 s
   Total hot run time: 31.36 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796292204

   
   
   TPC-H: Total hot run time: 34850 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, 
data reload: false
   
   -- Round 1 --
   q1   26428   506052055060
   q2   2088283 190 190
   q3   10474   1270691 691
   q4   10234   1003546 546
   q5   7604246223382338
   q6   188 162 131 131
   q7   933 726 608 608
   q8   9330129110771077
   q9   6875515251345134
   q10  6796229418691869
   q11  479 282 267 267
   q12  353 355 217 217
   q13  17793   366530833083
   q14  224 224 207 207
   q15  536 501 486 486
   q16  615 626 578 578
   q17  599 862 369 369
   q18  7600723071167116
   q19  1836979 569 569
   q20  324 343 231 231
   q21  4063336331353135
   q22  10491025948 948
   Total cold run time: 116421 ms
   Total hot run time: 34850 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5187505351125053
   q2   234 329 232 232
   q3   2173268022662266
   q4   1396190314961496
   q5   4582445543844384
   q6   213 174 126 126
   q7   1934186617391739
   q8   2606254425632544
   q9   7187714471617144
   q10  2945324527302730
   q11  566 501 484 484
   q12  694 761 604 604
   q13  3519383532633263
   q14  293 307 261 261
   q15  537 482 471 471
   q16  660 681 636 636
   q17  1166152613861386
   q18  7807758075097509
   q19  792 847 829 829
   q20  1967205418831883
   q21  5250469446824682
   q22  10721049995 995
   Total cold run time: 52780 ms
   Total hot run time: 50717 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (1d2ae9fb884 -> 13602d38f46)

2025-04-11 Thread panxiaolei
This is an automated email from the ASF dual-hosted git repository.

panxiaolei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 1d2ae9fb884 [feat](bi) support default_init_catalog user property for 
external catalog (#49658)
 add 13602d38f46 [Chore](runtime-filter) remove RuntimeFIlterParamsContext 
(#49837)

No new revisions were added by this update.

Summary of changes:
 .../exec/multi_cast_data_stream_source.cpp |  11 +--
 be/src/pipeline/exec/scan_operator.cpp |   7 +-
 be/src/pipeline/exec/scan_operator.h   |   4 +-
 be/src/pipeline/pipeline_fragment_context.cpp  |   8 +-
 be/src/pipeline/pipeline_fragment_context.h|   2 -
 be/src/pipeline/pipeline_task.cpp  |   2 +-
 be/src/runtime/fragment_mgr.cpp|  42 +
 be/src/runtime/fragment_mgr.h  |   5 +-
 be/src/runtime/query_context.cpp   |   3 +-
 be/src/runtime/query_context.h |   2 +-
 be/src/runtime/runtime_state.cpp   |  10 +-
 be/src/runtime_filter/runtime_filter.cpp   |  19 ++--
 be/src/runtime_filter/runtime_filter.h |  15 +--
 be/src/runtime_filter/runtime_filter_consumer.cpp  |  32 +++
 be/src/runtime_filter/runtime_filter_consumer.h|  34 +++
 .../runtime_filter_consumer_helper.cpp |  85 +++--
 .../runtime_filter_consumer_helper.h   |  34 +++
 be/src/runtime_filter/runtime_filter_definitions.h |  27 --
 be/src/runtime_filter/runtime_filter_merger.h  |  28 ++
 be/src/runtime_filter/runtime_filter_mgr.cpp   | 102 +++--
 be/src/runtime_filter/runtime_filter_mgr.h |  46 --
 be/src/runtime_filter/runtime_filter_producer.cpp  |  66 ++---
 be/src/runtime_filter/runtime_filter_producer.h|  24 +++--
 .../runtime_filter_producer_helper.cpp |  13 ++-
 .../runtime_filter_producer_helper.h   |   2 +-
 be/src/runtime_filter/runtime_filter_wrapper.cpp   |  24 ++---
 be/src/runtime_filter/runtime_filter_wrapper.h |  26 +++---
 be/src/vec/exec/scan/scanner.cpp   |   3 +-
 .../operator/partitioned_hash_join_test_helper.h   |   2 +-
 be/test/pipeline/pipeline_test.cpp |   5 +-
 .../runtime_filter_consumer_helper_test.cpp|  19 ++--
 .../runtime_filter_consumer_test.cpp   |  71 +-
 .../runtime_filter_definitions_test.cpp|  70 --
 .../runtime_filter/runtime_filter_merger_test.cpp  |  47 ++
 be/test/runtime_filter/runtime_filter_mgr_test.cpp |  61 ++--
 .../runtime_filter_producer_test.cpp   |  83 ++---
 be/test/runtime_filter/runtime_filter_test_utils.h |   6 +-
 .../runtime_filter/runtime_filter_wrapper_test.cpp |  31 ++-
 38 files changed, 383 insertions(+), 688 deletions(-)
 delete mode 100644 be/test/runtime_filter/runtime_filter_definitions_test.cpp


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]

2025-04-11 Thread via GitHub


BiteThet merged PR #49837:
URL: https://github.com/apache/doris/pull/49837


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925)

2025-04-11 Thread panxiaolei
This is an automated email from the ASF dual-hosted git repository.

panxiaolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new bd24a332c55 [fix](profile) Fix incorrect check of 
Profile.shouldStoreToStorage (#49925)
bd24a332c55 is described below

commit bd24a332c555adfe2adf037bc2b2a3880b130fe6
Author: zhiqiang 
AuthorDate: Fri Apr 11 17:06:04 2025 +0800

[fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925)

### What problem does this PR solve?

If resource is not busy, we can still see error log like
```
Profile 86e0aa6fa3e445ed-86cdc765118dbf3e should be stored to storage 
without waiting for incoming profile, since it has been waiting for 10140 ms, 
current time 1741661595669 query finished time: 1741661585529
```
This pr fix the problem by:

If profile collection is finished, we should write it to storage
immediately.

Add unit test for class Profile.

Bug is introduced by https://github.com/apache/doris/pull/48653

Issue Number: close #xxx

Related PR: https://github.com/apache/doris/pull/48653

Problem Summary:

### Release note

None

### Check List (For Author)

- Test 
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason 

- Behavior changed:
- [ ] No.
- [ ] Yes. 

- Does this need documentation?
- [ ] No.
- [ ] Yes. 

### Check List (For Reviewer who merge this PR)

- [x] Confirm the release note
- [x] Confirm test cases
- [x] Confirm document
- [x] Add branch pick label 
---
 .../org/apache/doris/common/profile/Profile.java   |  41 ++--
 .../apache/doris/common/profile/ProfileTest.java   | 263 +
 2 files changed, 290 insertions(+), 14 deletions(-)

diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java 
b/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java
index e15bafd6d0a..df1e92cb134 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java
@@ -450,22 +450,35 @@ public class Profile {
 return false;
 }
 
-long currentTimeMillis = System.currentTimeMillis();
-if (this.queryFinishTimestamp != Long.MAX_VALUE
-&& (currentTimeMillis - this.queryFinishTimestamp)
-> Config.profile_waiting_time_for_spill_seconds * 1000) {
-LOG.warn("Profile {} should be stored to storage without waiting 
for incoming profile,"
-+ " since it has been waiting for {} ms, current time {} 
query finished time: {}",
-getId(), currentTimeMillis - this.queryFinishTimestamp, 
currentTimeMillis,
-this.queryFinishTimestamp);
-
-this.summaryProfile.setSystemMessage(
-"This profile is not complete, since its 
collection does not finish in time."
-+ " Maybe increase 
profile_waiting_time_for_spill_secs in fe.conf current val: "
-+ 
String.valueOf(Config.profile_waiting_time_for_spill_seconds));
-return true;
+// below is the case where query has finished
+boolean hasReportingProfile = false;
+
+for (ExecutionProfile executionProfile : executionProfiles) {
+if (!executionProfile.isCompleted()) {
+hasReportingProfile = true;
+break;
+}
 }
 
+if (!hasReportingProfile) {
+return true;
+} else {
+long currentTimeMillis = System.currentTimeMillis();
+if (this.queryFinishTimestamp != Long.MAX_VALUE
+&& (currentTimeMillis - this.queryFinishTimestamp)
+> Config.profile_waiting_time_for_spill_seconds * 1000) {
+LOG.warn("Profile {} should be stored to storage without 
waiting for incoming profile,"
++ " since it has been waiting for {} ms, current time 
{} query finished time: {}",
+getId(), currentTimeMillis - 
this.queryFinishTimestamp, currentTimeMillis,
+this.queryFinishTimestamp);
+
+this.summaryProfile.setSystemMessage(
+"This profile is not complete, since its 
collection does not finish in time."
++ " Maybe increase 
prof

Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]

2025-04-11 Thread via GitHub


BiteThet merged PR #49925:
URL: https://github.com/apache/doris/pull/49925


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49925-branch-3.0 updated (c5e18ef5520 -> 7848acf131b)

2025-04-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49925-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


from c5e18ef5520 branch-3.0: [fix](multi-catalog) Fix multi-thread issue in 
hive/iceberg writer commit meta-info to fe. #49842 (#49863)
 add 7848acf131b [fix](profile) Fix incorrect check of 
Profile.shouldStoreToStorage (#49925)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/doris/common/profile/Profile.java   |  41 ++--
 .../apache/doris/common/profile/ProfileTest.java   | 263 +
 2 files changed, 290 insertions(+), 14 deletions(-)
 create mode 100644 
fe/fe-core/src/test/java/org/apache/doris/common/profile/ProfileTest.java


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


dataroaring closed pull request #49991: branch-3.0: [fix](profile) Fix 
incorrect check of Profile.shouldStoreToStorage #49925
URL: https://github.com/apache/doris/pull/49991


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49991:
URL: https://github.com/apache/doris/pull/49991#issuecomment-2796303465

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat](binlog) add modify distribution bucket num binlog [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49894:
URL: https://github.com/apache/doris/pull/49894#issuecomment-2796299741

   TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311) 
Line Coverage: 66.07% (18162/27489)
Region Coverage: 65.50% (8946/13657)
Branch Coverage: 55.34% (4819/8708)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/63c11714cd075d28b6cead457366b78f1591ee54_63c11714cd075d28b6cead457366b78f1591ee54_cloud/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49925-branch-3.0 created (now c5e18ef5520)

2025-04-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49925-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


  at c5e18ef5520 branch-3.0: [fix](multi-catalog) Fix multi-thread issue in 
hive/iceberg writer commit meta-info to fe. #49842 (#49863)

No new revisions were added by this update.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49991:
URL: https://github.com/apache/doris/pull/49991#issuecomment-2796303289

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


github-actions[bot] opened a new pull request, #49991:
URL: https://github.com/apache/doris/pull/49991

   Cherry-picked from #49925


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796320146

   
   
   TPC-DS: Total hot run time: 186425 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, 
data reload: false
   
   query1   995 475 462 462
   query2   6559195119201920
   query3   6770225 219 219
   query4   25896   23847   23123   23123
   query5   4400678 467 467
   query6   321 209 205 205
   query7   4618528 278 278
   query8   300 246 240 240
   query9   8665259725922592
   query10  463 332 256 256
   query11  15875   15076   14875   14875
   query12  172 116 106 106
   query13  1633526 384 384
   query14  9770607560876075
   query15  199 189 168 168
   query16  7637681 471 471
   query17  1192722 552 552
   query18  2005416 325 325
   query19  187 186 162 162
   query20  120 119 113 113
   query21  204 126 102 102
   query22  4221413040854085
   query23  33878   33048   33057   33048
   query24  8545236223762362
   query25  535 456 391 391
   query26  1240270 150 150
   query27  2771519 326 326
   query28  4339242124252421
   query29  726 593 443 443
   query30  301 225 199 199
   query31  943 846 768 768
   query32  73  65  65  65
   query33  571 408 302 302
   query34  813 911 505 505
   query35  813 841 754 754
   query36  1005981 859 859
   query37  119 105 80  80
   query38  4187420440904090
   query39  1450140013961396
   query40  213 121 107 107
   query41  58  79  54  54
   query42  117 110 107 107
   query43  495 505 479 479
   query44  1346809 798 798
   query45  178 173 169 169
   query46  880 1062626 626
   query47  1739179517341734
   query48  370 423 301 301
   query49  792 528 425 425
   query50  683 726 393 393
   query51  4140421740964096
   query52  109 109 94  94
   query53  230 262 187 187
   query54  584 585 510 510
   query55  86  84  85  84
   query56  287 296 287 287
   query57  1112115410601060
   query58  268 292 256 256
   query59  2571265726212621
   query60  363 345 324 324
   query61  161 162 151 151
   query62  792 754 673 673
   query63  225 195 188 188
   query64  44381126795 795
   query65  4370428443284284
   query66  435 303 303
   query67  15968   15573   15206   15206
   query68  8569916 514 514
   query69  471 304 272 272
   query70  1174113110601060
   query71  469 323 300 300
   query72  5553478345954595
   query73  692 580 347 347
   query74  8907909988798879
   query75  4016322426472647
   query76  37081297772 772
   query77  816 394 367 367
   query78  10002   10093   92709270
   query79  2778862 590 590
   query80  657 530 454 454
   query81  470 258 228 228
   query82  459 136 100 100
   query83  302 263 245 245
   query84  294 111 85  85
   query85  783 363 317 317
   query86  341 310 290 290
   query87  4466449743904390
   query88  3346226922752269
   query89  422 316 281 281
   query90  1963223 236 223
   query91  143 207 117 117
   query92  84  65  62  62
   query93  2140943 584 584
   query94  688 443 302 302
   query95  379 300 297 297
   query96  492 627 284 284
   query97  3146326631303130
   query98  228 206 201 201
   query99  1437142013021302
   Total cold run time: 277592 ms
   Total hot run time: 186425 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49958:
URL: https://github.com/apache/doris/pull/49958#issuecomment-2796334475

   
   
   ClickBench: Total hot run time: 31.51 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.100.10
   query3   0.240.190.19
   query4   1.580.200.20
   query5   0.580.570.56
   query6   1.180.720.72
   query7   0.030.020.01
   query8   0.040.030.04
   query9   0.580.510.51
   query10  0.600.590.59
   query11  0.160.110.10
   query12  0.150.120.11
   query13  0.610.590.60
   query14  2.672.672.81
   query15  0.920.850.86
   query16  0.400.380.39
   query17  1.031.081.04
   query18  0.210.200.19
   query19  1.991.851.86
   query20  0.010.010.01
   query21  15.35   0.860.55
   query22  0.761.370.77
   query23  14.77   1.370.61
   query24  7.191.100.99
   query25  0.520.180.06
   query26  0.710.160.14
   query27  0.050.050.06
   query28  9.520.870.44
   query29  12.56   4.053.36
   query30  0.250.090.07
   query31  2.830.580.39
   query32  3.230.550.47
   query33  3.033.013.10
   query34  15.58   5.134.56
   query35  4.564.524.56
   query36  0.650.490.48
   query37  0.090.060.06
   query38  0.050.030.03
   query39  0.030.030.02
   query40  0.180.130.13
   query41  0.080.030.02
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 105.21 s
   Total hot run time: 31.51 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](schema) add column comment length limit [doris]

2025-04-11 Thread via GitHub


cambyzju commented on code in PR #49989:
URL: https://github.com/apache/doris/pull/49989#discussion_r2039163570


##
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##
@@ -1765,6 +1765,12 @@ public class Config extends ConfigBase {
 @ConfField(mutable = true, masterOnly = true)
 public static int table_name_length_limit = 64;
 
+@ConfField(mutable = true, description = {
+"用于限制列注释长度;如果存量的列注释超长,则显示时进行截断",
+"Used to limit the length of column comment; "
++ "If the existing column comment is too long, it will be 
truncated when displayed."})
+public static int column_comment_length_limit = 1024;

Review Comment:
   good idea, I change it later



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49904:
URL: https://github.com/apache/doris/pull/49904#issuecomment-2796347274

   # BE UT Coverage Report
   Increment line coverage `100.00% (3/3)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/6617c5faeaa72baadb8e968c081ceeb1ec45a3d1_6617c5faeaa72baadb8e968c081ceeb1ec45a3d1/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/6617c5faeaa72baadb8e968c081ceeb1ec45a3d1_6617c5faeaa72baadb8e968c081ceeb1ec45a3d1/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.58% (14139/26888) |
   | Line Coverage | 41.35% (122184/295515) |
   | Region Coverage   | 40.10% (62231/155179) |
   | Branch Coverage   | 34.71% (31133/89690) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]

2025-04-11 Thread via GitHub


zclllyybb commented on PR #49972:
URL: https://github.com/apache/doris/pull/49972#issuecomment-2796348934

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (918dbff46f4 -> 8ffba74be78)

2025-04-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 918dbff46f4 Automated deployment with doris branch @ 
e311ae6cc1e209c9ac32b84b29e13eaeea920398
 new 8ffba74be78 Automated deployment with doris branch @ 
e311ae6cc1e209c9ac32b84b29e13eaeea920398

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (918dbff46f4)
\
 N -- N -- N   refs/heads/asf-site (8ffba74be78)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](nereids)use analyzed plan instead of rewritten plan in CreateMaterializedViewCommand [doris]

2025-04-11 Thread via GitHub


starocean999 commented on PR #49297:
URL: https://github.com/apache/doris/pull/49297#issuecomment-2796362198

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [UT](low memory) Test low memory mode in pipeline task [doris]

2025-04-11 Thread via GitHub


Gabriel39 opened a new pull request, #49992:
URL: https://github.com/apache/doris/pull/49992

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [UT](low memory) Test low memory mode in pipeline task [doris]

2025-04-11 Thread via GitHub


Gabriel39 commented on PR #49992:
URL: https://github.com/apache/doris/pull/49992#issuecomment-2796364388

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](task) Complete debug string if task is finalized [doris]

2025-04-11 Thread via GitHub


Gabriel39 merged PR #49950:
URL: https://github.com/apache/doris/pull/49950


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [minor](task) Complete debug string if task is finalized (#49950)

2025-04-11 Thread gabriellee
This is an automated email from the ASF dual-hosted git repository.

gabriellee pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 3e819ab64b0 [minor](task) Complete debug string if task is finalized 
(#49950)
3e819ab64b0 is described below

commit 3e819ab64b00a52ce622aa315f6fc81fe92f692e
Author: Gabriel 
AuthorDate: Fri Apr 11 17:29:18 2025 +0800

[minor](task) Complete debug string if task is finalized (#49950)

1. Add spill dependencies to run BE UT.
2. Add pipeline name in debug string if task is finalized.
---
 be/src/pipeline/exec/operator.h |  6 +
 be/src/pipeline/pipeline.h  |  1 +
 be/src/pipeline/pipeline_task.cpp   | 43 +++--
 be/src/pipeline/pipeline_task.h |  1 +
 be/test/pipeline/pipeline_task_test.cpp |  4 +--
 5 files changed, 29 insertions(+), 26 deletions(-)

diff --git a/be/src/pipeline/exec/operator.h b/be/src/pipeline/exec/operator.h
index 0625bcc0ad0..75a767aaa83 100644
--- a/be/src/pipeline/exec/operator.h
+++ b/be/src/pipeline/exec/operator.h
@@ -1100,12 +1100,15 @@ public:

"DummyOperatorDependency", true);
 _filter_dependency = Dependency::create_shared(_parent->operator_id(), 
_parent->node_id(),

"DummyOperatorDependency", true);
+_spill_dependency = Dependency::create_shared(_parent->operator_id(), 
_parent->node_id(),
+  
"DummyOperatorDependency", true);
 }
 Dependency* finishdependency() override { return _finish_dependency.get(); 
}
 ~DummyOperatorLocalState() = default;
 
 std::vector dependencies() const override { return 
{_tmp_dependency.get()}; }
 std::vector filter_dependencies() override { return 
{_filter_dependency.get()}; }
+Dependency* spill_dependency() const override { return 
_spill_dependency.get(); }
 
 private:
 std::shared_ptr _tmp_dependency;
@@ -1145,10 +1148,13 @@ public:
 "DummyOperatorDependency", 
true);
 _finish_dependency = Dependency::create_shared(_parent->operator_id(), 
_parent->node_id(),

"DummyOperatorDependency", true);
+_spill_dependency = Dependency::create_shared(_parent->operator_id(), 
_parent->node_id(),
+  
"DummyOperatorDependency", true);
 }
 
 std::vector dependencies() const override { return 
{_tmp_dependency.get()}; }
 Dependency* finishdependency() override { return _finish_dependency.get(); 
}
+Dependency* spill_dependency() const override { return 
_spill_dependency.get(); }
 bool is_finished() const override { return _is_finished; }
 
 private:
diff --git a/be/src/pipeline/pipeline.h b/be/src/pipeline/pipeline.h
index 7bde9323e94..7fff24cf8d9 100644
--- a/be/src/pipeline/pipeline.h
+++ b/be/src/pipeline/pipeline.h
@@ -138,6 +138,7 @@ public:
 }
 
 int num_tasks_of_parent() const { return _num_tasks_of_parent; }
+std::string& name() { return _name; }
 
 private:
 void _init_profile();
diff --git a/be/src/pipeline/pipeline_task.cpp 
b/be/src/pipeline/pipeline_task.cpp
index 94c5c6f7c75..852174137de 100644
--- a/be/src/pipeline/pipeline_task.cpp
+++ b/be/src/pipeline/pipeline_task.cpp
@@ -79,8 +79,8 @@ PipelineTask::PipelineTask(PipelinePtr& pipeline, uint32_t 
task_id, RuntimeState
   _shared_state_map(std::move(shared_state_map)),
   _task_idx(task_idx),
   _execution_dep(state->get_query_ctx()->get_execution_dependency()),
-  _memory_sufficient_dependency(
-  state->get_query_ctx()->get_memory_sufficient_dependency()) {
+  
_memory_sufficient_dependency(state->get_query_ctx()->get_memory_sufficient_dependency()),
+  _pipeline_name(_pipeline->name()) {
 _pipeline_task_watcher.start();
 
 if (!_shared_state_map.contains(_sink->dests_id().front())) {
@@ -291,24 +291,19 @@ void PipelineTask::terminate() {
 auto fragment = _fragment_context.lock();
 if (!is_finalized() && fragment) {
 DCHECK(_wake_up_early || fragment->is_canceled());
-for (auto* dep : _spill_dependencies) {
-dep->set_always_ready();
-}
-
-for (auto* dep : _filter_dependencies) {
-dep->set_always_ready();
-}
-for (auto& deps : _read_dependencies) {
-for (auto* dep : deps) {
-dep->set_always_ready();
-}
-}
-for (auto* dep : _write_dependencies) {
-dep->set_always_ready();
-}
-for (auto* dep : _finish_dependencies) {
-dep->set_always_ready();
-}
+std::for_each(_spill_dependencies.begin(), _spil

Re: [PR] [test](ut) add cases about hash join [doris]

2025-04-11 Thread via GitHub


mrhhsg commented on PR #49803:
URL: https://github.com/apache/doris/pull/49803#issuecomment-2796374574

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [UT](low memory) Test low memory mode in pipeline task [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49992:
URL: https://github.com/apache/doris/pull/49992#issuecomment-2796364245

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [only test] [doris]

2025-04-11 Thread via GitHub


Mryange commented on PR #49971:
URL: https://github.com/apache/doris/pull/49971#issuecomment-2796385322

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49991:
URL: https://github.com/apache/doris/pull/49991#issuecomment-2796391933

   
   
   TPC-H: Total hot run time: 40090 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 7848acf131b876ffad64c4880236b9832bde6539, 
data reload: false
   
   -- Round 1 --
   q1   17584   670365906590
   q2   2060174 176 174
   q3   10612   106211741062
   q4   10543   794 745 745
   q5   7765286027692769
   q6   214 133 136 133
   q7   995 621 605 605
   q8   9354196320101963
   q9   6590639664106396
   q10  7042228523012285
   q11  469 274 264 264
   q12  396 211 209 209
   q13  17771   295929862959
   q14  227 204 214 204
   q15  507 461 472 461
   q16  674 581 603 581
   q17  975 557 544 544
   q18  7273672967046704
   q19  1394111910101010
   q20  458 211 210 210
   q21  4001324033873240
   q22  1083983 982 982
   Total cold run time: 107987 ms
   Total hot run time: 40090 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   6563659565856585
   q2   343 241 241 241
   q3   2930280829362808
   q4   2062184018921840
   q5   5866581657365736
   q6   217 128 131 128
   q7   2223180418001800
   q8   3408353235023502
   q9   8777886888418841
   q10  3571353435043504
   q11  593 497 475 475
   q12  790 626 592 592
   q13  7903322331683168
   q14  304 273 283 273
   q15  522 451 467 451
   q16  672 638 651 638
   q17  1814164416211621
   q18  8231785676947694
   q19  1657157314391439
   q20  2127188319131883
   q21  5624531253585312
   q22  1101100310111003
   Total cold run time: 67298 ms
   Total hot run time: 59534 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]

2025-04-11 Thread via GitHub


zclllyybb commented on PR #49993:
URL: https://github.com/apache/doris/pull/49993#issuecomment-2796398910

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](schema) add column comment length limit [doris]

2025-04-11 Thread via GitHub


cambyzju commented on PR #49989:
URL: https://github.com/apache/doris/pull/49989#issuecomment-2796400575

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]

2025-04-11 Thread via GitHub


Thearas commented on PR #49993:
URL: https://github.com/apache/doris/pull/49993#issuecomment-2796398238

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49994:
URL: https://github.com/apache/doris/pull/49994#issuecomment-2796404881

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


zgxme opened a new pull request, #49994:
URL: https://github.com/apache/doris/pull/49994

   ### What problem does this PR solve?
   Version 3.0.0-SNAPSHOT does not work on aliyun mirror.This can cause the CI 
to become unstable.
   
   Related PR: https://github.com/apache/doris/pull/48023
   
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [x] No need to test or manual test. Explain why:
   - [x] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [x] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [x] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [x] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49993:
URL: https://github.com/apache/doris/pull/49993#issuecomment-2796414697

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49993:
URL: https://github.com/apache/doris/pull/49993#issuecomment-2796414999

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49991:
URL: https://github.com/apache/doris/pull/49991#issuecomment-2796434615

   
   
   TPC-DS: Total hot run time: 197220 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 7848acf131b876ffad64c4880236b9832bde6539, 
data reload: false
   
   query1   1293929 907 907
   query2   6215205419991999
   query3   10855   449242954295
   query4   65354   28152   23298   23298
   query5   5035443 439 439
   query6   391 169 168 168
   query7   5529320 311 311
   query8   316 228 222 222
   query9   8392259225832583
   query10  445 259 259 259
   query11  16931   15059   15738   15059
   query12  158 102 100 100
   query13  1434449 456 449
   query14  10728   758276267582
   query15  200 194 182 182
   query16  7274470 455 455
   query17  1089618 593 593
   query18  1839319 322 319
   query19  214 170 161 161
   query20  119 121 113 113
   query21  213 108 103 103
   query22  4661436144794361
   query23  34421   33892   34267   33892
   query24  6112293629042904
   query25  524 410 393 393
   query26  665 171 163 163
   query27  1693352 365 352
   query28  4358244124512441
   query29  709 457 434 434
   query30  240 161 163 161
   query31  1013837 850 837
   query32  64  57  55  55
   query33  417 312 317 312
   query34  918 523 499 499
   query35  841 756 725 725
   query36  1068972 984 972
   query37  116 64  69  64
   query38  4255402940364029
   query39  1521145214591452
   query40  208 100 101 100
   query41  49  48  53  48
   query42  111 99  100 99
   query43  518 477 485 477
   query44  1170823 833 823
   query45  184 173 175 173
   query46  1168721 721 721
   query47  2018193019291929
   query48  481 377 385 377
   query49  738 391 398 391
   query50  857 412 417 412
   query51  7276724471197119
   query52  102 86  87  86
   query53  256 174 182 174
   query54  560 462 454 454
   query55  76  73  74  73
   query56  271 238 253 238
   query57  1197111011341110
   query58  209 208 211 208
   query59  3145283530702835
   query60  271 243 260 243
   query61  108 127 147 127
   query62  778 661 677 661
   query63  224 187 188 187
   query64  1380672 642 642
   query65  3285319332443193
   query66  723 299 304 299
   query67  15987   15630   15794   15630
   query68  3757605 595 595
   query69  429 278 262 262
   query70  1181110510431043
   query71  363 260 266 260
   query72  6408405240004000
   query73  756 344 344 344
   query74  10073   936591619161
   query75  3352267926132613
   query76  1897107011281070
   query77  497 289 279 279
   query78  10548   957296019572
   query79  1122586 592 586
   query80  832 462 453 453
   query81  506 246 241 241
   query82  321 93  89  89
   query83  164 149 153 149
   query84  293 84  80  80
   query85  905 381 298 298
   query86  330 304 306 304
   query87  4478436143144314
   query88  4000248223592359
   query89  411 291 293 291
   query90  1955187 185 185
   query91  179 151 151 151
   query92  66  49  49  49
   query93  1448562 562 562
   query94  763 300 293 293
   query95  361 263 260 260
   query96  619 278 280 278
   query97  3425315331493149
   query98  206 204 203 203
   query99  1682125513101255
   Total cold run time: 314297 ms
   Total hot run time: 197220 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

[PR] [Fix](function) fix wrong length check of function array_range [doris]

2025-04-11 Thread via GitHub


zclllyybb opened a new pull request, #49993:
URL: https://github.com/apache/doris/pull/49993

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   before, for a short range with big value, like `[1, 10001]`, it 
will raise an error by mistake. now fixed.
   
   before:
   ```sql
   mysql> select number, array_range(number * 1, number * 1 + 
10) from numbers("number" = "1");
   ERROR 1105 (HY000): errCode = 2, detailMessage = [CANCELLED]Array size 
exceeds the limit 100
   ```
   now:
   ```sql
   mysql> select number, array_range(number * 1, number * 1 + 
10) from numbers("number" = "1");
   ++--+
   | number | array_range(number * 1, number * 1 + 10) |
   ++--+
   |  0 | [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]   |
   ++--+
   ```
   
   ### Release note
   
   fix wrong length check of function array_range
   
   ### Check List (For Author)
   
   - Test 
   - [x] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [x] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [x] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [poc](mtmv) Support copying tmp rewrite plan to memo for mv rewrite better [doris]

2025-04-11 Thread via GitHub


seawinde commented on PR #49597:
URL: https://github.com/apache/doris/pull/49597#issuecomment-2796434600

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


zddr commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796441783

   run cloud_p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


zddr commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796442004

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]

2025-04-11 Thread via GitHub


zddr commented on PR #49875:
URL: https://github.com/apache/doris/pull/49875#issuecomment-2796442717

   run external


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49994:
URL: https://github.com/apache/doris/pull/49994#issuecomment-2796453325

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49905:
URL: https://github.com/apache/doris/pull/49905#issuecomment-2796449965

   
   
   TPC-H: Total hot run time: 34728 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 04ccdf5c7932f06b30a8adf4c660e68b13fef148, 
data reload: false
   
   -- Round 1 --
   q1   26152   509250135013
   q2   2084282 207 207
   q3   10502   1234668 668
   q4   10242   1044529 529
   q5   7935243522912291
   q6   193 163 133 133
   q7   917 732 606 606
   q8   9312124011081108
   q9   6828513850965096
   q10  6866232718891889
   q11  504 290 277 277
   q12  368 354 228 228
   q13  17783   368531073107
   q14  231 222 210 210
   q15  529 486 486 486
   q16  610 616 568 568
   q17  610 852 361 361
   q18  7577716770037003
   q19  1773961 585 585
   q20  345 349 228 228
   q21  4324339931613161
   q22  10471017974 974
   Total cold run time: 116732 ms
   Total hot run time: 34728 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5308511650835083
   q2   242 323 236 236
   q3   2101263722682268
   q4   1408186114961496
   q5   4468444243694369
   q6   219 177 133 133
   q7   2010189018081808
   q8   2662266425672567
   q9   7190708171097081
   q10  3019317427562756
   q11  575 504 514 504
   q12  669 753 590 590
   q13  3577390333223322
   q14  316 315 276 276
   q15  533 479 476 476
   q16  649 668 663 663
   q17  1165152514191419
   q18  7864757974107410
   q19  845 795 851 795
   q20  1900194018511851
   q21  5427494248684868
   q22  1135108910341034
   Total cold run time: 53282 ms
   Total hot run time: 51005 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49991:
URL: https://github.com/apache/doris/pull/49991#issuecomment-2796452300

   
   
   ClickBench: Total hot run time: 32.32 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 7848acf131b876ffad64c4880236b9832bde6539, 
data reload: false
   
   query1   0.040.030.03
   query2   0.060.030.03
   query3   0.230.070.06
   query4   1.620.100.09
   query5   0.520.490.52
   query6   1.140.720.72
   query7   0.020.020.01
   query8   0.040.030.04
   query9   0.550.500.50
   query10  0.540.550.55
   query11  0.150.100.10
   query12  0.140.110.11
   query13  0.610.600.60
   query14  2.732.742.76
   query15  0.900.820.82
   query16  0.390.400.38
   query17  1.031.010.98
   query18  0.240.230.22
   query19  1.971.822.06
   query20  0.020.010.01
   query21  15.73   0.580.59
   query22  2.372.331.60
   query23  16.84   1.030.89
   query24  3.501.451.58
   query25  0.220.230.07
   query26  0.380.130.13
   query27  0.050.040.04
   query28  9.120.540.51
   query29  12.65   3.213.21
   query30  0.250.060.07
   query31  2.850.380.38
   query32  3.250.460.47
   query33  2.992.983.03
   query34  16.92   4.474.41
   query35  4.554.524.47
   query36  0.690.480.48
   query37  0.090.060.06
   query38  0.040.030.04
   query39  0.030.020.02
   query40  0.160.140.13
   query41  0.080.020.02
   query42  0.030.020.02
   query43  0.040.030.03
   Total cold run time: 105.77 s
   Total hot run time: 32.32 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


hello-stephen commented on PR #49994:
URL: https://github.com/apache/doris/pull/49994#issuecomment-2796454751

   skip buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49994:
URL: https://github.com/apache/doris/pull/49994#issuecomment-2796459514

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (3e819ab64b0 -> af913104b79)

2025-04-11 Thread hellostephen
This is an automated email from the ASF dual-hosted git repository.

hellostephen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 3e819ab64b0 [minor](task) Complete debug string if task is finalized 
(#49950)
 add af913104b79 [enhancement](ranger) modify ranger-intg to make testing 
more stable (#49994)

No new revisions were added by this update.

Summary of changes:
 regression-test/framework/pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]

2025-04-11 Thread via GitHub


github-actions[bot] commented on PR #49994:
URL: https://github.com/apache/doris/pull/49994#issuecomment-2796459405

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]

2025-04-11 Thread via GitHub


KeeProMise commented on PR #49852:
URL: https://github.com/apache/doris/pull/49852#issuecomment-2796477225

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]

2025-04-11 Thread via GitHub


doris-robot commented on PR #49905:
URL: https://github.com/apache/doris/pull/49905#issuecomment-2796479526

   
   
   TPC-DS: Total hot run time: 193437 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 04ccdf5c7932f06b30a8adf4c660e68b13fef148, 
data reload: false
   
   query1   1399107310141014
   query2   6379196619431943
   query3   11139   474145484548
   query4   25810   23882   23172   23172
   query5   4809622 450 450
   query6   299 210 202 202
   query7   3993479 281 281
   query8   290 232 234 232
   query9   8518259126092591
   query10  489 323 279 279
   query11  15350   15384   14763   14763
   query12  169 115 114 114
   query13  1560548 402 402
   query14  9172620561956195
   query15  201 187 162 162
   query16  7325640 490 490
   query17  1148789 593 593
   query18  1991419 311 311
   query19  193 190 162 162
   query20  127 127 121 121
   query21  214 130 113 113
   query22  4357463342964296
   query23  34584   33857   33784   33784
   query24  8478248724712471
   query25  533 465 398 398
   query26  1196279 150 150
   query27  3029498 341 341
   query28  4790245624292429
   query29  718 584 442 442
   query30  283 228 201 201
   query31  939 880 796 796
   query32  82  65  63  63
   query33  531 359 325 325
   query34  808 889 524 524
   query35  834 864 759 759
   query36  10211028920 920
   query37  124 98  75  75
   query38  4230423941874187
   query39  1498148814291429
   query40  217 120 108 108
   query41  52  52  50  50
   query42  123 107 108 107
   query43  524 497 496 496
   query44  1351853 834 834
   query45  190 185 170 170
   query46  865 1044658 658
   query47  1829185718401840
   query48  396 418 305 305
   query49  780 565 458 458
   query50  666 705 409 409
   query51  4279434242554255
   query52  115 108 101 101
   query53  250 279 187 187
   query54  604 585 530 530
   query55  86  88  88  88
   query56  327 309 300 300
   query57  1181117311451145
   query58  273 272 269 269
   query59  2764285727042704
   query60  330 334 309 309
   query61  136 145 176 145
   query62  762 749 667 667
   query63  240 186 190 186
   query64  41831058693 693
   query65  4422436043404340
   query66  1106410 308 308
   query67  15658   15398   15275   15275
   query68  6454886 512 512
   query69  475 304 262 262
   query70  1198110310451045
   query71  409 332 297 297
   query72  5745464346444643
   query73  654 650 354 354
   query74  9191902189418941
   query75  3221319827442744
   query76  31761186762 762
   query77  490 364 288 288
   query78  9851999092999299
   query79  2349818 568 568
   query80  1457526 464 464
   query81  532 262 228 228
   query82  428 127 90  90
   query83  326 251 234 234
   query84  243 107 82  82
   query85  799 424 318 318
   query86  449 306 272 272
   query87  4417443743994399
   query88  3488226922752269
   query89  399 313 293 293
   query90  1893212 219 212
   query91  144 141 112 112
   query92  78  58  59  58
   query93  2676927 574 574
   query94  726 406 308 308
   query95  380 301 288 288
   query96  506 562 281 281
   query97  3107322031143114
   query98  243 202 205 202
   query99  1331144612591259
   Total cold run time: 279154 ms
   Total hot run time: 193437 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

  1   2   3   >