Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
hubgeter commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796078451 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
hubgeter commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796083402 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](ut) add cases about hash join [doris]
doris-robot commented on PR #49803: URL: https://github.com/apache/doris/pull/49803#issuecomment-2796085627 TPC-DS: Total hot run time: 193254 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 07a95114e49761de827284fdfb42fb13fbaacd76, data reload: false query1 1388106810701068 query2 6139192119101910 query3 3 457447354574 query4 25439 23959 23375 23375 query5 4989635 471 471 query6 310 226 198 198 query7 3999491 283 283 query8 287 236 218 218 query9 8518258625942586 query10 502 313 266 266 query11 15471 15060 14863 14863 query12 164 121 109 109 query13 1573531 395 395 query14 9042624263296242 query15 198 190 172 172 query16 7580637 485 485 query17 1154800 595 595 query18 2056416 347 347 query19 191 190 161 161 query20 133 124 121 121 query21 208 130 108 108 query22 4379457943084308 query23 34566 33702 33326 33326 query24 8577244024022402 query25 524 478 399 399 query26 1163275 154 154 query27 2913507 338 338 query28 4741245124352435 query29 677 570 468 468 query30 270 227 196 196 query31 926 898 805 805 query32 78 69 65 65 query33 568 376 340 340 query34 787 862 528 528 query35 806 863 753 753 query36 974 1013917 917 query37 122 103 81 81 query38 4263431042344234 query39 1501143714601437 query40 224 135 118 118 query41 61 57 57 57 query42 123 114 111 111 query43 524 508 489 489 query44 1331838 834 834 query45 189 177 173 173 query46 842 1045674 674 query47 1897187617741774 query48 389 420 325 325 query49 778 509 439 439 query50 676 714 399 399 query51 4269430642814281 query52 114 110 108 108 query53 247 256 185 185 query54 586 595 519 519 query55 82 88 84 84 query56 326 309 297 297 query57 1203119411181118 query58 263 264 259 259 query59 2776278126952695 query60 342 335 305 305 query61 139 131 128 128 query62 761 734 693 693 query63 235 191 189 189 query64 42721090735 735 query65 4421439043524352 query66 949 399 306 306 query67 15581 15302 15153 15153 query68 8393886 504 504 query69 485 293 274 274 query70 1203109811241098 query71 488 320 294 294 query72 5840485349914853 query73 723 748 352 352 query74 9153907289078907 query75 3947319226972697 query76 38001192757 757 query77 796 358 284 284 query78 10043 10221 92619261 query79 2385818 557 557 query80 723 516 440 440 query81 485 257 277 257 query82 479 126 97 97 query83 259 261 231 231 query84 244 108 84 84 query85 782 358 314 314 query86 373 299 293 293 query87 4545451043184318 query88 3567221122022202 query89 399 314 285 285 query90 1884211 216 211 query91 146 144 109 109 query92 76 63 54 54 query93 1830955 567 567 query94 662 410 301 301 query95 366 306 281 281 query96 482 561 272 272 query97 3141324731143114 query98 244 214 201 201 query99 1419139912521252 Total cold run time: 281251 ms Total hot run time: 193254 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]
doris-robot commented on PR #49904: URL: https://github.com/apache/doris/pull/49904#issuecomment-2796093809 TPC-DS: Total hot run time: 193356 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, data reload: false query1 1376107110481048 query2 6299194819241924 query3 11035 449044984490 query4 53293 25699 23411 23411 query5 4950573 446 446 query6 328 205 189 189 query7 4869504 291 291 query8 327 249 251 249 query9 5277258725952587 query10 413 316 270 270 query11 14997 14959 14813 14813 query12 163 110 108 108 query13 1046503 387 387 query14 10157 629364566293 query15 207 195 180 180 query16 7102660 493 493 query17 1132757 606 606 query18 1570419 328 328 query19 205 190 176 176 query20 134 128 129 128 query21 216 139 110 110 query22 4320448743314331 query23 34151 33472 33609 33472 query24 6669242224592422 query25 453 481 407 407 query26 712 275 150 150 query27 2461503 325 325 query28 3129247924272427 query29 602 573 423 423 query30 294 229 199 199 query31 873 869 785 785 query32 76 63 63 63 query33 463 357 299 299 query34 777 882 526 526 query35 793 845 772 772 query36 940 1039916 916 query37 115 104 78 78 query38 4257433141014101 query39 1538144715831447 query40 221 135 113 113 query41 54 51 50 50 query42 125 110 109 109 query43 488 493 490 490 query44 1318822 825 822 query45 180 187 176 176 query46 844 1049648 648 query47 1840185117891789 query48 404 416 313 313 query49 717 521 455 455 query50 668 698 404 404 query51 4222431742604260 query52 107 104 102 102 query53 223 261 202 202 query54 587 581 508 508 query55 85 88 82 82 query56 311 314 303 303 query57 1174117911801179 query58 288 264 283 264 query59 2785286326852685 query60 333 330 310 310 query61 131 142 137 137 query62 730 751 709 709 query63 228 186 186 186 query64 20281030691 691 query65 4342426342264226 query66 767 399 305 305 query67 15756 15676 15337 15337 query68 7416883 510 510 query69 547 294 259 259 query70 1187110110991099 query71 499 319 305 305 query72 5954495448954895 query73 1507665 350 350 query74 9077894589308930 query75 3974320126882688 query76 43061180741 741 query77 699 383 287 287 query78 10010 10154 93009300 query79 3064816 560 560 query80 685 502 440 440 query81 479 268 216 216 query82 454 126 99 99 query83 314 254 239 239 query84 293 98 83 83 query85 784 363 322 322 query86 345 286 295 286 query87 4457443843364336 query88 3063222821972197 query89 404 309 280 280 query90 1979206 202 202 query91 145 148 115 115 query92 77 60 57 57 query93 1301928 580 580 query94 685 409 310 310 query95 425 292 285 285 query96 475 556 277 277 query97 3167320831113111 query98 224 204 203 203 query99 1441141012691269 Total cold run time: 298112 ms Total hot run time: 193356 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [minor](task) Complete debug string if task is finalized [doris]
github-actions[bot] commented on PR #49950: URL: https://github.com/apache/doris/pull/49950#issuecomment-2796095226 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [draft](nereids) Add constant propagation [doris]
yujun777 commented on PR #49982: URL: https://github.com/apache/doris/pull/49982#issuecomment-2796097520 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](task) Complete debug string if task is finalized [doris]
github-actions[bot] commented on PR #49950: URL: https://github.com/apache/doris/pull/49950#issuecomment-2796095139 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](ut) add cases about hash join [doris]
doris-robot commented on PR #49803: URL: https://github.com/apache/doris/pull/49803#issuecomment-2796095921 ClickBench: Total hot run time: 31.15 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 07a95114e49761de827284fdfb42fb13fbaacd76, data reload: false query1 0.040.030.04 query2 0.120.100.10 query3 0.250.200.20 query4 1.600.200.19 query5 0.610.590.62 query6 1.190.720.73 query7 0.030.010.02 query8 0.040.030.03 query9 0.570.530.54 query10 0.570.580.56 query11 0.150.110.12 query12 0.150.120.11 query13 0.620.600.60 query14 2.662.802.68 query15 0.930.850.86 query16 0.390.380.39 query17 1.041.060.98 query18 0.210.200.20 query19 1.841.961.82 query20 0.020.010.01 query21 15.35 0.910.55 query22 0.751.120.69 query23 15.06 1.400.64 query24 6.931.820.70 query25 0.490.120.20 query26 0.620.170.13 query27 0.060.060.05 query28 9.130.890.44 query29 12.53 4.043.34 query30 0.250.090.06 query31 2.830.610.39 query32 3.230.540.46 query33 3.073.023.03 query34 15.73 5.134.52 query35 4.564.574.52 query36 0.690.490.49 query37 0.080.060.07 query38 0.060.040.04 query39 0.030.020.02 query40 0.180.140.14 query41 0.070.020.03 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 104.8 s Total hot run time: 31.15 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [draft](nereids) Add constant propagation [doris]
yujun777 commented on PR #49982: URL: https://github.com/apache/doris/pull/49982#issuecomment-2796098356 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]
doris-robot commented on PR #49904: URL: https://github.com/apache/doris/pull/49904#issuecomment-2796104076 ClickBench: Total hot run time: 31.66 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, data reload: false query1 0.040.030.03 query2 0.130.110.11 query3 0.240.200.19 query4 1.600.200.20 query5 0.610.580.60 query6 1.200.730.72 query7 0.020.020.02 query8 0.040.040.03 query9 0.590.520.52 query10 0.570.600.57 query11 0.150.110.11 query12 0.140.110.11 query13 0.600.610.60 query14 2.772.672.72 query15 0.940.860.84 query16 0.380.390.40 query17 1.021.021.05 query18 0.210.200.19 query19 1.871.871.86 query20 0.010.010.02 query21 15.38 0.900.55 query22 0.751.250.69 query23 14.85 1.400.64 query24 7.021.301.19 query25 0.450.190.06 query26 0.630.160.15 query27 0.060.050.04 query28 9.710.890.43 query29 12.55 4.013.33 query30 0.260.090.06 query31 2.820.590.39 query32 3.230.550.47 query33 3.113.113.11 query34 15.74 5.084.51 query35 4.494.534.46 query36 0.670.490.47 query37 0.080.060.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.160.140.14 query41 0.080.030.03 query42 0.040.030.02 query43 0.030.030.03 Total cold run time: 105.32 s Total hot run time: 31.66 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix hint existing using problems [doris]
doris-robot commented on PR #49987: URL: https://github.com/apache/doris/pull/49987#issuecomment-2796109825 TPC-H: Total hot run time: 34963 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ae8c7515292bb6c1445e6739659e31a14079, data reload: false -- Round 1 -- q1 26033 504749884988 q2 2060293 186 186 q3 10374 1237689 689 q4 10237 1037545 545 q5 7528233123752331 q6 189 167 135 135 q7 942 749 618 618 q8 9331130911701170 q9 6841511150855085 q10 6809232318861886 q11 481 281 280 280 q12 345 353 221 221 q13 17752 367931343134 q14 246 233 204 204 q15 536 490 487 487 q16 637 610 589 589 q17 580 858 375 375 q18 7573724970367036 q19 1216949 584 584 q20 344 325 234 234 q21 4407339032193219 q22 1048990 967 967 Total cold run time: 115509 ms Total hot run time: 34963 ms - Round 2, with runtime_filter_mode=off - q1 5169504050265026 q2 238 332 248 248 q3 2104263023072307 q4 1395181815121512 q5 4542441143454345 q6 212 166 124 124 q7 1944190817611761 q8 2590263025452545 q9 7111724670447044 q10 3006319227202720 q11 567 497 485 485 q12 657 772 617 617 q13 3551395132533253 q14 273 300 263 263 q15 508 479 479 479 q16 647 696 666 666 q17 1119153513481348 q18 7665748975937489 q19 800 789 948 789 q20 1960193117951795 q21 5124470647204706 q22 10351020988 988 Total cold run time: 52217 ms Total hot run time: 50510 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]
doris-robot commented on PR #49984: URL: https://github.com/apache/doris/pull/49984#issuecomment-2796112496 TPC-H: Total hot run time: 34057 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, data reload: false -- Round 1 -- q1 26130 499250124992 q2 2069276 180 180 q3 10406 1256715 715 q4 10227 1007525 525 q5 7526232523322325 q6 188 162 132 132 q7 898 730 607 607 q8 9304127310861086 q9 6908509950675067 q10 6804231618891889 q11 473 283 278 278 q12 346 356 224 224 q13 17760 370330653065 q14 237 225 215 215 q15 534 483 498 483 q16 640 626 574 574 q17 599 838 369 369 q18 7412723470777077 q19 1356959 576 576 q20 327 335 231 231 q21 3965338924672467 q22 1050980 981 980 Total cold run time: 115159 ms Total hot run time: 34057 ms - Round 2, with runtime_filter_mode=off - q1 5140509550375037 q2 240 344 233 233 q3 2166264522722272 q4 1488186714281428 q5 4400440243644364 q6 220 170 132 132 q7 2001189217711771 q8 2582254225002500 q9 7243728071277127 q10 2974320927172717 q11 570 509 491 491 q12 677 731 611 611 q13 3483391333853385 q14 304 285 271 271 q15 514 477 474 474 q16 635 689 642 642 q17 1145151914191419 q18 7732761675927592 q19 803 809 832 809 q20 1943195718041804 q21 5320490848814881 q22 10901032977 977 Total cold run time: 52670 ms Total hot run time: 50937 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
KeeProMise commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2796117640 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix hint existing using problems [doris]
doris-robot commented on PR #49987: URL: https://github.com/apache/doris/pull/49987#issuecomment-2796133742 TPC-DS: Total hot run time: 186245 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ae8c7515292bb6c1445e6739659e31a14079, data reload: false query1 1033503 469 469 query2 6570191019681910 query3 6751222 216 216 query4 26132 23640 23542 23542 query5 4771619 473 473 query6 316 217 198 198 query7 4639490 274 274 query8 289 238 229 229 query9 8649258025822580 query10 503 332 282 282 query11 15352 14999 14889 14889 query12 156 111 106 106 query13 1645496 399 399 query14 9329610561096105 query15 216 186 174 174 query16 7273662 468 468 query17 1124707 559 559 query18 1974388 307 307 query19 185 186 156 156 query20 124 121 119 119 query21 218 119 100 100 query22 3957409339973997 query23 33832 32989 32977 32977 query24 8421237523842375 query25 529 450 383 383 query26 1230265 147 147 query27 2759503 326 326 query28 4336239623982396 query29 761 538 423 423 query30 278 215 190 190 query31 942 846 762 762 query32 72 65 66 65 query33 564 372 311 311 query34 786 871 505 505 query35 778 822 726 726 query36 943 987 910 910 query37 122 101 80 80 query38 4200419240804080 query39 1473139513811381 query40 218 120 107 107 query41 57 54 51 51 query42 120 101 107 101 query43 504 516 487 487 query44 1310811 808 808 query45 221 177 162 162 query46 829 1019627 627 query47 1731178417181718 query48 375 409 294 294 query49 775 482 415 415 query50 621 671 406 406 query51 4138408441614084 query52 110 107 100 100 query53 221 263 182 182 query54 578 566 515 515 query55 86 86 88 86 query56 299 284 286 284 query57 1105112510671067 query58 275 264 259 259 query59 2666266925612561 query60 327 312 310 310 query61 129 130 128 128 query62 784 718 657 657 query63 219 184 186 184 query64 43731063673 673 query65 4367420742534207 query66 1137417 306 306 query67 15746 15368 15219 15219 query68 4313897 527 527 query69 465 304 263 263 query70 1169111010641064 query71 406 316 306 306 query72 5739471246794679 query73 616 585 342 342 query74 8952913387658765 query75 3193322826872687 query76 32201193772 772 query77 502 382 299 299 query78 991610063 92649264 query79 1826816 582 582 query80 673 555 453 453 query81 499 266 232 232 query82 196 129 99 99 query83 266 260 239 239 query84 265 109 90 90 query85 827 414 483 414 query86 377 311 310 310 query87 4395449843694369 query88 2824226322592259 query89 384 310 285 285 query90 1812212 214 212 query91 144 141 115 115 query92 66 63 56 56 query93 1239936 580 580 query94 633 424 279 279 query95 371 295 283 283 query96 482 579 272 272 query97 3131320831063106 query98 228 218 204 204 query99 1325143212511251 Total cold run time: 267007 ms Total hot run time: 186245 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]
doris-robot commented on PR #49984: URL: https://github.com/apache/doris/pull/49984#issuecomment-2796138575 TPC-DS: Total hot run time: 193670 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, data reload: false query1 1400104410291029 query2 6110189919101899 query3 10984 452844584458 query4 53739 25327 23597 23597 query5 5090517 465 465 query6 371 207 200 200 query7 4990508 277 277 query8 296 249 231 231 query9 5885258825872587 query10 429 312 260 260 query11 15088 15109 15131 15109 query12 166 115 105 105 query13 1121494 413 413 query14 10097 620062046200 query15 189 202 185 185 query16 7093635 504 504 query17 1122801 598 598 query18 1572410 316 316 query19 199 190 164 164 query20 134 125 123 123 query21 213 126 105 105 query22 4336455442984298 query23 34188 33563 33487 33487 query24 6919241124162411 query25 466 476 457 457 query26 668 285 162 162 query27 2216508 345 345 query28 3125244524452445 query29 613 603 443 443 query30 272 224 192 192 query31 889 857 807 807 query32 71 63 73 63 query33 474 366 309 309 query34 768 873 532 532 query35 811 874 780 780 query36 941 989 940 940 query37 121 143 87 87 query38 4155418441344134 query39 1485147614421442 query40 211 123 105 105 query41 57 54 51 51 query42 121 113 109 109 query43 512 504 473 473 query44 1347828 814 814 query45 186 175 171 171 query46 833 1024640 640 query47 1885190618281828 query48 397 442 320 320 query49 690 544 456 456 query50 668 695 408 408 query51 4228424542174217 query52 110 115 103 103 query53 231 266 200 200 query54 580 597 518 518 query55 87 86 87 86 query56 316 311 300 300 query57 1218123111351135 query58 277 260 274 260 query59 2791285828382838 query60 334 351 336 336 query61 155 158 155 155 query62 722 746 673 673 query63 232 191 198 191 query64 15691073701 701 query65 4301423342564233 query66 729 405 316 316 query67 15894 15736 15363 15363 query68 6382871 512 512 query69 555 290 268 268 query70 1232111510691069 query71 445 314 280 280 query72 5686486447334733 query73 1231621 341 341 query74 9205906086248624 query75 3387322027302730 query76 38671188741 741 query77 543 406 282 282 query78 10013 997792759275 query79 2169812 567 567 query80 604 516 456 456 query81 488 255 220 220 query82 468 132 109 109 query83 252 252 241 241 query84 293 111 89 89 query85 780 360 324 324 query86 385 301 291 291 query87 4482454443874387 query88 3481225122442244 query89 407 312 289 289 query90 1786210 212 210 query91 147 149 112 112 query92 74 60 54 54 query93 1843959 575 575 query94 703 396 304 304 query95 362 288 287 287 query96 488 570 280 280 query97 3164322431323132 query98 231 227 201 201 query99 1340139812841284 Total cold run time: 295980 ms Total hot run time: 193670 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [ut](column_variant)update ut cases and some fix [doris]
amorynan commented on PR #49776: URL: https://github.com/apache/doris/pull/49776#issuecomment-2796146004 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix hint existing using problems [doris]
doris-robot commented on PR #49987: URL: https://github.com/apache/doris/pull/49987#issuecomment-2796145411 ClickBench: Total hot run time: 30.83 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ae8c7515292bb6c1445e6739659e31a14079, data reload: false query1 0.030.040.03 query2 0.120.100.11 query3 0.250.190.19 query4 1.600.180.19 query5 0.600.580.58 query6 1.180.720.73 query7 0.020.020.02 query8 0.040.030.03 query9 0.580.530.53 query10 0.570.610.57 query11 0.160.110.11 query12 0.140.110.11 query13 0.610.600.59 query14 2.802.842.69 query15 0.920.850.85 query16 0.370.380.40 query17 1.001.011.00 query18 0.200.190.20 query19 1.951.971.83 query20 0.020.010.01 query21 15.35 0.940.55 query22 0.751.190.63 query23 15.05 1.360.64 query24 6.971.640.60 query25 0.500.150.08 query26 0.660.160.14 query27 0.050.050.05 query28 8.980.880.44 query29 12.57 3.913.27 query30 0.240.080.07 query31 2.820.580.38 query32 3.220.540.47 query33 3.083.023.08 query34 15.58 5.024.50 query35 4.524.524.48 query36 0.670.490.48 query37 0.080.060.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.140.13 query41 0.080.020.02 query42 0.040.020.02 query43 0.030.030.03 Total cold run time: 104.65 s Total hot run time: 30.83 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](group commit) reduce cpu cost for group_commit get_block [doris]
mymeiyi commented on PR #49822: URL: https://github.com/apache/doris/pull/49822#issuecomment-2796146897 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]
doris-robot commented on PR #49984: URL: https://github.com/apache/doris/pull/49984#issuecomment-2796149425 ClickBench: Total hot run time: 31.2 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ac6a3c49d606fdaae2cfdd85a8dc0a3ee8697df5, data reload: false query1 0.040.040.03 query2 0.130.110.11 query3 0.260.200.19 query4 1.600.170.19 query5 0.590.580.58 query6 1.210.720.72 query7 0.030.020.01 query8 0.040.040.03 query9 0.590.520.54 query10 0.570.590.58 query11 0.150.100.11 query12 0.150.110.12 query13 0.610.600.60 query14 2.782.712.83 query15 0.940.860.85 query16 0.380.370.38 query17 1.061.001.04 query18 0.210.200.20 query19 1.892.001.80 query20 0.020.010.01 query21 15.36 0.960.57 query22 0.751.260.71 query23 14.76 1.410.64 query24 7.041.320.83 query25 0.520.340.07 query26 0.550.160.15 query27 0.050.060.06 query28 9.360.890.44 query29 12.53 3.933.29 query30 0.250.080.06 query31 2.820.600.39 query32 3.230.560.50 query33 3.083.053.05 query34 15.98 5.074.46 query35 4.514.514.48 query36 0.660.480.48 query37 0.090.060.06 query38 0.050.030.04 query39 0.030.030.03 query40 0.170.140.13 query41 0.080.030.03 query42 0.040.030.02 query43 0.030.030.03 Total cold run time: 105.19 s Total hot run time: 31.2 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
doris-robot commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796149544 TPC-H: Total hot run time: 34240 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, data reload: false -- Round 1 -- q1 25757 512350505050 q2 2070278 185 185 q3 10391 1258689 689 q4 10239 1008533 533 q5 7517239822832283 q6 186 161 129 129 q7 917 732 600 600 q8 9305124110931093 q9 6709510151415101 q10 6867230418981898 q11 509 300 265 265 q12 346 349 221 221 q13 17760 377730373037 q14 222 221 206 206 q15 534 484 486 484 q16 627 601 586 586 q17 589 839 383 383 q18 7551714071377137 q19 1981970 606 606 q20 351 338 227 227 q21 3965273025292529 q22 10661057998 998 Total cold run time: 115459 ms Total hot run time: 34240 ms - Round 2, with runtime_filter_mode=off - q1 5267513551625135 q2 248 335 248 248 q3 2161270522742274 q4 1412184514041404 q5 4451442443754375 q6 218 173 132 132 q7 1973195017651765 q8 2553252824732473 q9 7245720670757075 q10 2983319027412741 q11 572 523 521 521 q12 683 762 621 621 q13 3572396633223322 q14 309 307 281 281 q15 519 483 465 465 q16 665 690 641 641 q17 1180158013701370 q18 7607748674347434 q19 842 850 935 850 q20 2023194918691869 q21 5194488748524852 q22 11061066989 989 Total cold run time: 52783 ms Total hot run time: 50837 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
doris-robot commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796149451 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.10% (18170/27489) Region Coverage: 65.53% (8950/13657) Branch Coverage: 55.40% (4824/8708) Coverage Report: http://coverage.selectdb-in.cc/coverage/9f9079846d169698cdfd684ab14638827fae02b8_9f9079846d169698cdfd684ab14638827fae02b8_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] Issue on docs [doris-website]
footmanai opened a new issue, #2285: URL: https://github.com/apache/doris-website/issues/2285 Path:/zh-CN/docs/3.0/sql-manual/sql-statements/table-and-view/table/SHOW-TABLE-STATUS 环境情况: doris 3.0、mysql 8.0、 创建与 mysql 关联的 category,category 名称为 dit; mysql 下有一个 schema 名为 base,还有一张表 t_yardage 查询驱动使用 jdbc:arrow-flight-sql 版本 0.12.0 2)在mysql下执行的SQL `SELECT table_name, table_comment FROM information_schema.TABLES WHERE table_schema = 'base' and table_name='t_yardage'` 结果: table_name,table_comment t_yardage,全码谱明细值 3)在 doris 下采用下面3种方式查询结果 1. 方式1: `use dit.base; show table status like 't_yardage';` 结果: comment 列为空白 2. 方式2: `show table status from dit.base.t_yardage;` 结果: 执行错误 3. 方式3: `SELECT table_name, table_comment FROM dit.information_schema.TABLES WHERE table_schema = 'base' where table_name = 't_yardage'` 结果: comment 列为空白 通过 category 获取表 comment 都是空白。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix unix_timestamp [doris]
github-actions[bot] commented on PR #49686: URL: https://github.com/apache/doris/pull/49686#issuecomment-2796153405 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
doris-robot commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2796159076 TPC-H: Total hot run time: 34851 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, data reload: false -- Round 1 -- q1 26404 506350085008 q2 2079289 181 181 q3 10415 1226678 678 q4 10217 1005512 512 q5 7531235223292329 q6 190 166 131 131 q7 911 743 593 593 q8 9319129511171117 q9 6935519750945094 q10 6798230319001900 q11 475 306 289 289 q12 352 348 216 216 q13 17799 364530703070 q14 225 233 210 210 q15 540 491 479 479 q16 609 622 578 578 q17 592 831 390 390 q18 7712729671857185 q19 1223953 553 553 q20 342 349 229 229 q21 4196335331533153 q22 10531006956 956 Total cold run time: 115917 ms Total hot run time: 34851 ms - Round 2, with runtime_filter_mode=off - q1 5128503650675036 q2 227 328 227 227 q3 2126263123012301 q4 1446183615201520 q5 4478441843204320 q6 203 161 122 122 q7 1930193717121712 q8 2572246125182461 q9 7255716171597159 q10 2957317926982698 q11 564 511 476 476 q12 720 760 646 646 q13 3540389132333233 q14 275 311 268 268 q15 528 479 474 474 q16 661 688 637 637 q17 1117149014041404 q18 7832753174247424 q19 803 809 798 798 q20 1996199018651865 q21 5159471546094609 q22 10741032975 975 Total cold run time: 52591 ms Total hot run time: 50365 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" [doris]
yiguolei merged PR #49986: URL: https://github.com/apache/doris/pull/49986 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a commit to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/branch-2.1 by this push: new b9d447741e8 Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986) b9d447741e8 is described below commit b9d447741e8fe3b050673491f77042bfb1611d46 Author: Mingyu Chen (Rayner) AuthorDate: Fri Apr 11 01:08:02 2025 -0700 Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986) Reverts apache/doris#49831 --- .../vec/data_types/serde/data_type_array_serde.cpp | 5 +- .../vec/data_types/serde/data_type_map_serde.cpp | 7 +- .../data_types/serde/data_type_number_serde.cpp| 9 +- be/src/vec/data_types/serde/data_type_serde.h | 20 .../data_types/serde/data_type_struct_serde.cpp| 5 +- be/src/vec/sink/vmysql_result_writer.cpp | 16 --- .../org/apache/doris/nereids/NereidsPlanner.java | 1 - .../java/org/apache/doris/qe/SessionVariable.java | 10 +- gensrc/thrift/PaloInternalService.thrift | 3 +- .../datatype_p0/serde/test_serde_dialect_hive.out | Bin 2029 -> 0 bytes .../serde/test_serde_dialect_hive.groovy | 107 - 11 files changed, 8 insertions(+), 175 deletions(-) diff --git a/be/src/vec/data_types/serde/data_type_array_serde.cpp b/be/src/vec/data_types/serde/data_type_array_serde.cpp index e5fc7461e45..872dd84d8c7 100644 --- a/be/src/vec/data_types/serde/data_type_array_serde.cpp +++ b/be/src/vec/data_types/serde/data_type_array_serde.cpp @@ -336,8 +336,7 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const IColumn& column, const auto end_arr_element = offsets[row_idx_of_col_arr]; for (int j = begin_arr_element; j < end_arr_element; ++j) { if (j != begin_arr_element) { -if (0 != result.push_string(options.mysql_collection_delim.c_str(), - options.mysql_collection_delim.size())) { +if (0 != result.push_string(", ", 2)) { return Status::InternalError("pack mysql buffer failed."); } } @@ -346,7 +345,6 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const IColumn& column, return Status::InternalError("pack mysql buffer failed."); } } else { -++options.level; if (is_nested_string && options.wrapper_len > 0) { if (0 != result.push_string(options.nested_string_wrapper, options.wrapper_len)) { return Status::InternalError("pack mysql buffer failed."); @@ -360,7 +358,6 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const IColumn& column, RETURN_IF_ERROR( nested_serde->write_column_to_mysql(data, result, j, false, options)); } ---options.level; } } if (0 != result.push_string("]", 1)) { diff --git a/be/src/vec/data_types/serde/data_type_map_serde.cpp b/be/src/vec/data_types/serde/data_type_map_serde.cpp index bf018ce3a80..2140885942d 100644 --- a/be/src/vec/data_types/serde/data_type_map_serde.cpp +++ b/be/src/vec/data_types/serde/data_type_map_serde.cpp @@ -418,8 +418,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const IColumn& column, auto& offsets = map_column.get_offsets(); for (auto j = offsets[col_index - 1]; j < offsets[col_index]; ++j) { if (j != offsets[col_index - 1]) { -if (0 != result.push_string(options.mysql_collection_delim.c_str(), - options.mysql_collection_delim.size())) { +if (0 != result.push_string(", ", 2)) { return Status::InternalError("pack mysql buffer failed."); } } @@ -428,7 +427,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const IColumn& column, return Status::InternalError("pack mysql buffer failed."); } } else { -++options.level; if (is_key_string && options.wrapper_len > 0) { if (0 != result.push_string(options.nested_string_wrapper, options.wrapper_len)) { return Status::InternalError("pack mysql buffer failed."); @@ -442,7 +440,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const IColumn& column, RETURN_IF_ERROR(key_serde->write_column_to_mysql(nested_keys_column, result, j, false, options)); } ---options.level; } if (0 != result.push_string(&options.map_key_delim, 1)) { return Status::InternalError("pack mysql buffer failed."); @@ -452,7 +449,6 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const IColumn& column, return Status::I
Re: [PR] [test](ut) add cases about hash join [doris]
hello-stephen commented on PR #49803: URL: https://github.com/apache/doris/pull/49803#issuecomment-2796167609 # BE UT Coverage Report Increment line coverage `87.50% (7/8)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/07a95114e49761de827284fdfb42fb13fbaacd76_07a95114e49761de827284fdfb42fb13fbaacd76/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/07a95114e49761de827284fdfb42fb13fbaacd76_07a95114e49761de827284fdfb42fb13fbaacd76/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.38% (14083/26887) | | Line Coverage | 41.31% (122084/295537) | | Region Coverage | 40.02% (62105/155184) | | Branch Coverage | 34.70% (31120/89694) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve] add retry strategy [doris-kafka-connector]
JNSimba merged PR #67: URL: https://github.com/apache/doris-kafka-connector/pull/67 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-kafka-connector) branch master updated: [Improve] add retry strategy (#67)
This is an automated email from the ASF dual-hosted git repository. diwu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-kafka-connector.git The following commit(s) were added to refs/heads/master by this push: new 8d81331 [Improve] add retry strategy (#67) 8d81331 is described below commit 8d81331fc5bfe752c41f9ff0dbb64bc36c5a91f5 Author: wudi <676366...@qq.com> AuthorDate: Fri Apr 11 16:11:58 2025 +0800 [Improve] add retry strategy (#67) --- .../doris/kafka/connector/DorisSinkTask.java | 22 ++- .../doris/kafka/connector/cfg/DorisOptions.java| 21 +++ .../connector/cfg/DorisSinkConnectorConfig.java| 23 +++- .../doris/kafka/connector/model/RespContent.java | 4 + .../kafka/connector/utils/ConfigCheckUtils.java| 16 +++ .../doris/kafka/connector/writer/DorisWriter.java | 3 +- .../connector/writer/load/DorisStreamLoad.java | 3 + .../cfg/TestDorisSinkConnectorConfig.java | 14 ++ .../e2e/doris/DorisContainerServiceImpl.java | 14 +- .../e2e/sink/AbstractKafka2DorisSink.java | 55 .../stringconverter/DorisSinkFailoverSinkTest.java | 149 + src/test/resources/docker/doris/be.conf| 99 ++ src/test/resources/docker/doris/fe.conf| 74 ++ .../string_msg_failover_connector.json | 25 .../string_converter/string_msg_tab_failover.sql | 12 ++ 15 files changed, 528 insertions(+), 6 deletions(-) diff --git a/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java b/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java index f793d26..e83f033 100644 --- a/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java +++ b/src/main/java/org/apache/doris/kafka/connector/DorisSinkTask.java @@ -22,6 +22,7 @@ package org.apache.doris.kafka.connector; import java.util.Collection; import java.util.HashMap; import java.util.Map; +import org.apache.doris.kafka.connector.cfg.DorisOptions; import org.apache.doris.kafka.connector.service.DorisSinkService; import org.apache.doris.kafka.connector.service.DorisSinkServiceFactory; import org.apache.doris.kafka.connector.utils.Version; @@ -37,6 +38,8 @@ import org.slf4j.LoggerFactory; public class DorisSinkTask extends SinkTask { private static final Logger LOG = LoggerFactory.getLogger(DorisSinkTask.class); private DorisSinkService sink = null; +private DorisOptions options; +private int remainingRetries; /** default constructor, invoked by kafka connect framework */ public DorisSinkTask() {} @@ -49,7 +52,9 @@ public class DorisSinkTask extends SinkTask { */ @Override public void start(final Map parsedConfig) { -LOG.info("kafka doris sink task start"); +LOG.info("kafka doris sink task start with {}", parsedConfig); +this.options = new DorisOptions(parsedConfig); +this.remainingRetries = options.getMaxRetries(); this.sink = DorisSinkServiceFactory.getDorisSinkService(parsedConfig); } @@ -94,7 +99,20 @@ public class DorisSinkTask extends SinkTask { @Override public void put(final Collection records) { LOG.info("Read {} records from Kafka", records.size()); -sink.insert(records); +try { +sink.insert(records); +} catch (Exception ex) { +LOG.error("Error inserting records to Doris", ex); +if (remainingRetries > 0) { +LOG.info( +"Retrying to insert records to Doris, remaining retries: {}", +remainingRetries); +remainingRetries--; +context.timeout(options.getRetryIntervalMs()); +throw new RetriableException(ex); +} +throw ex; +} } /** diff --git a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java index 9afd9cb..c1a2cbd 100644 --- a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java +++ b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java @@ -66,6 +66,8 @@ public class DorisOptions { private final DeliveryGuarantee deliveryGuarantee; private final ConverterMode converterMode; private final SchemaEvolutionMode schemaEvolutionMode; +private final int maxRetries; +private final int retryIntervalMs; public DorisOptions(Map config) { this.name = config.get(DorisSinkConnectorConfig.NAME); @@ -127,6 +129,17 @@ public class DorisOptions { } this.streamLoadProp = getStreamLoadPropFromConfig(config); this.enableGroupCommit = ConfigCheckUtils.validateGroupCommitMode(this); +this.maxRetries = +Integer.parseInt( +config.getOrDefault( +DorisSinkConnectorConfig.MAX_RE
Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
Thearas commented on PR #49988: URL: https://github.com/apache/doris/pull/49988#issuecomment-2796171517 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
doris-robot commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796176437 TPC-DS: Total hot run time: 193350 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, data reload: false query1 1409104910701049 query2 6400190919241909 query3 10988 441145924411 query4 51039 24990 23210 23210 query5 5326586 483 483 query6 390 224 184 184 query7 5054506 282 282 query8 315 244 227 227 query9 6400258025902580 query10 423 310 251 251 query11 15196 15032 14920 14920 query12 171 115 106 106 query13 1141516 397 397 query14 10108 630163856301 query15 212 182 178 178 query16 7135648 506 506 query17 1083761 594 594 query18 1539429 331 331 query19 200 203 178 178 query20 132 129 125 125 query21 211 127 103 103 query22 4405444242754275 query23 34127 33463 33421 33421 query24 7038247024402440 query25 502 510 497 497 query26 703 286 155 155 query27 2286516 333 333 query28 3065242724242424 query29 594 554 447 447 query30 279 232 200 200 query31 845 887 807 807 query32 72 69 61 61 query33 472 376 319 319 query34 815 860 533 533 query35 799 856 784 784 query36 939 1036925 925 query37 127 105 82 82 query38 4174433742924292 query39 1498144114491441 query40 220 124 104 104 query41 52 58 49 49 query42 129 111 117 111 query43 503 513 492 492 query44 1387827 821 821 query45 185 179 168 168 query46 885 1076647 647 query47 1830185317831783 query48 391 427 318 318 query49 686 523 462 462 query50 670 681 405 405 query51 4274432742414241 query52 118 109 110 109 query53 245 261 184 184 query54 598 578 516 516 query55 88 84 80 80 query56 314 305 298 298 query57 1168118311381138 query58 268 283 282 282 query59 2658277926732673 query60 337 314 318 314 query61 134 134 145 134 query62 722 791 668 668 query63 225 192 189 189 query64 17791099757 757 query65 4341426642544254 query66 737 391 309 309 query67 15775 15476 15246 15246 query68 7040882 523 523 query69 536 296 264 264 query70 1226112311141114 query71 496 331 298 298 query72 5576480149444801 query73 1300694 349 349 query74 8938890888478847 query75 3936317626572657 query76 43371199738 738 query77 697 368 344 344 query78 10072 10145 92439243 query79 2309817 562 562 query80 614 513 440 440 query81 481 264 232 232 query82 454 136 96 96 query83 345 252 226 226 query84 288 114 86 86 query85 781 353 384 353 query86 379 282 297 282 query87 4553451744364436 query88 3415227822262226 query89 401 308 286 286 query90 1948208 212 208 query91 142 142 117 117 query92 76 61 57 57 query93 1634922 576 576 query94 676 425 309 309 query95 365 300 288 288 query96 483 559 274 274 query97 3220328331173117 query98 224 199 207 199 query99 1424139112891289 Total cold run time: 296697 ms Total hot run time: 193350 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]
github-actions[bot] commented on PR #49925: URL: https://github.com/apache/doris/pull/49925#issuecomment-2796179805 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]
github-actions[bot] commented on PR #49925: URL: https://github.com/apache/doris/pull/49925#issuecomment-2796179882 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
github-actions[bot] commented on PR #49837: URL: https://github.com/apache/doris/pull/49837#issuecomment-2796182079 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](schema) add column comment length limit [doris]
Thearas commented on PR #49989: URL: https://github.com/apache/doris/pull/49989#issuecomment-2796182260 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auditlog)Set sqlHash in executeInternalQuery [doris]
Jibing-Li commented on PR #49984: URL: https://github.com/apache/doris/pull/49984#issuecomment-2796180941 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
github-actions[bot] commented on PR #49837: URL: https://github.com/apache/doris/pull/49837#issuecomment-2796182003 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improve](schema) add column comment length limit [doris]
cambyzju opened a new pull request, #49989: URL: https://github.com/apache/doris/pull/49989 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note 1. add a config `column_comment_length_limit` to limit the max column comment length; 2. Mysql already enlarge this limit from 255 to 1024, after MySQL 5.5.3; ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
doris-robot commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2796183905 TPC-DS: Total hot run time: 186339 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, data reload: false query1 1019466 473 466 query2 6542194919361936 query3 6750215 219 215 query4 26224 23595 23618 23595 query5 4804611 482 482 query6 311 221 221 221 query7 4629489 278 278 query8 310 247 240 240 query9 8685259025862586 query10 499 318 262 262 query11 15824 15694 14837 14837 query12 174 111 109 109 query13 1647522 393 393 query14 11172 612761836127 query15 236 194 161 161 query16 7765649 450 450 query17 1546730 559 559 query18 2013423 300 300 query19 259 178 179 178 query20 124 115 112 112 query21 215 120 103 103 query22 4140412239193919 query23 33934 33099 33011 33011 query24 8032234323332333 query25 497 468 388 388 query26 1215271 147 147 query27 2705499 326 326 query28 4420244123842384 query29 712 556 425 425 query30 288 223 195 195 query31 970 847 790 790 query32 75 68 61 61 query33 601 370 309 309 query34 787 863 497 497 query35 787 796 732 732 query36 959 1026885 885 query37 119 103 77 77 query38 4195419940774077 query39 1624139514061395 query40 210 121 107 107 query41 89 57 52 52 query42 118 102 99 99 query43 494 506 497 497 query44 1334795 797 795 query45 175 173 169 169 query46 837 1019614 614 query47 1753177117191719 query48 366 415 299 299 query49 758 518 459 459 query50 627 672 405 405 query51 4161415840974097 query52 109 101 99 99 query53 222 254 180 180 query54 572 570 536 536 query55 84 83 83 83 query56 293 322 292 292 query57 1127114310791079 query58 273 257 257 257 query59 2620272025612561 query60 338 341 328 328 query61 151 152 154 152 query62 783 736 666 666 query63 223 186 185 185 query64 43921134688 688 query65 4383424942444244 query66 1059413 311 311 query67 15834 15725 15275 15275 query68 7882864 507 507 query69 450 303 267 267 query70 11441144 query71 463 307 294 294 query72 5481479046934693 query73 635 577 344 344 query74 9134909387218721 query75 3842319626762676 query76 35431187752 752 query77 796 369 301 301 query78 10043 10221 93429342 query79 2285809 566 566 query80 575 513 440 440 query81 493 253 224 224 query82 477 128 98 98 query83 256 250 235 235 query84 250 105 82 82 query85 790 351 327 327 query86 388 308 268 268 query87 4478451143584358 query88 3859224422562244 query89 397 309 280 280 query90 1936220 212 212 query91 145 148 116 116 query92 80 65 61 61 query93 1970941 564 564 query94 673 425 289 289 query95 372 293 292 292 query96 484 566 274 274 query97 3142320631303130 query98 230 216 204 204 query99 1408139712581258 Total cold run time: 278294 ms Total hot run time: 186339 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t
[PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
LiBinfeng-01 opened a new pull request, #49988: URL: https://github.com/apache/doris/pull/49988 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note change result of sql: select initcap('ärger'); from: äRger to: Ärger ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
LiBinfeng-01 commented on PR #49988: URL: https://github.com/apache/doris/pull/49988#issuecomment-2796186311 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
doris-robot commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796187637 ClickBench: Total hot run time: 31.75 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 195fc3404415054b02ad369b507ea13d57f8d611, data reload: false query1 0.040.040.03 query2 0.130.100.10 query3 0.240.190.19 query4 1.600.180.19 query5 0.600.580.58 query6 1.180.720.73 query7 0.020.020.02 query8 0.050.040.04 query9 0.580.500.52 query10 0.610.590.57 query11 0.160.100.11 query12 0.150.110.12 query13 0.610.590.60 query14 2.822.722.70 query15 0.940.850.84 query16 0.380.380.36 query17 1.011.001.04 query18 0.220.190.19 query19 1.831.911.87 query20 0.010.010.02 query21 15.38 0.940.56 query22 0.761.150.62 query23 15.04 1.400.67 query24 6.911.631.51 query25 0.470.210.12 query26 0.570.170.14 query27 0.050.050.05 query28 10.38 0.800.42 query29 12.60 3.923.25 query30 0.250.090.06 query31 2.820.570.40 query32 3.220.530.46 query33 3.013.083.01 query34 15.71 5.124.49 query35 4.524.494.54 query36 0.680.500.48 query37 0.100.060.07 query38 0.040.040.04 query39 0.040.020.02 query40 0.160.130.13 query41 0.080.030.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 106.05 s Total hot run time: 31.75 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](schema) add column comment length limit [doris]
morrySnow commented on code in PR #49989: URL: https://github.com/apache/doris/pull/49989#discussion_r2039049832 ## fe/fe-common/src/main/java/org/apache/doris/common/Config.java: ## @@ -1765,6 +1765,12 @@ public class Config extends ConfigBase { @ConfField(mutable = true, masterOnly = true) public static int table_name_length_limit = 64; +@ConfField(mutable = true, description = { +"用于限制列注释长度;如果存量的列注释超长,则显示时进行截断", +"Used to limit the length of column comment; " ++ "If the existing column comment is too long, it will be truncated when displayed."}) +public static int column_comment_length_limit = 1024; Review Comment: maybe default value should be `-1` to avoid some ddl that could run on privous version, failed after upgrade -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
doris-robot commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2796197442 ClickBench: Total hot run time: 31.01 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0637559533e7f7da9108cf67784c8659ccfc47bc, data reload: false query1 0.040.030.03 query2 0.110.110.10 query3 0.240.190.19 query4 1.600.180.20 query5 0.610.600.59 query6 1.190.720.73 query7 0.020.020.02 query8 0.040.040.03 query9 0.580.530.52 query10 0.570.580.57 query11 0.150.110.11 query12 0.150.120.11 query13 0.620.600.60 query14 2.792.702.71 query15 0.900.860.85 query16 0.390.390.39 query17 1.011.011.02 query18 0.210.190.20 query19 1.881.901.92 query20 0.020.010.00 query21 15.35 0.870.57 query22 0.771.210.68 query23 14.92 1.420.68 query24 6.872.140.56 query25 0.490.110.14 query26 0.600.160.13 query27 0.050.040.05 query28 10.16 0.880.43 query29 12.56 3.973.27 query30 0.250.090.07 query31 2.820.620.38 query32 3.220.540.47 query33 3.053.033.08 query34 15.67 5.124.51 query35 4.504.534.48 query36 0.680.500.48 query37 0.080.060.06 query38 0.060.040.04 query39 0.030.020.02 query40 0.180.130.13 query41 0.080.020.02 query42 0.040.020.02 query43 0.030.020.02 Total cold run time: 105.58 s Total hot run time: 31.01 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mv) Add sync mv test that had been commented [doris]
seawinde commented on PR #49970: URL: https://github.com/apache/doris/pull/49970#issuecomment-2796209064 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (3c6ad1d0083 -> 918dbff46f4)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 3c6ad1d0083 Automated deployment with doris branch @ e311ae6cc1e209c9ac32b84b29e13eaeea920398 new 918dbff46f4 Automated deployment with doris branch @ e311ae6cc1e209c9ac32b84b29e13eaeea920398 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3c6ad1d0083) \ N -- N -- N refs/heads/asf-site (918dbff46f4) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
doris-robot commented on PR #49988: URL: https://github.com/apache/doris/pull/49988#issuecomment-2796242008 TPC-H: Total hot run time: 34215 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, data reload: false -- Round 1 -- q1 26067 509450085008 q2 2066285 191 191 q3 10394 1240703 703 q4 10238 1002537 537 q5 7768238923462346 q6 193 170 133 133 q7 918 735 621 621 q8 9318132111641164 q9 6861518450965096 q10 6817228519081908 q11 483 283 270 270 q12 350 357 223 223 q13 17780 367930543054 q14 222 219 205 205 q15 536 478 473 473 q16 612 631 579 579 q17 591 845 375 375 q18 7566721770987098 q19 1834942 562 562 q20 330 325 224 224 q21 4066337724842484 q22 10561002961 961 Total cold run time: 116066 ms Total hot run time: 34215 ms - Round 2, with runtime_filter_mode=off - q1 5193510050965096 q2 232 329 227 227 q3 2133266822792279 q4 1408180214971497 q5 4529446643704370 q6 207 162 122 122 q7 1939190817041704 q8 2583247324962473 q9 7241705372677053 q10 2987317826982698 q11 601 493 488 488 q12 670 764 606 606 q13 3502391232223222 q14 280 286 271 271 q15 513 476 469 469 q16 667 694 635 635 q17 1140151313771377 q18 7556744674247424 q19 821 837 971 837 q20 1941197418051805 q21 5133476546944694 q22 10021015989 989 Total cold run time: 52278 ms Total hot run time: 50336 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](binlog) add modify distribution bucket num binlog [doris]
koarz commented on PR #49894: URL: https://github.com/apache/doris/pull/49894#issuecomment-2796258600 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
doris-robot commented on PR #49988: URL: https://github.com/apache/doris/pull/49988#issuecomment-2796267686 TPC-DS: Total hot run time: 186559 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, data reload: false query1 1019459 476 459 query2 6560195618961896 query3 6744234 209 209 query4 26192 23417 23222 23222 query5 4409637 465 465 query6 312 208 216 208 query7 4620487 279 279 query8 291 250 239 239 query9 8654260825982598 query10 475 307 257 257 query11 16011 15018 14904 14904 query12 175 108 105 105 query13 1662493 374 374 query14 9531612961226122 query15 203 182 166 166 query16 7292599 480 480 query17 1189727 546 546 query18 1964389 290 290 query19 186 170 149 149 query20 119 116 113 113 query21 207 125 107 107 query22 3935415740204020 query23 33874 33155 32967 32967 query24 8489236523752365 query25 564 473 419 419 query26 1239272 153 153 query27 2750504 332 332 query28 4353244824342434 query29 785 529 424 424 query30 283 217 217 217 query31 953 839 778 778 query32 72 68 66 66 query33 557 371 300 300 query34 774 855 510 510 query35 776 816 740 740 query36 951 1001877 877 query37 118 101 77 77 query38 4166418141294129 query39 1496140114151401 query40 210 117 111 111 query41 59 54 52 52 query42 123 102 108 102 query43 496 497 477 477 query44 1283806 797 797 query45 180 172 164 164 query46 826 1013626 626 query47 1751179617381738 query48 370 401 291 291 query49 788 495 418 418 query50 624 678 396 396 query51 4086418140984098 query52 111 109 100 100 query53 224 250 183 183 query54 575 561 499 499 query55 84 83 82 82 query56 307 295 279 279 query57 1126114310821082 query58 270 257 266 257 query59 2584279527132713 query60 326 319 306 306 query61 132 129 128 128 query62 780 736 677 677 query63 233 183 184 183 query64 43111012686 686 query65 4297418743014187 query66 1139415 302 302 query67 15953 15323 15227 15227 query68 5286891 527 527 query69 482 305 276 276 query70 1143109110951091 query71 407 320 295 295 query72 5531480048624800 query73 667 638 341 341 query74 9188902189918991 query75 3198317326492649 query76 32251175748 748 query77 474 371 335 335 query78 9871999092779277 query79 1939797 566 566 query80 662 515 441 441 query81 499 273 220 220 query82 407 125 94 94 query83 261 245 239 239 query84 248 102 84 84 query85 755 346 305 305 query86 374 312 303 303 query87 4453457044594459 query88 2881224822482248 query89 373 307 343 307 query90 1784211 213 211 query91 139 142 109 109 query92 71 60 56 56 query93 1397931 583 583 query94 641 410 300 300 query95 364 296 281 281 query96 488 554 275 275 query97 3139321931013101 query98 226 209 201 201 query99 1321141112881288 Total cold run time: 269092 ms Total hot run time: 186559 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [minor](task) Complete debug string if task is finalized [doris]
hello-stephen commented on PR #49950: URL: https://github.com/apache/doris/pull/49950#issuecomment-2796274109 # BE UT Coverage Report Increment line coverage `100.00% (25/25)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/84bf3f2ea4375acd57776d7d0551152d011ea40c_84bf3f2ea4375acd57776d7d0551152d011ea40c/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/84bf3f2ea4375acd57776d7d0551152d011ea40c_84bf3f2ea4375acd57776d7d0551152d011ea40c/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.49% (14117/26895) | | Line Coverage | 41.28% (121983/295525) | | Region Coverage | 40.03% (62111/155180) | | Branch Coverage | 34.67% (31091/89678) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fix initcap of utf-8 charset [doris]
doris-robot commented on PR #49988: URL: https://github.com/apache/doris/pull/49988#issuecomment-2796279637 ClickBench: Total hot run time: 31.36 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit bc0ddaae0f19680315282a3d5c03aa70da9010a9, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.250.180.19 query4 1.580.190.18 query5 0.600.570.58 query6 1.190.710.72 query7 0.020.020.01 query8 0.040.040.03 query9 0.580.530.53 query10 0.580.590.58 query11 0.150.100.10 query12 0.140.110.12 query13 0.600.600.60 query14 2.662.832.82 query15 0.920.860.86 query16 0.390.400.37 query17 1.041.061.04 query18 0.210.200.19 query19 1.921.971.83 query20 0.010.010.00 query21 15.35 0.920.57 query22 0.751.200.70 query23 14.90 1.390.64 query24 7.021.021.37 query25 0.470.270.06 query26 0.600.160.14 query27 0.050.060.05 query28 8.890.830.46 query29 12.59 3.893.25 query30 0.250.090.07 query31 2.820.580.39 query32 3.220.530.46 query33 3.083.013.17 query34 15.70 5.084.47 query35 4.574.524.45 query36 0.660.480.48 query37 0.080.060.06 query38 0.050.040.03 query39 0.030.020.03 query40 0.180.140.12 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 104.45 s Total hot run time: 31.36 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
doris-robot commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796292204 TPC-H: Total hot run time: 34850 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false -- Round 1 -- q1 26428 506052055060 q2 2088283 190 190 q3 10474 1270691 691 q4 10234 1003546 546 q5 7604246223382338 q6 188 162 131 131 q7 933 726 608 608 q8 9330129110771077 q9 6875515251345134 q10 6796229418691869 q11 479 282 267 267 q12 353 355 217 217 q13 17793 366530833083 q14 224 224 207 207 q15 536 501 486 486 q16 615 626 578 578 q17 599 862 369 369 q18 7600723071167116 q19 1836979 569 569 q20 324 343 231 231 q21 4063336331353135 q22 10491025948 948 Total cold run time: 116421 ms Total hot run time: 34850 ms - Round 2, with runtime_filter_mode=off - q1 5187505351125053 q2 234 329 232 232 q3 2173268022662266 q4 1396190314961496 q5 4582445543844384 q6 213 174 126 126 q7 1934186617391739 q8 2606254425632544 q9 7187714471617144 q10 2945324527302730 q11 566 501 484 484 q12 694 761 604 604 q13 3519383532633263 q14 293 307 261 261 q15 537 482 471 471 q16 660 681 636 636 q17 1166152613861386 q18 7807758075097509 q19 792 847 829 829 q20 1967205418831883 q21 5250469446824682 q22 10721049995 995 Total cold run time: 52780 ms Total hot run time: 50717 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (1d2ae9fb884 -> 13602d38f46)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 1d2ae9fb884 [feat](bi) support default_init_catalog user property for external catalog (#49658) add 13602d38f46 [Chore](runtime-filter) remove RuntimeFIlterParamsContext (#49837) No new revisions were added by this update. Summary of changes: .../exec/multi_cast_data_stream_source.cpp | 11 +-- be/src/pipeline/exec/scan_operator.cpp | 7 +- be/src/pipeline/exec/scan_operator.h | 4 +- be/src/pipeline/pipeline_fragment_context.cpp | 8 +- be/src/pipeline/pipeline_fragment_context.h| 2 - be/src/pipeline/pipeline_task.cpp | 2 +- be/src/runtime/fragment_mgr.cpp| 42 + be/src/runtime/fragment_mgr.h | 5 +- be/src/runtime/query_context.cpp | 3 +- be/src/runtime/query_context.h | 2 +- be/src/runtime/runtime_state.cpp | 10 +- be/src/runtime_filter/runtime_filter.cpp | 19 ++-- be/src/runtime_filter/runtime_filter.h | 15 +-- be/src/runtime_filter/runtime_filter_consumer.cpp | 32 +++ be/src/runtime_filter/runtime_filter_consumer.h| 34 +++ .../runtime_filter_consumer_helper.cpp | 85 +++-- .../runtime_filter_consumer_helper.h | 34 +++ be/src/runtime_filter/runtime_filter_definitions.h | 27 -- be/src/runtime_filter/runtime_filter_merger.h | 28 ++ be/src/runtime_filter/runtime_filter_mgr.cpp | 102 +++-- be/src/runtime_filter/runtime_filter_mgr.h | 46 -- be/src/runtime_filter/runtime_filter_producer.cpp | 66 ++--- be/src/runtime_filter/runtime_filter_producer.h| 24 +++-- .../runtime_filter_producer_helper.cpp | 13 ++- .../runtime_filter_producer_helper.h | 2 +- be/src/runtime_filter/runtime_filter_wrapper.cpp | 24 ++--- be/src/runtime_filter/runtime_filter_wrapper.h | 26 +++--- be/src/vec/exec/scan/scanner.cpp | 3 +- .../operator/partitioned_hash_join_test_helper.h | 2 +- be/test/pipeline/pipeline_test.cpp | 5 +- .../runtime_filter_consumer_helper_test.cpp| 19 ++-- .../runtime_filter_consumer_test.cpp | 71 +- .../runtime_filter_definitions_test.cpp| 70 -- .../runtime_filter/runtime_filter_merger_test.cpp | 47 ++ be/test/runtime_filter/runtime_filter_mgr_test.cpp | 61 ++-- .../runtime_filter_producer_test.cpp | 83 ++--- be/test/runtime_filter/runtime_filter_test_utils.h | 6 +- .../runtime_filter/runtime_filter_wrapper_test.cpp | 31 ++- 38 files changed, 383 insertions(+), 688 deletions(-) delete mode 100644 be/test/runtime_filter/runtime_filter_definitions_test.cpp - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
BiteThet merged PR #49837: URL: https://github.com/apache/doris/pull/49837 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new bd24a332c55 [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925) bd24a332c55 is described below commit bd24a332c555adfe2adf037bc2b2a3880b130fe6 Author: zhiqiang AuthorDate: Fri Apr 11 17:06:04 2025 +0800 [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925) ### What problem does this PR solve? If resource is not busy, we can still see error log like ``` Profile 86e0aa6fa3e445ed-86cdc765118dbf3e should be stored to storage without waiting for incoming profile, since it has been waiting for 10140 ms, current time 1741661595669 query finished time: 1741661585529 ``` This pr fix the problem by: If profile collection is finished, we should write it to storage immediately. Add unit test for class Profile. Bug is introduced by https://github.com/apache/doris/pull/48653 Issue Number: close #xxx Related PR: https://github.com/apache/doris/pull/48653 Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [x] Confirm the release note - [x] Confirm test cases - [x] Confirm document - [x] Add branch pick label --- .../org/apache/doris/common/profile/Profile.java | 41 ++-- .../apache/doris/common/profile/ProfileTest.java | 263 + 2 files changed, 290 insertions(+), 14 deletions(-) diff --git a/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java b/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java index e15bafd6d0a..df1e92cb134 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java +++ b/fe/fe-core/src/main/java/org/apache/doris/common/profile/Profile.java @@ -450,22 +450,35 @@ public class Profile { return false; } -long currentTimeMillis = System.currentTimeMillis(); -if (this.queryFinishTimestamp != Long.MAX_VALUE -&& (currentTimeMillis - this.queryFinishTimestamp) -> Config.profile_waiting_time_for_spill_seconds * 1000) { -LOG.warn("Profile {} should be stored to storage without waiting for incoming profile," -+ " since it has been waiting for {} ms, current time {} query finished time: {}", -getId(), currentTimeMillis - this.queryFinishTimestamp, currentTimeMillis, -this.queryFinishTimestamp); - -this.summaryProfile.setSystemMessage( -"This profile is not complete, since its collection does not finish in time." -+ " Maybe increase profile_waiting_time_for_spill_secs in fe.conf current val: " -+ String.valueOf(Config.profile_waiting_time_for_spill_seconds)); -return true; +// below is the case where query has finished +boolean hasReportingProfile = false; + +for (ExecutionProfile executionProfile : executionProfiles) { +if (!executionProfile.isCompleted()) { +hasReportingProfile = true; +break; +} } +if (!hasReportingProfile) { +return true; +} else { +long currentTimeMillis = System.currentTimeMillis(); +if (this.queryFinishTimestamp != Long.MAX_VALUE +&& (currentTimeMillis - this.queryFinishTimestamp) +> Config.profile_waiting_time_for_spill_seconds * 1000) { +LOG.warn("Profile {} should be stored to storage without waiting for incoming profile," ++ " since it has been waiting for {} ms, current time {} query finished time: {}", +getId(), currentTimeMillis - this.queryFinishTimestamp, currentTimeMillis, +this.queryFinishTimestamp); + +this.summaryProfile.setSystemMessage( +"This profile is not complete, since its collection does not finish in time." ++ " Maybe increase prof
Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]
BiteThet merged PR #49925: URL: https://github.com/apache/doris/pull/49925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49925-branch-3.0 updated (c5e18ef5520 -> 7848acf131b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49925-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from c5e18ef5520 branch-3.0: [fix](multi-catalog) Fix multi-thread issue in hive/iceberg writer commit meta-info to fe. #49842 (#49863) add 7848acf131b [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage (#49925) No new revisions were added by this update. Summary of changes: .../org/apache/doris/common/profile/Profile.java | 41 ++-- .../apache/doris/common/profile/ProfileTest.java | 263 + 2 files changed, 290 insertions(+), 14 deletions(-) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/common/profile/ProfileTest.java - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
dataroaring closed pull request #49991: branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 URL: https://github.com/apache/doris/pull/49991 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
hello-stephen commented on PR #49991: URL: https://github.com/apache/doris/pull/49991#issuecomment-2796303465 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](binlog) add modify distribution bucket num binlog [doris]
doris-robot commented on PR #49894: URL: https://github.com/apache/doris/pull/49894#issuecomment-2796299741 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.07% (18162/27489) Region Coverage: 65.50% (8946/13657) Branch Coverage: 55.34% (4819/8708) Coverage Report: http://coverage.selectdb-in.cc/coverage/63c11714cd075d28b6cead457366b78f1591ee54_63c11714cd075d28b6cead457366b78f1591ee54_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49925-branch-3.0 created (now c5e18ef5520)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49925-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at c5e18ef5520 branch-3.0: [fix](multi-catalog) Fix multi-thread issue in hive/iceberg writer commit meta-info to fe. #49842 (#49863) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
hello-stephen commented on PR #49991: URL: https://github.com/apache/doris/pull/49991#issuecomment-2796303289 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
github-actions[bot] opened a new pull request, #49991: URL: https://github.com/apache/doris/pull/49991 Cherry-picked from #49925 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
doris-robot commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796320146 TPC-DS: Total hot run time: 186425 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false query1 995 475 462 462 query2 6559195119201920 query3 6770225 219 219 query4 25896 23847 23123 23123 query5 4400678 467 467 query6 321 209 205 205 query7 4618528 278 278 query8 300 246 240 240 query9 8665259725922592 query10 463 332 256 256 query11 15875 15076 14875 14875 query12 172 116 106 106 query13 1633526 384 384 query14 9770607560876075 query15 199 189 168 168 query16 7637681 471 471 query17 1192722 552 552 query18 2005416 325 325 query19 187 186 162 162 query20 120 119 113 113 query21 204 126 102 102 query22 4221413040854085 query23 33878 33048 33057 33048 query24 8545236223762362 query25 535 456 391 391 query26 1240270 150 150 query27 2771519 326 326 query28 4339242124252421 query29 726 593 443 443 query30 301 225 199 199 query31 943 846 768 768 query32 73 65 65 65 query33 571 408 302 302 query34 813 911 505 505 query35 813 841 754 754 query36 1005981 859 859 query37 119 105 80 80 query38 4187420440904090 query39 1450140013961396 query40 213 121 107 107 query41 58 79 54 54 query42 117 110 107 107 query43 495 505 479 479 query44 1346809 798 798 query45 178 173 169 169 query46 880 1062626 626 query47 1739179517341734 query48 370 423 301 301 query49 792 528 425 425 query50 683 726 393 393 query51 4140421740964096 query52 109 109 94 94 query53 230 262 187 187 query54 584 585 510 510 query55 86 84 85 84 query56 287 296 287 287 query57 1112115410601060 query58 268 292 256 256 query59 2571265726212621 query60 363 345 324 324 query61 161 162 151 151 query62 792 754 673 673 query63 225 195 188 188 query64 44381126795 795 query65 4370428443284284 query66 435 303 303 query67 15968 15573 15206 15206 query68 8569916 514 514 query69 471 304 272 272 query70 1174113110601060 query71 469 323 300 300 query72 5553478345954595 query73 692 580 347 347 query74 8907909988798879 query75 4016322426472647 query76 37081297772 772 query77 816 394 367 367 query78 10002 10093 92709270 query79 2778862 590 590 query80 657 530 454 454 query81 470 258 228 228 query82 459 136 100 100 query83 302 263 245 245 query84 294 111 85 85 query85 783 363 317 317 query86 341 310 290 290 query87 4466449743904390 query88 3346226922752269 query89 422 316 281 281 query90 1963223 236 223 query91 143 207 117 117 query92 84 65 62 62 query93 2140943 584 584 query94 688 443 302 302 query95 379 300 297 297 query96 492 627 284 284 query97 3146326631303130 query98 228 206 201 201 query99 1437142013021302 Total cold run time: 277592 ms Total hot run time: 186425 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) [doris]
doris-robot commented on PR #49958: URL: https://github.com/apache/doris/pull/49958#issuecomment-2796334475 ClickBench: Total hot run time: 31.51 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false query1 0.040.040.03 query2 0.130.100.10 query3 0.240.190.19 query4 1.580.200.20 query5 0.580.570.56 query6 1.180.720.72 query7 0.030.020.01 query8 0.040.030.04 query9 0.580.510.51 query10 0.600.590.59 query11 0.160.110.10 query12 0.150.120.11 query13 0.610.590.60 query14 2.672.672.81 query15 0.920.850.86 query16 0.400.380.39 query17 1.031.081.04 query18 0.210.200.19 query19 1.991.851.86 query20 0.010.010.01 query21 15.35 0.860.55 query22 0.761.370.77 query23 14.77 1.370.61 query24 7.191.100.99 query25 0.520.180.06 query26 0.710.160.14 query27 0.050.050.06 query28 9.520.870.44 query29 12.56 4.053.36 query30 0.250.090.07 query31 2.830.580.39 query32 3.230.550.47 query33 3.033.013.10 query34 15.58 5.134.56 query35 4.564.524.56 query36 0.650.490.48 query37 0.090.060.06 query38 0.050.030.03 query39 0.030.030.02 query40 0.180.130.13 query41 0.080.030.02 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 105.21 s Total hot run time: 31.51 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](schema) add column comment length limit [doris]
cambyzju commented on code in PR #49989: URL: https://github.com/apache/doris/pull/49989#discussion_r2039163570 ## fe/fe-common/src/main/java/org/apache/doris/common/Config.java: ## @@ -1765,6 +1765,12 @@ public class Config extends ConfigBase { @ConfField(mutable = true, masterOnly = true) public static int table_name_length_limit = 64; +@ConfField(mutable = true, description = { +"用于限制列注释长度;如果存量的列注释超长,则显示时进行截断", +"Used to limit the length of column comment; " ++ "If the existing column comment is too long, it will be truncated when displayed."}) +public static int column_comment_length_limit = 1024; Review Comment: good idea, I change it later -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]
hello-stephen commented on PR #49904: URL: https://github.com/apache/doris/pull/49904#issuecomment-2796347274 # BE UT Coverage Report Increment line coverage `100.00% (3/3)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/6617c5faeaa72baadb8e968c081ceeb1ec45a3d1_6617c5faeaa72baadb8e968c081ceeb1ec45a3d1/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/6617c5faeaa72baadb8e968c081ceeb1ec45a3d1_6617c5faeaa72baadb8e968c081ceeb1ec45a3d1/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.58% (14139/26888) | | Line Coverage | 41.35% (122184/295515) | | Region Coverage | 40.10% (62231/155179) | | Branch Coverage | 34.71% (31133/89690) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-3.0](lock) Remove SpinLock compeletely [doris]
zclllyybb commented on PR #49972: URL: https://github.com/apache/doris/pull/49972#issuecomment-2796348934 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (918dbff46f4 -> 8ffba74be78)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 918dbff46f4 Automated deployment with doris branch @ e311ae6cc1e209c9ac32b84b29e13eaeea920398 new 8ffba74be78 Automated deployment with doris branch @ e311ae6cc1e209c9ac32b84b29e13eaeea920398 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (918dbff46f4) \ N -- N -- N refs/heads/asf-site (8ffba74be78) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)use analyzed plan instead of rewritten plan in CreateMaterializedViewCommand [doris]
starocean999 commented on PR #49297: URL: https://github.com/apache/doris/pull/49297#issuecomment-2796362198 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [UT](low memory) Test low memory mode in pipeline task [doris]
Gabriel39 opened a new pull request, #49992: URL: https://github.com/apache/doris/pull/49992 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](low memory) Test low memory mode in pipeline task [doris]
Gabriel39 commented on PR #49992: URL: https://github.com/apache/doris/pull/49992#issuecomment-2796364388 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](task) Complete debug string if task is finalized [doris]
Gabriel39 merged PR #49950: URL: https://github.com/apache/doris/pull/49950 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [minor](task) Complete debug string if task is finalized (#49950)
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 3e819ab64b0 [minor](task) Complete debug string if task is finalized (#49950) 3e819ab64b0 is described below commit 3e819ab64b00a52ce622aa315f6fc81fe92f692e Author: Gabriel AuthorDate: Fri Apr 11 17:29:18 2025 +0800 [minor](task) Complete debug string if task is finalized (#49950) 1. Add spill dependencies to run BE UT. 2. Add pipeline name in debug string if task is finalized. --- be/src/pipeline/exec/operator.h | 6 + be/src/pipeline/pipeline.h | 1 + be/src/pipeline/pipeline_task.cpp | 43 +++-- be/src/pipeline/pipeline_task.h | 1 + be/test/pipeline/pipeline_task_test.cpp | 4 +-- 5 files changed, 29 insertions(+), 26 deletions(-) diff --git a/be/src/pipeline/exec/operator.h b/be/src/pipeline/exec/operator.h index 0625bcc0ad0..75a767aaa83 100644 --- a/be/src/pipeline/exec/operator.h +++ b/be/src/pipeline/exec/operator.h @@ -1100,12 +1100,15 @@ public: "DummyOperatorDependency", true); _filter_dependency = Dependency::create_shared(_parent->operator_id(), _parent->node_id(), "DummyOperatorDependency", true); +_spill_dependency = Dependency::create_shared(_parent->operator_id(), _parent->node_id(), + "DummyOperatorDependency", true); } Dependency* finishdependency() override { return _finish_dependency.get(); } ~DummyOperatorLocalState() = default; std::vector dependencies() const override { return {_tmp_dependency.get()}; } std::vector filter_dependencies() override { return {_filter_dependency.get()}; } +Dependency* spill_dependency() const override { return _spill_dependency.get(); } private: std::shared_ptr _tmp_dependency; @@ -1145,10 +1148,13 @@ public: "DummyOperatorDependency", true); _finish_dependency = Dependency::create_shared(_parent->operator_id(), _parent->node_id(), "DummyOperatorDependency", true); +_spill_dependency = Dependency::create_shared(_parent->operator_id(), _parent->node_id(), + "DummyOperatorDependency", true); } std::vector dependencies() const override { return {_tmp_dependency.get()}; } Dependency* finishdependency() override { return _finish_dependency.get(); } +Dependency* spill_dependency() const override { return _spill_dependency.get(); } bool is_finished() const override { return _is_finished; } private: diff --git a/be/src/pipeline/pipeline.h b/be/src/pipeline/pipeline.h index 7bde9323e94..7fff24cf8d9 100644 --- a/be/src/pipeline/pipeline.h +++ b/be/src/pipeline/pipeline.h @@ -138,6 +138,7 @@ public: } int num_tasks_of_parent() const { return _num_tasks_of_parent; } +std::string& name() { return _name; } private: void _init_profile(); diff --git a/be/src/pipeline/pipeline_task.cpp b/be/src/pipeline/pipeline_task.cpp index 94c5c6f7c75..852174137de 100644 --- a/be/src/pipeline/pipeline_task.cpp +++ b/be/src/pipeline/pipeline_task.cpp @@ -79,8 +79,8 @@ PipelineTask::PipelineTask(PipelinePtr& pipeline, uint32_t task_id, RuntimeState _shared_state_map(std::move(shared_state_map)), _task_idx(task_idx), _execution_dep(state->get_query_ctx()->get_execution_dependency()), - _memory_sufficient_dependency( - state->get_query_ctx()->get_memory_sufficient_dependency()) { + _memory_sufficient_dependency(state->get_query_ctx()->get_memory_sufficient_dependency()), + _pipeline_name(_pipeline->name()) { _pipeline_task_watcher.start(); if (!_shared_state_map.contains(_sink->dests_id().front())) { @@ -291,24 +291,19 @@ void PipelineTask::terminate() { auto fragment = _fragment_context.lock(); if (!is_finalized() && fragment) { DCHECK(_wake_up_early || fragment->is_canceled()); -for (auto* dep : _spill_dependencies) { -dep->set_always_ready(); -} - -for (auto* dep : _filter_dependencies) { -dep->set_always_ready(); -} -for (auto& deps : _read_dependencies) { -for (auto* dep : deps) { -dep->set_always_ready(); -} -} -for (auto* dep : _write_dependencies) { -dep->set_always_ready(); -} -for (auto* dep : _finish_dependencies) { -dep->set_always_ready(); -} +std::for_each(_spill_dependencies.begin(), _spil
Re: [PR] [test](ut) add cases about hash join [doris]
mrhhsg commented on PR #49803: URL: https://github.com/apache/doris/pull/49803#issuecomment-2796374574 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](low memory) Test low memory mode in pipeline task [doris]
hello-stephen commented on PR #49992: URL: https://github.com/apache/doris/pull/49992#issuecomment-2796364245 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] [doris]
Mryange commented on PR #49971: URL: https://github.com/apache/doris/pull/49971#issuecomment-2796385322 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
doris-robot commented on PR #49991: URL: https://github.com/apache/doris/pull/49991#issuecomment-2796391933 TPC-H: Total hot run time: 40090 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7848acf131b876ffad64c4880236b9832bde6539, data reload: false -- Round 1 -- q1 17584 670365906590 q2 2060174 176 174 q3 10612 106211741062 q4 10543 794 745 745 q5 7765286027692769 q6 214 133 136 133 q7 995 621 605 605 q8 9354196320101963 q9 6590639664106396 q10 7042228523012285 q11 469 274 264 264 q12 396 211 209 209 q13 17771 295929862959 q14 227 204 214 204 q15 507 461 472 461 q16 674 581 603 581 q17 975 557 544 544 q18 7273672967046704 q19 1394111910101010 q20 458 211 210 210 q21 4001324033873240 q22 1083983 982 982 Total cold run time: 107987 ms Total hot run time: 40090 ms - Round 2, with runtime_filter_mode=off - q1 6563659565856585 q2 343 241 241 241 q3 2930280829362808 q4 2062184018921840 q5 5866581657365736 q6 217 128 131 128 q7 2223180418001800 q8 3408353235023502 q9 8777886888418841 q10 3571353435043504 q11 593 497 475 475 q12 790 626 592 592 q13 7903322331683168 q14 304 273 283 273 q15 522 451 467 451 q16 672 638 651 638 q17 1814164416211621 q18 8231785676947694 q19 1657157314391439 q20 2127188319131883 q21 5624531253585312 q22 1101100310111003 Total cold run time: 67298 ms Total hot run time: 59534 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]
zclllyybb commented on PR #49993: URL: https://github.com/apache/doris/pull/49993#issuecomment-2796398910 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](schema) add column comment length limit [doris]
cambyzju commented on PR #49989: URL: https://github.com/apache/doris/pull/49989#issuecomment-2796400575 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]
Thearas commented on PR #49993: URL: https://github.com/apache/doris/pull/49993#issuecomment-2796398238 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
hello-stephen commented on PR #49994: URL: https://github.com/apache/doris/pull/49994#issuecomment-2796404881 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
zgxme opened a new pull request, #49994: URL: https://github.com/apache/doris/pull/49994 ### What problem does this PR solve? Version 3.0.0-SNAPSHOT does not work on aliyun mirror.This can cause the CI to become unstable. Related PR: https://github.com/apache/doris/pull/48023 ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [x] No need to test or manual test. Explain why: - [x] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [x] No. - [ ] Yes. - Does this need documentation? - [x] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [x] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]
github-actions[bot] commented on PR #49993: URL: https://github.com/apache/doris/pull/49993#issuecomment-2796414697 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) fix wrong length check of function array_range [doris]
github-actions[bot] commented on PR #49993: URL: https://github.com/apache/doris/pull/49993#issuecomment-2796414999 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
doris-robot commented on PR #49991: URL: https://github.com/apache/doris/pull/49991#issuecomment-2796434615 TPC-DS: Total hot run time: 197220 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7848acf131b876ffad64c4880236b9832bde6539, data reload: false query1 1293929 907 907 query2 6215205419991999 query3 10855 449242954295 query4 65354 28152 23298 23298 query5 5035443 439 439 query6 391 169 168 168 query7 5529320 311 311 query8 316 228 222 222 query9 8392259225832583 query10 445 259 259 259 query11 16931 15059 15738 15059 query12 158 102 100 100 query13 1434449 456 449 query14 10728 758276267582 query15 200 194 182 182 query16 7274470 455 455 query17 1089618 593 593 query18 1839319 322 319 query19 214 170 161 161 query20 119 121 113 113 query21 213 108 103 103 query22 4661436144794361 query23 34421 33892 34267 33892 query24 6112293629042904 query25 524 410 393 393 query26 665 171 163 163 query27 1693352 365 352 query28 4358244124512441 query29 709 457 434 434 query30 240 161 163 161 query31 1013837 850 837 query32 64 57 55 55 query33 417 312 317 312 query34 918 523 499 499 query35 841 756 725 725 query36 1068972 984 972 query37 116 64 69 64 query38 4255402940364029 query39 1521145214591452 query40 208 100 101 100 query41 49 48 53 48 query42 111 99 100 99 query43 518 477 485 477 query44 1170823 833 823 query45 184 173 175 173 query46 1168721 721 721 query47 2018193019291929 query48 481 377 385 377 query49 738 391 398 391 query50 857 412 417 412 query51 7276724471197119 query52 102 86 87 86 query53 256 174 182 174 query54 560 462 454 454 query55 76 73 74 73 query56 271 238 253 238 query57 1197111011341110 query58 209 208 211 208 query59 3145283530702835 query60 271 243 260 243 query61 108 127 147 127 query62 778 661 677 661 query63 224 187 188 187 query64 1380672 642 642 query65 3285319332443193 query66 723 299 304 299 query67 15987 15630 15794 15630 query68 3757605 595 595 query69 429 278 262 262 query70 1181110510431043 query71 363 260 266 260 query72 6408405240004000 query73 756 344 344 344 query74 10073 936591619161 query75 3352267926132613 query76 1897107011281070 query77 497 289 279 279 query78 10548 957296019572 query79 1122586 592 586 query80 832 462 453 453 query81 506 246 241 241 query82 321 93 89 89 query83 164 149 153 149 query84 293 84 80 80 query85 905 381 298 298 query86 330 304 306 304 query87 4478436143144314 query88 4000248223592359 query89 411 291 293 291 query90 1955187 185 185 query91 179 151 151 151 query92 66 49 49 49 query93 1448562 562 562 query94 763 300 293 293 query95 361 263 260 260 query96 619 278 280 278 query97 3425315331493149 query98 206 204 203 203 query99 1682125513101255 Total cold run time: 314297 ms Total hot run time: 197220 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
[PR] [Fix](function) fix wrong length check of function array_range [doris]
zclllyybb opened a new pull request, #49993: URL: https://github.com/apache/doris/pull/49993 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: before, for a short range with big value, like `[1, 10001]`, it will raise an error by mistake. now fixed. before: ```sql mysql> select number, array_range(number * 1, number * 1 + 10) from numbers("number" = "1"); ERROR 1105 (HY000): errCode = 2, detailMessage = [CANCELLED]Array size exceeds the limit 100 ``` now: ```sql mysql> select number, array_range(number * 1, number * 1 + 10) from numbers("number" = "1"); ++--+ | number | array_range(number * 1, number * 1 + 10) | ++--+ | 0 | [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] | ++--+ ``` ### Release note fix wrong length check of function array_range ### Check List (For Author) - Test - [x] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [x] No. - [ ] Yes. - Does this need documentation? - [x] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [poc](mtmv) Support copying tmp rewrite plan to memo for mv rewrite better [doris]
seawinde commented on PR #49597: URL: https://github.com/apache/doris/pull/49597#issuecomment-2796434600 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
zddr commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796441783 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
zddr commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796442004 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)fix when compatible fail, will throw NPE [doris]
zddr commented on PR #49875: URL: https://github.com/apache/doris/pull/49875#issuecomment-2796442717 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
hello-stephen commented on PR #49994: URL: https://github.com/apache/doris/pull/49994#issuecomment-2796453325 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]
doris-robot commented on PR #49905: URL: https://github.com/apache/doris/pull/49905#issuecomment-2796449965 TPC-H: Total hot run time: 34728 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 04ccdf5c7932f06b30a8adf4c660e68b13fef148, data reload: false -- Round 1 -- q1 26152 509250135013 q2 2084282 207 207 q3 10502 1234668 668 q4 10242 1044529 529 q5 7935243522912291 q6 193 163 133 133 q7 917 732 606 606 q8 9312124011081108 q9 6828513850965096 q10 6866232718891889 q11 504 290 277 277 q12 368 354 228 228 q13 17783 368531073107 q14 231 222 210 210 q15 529 486 486 486 q16 610 616 568 568 q17 610 852 361 361 q18 7577716770037003 q19 1773961 585 585 q20 345 349 228 228 q21 4324339931613161 q22 10471017974 974 Total cold run time: 116732 ms Total hot run time: 34728 ms - Round 2, with runtime_filter_mode=off - q1 5308511650835083 q2 242 323 236 236 q3 2101263722682268 q4 1408186114961496 q5 4468444243694369 q6 219 177 133 133 q7 2010189018081808 q8 2662266425672567 q9 7190708171097081 q10 3019317427562756 q11 575 504 514 504 q12 669 753 590 590 q13 3577390333223322 q14 316 315 276 276 q15 533 479 476 476 q16 649 668 663 663 q17 1165152514191419 q18 7864757974107410 q19 845 795 851 795 q20 1900194018511851 q21 5427494248684868 q22 1135108910341034 Total cold run time: 53282 ms Total hot run time: 51005 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 [doris]
doris-robot commented on PR #49991: URL: https://github.com/apache/doris/pull/49991#issuecomment-2796452300 ClickBench: Total hot run time: 32.32 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7848acf131b876ffad64c4880236b9832bde6539, data reload: false query1 0.040.030.03 query2 0.060.030.03 query3 0.230.070.06 query4 1.620.100.09 query5 0.520.490.52 query6 1.140.720.72 query7 0.020.020.01 query8 0.040.030.04 query9 0.550.500.50 query10 0.540.550.55 query11 0.150.100.10 query12 0.140.110.11 query13 0.610.600.60 query14 2.732.742.76 query15 0.900.820.82 query16 0.390.400.38 query17 1.031.010.98 query18 0.240.230.22 query19 1.971.822.06 query20 0.020.010.01 query21 15.73 0.580.59 query22 2.372.331.60 query23 16.84 1.030.89 query24 3.501.451.58 query25 0.220.230.07 query26 0.380.130.13 query27 0.050.040.04 query28 9.120.540.51 query29 12.65 3.213.21 query30 0.250.060.07 query31 2.850.380.38 query32 3.250.460.47 query33 2.992.983.03 query34 16.92 4.474.41 query35 4.554.524.47 query36 0.690.480.48 query37 0.090.060.06 query38 0.040.030.04 query39 0.030.020.02 query40 0.160.140.13 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.030.03 Total cold run time: 105.77 s Total hot run time: 32.32 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
hello-stephen commented on PR #49994: URL: https://github.com/apache/doris/pull/49994#issuecomment-2796454751 skip buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
github-actions[bot] commented on PR #49994: URL: https://github.com/apache/doris/pull/49994#issuecomment-2796459514 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (3e819ab64b0 -> af913104b79)
This is an automated email from the ASF dual-hosted git repository. hellostephen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 3e819ab64b0 [minor](task) Complete debug string if task is finalized (#49950) add af913104b79 [enhancement](ranger) modify ranger-intg to make testing more stable (#49994) No new revisions were added by this update. Summary of changes: regression-test/framework/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](ranger) modify ranger-intg to make testing more stable [doris]
github-actions[bot] commented on PR #49994: URL: https://github.com/apache/doris/pull/49994#issuecomment-2796459405 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv) Create a materialized view that only includes the partitions in the query conditions. [doris]
KeeProMise commented on PR #49852: URL: https://github.com/apache/doris/pull/49852#issuecomment-2796477225 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt](mow) Forbid time_series compaction policy on unique table [doris]
doris-robot commented on PR #49905: URL: https://github.com/apache/doris/pull/49905#issuecomment-2796479526 TPC-DS: Total hot run time: 193437 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 04ccdf5c7932f06b30a8adf4c660e68b13fef148, data reload: false query1 1399107310141014 query2 6379196619431943 query3 11139 474145484548 query4 25810 23882 23172 23172 query5 4809622 450 450 query6 299 210 202 202 query7 3993479 281 281 query8 290 232 234 232 query9 8518259126092591 query10 489 323 279 279 query11 15350 15384 14763 14763 query12 169 115 114 114 query13 1560548 402 402 query14 9172620561956195 query15 201 187 162 162 query16 7325640 490 490 query17 1148789 593 593 query18 1991419 311 311 query19 193 190 162 162 query20 127 127 121 121 query21 214 130 113 113 query22 4357463342964296 query23 34584 33857 33784 33784 query24 8478248724712471 query25 533 465 398 398 query26 1196279 150 150 query27 3029498 341 341 query28 4790245624292429 query29 718 584 442 442 query30 283 228 201 201 query31 939 880 796 796 query32 82 65 63 63 query33 531 359 325 325 query34 808 889 524 524 query35 834 864 759 759 query36 10211028920 920 query37 124 98 75 75 query38 4230423941874187 query39 1498148814291429 query40 217 120 108 108 query41 52 52 50 50 query42 123 107 108 107 query43 524 497 496 496 query44 1351853 834 834 query45 190 185 170 170 query46 865 1044658 658 query47 1829185718401840 query48 396 418 305 305 query49 780 565 458 458 query50 666 705 409 409 query51 4279434242554255 query52 115 108 101 101 query53 250 279 187 187 query54 604 585 530 530 query55 86 88 88 88 query56 327 309 300 300 query57 1181117311451145 query58 273 272 269 269 query59 2764285727042704 query60 330 334 309 309 query61 136 145 176 145 query62 762 749 667 667 query63 240 186 190 186 query64 41831058693 693 query65 4422436043404340 query66 1106410 308 308 query67 15658 15398 15275 15275 query68 6454886 512 512 query69 475 304 262 262 query70 1198110310451045 query71 409 332 297 297 query72 5745464346444643 query73 654 650 354 354 query74 9191902189418941 query75 3221319827442744 query76 31761186762 762 query77 490 364 288 288 query78 9851999092999299 query79 2349818 568 568 query80 1457526 464 464 query81 532 262 228 228 query82 428 127 90 90 query83 326 251 234 234 query84 243 107 82 82 query85 799 424 318 318 query86 449 306 272 272 query87 4417443743994399 query88 3488226922752269 query89 399 313 293 293 query90 1893212 219 212 query91 144 141 112 112 query92 78 58 59 58 query93 2676927 574 574 query94 726 406 308 308 query95 380 301 288 288 query96 506 562 281 281 query97 3107322031143114 query98 243 202 205 202 query99 1331144612591259 Total cold run time: 279154 ms Total hot run time: 193437 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go