Re: [PR] [fix](inverted index) add in list to fast execute logic after hit index [doris]
doris-robot commented on PR #35302: URL: https://github.com/apache/doris/pull/35302#issuecomment-2143734442 TeamCity be ut coverage result: Function Coverage: 37.80% (8099/21424) Line Coverage: 29.47% (66147/224477) Region Coverage: 28.96% (34100/117763) Branch Coverage: 24.81% (17505/70546) Coverage Report: http://coverage.selectdb-in.cc/coverage/e5f5273383dc69cec51e4698beb22ef9b389aa14_e5f5273383dc69cec51e4698beb22ef9b389aa14/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) add in list to fast execute logic after hit index [doris]
doris-robot commented on PR #35302: URL: https://github.com/apache/doris/pull/35302#issuecomment-2143734385 TPC-H: Total hot run time: 49994 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e5f5273383dc69cec51e4698beb22ef9b389aa14, data reload: false -- Round 1 -- q1 18161 446443474347 q2 2071160 150 150 q3 10457 192519081908 q4 10323 127213251272 q5 8428393139743931 q6 239 150 124 124 q7 2039162416231623 q8 9284274527112711 q9 10675 10255 10419 10255 q10 8672353334793479 q11 429 242 254 242 q12 474 306 305 305 q13 18353 400140624001 q14 358 322 325 322 q15 514 456 463 456 q16 685 576 569 569 q17 1161980 992 980 q18 7272691068206820 q19 1807164416321632 q20 545 328 313 313 q21 4502411741334117 q22 533 437 457 437 Total cold run time: 116982 ms Total hot run time: 49994 ms - Round 2, with runtime_filter_mode=off - q1 4385438242944294 q2 330 226 226 226 q3 4165415841824158 q4 2757274027532740 q5 7228711170757075 q6 237 124 122 122 q7 3234278427612761 q8 4351445345144453 q9 16885 16922 16739 16739 q10 4227427242104210 q11 748 701 672 672 q12 1033854 864 854 q13 6653371437173714 q14 450 421 421 421 q15 509 451 449 449 q16 728 683 690 683 q17 3807382838853828 q18 8845887187548754 q19 1744175116531653 q20 2354214221712142 q21 8492841985718419 q22 1040976 983 976 Total cold run time: 84202 ms Total hot run time: 79343 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
svn commit: r69495 - in /dev/doris/2.0.11: ./ apache-doris-2.0.11-src.tar.gz apache-doris-2.0.11-src.tar.gz.asc apache-doris-2.0.11-src.tar.gz.sha512
Author: kxiao Date: Sun Jun 2 07:39:00 2024 New Revision: 69495 Log: doris-2.0.11 release vote Added: dev/doris/2.0.11/ dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz (with props) dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.asc (with props) dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.sha512 Added: dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz == Binary file - no diff available. Propchange: dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz -- svn:mime-type = application/x-gzip Added: dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.asc == Binary file - no diff available. Propchange: dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.asc -- svn:mime-type = application/pgp-signature Added: dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.sha512 == --- dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.sha512 (added) +++ dev/doris/2.0.11/apache-doris-2.0.11-src.tar.gz.sha512 Sun Jun 2 07:39:00 2024 @@ -0,0 +1 @@ +959f284985d58cfc69256cebf672f196e3b937aeb5663180a962bca8b7de46dcab2b698e54ca6abad61a84206eec3e6dc4abc09a8a49046fa22d2bcf8685bb9d apache-doris-2.0.11-src.tar.gz - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) add in list to fast execute logic after hit index [doris]
doris-robot commented on PR #35302: URL: https://github.com/apache/doris/pull/35302#issuecomment-2143737645 TPC-DS: Total hot run time: 204624 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e5f5273383dc69cec51e4698beb22ef9b389aa14, data reload: false query1 939 393 433 393 query2 6524281126712671 query3 6919215 208 208 query4 20849 18090 17872 17872 query5 19727 651465416514 query6 284 224 230 224 query7 4156300 296 296 query8 407 392 415 392 query9 3141271326392639 query10 424 294 293 293 query11 11364 10669 10711 10669 query12 120 74 77 74 query13 5607709 677 677 query14 17622 13707 13604 13604 query15 367 247 242 242 query16 6463292 263 263 query17 16991456857 857 query18 2337412 402 402 query19 209 147 157 147 query20 82 79 84 79 query21 190 98 97 97 query22 5063516249994999 query23 32625 32080 31947 31947 query24 7011648665136486 query25 532 438 410 410 query26 530 161 163 161 query27 1879298 297 297 query28 6253239723472347 query29 2858272327092709 query30 248 166 166 166 query31 912 745 737 737 query32 70 72 59 59 query33 399 267 255 255 query34 833 472 465 465 query35 1149950 944 944 query36 1328125912371237 query37 89 62 62 62 query38 3045299729332933 query39 1370132212941294 query40 211 94 98 94 query41 48 45 44 44 query42 93 97 87 87 query43 818 676 745 676 query44 1129720 722 720 query45 249 237 239 237 query46 1227983 990 983 query47 1838186118671861 query48 1012732 703 703 query49 625 386 373 373 query50 869 652 613 613 query51 4746464246134613 query52 94 92 80 80 query53 469 325 324 324 query54 2689243225042432 query55 97 83 94 83 query56 231 226 197 197 query57 1136109611761096 query58 221 197 205 197 query59 4214401338343834 query60 217 212 213 212 query61 98 96 95 95 query62 847 453 513 453 query63 494 345 350 345 query64 2559157914311431 query65 3634352235113511 query66 779 382 365 365 query67 16137 15193 15185 15185 query68 9804660 642 642 query69 564 371 342 342 query70 1962142714061406 query71 425 309 329 309 query72 6683348134813481 query73 740 325 325 325 query74 6351584058065806 query75 5524362237313622 query76 6119110411381104 query77 1051258 253 253 query78 12644 12694 12565 12565 query79 12087 640 636 636 query80 746 396 397 396 query81 493 236 231 231 query82 960 99 98 98 query83 197 135 140 135 query84 259 71 70 70 query85 776 335 317 317 query86 340 298 330 298 query87 3238305730803057 query88 5557236223652362 query89 415 309 285 285 query90 2186210 211 210 query91 182 142 140 140 query92 61 54 55 54 query93 6189572 566 566 query94 896 213 203 203 query95 1074106210511051 query96 644 334 337 334 query97 6376632963866329 query98 198 178 174 174 query99 2772916 858 858 Total cold run time: 319918 ms Total hot run time: 204624 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [fix](inverted index) add in list to fast execute logic after hit index [doris]
doris-robot commented on PR #35302: URL: https://github.com/apache/doris/pull/35302#issuecomment-2143738857 ClickBench: Total hot run time: 31.07 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e5f5273383dc69cec51e4698beb22ef9b389aa14, data reload: false query1 0.020.020.02 query2 0.070.020.02 query3 0.250.040.04 query4 1.800.060.06 query5 0.540.520.52 query6 1.260.620.63 query7 0.020.010.01 query8 0.030.030.02 query9 0.530.500.49 query10 0.550.540.54 query11 0.120.080.09 query12 0.120.090.10 query13 0.620.610.60 query14 0.800.780.79 query15 0.780.760.77 query16 0.370.370.37 query17 1.031.031.00 query18 0.240.240.22 query19 1.931.831.81 query20 0.010.020.01 query21 15.45 0.570.55 query22 1.961.821.54 query23 16.80 0.840.92 query24 5.481.561.42 query25 0.390.070.06 query26 0.700.150.15 query27 0.040.030.04 query28 6.990.740.74 query29 12.60 2.272.30 query30 0.600.540.54 query31 2.810.390.39 query32 3.370.500.50 query33 3.053.093.08 query34 15.27 4.804.80 query35 4.904.834.82 query36 1.071.031.02 query37 0.050.050.05 query38 0.030.020.02 query39 0.020.010.01 query40 0.160.150.14 query41 0.060.010.01 query42 0.020.010.01 query43 0.030.020.02 Total cold run time: 102.94 s Total hot run time: 31.07 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) add in list to fast execute logic after hit index [doris]
doris-robot commented on PR #35302: URL: https://github.com/apache/doris/pull/35302#issuecomment-2143739639 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit e5f5273383dc69cec51e4698beb22ef9b389aa14 with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.1 seconds inserted 1000 Rows, about 473K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [wip-enhance](tablet) Ignore expired stale rowsets when load tablets [doris]
platoneko closed pull request #35669: [wip-enhance](tablet) Ignore expired stale rowsets when load tablets URL: https://github.com/apache/doris/pull/35669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
platoneko opened a new pull request, #35768: URL: https://github.com/apache/doris/pull/35768 Fix the issue of redundant loading of stale rowset meta in `TabletMeta::init_from_pb` ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
doris-robot commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143749096 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
platoneko commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143749611 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
platoneko commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143750287 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
github-actions[bot] commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143751023 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
github-actions[bot] commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143751529 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
github-actions[bot] commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143754776 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](IP) support ipv4/ipv6 with inverted index and conjuncts for query [doris]
airborne12 commented on code in PR #35734: URL: https://github.com/apache/doris/pull/35734#discussion_r1623361997 ## be/src/olap/rowset/segment_v2/inverted_index_writer.cpp: ## @@ -695,6 +695,8 @@ Status InvertedIndexColumnWriter::create(const Field* field, M(FieldType::OLAP_FIELD_TYPE_DECIMAL128I) M(FieldType::OLAP_FIELD_TYPE_DECIMAL256) M(FieldType::OLAP_FIELD_TYPE_BOOL) +M(FieldType::OLAP_FIELD_TYPE_IPV4) +M(FieldType::OLAP_FIELD_TYPE_IPV6) Review Comment: in key_coder's full_encoding function. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
doris-robot commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2143783137 TPC-H: Total hot run time: 40940 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 913595ab6285ced6a976fe5e68a711a35f23d931, data reload: false -- Round 1 -- q1 17607 433942744274 q2 2029192 196 192 q3 10447 121711081108 q4 10197 775 868 775 q5 7483273027602730 q6 232 145 139 139 q7 970 620 606 606 q8 9219215521162116 q9 9218673566846684 q10 9232386740373867 q11 493 254 244 244 q12 463 258 233 233 q13 18702 327532113211 q14 270 224 231 224 q15 512 482 480 480 q16 514 408 408 408 q17 995 603 568 568 q18 8554800878047804 q19 5914133713391337 q20 650 332 318 318 q21 5112326640843266 q22 419 356 356 356 Total cold run time: 119232 ms Total hot run time: 40940 ms - Round 2, with runtime_filter_mode=off - q1 4577445344224422 q2 382 278 279 278 q3 3116293529302930 q4 2032174016731673 q5 5315553254915491 q6 227 126 128 126 q7 2196183117851785 q8 3220337633883376 q9 8675861086338610 q10 4140393238133813 q11 618 495 488 488 q12 780 611 602 602 q13 16074 311532023115 q14 296 269 274 269 q15 526 465 472 465 q16 477 412 440 412 q17 1812152014961496 q18 8090782173077307 q19 1779158515431543 q20 3022180118181801 q21 7968472947664729 q22 661 521 527 521 Total cold run time: 75983 ms Total hot run time: 55252 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only for test] open UBSAN [doris]
Mryange commented on PR #35177: URL: https://github.com/apache/doris/pull/35177#issuecomment-2143795322 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only for test] open UBSAN [doris]
github-actions[bot] commented on PR #35177:
URL: https://github.com/apache/doris/pull/35177#issuecomment-2143795494
`sh-checker report`
To get the full details, please check in the
[job]("https://github.com/apache/doris/actions/runs/9337639702";) output.
shellcheck errors
```
'shellcheck ' returned error 1 finding the following syntactical issues:
--
In build.sh line 362:
BUILD_TYPE_LOWWER=$(echo "${BUILD_TYPE}" | tr '[:upper:]' '[:lower:]')
^---^ SC2154 (warning): BUILD_TYPE is
referenced but not assigned.
For more information:
https://www.shellcheck.net/wiki/SC2154 -- BUILD_TYPE is referenced but not
...
--
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=
above the line that contains the issue, where is the error code;
3. Add '-e ' to the SHELLCHECK_OPTS setting in your .yml action file.
```
shfmt errors
```
'shfmt ' found no issues.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
zzzs commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2143810905 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2143821006 TPC-H: Total hot run time: 42057 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ef69c2964506297597ade34a2b3b85fdedf27123, data reload: false -- Round 1 -- q1 17619 436542804280 q2 2019202 210 202 q3 10453 117711491149 q4 10199 817 809 809 q5 7471269926812681 q6 222 133 136 133 q7 973 609 625 609 q8 9244212120822082 q9 9468667866626662 q10 9510394839683948 q11 451 245 272 245 q12 476 241 235 235 q13 18088 327233193272 q14 274 214 222 214 q15 526 480 476 476 q16 486 386 401 386 q17 995 664 669 664 q18 8472791479257914 q19 6581139313451345 q20 655 335 326 326 q21 5178409041504090 q22 405 344 335 335 Total cold run time: 119765 ms Total hot run time: 42057 ms - Round 2, with runtime_filter_mode=off - q1 4686449544674467 q2 386 278 272 272 q3 3206298928142814 q4 1883165816831658 q5 5596566556205620 q6 238 131 130 130 q7 2287191819311918 q8 3297344634363436 q9 8873895588288828 q10 4102394638353835 q11 586 487 495 487 q12 790 633 615 615 q13 16181 312431853124 q14 308 272 266 266 q15 510 479 488 479 q16 471 427 432 427 q17 1801151715671517 q18 8083782072517251 q19 1738156815981568 q20 2100182417831783 q21 9920496448304830 q22 663 537 552 537 Total cold run time: 77705 ms Total hot run time: 55862 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
Mryange commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143823744 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2143824665 TPC-DS: Total hot run time: 169911 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ef69c2964506297597ade34a2b3b85fdedf27123, data reload: false query1 911 383 371 371 query2 6452252325222522 query3 6657198 206 198 query4 19466 17259 17237 17237 query5 4151445 444 444 query6 245 158 155 155 query7 4581302 293 293 query8 311 286 281 281 query9 8682237223342334 query10 420 303 266 266 query11 10691 999710036 9997 query12 138 94 88 88 query13 1627376 374 374 query14 8464702974627029 query15 231 195 189 189 query16 7817274 305 274 query17 1781517 507 507 query18 1943275 269 269 query19 215 145 149 145 query20 101 84 85 84 query21 211 143 136 136 query22 4251406641944066 query23 33656 33006 33159 33006 query24 10956 295928692869 query25 621 349 352 349 query26 1430168 153 153 query27 2965321 319 319 query28 7532207120582058 query29 950 614 602 602 query30 288 145 149 145 query31 982 757 723 723 query32 92 55 52 52 query33 756 283 268 268 query34 963 473 470 470 query35 764 620 592 592 query36 1089948 937 937 query37 163 69 75 69 query38 2895275227412741 query39 866 809 801 801 query40 210 124 123 123 query41 55 52 50 50 query42 143 94 95 94 query43 580 565 550 550 query44 1216738 763 738 query45 208 169 166 166 query46 1071706 742 706 query47 1873177017651765 query48 365 303 312 303 query49 1090400 404 400 query50 776 398 381 381 query51 6725668166696669 query52 103 87 88 87 query53 356 291 281 281 query54 852 459 442 442 query55 72 73 73 73 query56 278 278 256 256 query57 1152108010281028 query58 264 253 260 253 query59 3596318533373185 query60 281 279 274 274 query61 89 83 88 83 query62 630 453 452 452 query63 318 297 292 292 query64 8960226117131713 query65 3155310431633104 query66 1299322 328 322 query67 15375 14891 14886 14886 query68 4484543 547 543 query69 458 296 308 296 query70 1141107111631071 query71 408 271 283 271 query72 7446271125212521 query73 730 330 327 327 query74 5926560055335533 query75 3530267226412641 query76 2766944 887 887 query77 504 302 285 285 query78 10293 978197649764 query79 1464526 517 517 query80 1848458 461 458 query81 563 220 218 218 query82 1034100 103 100 query83 309 163 165 163 query84 266 84 81 81 query85 1309265 277 265 query86 391 344 321 321 query87 3323312330733073 query88 2994242224282422 query89 478 382 388 382 query90 1806185 186 185 query91 124 97 98 97 query92 67 48 51 48 query93 1131526 514 514 query94 1289196 196 196 query95 431 392 323 323 query96 583 267 269 267 query97 3168300830713008 query98 242 220 213 213 query99 1110832 839 832 Total cold run time: 269022 ms Total hot run time: 169911 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
[PR] [fix](ub) fix some ub error [doris]
Mryange opened a new pull request, #35769: URL: https://github.com/apache/doris/pull/35769 ## Proposed changes test pr in this https://github.com/apache/doris/pull/35177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
doris-robot commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143824954 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only for test] open UBSAN [doris]
doris-robot commented on PR #35177: URL: https://github.com/apache/doris/pull/35177#issuecomment-2143825929 TeamCity be ut coverage result: Function Coverage: 36.27% (9235/25460) Line Coverage: 27.61% (75700/274213) Region Coverage: 26.82% (39182/146108) Branch Coverage: 23.54% (19855/84338) Coverage Report: http://coverage.selectdb-in.cc/coverage/1fc952448c49edea326f639544eb55cdcaa24aa8_1fc952448c49edea326f639544eb55cdcaa24aa8/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
Mryange commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143826387 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2143826539 ClickBench: Total hot run time: 30.92 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ef69c2964506297597ade34a2b3b85fdedf27123, data reload: false query1 0.040.030.04 query2 0.080.040.05 query3 0.230.050.05 query4 1.680.090.09 query5 0.520.490.50 query6 1.120.730.72 query7 0.010.010.02 query8 0.050.050.04 query9 0.550.490.51 query10 0.550.560.55 query11 0.160.110.11 query12 0.150.120.12 query13 0.600.600.58 query14 0.790.770.79 query15 0.810.810.82 query16 0.370.350.35 query17 1.041.050.95 query18 0.210.260.24 query19 1.761.681.84 query20 0.020.010.01 query21 15.65 0.680.67 query22 4.996.922.03 query23 18.32 1.381.32 query24 1.730.250.23 query25 0.150.080.08 query26 0.250.160.17 query27 0.070.070.08 query28 13.37 1.021.00 query29 12.76 3.573.49 query30 0.240.070.05 query31 2.860.370.40 query32 3.280.480.46 query33 2.862.902.99 query34 17.30 4.394.50 query35 4.514.534.51 query36 0.740.500.48 query37 0.170.160.16 query38 0.150.140.14 query39 0.040.040.03 query40 0.160.140.15 query41 0.090.040.04 query42 0.060.040.04 query43 0.040.030.04 Total cold run time: 110.53 s Total hot run time: 30.92 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
github-actions[bot] commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143827362 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](spill) handle oom exception in spill tasks (#35025) [doris]
mrhhsg commented on PR #35171: URL: https://github.com/apache/doris/pull/35171#issuecomment-2143832447 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
mrhhsg commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143834507 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
doris-robot commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143834563 TeamCity be ut coverage result: Function Coverage: 36.26% (9233/25460) Line Coverage: 27.60% (75677/274213) Region Coverage: 26.81% (39177/146108) Branch Coverage: 23.53% (19846/84338) Coverage Report: http://coverage.selectdb-in.cc/coverage/3073ae37bd7d63317457da7a448fbc48ddcbdcd8_3073ae37bd7d63317457da7a448fbc48ddcbdcd8/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
github-actions[bot] commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143839813 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
HappenLee commented on PR #31508: URL: https://github.com/apache/doris/pull/31508#issuecomment-2143845932 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](oom) add exception in olap data convertor when memory is not enough to prevent oom [doris]
yiguolei merged PR #35761: URL: https://github.com/apache/doris/pull/35761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (67f1ae8a12f -> 502721149f5)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 67f1ae8a12f [Enhancement] support to erase all tables and partitions with same DbId while drop a database which is not in catalog recycle bin (#35750) add 502721149f5 [enhancement](oom) add exception in olap data convertor when memory is not enough to prevent oom (#35761) No new revisions were added by this update. Summary of changes: be/src/olap/rowset/segment_v2/plain_page.h| 2 +- be/src/olap/rowset/segment_v2/segment_writer.cpp | 8 .../rowset/segment_v2/vertical_segment_writer.cpp | 12 ++-- .../exec/group_commit_block_sink_operator.cpp | 2 +- be/src/vec/core/block.cpp | 19 +++ be/src/vec/core/block.h | 2 +- be/src/vec/olap/olap_data_convertor.cpp | 19 +-- be/src/vec/olap/olap_data_convertor.h | 4 ++-- be/src/vec/sink/group_commit_block_sink.cpp | 2 +- be/src/vec/sink/writer/vtablet_writer.cpp | 3 ++- 10 files changed, 42 insertions(+), 31 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [enhancement](oom) add exception in olap data convertor when memory is not enough to prevent oom (#35761)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new f03cee5e30d [enhancement](oom) add exception in olap data convertor
when memory is not enough to prevent oom (#35761)
f03cee5e30d is described below
commit f03cee5e30d919833a70e7da8a8c5f22f20f9a28
Author: yiguolei <676222...@qq.com>
AuthorDate: Sun Jun 2 21:11:18 2024 +0800
[enhancement](oom) add exception in olap data convertor when memory is not
enough to prevent oom (#35761)
Issue Number: close #xxx
-
Co-authored-by: yiguolei
---
be/src/olap/rowset/segment_v2/plain_page.h| 2 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 8
.../rowset/segment_v2/vertical_segment_writer.cpp | 12 ++--
be/src/vec/core/block.cpp | 19 +++
be/src/vec/core/block.h | 2 +-
be/src/vec/olap/olap_data_convertor.cpp | 19 +--
be/src/vec/olap/olap_data_convertor.h | 4 ++--
be/src/vec/sink/group_commit_block_sink.cpp | 2 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 3 ++-
9 files changed, 41 insertions(+), 30 deletions(-)
diff --git a/be/src/olap/rowset/segment_v2/plain_page.h
b/be/src/olap/rowset/segment_v2/plain_page.h
index cbcc96f31ba..af31275002a 100644
--- a/be/src/olap/rowset/segment_v2/plain_page.h
+++ b/be/src/olap/rowset/segment_v2/plain_page.h
@@ -39,7 +39,7 @@ public:
Status init() override {
// Reserve enough space for the page, plus a bit of slop since
// we often overrun the page by a few values.
-_buffer.reserve(_options.data_page_size + 1024);
+RETURN_IF_CATCH_EXCEPTION(_buffer.reserve(_options.data_page_size +
1024));
return reset();
}
diff --git a/be/src/olap/rowset/segment_v2/segment_writer.cpp
b/be/src/olap/rowset/segment_v2/segment_writer.cpp
index 83e93631ab1..ec3bb9c993e 100644
--- a/be/src/olap/rowset/segment_v2/segment_writer.cpp
+++ b/be/src/olap/rowset/segment_v2/segment_writer.cpp
@@ -385,8 +385,8 @@ Status
SegmentWriter::append_block_with_partial_content(const vectorized::Block*
for (auto i : including_cids) {
full_block.replace_by_position(i,
block->get_by_position(input_id++).column);
}
-
_olap_data_convertor->set_source_content_with_specifid_columns(&full_block,
row_pos, num_rows,
-
including_cids);
+
RETURN_IF_ERROR(_olap_data_convertor->set_source_content_with_specifid_columns(
+&full_block, row_pos, num_rows, including_cids));
bool have_input_seq_column = false;
// write including columns
@@ -561,8 +561,8 @@ Status
SegmentWriter::append_block_with_partial_content(const vectorized::Block*
}
// convert missing columns and send to column writer
-
_olap_data_convertor->set_source_content_with_specifid_columns(&full_block,
row_pos, num_rows,
-
missing_cids);
+
RETURN_IF_ERROR(_olap_data_convertor->set_source_content_with_specifid_columns(
+&full_block, row_pos, num_rows, missing_cids));
for (auto cid : missing_cids) {
auto converted_result = _olap_data_convertor->convert_column_data(cid);
if (!converted_result.first.ok()) {
diff --git a/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp
b/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp
index 5d2ddedb204..48b892afc38 100644
--- a/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp
+++ b/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp
@@ -321,8 +321,8 @@ Status
VerticalSegmentWriter::_append_block_with_partial_content(RowsInBlock& da
for (auto i : including_cids) {
full_block.replace_by_position(i,
data.block->get_by_position(input_id++).column);
}
-
_olap_data_convertor->set_source_content_with_specifid_columns(&full_block,
data.row_pos,
-
data.num_rows, including_cids);
+
RETURN_IF_ERROR(_olap_data_convertor->set_source_content_with_specifid_columns(
+&full_block, data.row_pos, data.num_rows, including_cids));
bool have_input_seq_column = false;
// write including columns
@@ -497,8 +497,8 @@ Status
VerticalSegmentWriter::_append_block_with_partial_content(RowsInBlock& da
// convert missing columns and send to column writer
const auto& missing_cids =
_opts.rowset_ctx->partial_update_info->missing_cids;
-
_olap_data_convertor->set_source_content_with_specifid_columns(&full_block,
data.row_pos,
-
data.num_rows, missi
Re: [PR] [improvement](mtmv) Materialized view partition track supports date_trunc and optimize the fail reason [doris]
seawinde commented on PR #35562: URL: https://github.com/apache/doris/pull/35562#issuecomment-2143849451 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Materialized view partition track supports date_trunc and optimize the fail reason [doris]
seawinde commented on PR #35562: URL: https://github.com/apache/doris/pull/35562#issuecomment-2143850141 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](memory) find large memory allocation not catch exception [doris]
yiguolei commented on PR #35223: URL: https://github.com/apache/doris/pull/35223#issuecomment-2143851756 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](memory) find large memory allocation not catch exception [doris]
github-actions[bot] commented on PR #35223: URL: https://github.com/apache/doris/pull/35223#issuecomment-2143853497 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
doris-robot commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143854367 TPC-H: Total hot run time: 41496 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f8c9f717bc862925455f45b92a2dec6ef8ba4158, data reload: false -- Round 1 -- q1 17654 450742824282 q2 2027192 209 192 q3 10485 126811351135 q4 10215 742 785 742 q5 7577271327612713 q6 226 136 139 136 q7 980 635 612 612 q8 9233213821122112 q9 9276662666986626 q10 9173398139473947 q11 479 247 251 247 q12 571 237 230 230 q13 17687 329431453145 q14 274 229 228 228 q15 526 469 471 469 q16 529 408 389 389 q17 994 591 674 591 q18 8456790477757775 q19 6796126914801269 q20 654 315 326 315 q21 5085403240044004 q22 406 337 345 337 Total cold run time: 119303 ms Total hot run time: 41496 ms - Round 2, with runtime_filter_mode=off - q1 4577449144104410 q2 377 295 284 284 q3 3163292929412929 q4 2045172316231623 q5 5374555755065506 q6 227 128 131 128 q7 2189186417921792 q8 3263342033673367 q9 8681854086818540 q10 4104392038403840 q11 623 514 505 505 q12 783 586 617 586 q13 15823 305131953051 q14 302 280 288 280 q15 520 472 486 472 q16 489 448 440 440 q17 1811151214921492 q18 8168788775077507 q19 1756145815351458 q20 3026178617891786 q21 9682473747574737 q22 707 522 532 522 Total cold run time: 77690 ms Total hot run time: 55255 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
doris-robot commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143856279 TPC-H: Total hot run time: 41926 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bdf3e9e0a14cb1c38a143aab500c1cd6c94e2b9d, data reload: false -- Round 1 -- q1 17612 431542894289 q2 2034190 195 190 q3 10445 124111611161 q4 10190 877 832 832 q5 7530271627452716 q6 242 136 131 131 q7 976 636 613 613 q8 9212216821472147 q9 9387675667866756 q10 9750391038513851 q11 448 243 244 243 q12 474 238 227 227 q13 17235 319032793190 q14 285 238 230 230 q15 511 462 465 462 q16 493 388 384 384 q17 984 613 667 613 q18 8509796277937793 q19 6480147615421476 q20 658 326 327 326 q21 5219402839623962 q22 412 334 353 334 Total cold run time: 119086 ms Total hot run time: 41926 ms - Round 2, with runtime_filter_mode=off - q1 4621449544144414 q2 375 260 270 260 q3 3162295930132959 q4 1915167516701670 q5 549855475547 q6 218 123 123 123 q7 2215185518021802 q8 3255341433873387 q9 8629865087598650 q10 4146388837113711 q11 592 489 474 474 q12 771 616 658 616 q13 15884 321031463146 q14 308 274 274 274 q15 518 506 482 482 q16 480 440 424 424 q17 1826151215141512 q18 8134752473857385 q19 1793149415901494 q20 3031179418021794 q21 4895488446424642 q22 639 560 530 530 Total cold run time: 72905 ms Total hot run time: 55296 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
doris-robot commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143856458 TPC-H: Total hot run time: 40349 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3073ae37bd7d63317457da7a448fbc48ddcbdcd8, data reload: false -- Round 1 -- q1 18898 453444104410 q2 2646198 206 198 q3 11198 115012311150 q4 11106 822 909 822 q5 7831287326712671 q6 221 138 133 133 q7 970 585 586 585 q8 9205207321042073 q9 8918647364796473 q10 9017372637323726 q11 460 253 246 246 q12 405 233 223 223 q13 17846 298929752975 q14 279 224 219 219 q15 514 473 477 473 q16 527 387 387 387 q17 975 638 710 638 q18 8046758774337433 q19 7619157014831483 q20 690 316 314 314 q21 4941337939123379 q22 391 338 342 338 Total cold run time: 122703 ms Total hot run time: 40349 ms - Round 2, with runtime_filter_mode=off - q1 4379425642474247 q2 383 280 279 279 q3 3018273327512733 q4 1926163115881588 q5 5267532353215321 q6 215 128 128 128 q7 2144171217611712 q8 3241335833593358 q9 8418835483088308 q10 3913367236453645 q11 581 491 512 491 q12 761 611 601 601 q13 17732 296529652965 q14 291 275 257 257 q15 524 480 481 480 q16 506 422 429 422 q17 1790148015081480 q18 7604744475477444 q19 1704162716171617 q20 2001180517881788 q21 4943480847714771 q22 622 554 534 534 Total cold run time: 71963 ms Total hot run time: 54169 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
doris-robot commented on PR #31508: URL: https://github.com/apache/doris/pull/31508#issuecomment-2143859576 TPC-H: Total hot run time: 40957 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 65681967406b62fc80207583f8efb1fc51c1b9b3, data reload: false -- Round 1 -- q1 17625 431142684268 q2 2029190 196 190 q3 10452 112911831129 q4 10202 869 863 863 q5 7469272426402640 q6 221 133 140 133 q7 959 638 616 616 q8 9220212520682068 q9 9786670467546704 q10 9643388638073807 q11 447 241 245 241 q12 455 244 250 244 q13 17474 319932533199 q14 255 213 221 213 q15 517 465 464 464 q16 504 389 397 389 q17 970 681 580 580 q18 8404782978367829 q19 6696145015281450 q20 659 353 312 312 q21 5058327741113277 q22 400 344 341 341 Total cold run time: 119445 ms Total hot run time: 40957 ms - Round 2, with runtime_filter_mode=off - q1 4557440744654407 q2 369 261 271 261 q3 3157297329172917 q4 1953157816401578 q5 5418553054795479 q6 226 124 131 124 q7 2188184617461746 q8 3204334133623341 q9 8644861586868615 q10 4091382338203820 q11 636 484 503 484 q12 785 599 594 594 q13 15978 309232033092 q14 307 267 291 267 q15 520 491 472 472 q16 503 417 431 417 q17 1813153615261526 q18 7890766674537453 q19 1737153814941494 q20 3022178417651765 q21 4858479347154715 q22 812 548 547 547 Total cold run time: 72668 ms Total hot run time: 55114 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
doris-robot commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143859788 TPC-DS: Total hot run time: 171529 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit bdf3e9e0a14cb1c38a143aab500c1cd6c94e2b9d, data reload: false query1 927 374 376 374 query2 6453250025002500 query3 6641204 202 202 query4 19259 17362 17486 17362 query5 4129451 456 451 query6 247 163 156 156 query7 4591306 299 299 query8 294 288 285 285 query9 8643235123432343 query10 442 318 272 272 query11 10741 10138 99409940 query12 139 93 85 85 query13 1662371 368 368 query14 9342637476006374 query15 245 188 187 187 query16 7816267 275 267 query17 1736527 515 515 query18 1950265 271 265 query19 194 156 151 151 query20 91 91 84 84 query21 208 133 129 129 query22 4245396939943969 query23 33837 32934 33102 32934 query24 10883 282628242824 query25 610 345 359 345 query26 1205158 150 150 query27 3007347 326 326 query28 7365207020522052 query29 871 602 610 602 query30 278 150 148 148 query31 961 747 768 747 query32 91 50 56 50 query33 762 281 270 270 query34 990 471 467 467 query35 737 638 616 616 query36 1113969 942 942 query37 160 67 67 67 query38 2865277027252725 query39 888 785 791 785 query40 203 123 122 122 query41 59 52 51 51 query42 126 98 105 98 query43 583 534 553 534 query44 1238736 751 736 query45 196 163 170 163 query46 1078722 706 706 query47 1845173417761734 query48 381 301 301 301 query49 990 400 405 400 query50 770 379 382 379 query51 6797660966716609 query52 100 91 89 89 query53 356 286 283 283 query54 863 457 445 445 query55 77 73 71 71 query56 282 295 248 248 query57 1119105410751054 query58 262 231 263 231 query59 3332305731633057 query60 298 273 259 259 query61 91 88 85 85 query62 646 439 453 439 query63 328 289 289 289 query64 8917221117091709 query65 3205308531303085 query66 825 320 327 320 query67 15259 14824 14847 14824 query68 4491558 547 547 query69 468 328 312 312 query70 115211461146 query71 398 266 281 266 query72 7038551953945394 query73 737 321 325 321 query74 5972547254645464 query75 3292262326842623 query76 2516858 937 858 query77 496 289 286 286 query78 10343 984197469746 query79 1994512 511 511 query80 722 460 453 453 query81 587 227 214 214 query82 1179101 104 101 query83 182 162 162 162 query84 255 83 86 83 query85 1353264 265 264 query86 464 311 301 301 query87 3301310130853085 query88 4152242824212421 query89 485 382 397 382 query90 1901187 184 184 query91 124 97 95 95 query92 58 51 49 49 query93 2130528 510 510 query94 1233184 179 179 query95 406 308 314 308 query96 586 278 268 268 query97 3197305130343034 query98 213 201 195 195 query99 1265818 832 818 Total cold run time: 269493 ms Total hot run time: 171529 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [fix](ub) fix some ub error [doris]
doris-robot commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143859936 TPC-DS: Total hot run time: 170459 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3073ae37bd7d63317457da7a448fbc48ddcbdcd8, data reload: false query1 942 384 365 365 query2 6464247623092309 query3 6657206 212 206 query4 19516 17130 17255 17130 query5 4147442 443 442 query6 252 158 149 149 query7 4586314 299 299 query8 340 292 288 288 query9 8540237423592359 query10 451 298 274 274 query11 10708 10099 10144 10099 query12 138 93 88 88 query13 1652374 372 372 query14 10271 748773927392 query15 249 189 183 183 query16 7956262 258 258 query17 1845526 505 505 query18 2003270 270 270 query19 198 147 147 147 query20 91 86 85 85 query21 208 134 140 134 query22 4221421242364212 query23 33745 32861 33275 32861 query24 11912 286628092809 query25 623 358 364 358 query26 1691151 162 151 query27 2982313 330 313 query28 7521207020652065 query29 1032619 584 584 query30 289 152 151 151 query31 979 754 740 740 query32 93 52 53 52 query33 765 289 274 274 query34 983 476 487 476 query35 741 614 606 606 query36 1126972 958 958 query37 150 66 67 66 query38 2860272827452728 query39 846 796 783 783 query40 289 122 123 122 query41 53 51 53 51 query42 121 93 97 93 query43 614 557 549 549 query44 1209742 754 742 query45 200 160 172 160 query46 1079729 747 729 query47 1875175617861756 query48 360 296 296 296 query49 1143395 409 395 query50 786 382 390 382 query51 6833661466286614 query52 100 92 96 92 query53 355 282 279 279 query54 1042450 478 450 query55 70 70 73 70 query56 273 255 251 251 query57 1140105610131013 query58 258 250 249 249 query59 3554349034283428 query60 284 278 296 278 query61 92 84 86 84 query62 652 447 445 445 query63 318 285 286 285 query64 9926220617371737 query65 3158310830813081 query66 1357327 327 327 query67 15398 14877 14891 14877 query68 4594539 541 539 query69 454 306 309 306 query70 1127118310891089 query71 396 299 282 282 query72 7175536227582758 query73 744 322 325 322 query74 5970553955135513 query75 3372263326642633 query76 2698936 897 897 query77 431 291 292 291 query78 10360 988798319831 query79 2723515 503 503 query80 1134462 454 454 query81 577 222 222 222 query82 825 102 99 99 query83 233 171 170 170 query84 245 86 85 85 query85 1540280 256 256 query86 497 283 318 283 query87 3252310130893089 query88 4092244724422442 query89 537 384 387 384 query90 1753185 183 183 query91 119 100 96 96 query92 69 47 50 47 query93 1819520 504 504 query94 1249179 180 179 query95 401 304 311 304 query96 589 272 272 272 query97 3199305530043004 query98 238 232 211 211 query99 1281857 835 835 Total cold run time: 276005 ms Total hot run time: 170459 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [test](memory) find large memory allocation not catch exception [doris]
doris-robot commented on PR #35223: URL: https://github.com/apache/doris/pull/35223#issuecomment-2143860727 TPC-H: Total hot run time: 40111 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 0570f954375b0d96fa75f1cb2c7b913bc8a72e43, data reload: false -- Round 1 -- q1 17632 442042824282 q2 2024206 191 191 q3 10449 123711451145 q4 10157 800 826 800 q5 7467272426642664 q6 222 137 138 137 q7 959 608 600 600 q8 9211211320922092 q9 9115652564746474 q10 8997372837213721 q11 468 239 243 239 q12 461 226 228 226 q13 17789 299130052991 q14 278 215 225 215 q15 516 463 471 463 q16 503 384 386 384 q17 971 658 690 658 q18 8121751074667466 q19 1811144514521445 q20 644 299 303 299 q21 5014327740313277 q22 398 342 343 342 Total cold run time: 113207 ms Total hot run time: 40111 ms - Round 2, with runtime_filter_mode=off - q1 4358427142234223 q2 373 262 276 262 q3 3050279827792779 q4 1891162216001600 q5 5287531153095309 q6 220 132 134 132 q7 2159175017391739 q8 3198332733753327 q9 8378837883918378 q10 3891360536803605 q11 587 494 498 494 q12 757 582 606 582 q13 16508 301730403017 q14 284 282 277 277 q15 507 488 477 477 q16 474 421 422 421 q17 1780150914831483 q18 7571774274467446 q19 1813144214741442 q20 1976178617791779 q21 5126473949064739 q22 639 537 538 537 Total cold run time: 70827 ms Total hot run time: 54048 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
doris-robot commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143861463 ClickBench: Total hot run time: 30.61 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit bdf3e9e0a14cb1c38a143aab500c1cd6c94e2b9d, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.240.060.06 query4 1.650.080.08 query5 0.510.490.49 query6 1.120.730.72 query7 0.020.010.01 query8 0.050.040.05 query9 0.540.490.49 query10 0.550.560.54 query11 0.140.110.11 query12 0.140.120.12 query13 0.590.580.62 query14 0.770.760.78 query15 0.830.820.81 query16 0.370.380.37 query17 1.031.021.03 query18 0.240.230.25 query19 1.891.811.73 query20 0.010.010.01 query21 15.71 0.670.65 query22 4.286.781.87 query23 18.28 1.421.24 query24 2.110.220.21 query25 0.160.080.08 query26 0.250.170.17 query27 0.080.080.09 query28 13.25 1.011.00 query29 12.88 3.423.39 query30 0.240.050.05 query31 2.870.380.39 query32 3.280.470.46 query33 2.852.902.95 query34 17.17 4.424.40 query35 4.484.564.44 query36 0.680.510.48 query37 0.180.160.15 query38 0.160.140.15 query39 0.040.030.03 query40 0.170.140.14 query41 0.080.040.04 query42 0.050.050.04 query43 0.040.040.04 Total cold run time: 110.1 s Total hot run time: 30.61 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ub) fix some ub error [doris]
doris-robot commented on PR #35769: URL: https://github.com/apache/doris/pull/35769#issuecomment-2143861607 ClickBench: Total hot run time: 30.63 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3073ae37bd7d63317457da7a448fbc48ddcbdcd8, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.230.060.05 query4 1.680.090.10 query5 0.490.490.49 query6 1.120.730.73 query7 0.020.010.02 query8 0.050.040.04 query9 0.540.480.48 query10 0.540.550.55 query11 0.150.110.11 query12 0.140.110.11 query13 0.580.580.59 query14 0.780.780.78 query15 0.820.800.81 query16 0.380.370.36 query17 0.991.051.04 query18 0.230.250.24 query19 1.741.711.79 query20 0.020.010.01 query21 15.51 0.670.64 query22 4.516.131.97 query23 18.21 1.291.16 query24 1.520.290.24 query25 0.140.080.08 query26 0.250.170.17 query27 0.080.090.08 query28 13.43 1.021.00 query29 12.99 3.373.30 query30 0.240.050.06 query31 2.880.390.39 query32 3.270.480.48 query33 2.902.912.93 query34 17.28 4.454.40 query35 4.464.474.50 query36 0.650.470.46 query37 0.170.160.17 query38 0.160.150.14 query39 0.040.030.03 query40 0.170.140.13 query41 0.100.050.04 query42 0.060.050.06 query43 0.040.040.05 Total cold run time: 109.68 s Total hot run time: 30.63 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Materialized view partition track supports date_trunc and optimize the fail reason [doris]
doris-robot commented on PR #35562: URL: https://github.com/apache/doris/pull/35562#issuecomment-2143862154 TPC-H: Total hot run time: 40701 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e39b949193ffb9341f1398b6be280c3f55b46579, data reload: false -- Round 1 -- q1 17616 434542684268 q2 2024190 203 190 q3 10441 121611851185 q4 10203 794 762 762 q5 7468268525982598 q6 231 133 137 133 q7 981 613 607 607 q8 9213211620972097 q9 9390667167086671 q10 9649391439003900 q11 450 240 241 240 q12 521 246 221 221 q13 17247 319132403191 q14 268 223 243 223 q15 511 472 466 466 q16 523 394 377 377 q17 973 645 670 645 q18 8367783577467746 q19 6095125813631258 q20 654 326 338 326 q21 5173325342193253 q22 417 350 344 344 Total cold run time: 118415 ms Total hot run time: 40701 ms - Round 2, with runtime_filter_mode=off - q1 45334671 q2 382 286 276 276 q3 3152296428982898 q4 2015161316111611 q5 5365552454825482 q6 224 127 126 126 q7 2215184218551842 q8 3192335133853351 q9 8663863786578637 q10 4113383138263826 q11 590 489 477 477 q12 788 619 590 590 q13 16025 306731913067 q14 311 274 273 273 q15 525 476 483 476 q16 478 427 425 425 q17 1771146415111464 q18 8088796374417441 q19 1762166915091509 q20 3031181217661766 q21 8219468146964681 q22 778 535 543 535 Total cold run time: 76220 ms Total hot run time: 55197 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
doris-robot commented on PR #31508: URL: https://github.com/apache/doris/pull/31508#issuecomment-2143862822 TPC-DS: Total hot run time: 168692 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 65681967406b62fc80207583f8efb1fc51c1b9b3, data reload: false query1 921 371 362 362 query2 6451243922342234 query3 6648204 207 204 query4 19358 17303 17034 17034 query5 4122443 444 443 query6 250 155 152 152 query7 4582298 282 282 query8 337 279 280 279 query9 8497236623692366 query10 446 302 287 287 query11 10605 994599429942 query12 136 91 87 87 query13 1634369 366 366 query14 9400680676446806 query15 238 188 184 184 query16 7513269 267 267 query17 1293526 533 526 query18 1697270 265 265 query19 196 157 156 156 query20 93 86 88 86 query21 211 136 127 127 query22 4303403439213921 query23 33615 32878 33054 32878 query24 11101 277527902775 query25 613 364 365 364 query26 1371160 149 149 query27 2971329 321 321 query28 7386205120502050 query29 918 618 582 582 query30 278 148 151 148 query31 941 745 720 720 query32 93 54 56 54 query33 758 279 273 273 query34 977 483 460 460 query35 743 611 605 605 query36 1071928 928 928 query37 153 66 72 66 query38 2881278727022702 query39 835 797 782 782 query40 207 126 122 122 query41 52 53 53 53 query42 118 96 99 96 query43 577 561 554 554 query44 1195736 743 736 query45 197 168 170 168 query46 1059703 688 688 query47 1906174717761747 query48 380 298 304 298 query49 1000395 406 395 query50 778 382 374 374 query51 6898673868746738 query52 100 90 88 88 query53 351 282 289 282 query54 856 448 455 448 query55 77 73 74 73 query56 293 272 287 272 query57 1154102510481025 query58 256 273 278 273 query59 3462328430863086 query60 311 296 281 281 query61 137 86 87 86 query62 639 456 443 443 query63 319 280 285 280 query64 9859218017731773 query65 3167310530973097 query66 1373325 324 324 query67 15554 15161 14954 14954 query68 4594541 544 541 query69 546 450 393 393 query70 11841117 query71 409 285 281 281 query72 6989277025312531 query73 758 323 324 323 query74 5912552455205520 query75 263826322632 query76 2327905 892 892 query77 474 296 283 283 query78 10299 983796059605 query79 1623508 507 507 query80 1032459 502 459 query81 566 222 221 221 query82 1041103 101 101 query83 242 169 165 165 query84 259 87 82 82 query85 1285275 260 260 query86 453 294 327 294 query87 3299311430673067 query88 3359243624322432 query89 466 384 370 370 query90 1734181 188 181 query91 126 96 96 96 query92 67 47 49 47 query93 1780515 505 505 query94 1223189 187 187 query95 397 303 301 301 query96 591 276 280 276 query97 3171304229982998 query98 248 230 204 204 query99 1110840 848 840 Total cold run time: 268808 ms Total hot run time: 168692 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [regression] Add test checkpoint for the Show Procedure status and Show create procedure command [doris]
zy-kkk merged PR #35395: URL: https://github.com/apache/doris/pull/35395 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [regression](show stmt) Add test checkpoint for the Show Procedure status and Show create procedure command (#35395)
This is an automated email from the ASF dual-hosted git repository.
zykkk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 8cae0848d09 [regression](show stmt) Add test checkpoint for the Show
Procedure status and Show create procedure command (#35395)
8cae0848d09 is described below
commit 8cae0848d0967196cdef932bc01104a5f1b38a57
Author: Vallish Pai
AuthorDate: Sun Jun 2 19:26:00 2024 +0530
[regression](show stmt) Add test checkpoint for the Show Procedure status
and Show create procedure command (#35395)
improve regression check point for bug #35350
Added EmptySet checkpoint for SHOW PROCEDURE STATUS and SHOW CREATE
PROCEDURE commands.
If empty set return the result in groovy check point will be empty.
if return OK query, the result will contains [0]
added empty check for result for cases where both command return 0 rows.
---
.../suites/plsql_p0/test_plsql_show_procedure.groovy | 16
1 file changed, 16 insertions(+)
diff --git a/regression-test/suites/plsql_p0/test_plsql_show_procedure.groovy
b/regression-test/suites/plsql_p0/test_plsql_show_procedure.groovy
index 2202be9ee5c..830c06d5c9e 100644
--- a/regression-test/suites/plsql_p0/test_plsql_show_procedure.groovy
+++ b/regression-test/suites/plsql_p0/test_plsql_show_procedure.groovy
@@ -109,6 +109,22 @@ suite("test_plsql_show_procedure") {
sql """SHOW PROCEDURE STATUS where Db="${dbName}" and name =
"test_plsql_show_proc1";"""
sql """SHOW PROCEDURE STATUS where Db="${dbName}" and Name LIKE
"test_plsql_show_proc1";"""
sql """SHOW PROCEDURE STATUS where
procedureName="test_plsql_show_proc1";"""
+
+test {
+sql """SHOW PROCEDURE STATUS where
procedureName="not_exist_procedure";"""
+check { result, ex, startTime, endTime ->
+ assertTrue(result.isEmpty());
+}
+}
+
+test {
+sql """SHOW CREATE PROCEDURE not_exist_procedure;"""
+check { result, ex, startTime, endTime ->
+ assertTrue(result.isEmpty());
+}
+}
+
+
sql """DROP PROC test_plsql_show_proc1"""
sql """DROP PROC test_plsql_show_proc2"""
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](memory) find large memory allocation not catch exception [doris]
doris-robot commented on PR #35223: URL: https://github.com/apache/doris/pull/35223#issuecomment-2143864866 TPC-DS: Total hot run time: 171096 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 0570f954375b0d96fa75f1cb2c7b913bc8a72e43, data reload: false query1 934 382 381 381 query2 6450246422932293 query3 6649207 213 207 query4 19035 17456 17241 17241 query5 4191469 455 455 query6 299 168 158 158 query7 4595299 302 299 query8 321 283 287 283 query9 8516234623372337 query10 459 290 284 284 query11 10662 10196 10137 10137 query12 143 89 94 89 query13 1637363 368 363 query14 9484774978387749 query15 270 192 192 192 query16 8030271 267 267 query17 1842546 529 529 query18 2002281 318 281 query19 202 150 156 150 query20 93 82 86 82 query21 206 135 128 128 query22 4213416441054105 query23 33703 32935 33002 32935 query24 10728 286127912791 query25 561 360 365 360 query26 703 158 159 158 query27 2210333 326 326 query28 5962206020882060 query29 883 622 624 622 query30 292 148 147 147 query31 969 732 739 732 query32 99 53 54 53 query33 651 284 282 282 query34 905 477 470 470 query35 753 618 621 618 query36 1093945 933 933 query37 133 72 69 69 query38 2878276827552755 query39 857 791 771 771 query40 205 124 126 124 query41 54 52 50 50 query42 126 96 102 96 query43 600 548 536 536 query44 1094741 748 741 query45 198 176 167 167 query46 1079735 752 735 query47 1836178517601760 query48 382 319 302 302 query49 1041398 416 398 query50 799 388 399 388 query51 6895670467056704 query52 102 92 91 91 query53 359 283 285 283 query54 836 494 444 444 query55 74 72 72 72 query56 272 253 262 253 query57 1117102910511029 query58 262 257 246 246 query59 3450324831903190 query60 293 274 275 274 query61 92 88 96 88 query62 643 463 445 445 query63 328 293 293 293 query64 8574221317901790 query65 3211311631093109 query66 825 331 331 331 query67 15397 15442 14970 14970 query68 4552554 548 548 query69 458 321 298 298 query70 1148111211371112 query71 376 290 280 280 query72 7163532327092709 query73 789 327 325 325 query74 6040553454425442 query75 3353267427272674 query76 2351955 923 923 query77 456 296 288 288 query78 10199 996597349734 query79 2544508 512 508 query80 1097476 510 476 query81 590 226 221 221 query82 754 103 102 102 query83 230 170 170 170 query84 247 117 89 89 query85 1880271 268 268 query86 501 319 289 289 query87 309630813081 query88 4075245524492449 query89 469 394 390 390 query90 1767194 192 192 query91 125 98 97 97 query92 60 49 47 47 query93 2302512 508 508 query94 1176195 194 194 query95 404 318 309 309 query96 609 272 274 272 query97 3244304030503040 query98 235 227 214 214 query99 1408850 846 846 Total cold run time: 267692 ms Total hot run time: 171096 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
doris-robot commented on PR #31508: URL: https://github.com/apache/doris/pull/31508#issuecomment-2143865470 ClickBench: Total hot run time: 30.33 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 65681967406b62fc80207583f8efb1fc51c1b9b3, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.230.050.05 query4 1.680.070.07 query5 0.510.470.49 query6 1.130.710.72 query7 0.020.010.02 query8 0.050.040.04 query9 0.540.480.48 query10 0.540.550.53 query11 0.160.110.11 query12 0.140.110.11 query13 0.590.580.60 query14 0.800.770.77 query15 0.830.800.80 query16 0.370.350.37 query17 0.970.941.00 query18 0.200.230.22 query19 1.801.721.74 query20 0.020.010.01 query21 15.63 0.660.64 query22 3.846.751.85 query23 18.36 1.421.31 query24 1.310.360.25 query25 0.160.090.09 query26 0.260.180.17 query27 0.080.070.08 query28 13.47 1.010.99 query29 13.74 3.283.24 query30 0.240.060.05 query31 2.860.380.38 query32 3.300.470.47 query33 2.912.822.95 query34 17.08 4.424.41 query35 4.494.494.54 query36 0.680.470.47 query37 0.170.150.15 query38 0.150.150.15 query39 0.040.040.04 query40 0.160.140.14 query41 0.100.050.04 query42 0.060.040.05 query43 0.040.040.04 Total cold run time: 109.83 s Total hot run time: 30.33 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](memory) find large memory allocation not catch exception [doris]
doris-robot commented on PR #35223: URL: https://github.com/apache/doris/pull/35223#issuecomment-2143866821 ClickBench: Total hot run time: 30.75 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0570f954375b0d96fa75f1cb2c7b913bc8a72e43, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.230.040.05 query4 1.680.070.08 query5 0.510.490.49 query6 1.130.720.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.540.470.50 query10 0.520.550.54 query11 0.170.120.12 query12 0.140.120.12 query13 0.600.590.60 query14 0.780.770.78 query15 0.830.820.80 query16 0.360.360.37 query17 1.041.050.98 query18 0.230.230.25 query19 1.941.851.75 query20 0.020.010.02 query21 15.73 0.660.67 query22 4.507.052.07 query23 18.27 1.371.30 query24 1.690.290.20 query25 0.140.080.08 query26 0.270.170.17 query27 0.080.080.08 query28 13.39 1.020.99 query29 15.37 3.323.27 query30 0.240.060.06 query31 2.860.370.38 query32 3.290.480.46 query33 2.922.902.93 query34 17.21 4.464.45 query35 4.484.464.66 query36 0.650.460.48 query37 0.180.160.16 query38 0.160.150.15 query39 0.050.040.03 query40 0.160.130.14 query41 0.090.050.04 query42 0.060.050.05 query43 0.040.040.03 Total cold run time: 112.74 s Total hot run time: 30.75 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
doris-robot commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143867161 TeamCity be ut coverage result: Function Coverage: 36.28% (9234/25454) Line Coverage: 27.61% (75703/274161) Region Coverage: 26.83% (39188/146078) Branch Coverage: 23.55% (19858/84322) Coverage Report: http://coverage.selectdb-in.cc/coverage/f8c9f717bc862925455f45b92a2dec6ef8ba4158_f8c9f717bc862925455f45b92a2dec6ef8ba4158/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support generated column [doris]
feiniaofeiafei commented on PR #35284: URL: https://github.com/apache/doris/pull/35284#issuecomment-2143877480 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
doris-robot commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143880418 TPC-H: Total hot run time: 40613 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f8c9f717bc862925455f45b92a2dec6ef8ba4158, data reload: false -- Round 1 -- q1 17660 493742454245 q2 2042196 192 192 q3 10458 119510701070 q4 10176 765 736 736 q5 8159271327002700 q6 227 139 137 137 q7 972 617 612 612 q8 9591210121232101 q9 8943651365136513 q10 9090371636653665 q11 452 238 237 237 q12 518 231 229 229 q13 17765 297329662966 q14 267 220 230 220 q15 521 489 469 469 q16 525 377 376 376 q17 962 711 731 711 q18 8160758874437443 q19 1832142514381425 q20 651 305 298 298 q21 5005396539343934 q22 407 359 334 334 Total cold run time: 114383 ms Total hot run time: 40613 ms - Round 2, with runtime_filter_mode=off - q1 4355420742354207 q2 384 261 278 261 q3 2977278027382738 q4 1878158016091580 q5 5269530952815281 q6 215 127 123 123 q7 2088170716991699 q8 3236331433193314 q9 8333828483458284 q10 3852368736493649 q11 599 485 481 481 q12 754 582 580 580 q13 17406 300629702970 q14 312 251 281 251 q15 510 485 484 484 q16 478 426 415 415 q17 1767147614641464 q18 7547747373297329 q19 1686157516801575 q20 2017182517901790 q21 4826475746444644 q22 616 546 520 520 Total cold run time: 71105 ms Total hot run time: 53639 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
doris-robot commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143885560 TPC-DS: Total hot run time: 170167 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit f8c9f717bc862925455f45b92a2dec6ef8ba4158, data reload: false query1 922 387 373 373 query2 6454236223942362 query3 6647206 209 206 query4 19530 17426 17150 17150 query5 4158453 448 448 query6 268 160 163 160 query7 4586303 291 291 query8 326 281 295 281 query9 8487237023282328 query10 458 302 282 282 query11 10586 998810065 9988 query12 139 92 87 87 query13 1654379 390 379 query14 10206 764775917591 query15 263 204 186 186 query16 7860262 259 259 query17 1857526 507 507 query18 1960272 273 272 query19 185 164 154 154 query20 93 102 82 82 query21 216 131 128 128 query22 4319410942374109 query23 33802 33210 33028 33028 query24 11718 285828232823 query25 624 379 355 355 query26 1648159 156 156 query27 2954319 316 316 query28 7595204020402040 query29 984 602 609 602 query30 277 148 153 148 query31 989 756 713 713 query32 97 52 55 52 query33 758 284 280 280 query34 963 495 469 469 query35 732 606 645 606 query36 1115925 921 921 query37 152 69 69 69 query38 2871273127282728 query39 865 775 797 775 query40 287 124 126 124 query41 53 51 54 51 query42 114 98 98 98 query43 606 558 524 524 query44 1278735 750 735 query45 195 170 170 170 query46 1078725 718 718 query47 1864177617971776 query48 382 297 300 297 query49 1144393 412 393 query50 771 387 395 387 query51 6814671767806717 query52 101 100 86 86 query53 380 285 298 285 query54 870 450 432 432 query55 71 73 73 73 query56 276 291 256 256 query57 1170106310531053 query58 264 243 241 241 query59 3421325030323032 query60 292 262 278 262 query61 88 88 86 86 query62 647 448 437 437 query63 321 285 284 284 query64 9861226617201720 query65 3165309931263099 query66 1363324 327 324 query67 15447 14842 14899 14842 query68 4590547 539 539 query69 461 303 299 299 query70 1221108710771077 query71 404 279 282 279 query72 7138577026892689 query73 756 333 320 320 query74 5971560054375437 query75 3482271226692669 query76 2834867 959 867 query77 438 296 290 290 query78 10277 10066 97189718 query79 1947516 507 507 query80 1101456 456 456 query81 546 235 220 220 query82 1030103 101 101 query83 231 168 164 164 query84 248 91 93 91 query85 1338298 256 256 query86 455 317 321 317 query87 3284311331043104 query88 3095244224482442 query89 465 388 384 384 query90 1754195 194 194 query91 134 109 108 108 query92 72 54 50 50 query93 1959520 508 508 query94 1234194 194 194 query95 418 318 388 318 query96 592 275 270 270 query97 3202303130533031 query98 250 229 215 215 query99 1271847 848 847 Total cold run time: 273839 ms Total hot run time: 170167 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
doris-robot commented on PR #35642: URL: https://github.com/apache/doris/pull/35642#issuecomment-2143887326 ClickBench: Total hot run time: 30.4 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit f8c9f717bc862925455f45b92a2dec6ef8ba4158, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.680.070.07 query5 0.520.480.48 query6 1.130.730.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.540.510.49 query10 0.520.540.54 query11 0.150.110.11 query12 0.150.120.11 query13 0.590.590.59 query14 0.770.770.80 query15 0.840.810.81 query16 0.360.360.36 query17 1.051.071.02 query18 0.210.230.25 query19 1.881.771.73 query20 0.020.010.01 query21 15.82 0.680.66 query22 4.417.361.71 query23 18.30 1.441.27 query24 1.400.230.29 query25 0.130.080.07 query26 0.260.170.17 query27 0.080.080.07 query28 13.62 1.011.01 query29 12.95 3.273.25 query30 0.240.050.06 query31 2.890.400.38 query32 3.260.480.48 query33 2.862.892.92 query34 16.88 4.414.42 query35 4.494.494.52 query36 0.660.480.46 query37 0.170.160.15 query38 0.160.150.14 query39 0.040.030.04 query40 0.170.140.14 query41 0.090.050.04 query42 0.060.050.04 query43 0.040.040.04 Total cold run time: 109.81 s Total hot run time: 30.4 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
liaoxin01 opened a new pull request, #35770: URL: https://github.com/apache/doris/pull/35770 ## Proposed changes Issue Number: close #xxx when send large data by rpc，load will report the follow error: ``` add batch req success but status isn't ok, err: [INTERNAL_ERROR]PStatus: (172.200.0.1)[INTERNAL_ERROR]fail to add batch in load channel. unknown load_id=-. ``` The maximum length of protobuf is 2GB. When it exceeds 2GB, we will use the brpc HTTP method. However, the block data was not removed during encoding, resulting in protobuf exceeding the length and encoding failure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
doris-robot commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143891048 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] Doris2.1.2 be内存占用过高 [doris]
kingsylin commented on issue #34631: URL: https://github.com/apache/doris/issues/34631#issuecomment-2143891537 I have same problem and i will follow it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] Memory Leak in BE (2.1.1) [doris]
kingsylin commented on issue #34168: URL: https://github.com/apache/doris/issues/34168#issuecomment-2143892635 > @yiguolei I have the same issue. version: 2.1.2 me too -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] be oom [doris]
kingsylin commented on issue #34011: URL: https://github.com/apache/doris/issues/34011#issuecomment-2143893041 I have same problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
github-actions[bot] commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143893343 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
liaoxin01 commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143893374 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
github-actions[bot] commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143893493 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] doris稳定复现BE内存泄露 [doris]
kingsylin commented on issue #34164: URL: https://github.com/apache/doris/issues/34164#issuecomment-2143893553 > 确定是2.1.0版本的问题，问题已修复在2.1.2版本 Are you sure the problem have been resovled -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
github-actions[bot] commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143894623 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] Suspected BE memory leak [doris]
kingsylin commented on issue #11152: URL: https://github.com/apache/doris/issues/11152#issuecomment-2143895100 I have the same problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [branch-2.0][feature](tvf) support query table value function [doris]
zy-kkk opened a new pull request, #35771:
URL: https://github.com/apache/doris/pull/35771
## Proposed changes
pick #34516,#34779
This PR supports a Table Value Function called `Query`. He can push a query
directly to the catalog source for execution by specifying `catalog` and
`query` without parsing by Doris. Doris only receives the results returned by
the query. Currently only JDBC Catalog is supported.
Example:
```
Doris > desc function query('catalog' = 'mysql','query' = 'select count(*)
as cnt from test.test');
+---++--+--+-+---+
| Field | Type | Null | Key | Default | Extra |
+---++--+--+-+---+
| cnt | BIGINT | Yes | true | NULL| NONE |
+---++--+--+-+---+
Doris > select * from query('catalog' = 'mysql','query' = 'select count(*)
as cnt from test.test');
+--+
| cnt |
+--+
| 3000 |
+--+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
zy-kkk commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143898019 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
Mryange commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143898364 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
doris-robot commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143897998 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
zy-kkk commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2143898582 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC [doris]
zy-kkk commented on PR #35692: URL: https://github.com/apache/doris/pull/35692#issuecomment-2143898658 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
github-actions[bot] commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2143900436 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](rpc) fix transfer large data and enable transfer_large_data_by_brpc by default [doris]
doris-robot commented on PR #35770: URL: https://github.com/apache/doris/pull/35770#issuecomment-2143904447 TeamCity be ut coverage result: Function Coverage: 36.27% (9235/25460) Line Coverage: 27.61% (75717/274205) Region Coverage: 26.84% (39221/146151) Branch Coverage: 23.55% (19866/84346) Coverage Report: http://coverage.selectdb-in.cc/coverage/04496888e6dcc4fd26bb15954439312c2c14ec93_04496888e6dcc4fd26bb15954439312c2c14ec93/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
doris-robot commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143910605 TPC-H: Total hot run time: 49454 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c8e0274eef97270afb0bb93b813d1bb7a5666264, data reload: false -- Round 1 -- q1 18121 432742994299 q2 2071158 148 148 q3 10351 187619081876 q4 10389 122713051227 q5 8668383338593833 q6 232 125 141 125 q7 2032159815901590 q8 9253271026982698 q9 10728 10382 10291 10291 q10 8646351535153515 q11 424 248 252 248 q12 464 295 299 295 q13 18346 394339893943 q14 352 329 328 328 q15 509 462 453 453 q16 670 567 569 567 q17 1130984 939 939 q18 7273675968006759 q19 1700155115631551 q20 523 318 293 293 q21 4416408040904080 q22 497 398 396 396 Total cold run time: 116795 ms Total hot run time: 49454 ms - Round 2, with runtime_filter_mode=off - q1 4282428443184284 q2 324 227 225 225 q3 4153415941324132 q4 2719272227352722 q5 7204707469856985 q6 237 122 119 119 q7 3238278428742784 q8 4329443544504435 q9 16755 16751 16760 16751 q10 4208428742544254 q11 770 708 690 690 q12 1041859 864 859 q13 7241375337423742 q14 465 428 418 418 q15 522 460 458 458 q16 730 676 671 671 q17 3842375738593757 q18 8887863086918630 q19 1698171816861686 q20 2393213020762076 q21 8462838585368385 q22 1019928 918 918 Total cold run time: 84519 ms Total hot run time: 78981 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
github-actions[bot] commented on PR #31508: URL: https://github.com/apache/doris/pull/31508#issuecomment-2143915986 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Scanner](revert) revert the scanner change by apache#35604 [doris]
HappenLee merged PR #31508: URL: https://github.com/apache/doris/pull/31508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Scanner](revert) revert the scanner change by apache#35604 (#31508)
This is an automated email from the ASF dual-hosted git repository.
lihaopeng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ae50d7a614a [Scanner](revert) revert the scanner change by
apache#35604 (#31508)
ae50d7a614a is described below
commit ae50d7a614a8c62b47aea59340054676be62cdf2
Author: HappenLee
AuthorDate: Mon Jun 3 00:07:07 2024 +0800
[Scanner](revert) revert the scanner change by apache#35604 (#31508)
---
be/src/vec/exec/scan/scanner_context.cpp | 29 +++--
1 file changed, 15 insertions(+), 14 deletions(-)
diff --git a/be/src/vec/exec/scan/scanner_context.cpp
b/be/src/vec/exec/scan/scanner_context.cpp
index fd570c99a68..813643978d0 100644
--- a/be/src/vec/exec/scan/scanner_context.cpp
+++ b/be/src/vec/exec/scan/scanner_context.cpp
@@ -296,12 +296,12 @@ Status ScannerContext::get_block_from_queue(RuntimeState*
state, vectorized::Blo
// `_free_blocks` serve all running scanners, maybe it's
too large for the remaining scanners
int free_blocks_for_each = _free_blocks.size_approx() /
_num_running_scanners;
_num_running_scanners--;
-std::vector
blocks(free_blocks_for_each);
-free_blocks_for_each =
-_free_blocks.try_dequeue_bulk(blocks.data(),
free_blocks_for_each);
for (int i = 0; i < free_blocks_for_each; ++i) {
-_free_blocks_memory_usage -=
blocks[i]->allocated_bytes();
-
_free_blocks_memory_usage_mark->set(_free_blocks_memory_usage);
+vectorized::BlockUPtr removed_block;
+if (_free_blocks.try_dequeue(removed_block)) {
+_free_blocks_memory_usage -=
block->allocated_bytes();
+
_free_blocks_memory_usage_mark->set(_free_blocks_memory_usage);
+}
}
}
} else {
@@ -350,16 +350,17 @@ void ScannerContext::_try_to_scale_up() {
(_max_bytes_in_queue - _free_blocks_memory_usage) /
_estimated_block_size;
num_add = std::min(num_add, most_add);
}
-std::vector> scale_up_scanners(num_add);
-// get enough memory to launch one more scanner.
-if (auto real_size =
_scanners.try_dequeue_bulk(scale_up_scanners.data(), num_add);
-real_size) {
-for (int i = 0; i < real_size; ++i) {
-
submit_scan_task(std::make_shared(scale_up_scanners[i]));
+for (int i = 0; i < num_add; ++i) {
+// get enough memory to launch one more scanner.
+std::weak_ptr scale_up_scanner;
+if (_scanners.try_dequeue(scale_up_scanner)) {
+submit_scan_task(std::make_shared(scale_up_scanner));
+_num_running_scanners++;
+_scale_up_scanners_counter->update(1);
+is_scale_up = true;
+} else {
+break;
}
-_num_running_scanners += real_size;
-_scale_up_scanners_counter->update(real_size);
-is_scale_up = true;
}
if (is_scale_up) {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
doris-robot commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143916360 TPC-DS: Total hot run time: 203210 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit c8e0274eef97270afb0bb93b813d1bb7a5666264, data reload: false query1 925 383 410 383 query2 6532284625882588 query3 6922208 207 207 query4 21437 18007 18029 18007 query5 19731 647965186479 query6 272 222 236 222 query7 4150317 313 313 query8 266 246 253 246 query9 3174271626622662 query10 411 304 308 304 query11 11243 10630 10642 10630 query12 119 81 73 73 query13 5585682 673 673 query14 17701 13250 13669 13250 query15 351 217 237 217 query16 6461292 265 265 query17 17341444901 901 query18 2292428 423 423 query19 210 156 152 152 query20 82 78 82 78 query21 188 97 89 89 query22 5297493349294929 query23 32743 31852 31827 31827 query24 6992653864876487 query25 545 421 416 416 query26 526 168 162 162 query27 1874304 297 297 query28 6146233023222322 query29 2865275228352752 query30 238 164 169 164 query31 909 730 773 730 query32 68 66 61 61 query33 401 272 255 255 query34 831 478 483 478 query35 1129916 934 916 query36 1441114812581148 query37 94 60 61 60 query38 3040288428952884 query39 1384133613331333 query40 202 94 91 91 query41 48 38 36 36 query42 90 84 84 84 query43 801 743 725 725 query44 1159716 710 710 query45 241 232 231 231 query46 1227960 996 960 query47 1960181917601760 query48 1021750 726 726 query49 631 369 386 369 query50 866 639 610 610 query51 4720472347864723 query52 94 74 79 74 query53 450 326 322 322 query54 2674245724802457 query55 88 89 82 82 query56 241 234 192 192 query57 1151112510511051 query58 210 208 209 208 query59 4181380239503802 query60 225 197 220 197 query61 96 92 94 92 query62 888 484 475 475 query63 492 334 353 334 query64 2494156614851485 query65 3657357935483548 query66 762 375 375 375 query67 16383 17266 15353 15353 query68 8447662 657 657 query69 569 346 350 346 query70 1893140614081406 query71 408 302 318 302 query72 6508350634573457 query73 735 332 328 328 query74 6291584458705844 query75 4718365037263650 query76 4852117111891171 query77 671 251 252 251 query78 12568 12018 11661 11661 query79 8866641 651 641 query80 1161395 401 395 query81 495 235 230 230 query82 1550102 96 96 query83 176 130 133 130 query84 262 71 70 70 query85 884 308 315 308 query86 339 294 295 294 query87 3182298830282988 query88 5179233823192319 query89 390 302 293 293 query90 1911220 196 196 query91 185 138 142 138 query92 60 55 50 50 query93 5293583 587 583 query94 767 205 215 205 query95 1107107410761074 query96 651 327 328 327 query97 6461637863756375 query98 187 187 177 177 query99 2834793 867 793 Total cold run time: 312961 ms Total hot run time: 203210 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
doris-robot commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143918590 ClickBench: Total hot run time: 30.65 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c8e0274eef97270afb0bb93b813d1bb7a5666264, data reload: false query1 0.020.020.02 query2 0.070.030.02 query3 0.250.040.04 query4 1.800.060.06 query5 0.540.520.50 query6 1.230.610.61 query7 0.020.010.01 query8 0.030.020.03 query9 0.530.480.48 query10 0.530.540.54 query11 0.120.090.09 query12 0.110.100.09 query13 0.630.610.60 query14 0.780.790.78 query15 0.770.760.76 query16 0.380.370.35 query17 0.991.011.02 query18 0.200.260.22 query19 1.921.841.82 query20 0.010.020.01 query21 15.46 0.550.54 query22 1.972.311.83 query23 17.06 0.980.97 query24 8.040.731.31 query25 0.370.140.04 query26 0.880.150.14 query27 0.050.030.04 query28 5.150.750.74 query29 12.66 2.382.34 query30 0.590.530.53 query31 2.790.380.37 query32 3.390.510.49 query33 3.063.053.07 query34 15.26 4.784.79 query35 4.844.814.84 query36 1.041.001.03 query37 0.060.050.04 query38 0.040.020.02 query39 0.020.010.01 query40 0.160.130.15 query41 0.060.020.01 query42 0.020.020.01 query43 0.020.010.02 Total cold run time: 103.92 s Total hot run time: 30.65 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC [doris]
doris-robot commented on PR #35692: URL: https://github.com/apache/doris/pull/35692#issuecomment-2143918613 TPC-H: Total hot run time: 40561 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 86ff59813622fb9c4b2996f2305f98dd8845a479, data reload: false -- Round 1 -- q1 17617 432342604260 q2 2028196 190 190 q3 10461 110311791103 q4 10200 848 697 697 q5 7496273227172717 q6 223 149 141 141 q7 960 619 618 618 q8 9229209621142096 q9 9381667967126679 q10 9569383738623837 q11 446 238 242 238 q12 495 225 237 225 q13 18607 319631043104 q14 262 216 236 216 q15 525 478 482 478 q16 504 393 403 393 q17 985 553 692 553 q18 8308773577237723 q19 5471127214301272 q20 644 333 309 309 q21 5067338341723383 q22 393 335 329 329 Total cold run time: 118871 ms Total hot run time: 40561 ms - Round 2, with runtime_filter_mode=off - q1 4547445344734453 q2 372 265 268 265 q3 3083295829622958 q4 1980159216461592 q5 5365549254865486 q6 223 130 129 129 q7 2163182417831783 q8 3206333133363331 q9 8647855486298554 q10 4105383239183832 q11 588 491 482 482 q12 780 620 581 581 q13 15761 312831613128 q14 300 278 261 261 q15 515 494 480 480 q16 474 426 438 426 q17 1809153014951495 q18 8140762074737473 q19 1751163514591459 q20 3050179917911791 q21 9977476046244624 q22 625 539 540 539 Total cold run time: 77461 ms Total hot run time: 55122 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0][feature](tvf) support query table value function [doris]
doris-robot commented on PR #35771: URL: https://github.com/apache/doris/pull/35771#issuecomment-2143920707 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit c8e0274eef97270afb0bb93b813d1bb7a5666264 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s Insert into select: 21.5 seconds inserted 1000 Rows, about 465K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC [doris]
doris-robot commented on PR #35692: URL: https://github.com/apache/doris/pull/35692#issuecomment-2143923053 TPC-DS: Total hot run time: 172694 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 86ff59813622fb9c4b2996f2305f98dd8845a479, data reload: false query1 918 389 372 372 query2 6457233224162332 query3 6639204 209 204 query4 20399 17388 17307 17307 query5 4158439 439 439 query6 257 153 153 153 query7 4580309 299 299 query8 319 269 275 269 query9 8406238423502350 query10 465 286 275 275 query11 10539 996010158 9960 query12 132 87 91 87 query13 1629369 361 361 query14 9526750276227502 query15 229 186 179 179 query16 7826270 272 270 query17 1563536 513 513 query18 1947279 271 271 query19 204 152 151 151 query20 92 86 86 86 query21 212 133 127 127 query22 4351409039803980 query23 33641 32934 33052 32934 query24 10991 280728482807 query25 594 348 366 348 query26 1173155 157 155 query27 2969312 316 312 query28 7545203720402037 query29 882 636 603 603 query30 270 146 149 146 query31 955 758 728 728 query32 92 51 56 51 query33 764 288 272 272 query34 962 472 463 463 query35 737 618 609 609 query36 1079938 912 912 query37 166 69 72 69 query38 2857278627322732 query39 877 787 801 787 query40 210 130 125 125 query41 55 46 50 46 query42 116 95 97 95 query43 576 538 540 538 query44 1200745 763 745 query45 209 162 163 162 query46 1086712 700 700 query47 1873175717861757 query48 368 302 305 302 query49 1021427 429 427 query50 776 405 401 401 query51 6924673267166716 query52 103 94 93 93 query53 358 303 295 295 query54 885 461 463 461 query55 77 73 75 73 query56 300 280 285 280 query57 1107102210831022 query58 267 258 279 258 query59 3330308130353035 query60 315 297 310 297 query61 110 108 107 107 query62 648 439 438 438 query63 386 285 298 285 query64 8912219117621762 query65 3205307631263076 query66 898 324 345 324 query67 15407 14917 14835 14835 query68 4607546 558 546 query69 553 440 380 380 query70 1077103610911036 query71 441 283 279 279 query72 7584558352465246 query73 766 330 325 325 query74 59775576 query75 3362264226052605 query76 2246869 873 869 query77 469 294 287 287 query78 10279 992897689768 query79 2780516 509 509 query80 2262482 462 462 query81 569 222 216 216 query82 797 108 106 106 query83 308 185 171 171 query84 263 91 87 87 query85 1525273 274 273 query86 433 306 329 306 query87 3276308730683068 query88 3700244224222422 query89 479 392 383 383 query90 1823193 194 193 query91 129 100 97 97 query92 67 53 50 50 query93 2566526 522 522 query94 1172187 187 187 query95 397 332 369 332 query96 598 268 266 266 query97 3226299630432996 query98 245 212 212 212 query99 1206837 833 833 Total cold run time: 273306 ms Total hot run time: 172694 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [improvement](jdbc catalog) Change JdbcExecutor's error reporting from UDF to JDBC [doris]
doris-robot commented on PR #35692: URL: https://github.com/apache/doris/pull/35692#issuecomment-2143924573 ClickBench: Total hot run time: 30.3 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 86ff59813622fb9c4b2996f2305f98dd8845a479, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.230.050.04 query4 1.690.070.07 query5 0.500.490.49 query6 1.140.720.73 query7 0.020.020.01 query8 0.050.040.04 query9 0.530.490.49 query10 0.560.560.53 query11 0.140.110.12 query12 0.140.110.12 query13 0.610.600.60 query14 0.810.770.79 query15 0.830.800.81 query16 0.400.360.34 query17 1.050.961.03 query18 0.230.220.28 query19 1.831.681.68 query20 0.020.010.01 query21 15.66 0.670.67 query22 4.547.191.72 query23 18.38 1.381.24 query24 1.610.240.30 query25 0.140.090.09 query26 0.270.180.17 query27 0.080.080.08 query28 13.35 1.021.00 query29 13.37 3.353.28 query30 0.260.050.05 query31 2.880.390.38 query32 3.280.460.47 query33 2.912.902.91 query34 17.04 4.454.42 query35 4.564.454.59 query36 0.690.490.49 query37 0.180.150.16 query38 0.150.140.15 query39 0.040.040.04 query40 0.160.140.15 query41 0.080.060.05 query42 0.060.050.05 query43 0.040.030.03 Total cold run time: 110.63 s Total hot run time: 30.3 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](exec) Support group by limit opt in BE code [doris]
doris-robot commented on PR #29641: URL: https://github.com/apache/doris/pull/29641#issuecomment-2143943437 TPC-H: Total hot run time: 40449 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 751bf0d718fb2be5a5747b2091289e44801ff540, data reload: false -- Round 1 -- q1 17634 500443164316 q2 2029212 202 202 q3 10474 120511091109 q4 10174 843 871 843 q5 7485274727332733 q6 225 134 133 133 q7 1004612 609 609 q8 9281209921262099 q9 9553668466716671 q10 9188398538843884 q11 480 237 238 237 q12 425 225 220 220 q13 17751 297929742974 q14 279 202 217 202 q15 501 465 455 455 q16 517 386 374 374 q17 977 650 667 650 q18 8210750075697500 q19 2428147014461446 q20 665 310 304 304 q21 4965315732663157 q22 389 334 331 331 Total cold run time: 114634 ms Total hot run time: 40449 ms - Round 2, with runtime_filter_mode=off - q1 4347422042134213 q2 364 260 273 260 q3 3001276827122712 q4 1875160116291601 q5 5298529653325296 q6 214 124 124 124 q7 2122176117491749 q8 3159330033443300 q9 8388834983728349 q10 3853368236713671 q11 608 503 494 494 q12 758 595 657 595 q13 17482 296530392965 q14 301 253 246 246 q15 514 481 478 478 q16 470 406 418 406 q17 1786152614611461 q18 7602756773647364 q19 1713149415851494 q20 1983180117961796 q21 4942462246704622 q22 619 533 530 530 Total cold run time: 71399 ms Total hot run time: 53726 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](docs) Update upgrade.md file add mysql_ssl_default_certificate f… [doris]
github-actions[bot] commented on PR #28018: URL: https://github.com/apache/doris/pull/28018#issuecomment-2144072238 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](log) add config for storage to reduce stacktrace log on fe [doris]
github-actions[bot] commented on PR #27061: URL: https://github.com/apache/doris/pull/27061#issuecomment-2144072251 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](spill) support spill to disk for pipeline engine [doris]
github-actions[bot] commented on PR #21052: URL: https://github.com/apache/doris/pull/21052#issuecomment-2144072269 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [FIX](MemoryScratchSink) fix issue spark read datev2 and datetimev2 with filter [doris]
github-actions[bot] closed pull request #27970: [FIX](MemoryScratchSink) fix issue spark read datev2 and datetimev2 with filter URL: https://github.com/apache/doris/pull/27970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
Mryange commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2144078755 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
doris-robot commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2144099601 TPC-H: Total hot run time: 40852 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 68da8b3f9a5f675441658db45d2792f787f84f98, data reload: false -- Round 1 -- q1 17628 439442654265 q2 2036203 192 192 q3 10443 128910961096 q4 10189 881 768 768 q5 7509272427592724 q6 220 138 144 138 q7 982 633 627 627 q8 9230211520732073 q9 9234670367346703 q10 9177391139483911 q11 442 251 249 249 q12 428 235 240 235 q13 17273 321732553217 q14 267 227 234 227 q15 544 467 480 467 q16 492 378 381 378 q17 970 517 643 517 q18 8311782678827826 q19 7322121215081212 q20 657 322 326 322 q21 5093336041813360 q22 404 345 362 345 Total cold run time: 118851 ms Total hot run time: 40852 ms - Round 2, with runtime_filter_mode=off - q1 4503448045854480 q2 392 260 290 260 q3 3173295029352935 q4 2049160015891589 q5 5405549755485497 q6 225 125 126 125 q7 2206184117781778 q8 3188340434503404 q9 8692865486488648 q10 4110388637933793 q11 571 488 492 488 q12 787 586 589 586 q13 15935 311931793119 q14 306 265 271 265 q15 522 479 477 477 q16 460 433 428 428 q17 1788152214981498 q18 8014796773587358 q19 1729154015541540 q20 3029179017951790 q21 5756461647464616 q22 929 517 534 517 Total cold run time: 73769 ms Total hot run time: 55191 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](IP) support ipv4/ipv6 with inverted index and conjuncts for query [doris]
amorynan commented on code in PR #35734: URL: https://github.com/apache/doris/pull/35734#discussion_r1623693872 ## be/src/olap/rowset/segment_v2/inverted_index_writer.cpp: ## @@ -695,6 +695,8 @@ Status InvertedIndexColumnWriter::create(const Field* field, M(FieldType::OLAP_FIELD_TYPE_DECIMAL128I) M(FieldType::OLAP_FIELD_TYPE_DECIMAL256) M(FieldType::OLAP_FIELD_TYPE_BOOL) +M(FieldType::OLAP_FIELD_TYPE_IPV4) +M(FieldType::OLAP_FIELD_TYPE_IPV6) Review Comment: writer & reader part both has key_coder's full_encoding function before add_doc and seek in bkd -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](IP) support ipv4/ipv6 with inverted index and conjuncts for query [doris]
amorynan commented on code in PR #35734:
URL: https://github.com/apache/doris/pull/35734#discussion_r1623694021
##
be/src/olap/rowset/segment_v2/column_reader.cpp:
##
@@ -573,7 +573,7 @@ Status ColumnReader::_load_inverted_index_index(
"create StringTypeInvertedIndexReader error: {}",
e.what());
}
}
-} else if (is_numeric_type(type)) {
+} else if (is_numeric_type(type) || is_ip_type(type)) {
Review Comment:
ok I will make the same
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipelline)add local merge sort exchaner [doris]
doris-robot commented on PR #35682: URL: https://github.com/apache/doris/pull/35682#issuecomment-2144107235 TPC-DS: Total hot run time: 173145 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 68da8b3f9a5f675441658db45d2792f787f84f98, data reload: false query1 927 388 384 384 query2 6460242423842384 query3 6645204 209 204 query4 19032 17382 17360 17360 query5 4156454 459 454 query6 246 156 163 156 query7 4588298 294 294 query8 312 288 282 282 query9 8632236623322332 query10 443 305 283 283 query11 10332 10089 98879887 query12 137 82 85 82 query13 1653364 368 364 query14 10164 782176817681 query15 248 187 187 187 query16 7809264 280 264 query17 1356532 525 525 query18 1910276 277 276 query19 193 160 156 156 query20 96 88 87 87 query21 211 141 125 125 query22 4199396139233923 query23 33794 33013 33178 33013 query24 11331 288428622862 query25 606 357 374 357 query26 1214161 162 161 query27 2895314 318 314 query28 7378202320332023 query29 910 617 615 615 query30 270 151 152 151 query31 1011762 735 735 query32 92 58 53 53 query33 746 312 278 278 query34 916 476 477 476 query35 729 610 634 610 query36 1057942 944 942 query37 151 68 74 68 query38 2843271927032703 query39 885 794 791 791 query40 204 128 125 125 query41 56 54 51 51 query42 128 100 100 100 query43 589 593 548 548 query44 1189747 746 746 query45 196 164 167 164 query46 1073766 726 726 query47 1836175217971752 query48 379 305 300 300 query49 982 420 461 420 query50 782 396 397 396 query51 6847666867426668 query52 101 91 91 91 query53 359 302 296 296 query54 886 451 443 443 query55 75 76 73 73 query56 287 251 277 251 query57 1154108311031083 query58 275 238 238 238 query59 3434306732493067 query60 292 287 280 280 query61 93 87 93 87 query62 623 428 448 428 query63 320 298 293 293 query64 9410229917491749 query65 3206313731233123 query66 1200338 330 330 query67 15523 15174 14772 14772 query68 4612551 544 544 query69 571 490 396 396 query70 1204112311691123 query71 427 270 317 270 query72 7889520055675200 query73 766 325 326 325 query74 5844556554995499 query75 3483267427222674 query76 27941014934 934 query77 641 297 291 291 query78 10256 997197089708 query79 1980535 539 535 query80 1889476 468 468 query81 564 225 225 225 query82 667 103 105 103 query83 287 169 183 169 query84 260 89 86 86 query85 1246286 277 277 query86 450 315 301 301 query87 3272305331103053 query88 3761244424712444 query89 492 408 397 397 query90 1759198 199 198 query91 210 100 99 99 query92 62 49 49 49 query93 1897532 507 507 query94 1234194 187 187 query95 396 318 323 318 query96 587 271 265 265 query97 3179305730443044 query98 237 201 194 194 query99 1190846 820 820 Total cold run time: 272182 ms Total hot run time: 173145 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
