Re: [PR] [fix](bit shift) fix undefined behavior of bit shift functions. [doris]
HappenLee merged PR #35723: URL: https://github.com/apache/doris/pull/35723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](bit shift) fix undefined behavior of bit shift functions. (#35723)
This is an automated email from the ASF dual-hosted git repository. lihaopeng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 539cad87b0e [fix](bit shift) fix undefined behavior of bit shift functions. (#35723) 539cad87b0e is described below commit 539cad87b0ebde0ebd71230fd2e71ae36e857e91 Author: zhiqiang AuthorDate: Mon Jun 3 14:59:39 2024 +0800 [fix](bit shift) fix undefined behavior of bit shift functions. (#35723) `If the value of rhs is negative or is not less than the number of bits in lhs, the behavior is undefined.` - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
github-actions[bot] commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2144423576 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](exchange) Add buffer size limit for exchange sink operator [doris]
mrhhsg merged PR #35642: URL: https://github.com/apache/doris/pull/35642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (539cad87b0e -> f2a2c7082b8)
This is an automated email from the ASF dual-hosted git repository. mrhhsg pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 539cad87b0e [fix](bit shift) fix undefined behavior of bit shift functions. (#35723) add f2a2c7082b8 [opt](exchange) Add buffer size limit for exchange sink operator (#35642) No new revisions were added by this update. Summary of changes: be/src/pipeline/exec/exchange_sink_buffer.cpp | 37 + be/src/pipeline/exec/exchange_sink_buffer.h | 32 + be/src/pipeline/exec/exchange_sink_operator.cpp | 27 -- be/src/pipeline/exec/exchange_sink_operator.h | 3 +- be/src/vec/sink/vdata_stream_sender.cpp | 16 --- be/src/vec/sink/vdata_stream_sender.h | 6 6 files changed, 40 insertions(+), 81 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Improve]schema.evolution adds debezium prefix [doris-kafka-connector]
DongLiang-0 opened a new pull request, #24: URL: https://github.com/apache/doris-kafka-connector/pull/24 Since this parameter is only used when ```converter.mode=debezium_ingestion```, add the debezium prefix to ``schema.evolution`` to become ```debezium.schema.evolution``` to avoid misunderstandings -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](datetime) Fix date floor functions overflow [doris]
github-actions[bot] commented on PR #35477: URL: https://github.com/apache/doris/pull/35477#issuecomment-2144434624 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](bitmap) set enable_set_in_bitmap_value default value to true [doris]
BiteThet merged PR #35730: URL: https://github.com/apache/doris/pull/35730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (f2a2c7082b8 -> 79ad00a0e15)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from f2a2c7082b8 [opt](exchange) Add buffer size limit for exchange sink operator (#35642) add 79ad00a0e15 [Chore](bitmap) set enable_set_in_bitmap_value default value to true (#35730) No new revisions were added by this update. Summary of changes: be/src/common/config.cpp | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](dynamic partition) fix dynamic partition thread met uncatch exception [doris]
yujun777 commented on PR #35778: URL: https://github.com/apache/doris/pull/35778#issuecomment-2144457295 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](s3) fix invalid s3 properties checking logic [doris]
github-actions[bot] commented on PR #35762: URL: https://github.com/apache/doris/pull/35762#issuecomment-2144460086 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Tablet) Fix the issue of redundant loading of stale rowset meta [doris]
github-actions[bot] commented on PR #35768: URL: https://github.com/apache/doris/pull/35768#issuecomment-2144463692 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Cherry-pick]Support kill query in be [doris]
doris-robot commented on PR #35794: URL: https://github.com/apache/doris/pull/35794#issuecomment-2144465326 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Cherry-pick]Support kill query in be [doris]
wangbo opened a new pull request, #35794: URL: https://github.com/apache/doris/pull/35794 ## Proposed changes pick #35602 ``` mysql [information_schema]>kill query '2047df937c66704d-3ac4cfaf17f65eae'; Query OK, 0 rows affected (0.01 sec) I20240603 15:21:50.37 3355508 internal_service.cpp:592] Cancel query 2047df937c66704d-3ac4cfaf17f65eae, reason: USER_CANCEL ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
xzj7019 opened a new pull request, #35795: URL: https://github.com/apache/doris/pull/35795 ## Proposed changes Issue Number: close #xxx Based on real testing perf. data, the doris_scanner_thread_pool_thread_num's setting will have big influence on multi-stream perf. scenarios. Current 2 * num_cores configuration will be too big on the high configuration cluster be, e.g, per-node with 64 cores, under multi-stream testing cases. Perf. data shows that 5 be cluster with 8 streams ad-hoc test cases will have 60% improvement if reduce this configuration from 2 * num_cores to num_cores. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
doris-robot commented on PR #35795: URL: https://github.com/apache/doris/pull/35795#issuecomment-2144469279 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]
doris-robot commented on PR #35093: URL: https://github.com/apache/doris/pull/35093#issuecomment-2144470359 TPC-H: Total hot run time: 41036 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit b142db98e5ad3741b5e19699e642f3d3785dfa33, data reload: false -- Round 1 -- q1 17848 462444634463 q2 3011196 200 196 q3 10736 128212231223 q4 10522 846 746 746 q5 7837272727312727 q6 221 139 142 139 q7 991 612 604 604 q8 9447214721362136 q9 9028650664926492 q10 8955373337733733 q11 476 247 242 242 q12 419 236 230 230 q13 17778 300029852985 q14 275 221 228 221 q15 510 469 481 469 q16 515 383 393 383 q17 979 767 668 668 q18 8123751773857385 q19 7220153614701470 q20 653 326 322 322 q21 4991385640523856 q22 411 354 346 346 Total cold run time: 120946 ms Total hot run time: 41036 ms - Round 2, with runtime_filter_mode=off - q1 4415425943034259 q2 392 260 267 260 q3 2974277627052705 q4 1887165015981598 q5 5292536054675360 q6 217 127 130 127 q7 2172174517641745 q8 3226335933423342 q9 8356839283968392 q10 3931364836763648 q11 574 482 495 482 q12 768 591 611 591 q13 17522 298530262985 q14 293 270 261 261 q15 510 496 468 468 q16 470 440 436 436 q17 1785149814681468 q18 7724768274567456 q19 1708144815451448 q20 1966178417961784 q21 8748465546564655 q22 619 542 551 542 Total cold run time: 75549 ms Total hot run time: 54012 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
github-actions[bot] commented on PR #35795: URL: https://github.com/apache/doris/pull/35795#issuecomment-2144474754 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
github-actions[bot] commented on PR #35795: URL: https://github.com/apache/doris/pull/35795#issuecomment-2144474681 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
github-actions[bot] commented on PR #35795: URL: https://github.com/apache/doris/pull/35795#issuecomment-2144480920 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](clone) Fix clone and alter tablet use same tablet path [doris]
doris-robot commented on PR #34889: URL: https://github.com/apache/doris/pull/34889#issuecomment-2144481179 TPC-H: Total hot run time: 41839 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 6438ef497465829b8314ffbd48e8000d99e0b5f3, data reload: false -- Round 1 -- q1 17609 503143194319 q2 2037189 195 189 q3 10474 114911471147 q4 10195 810 843 810 q5 7497274027122712 q6 227 141 140 140 q7 986 644 610 610 q8 9271215521422142 q9 9497669967136699 q10 9283390139283901 q11 469 250 240 240 q12 487 234 245 234 q13 17497 320731943194 q14 258 210 224 210 q15 511 481 474 474 q16 510 403 399 399 q17 1015667 633 633 q18 8504786677087708 q19 6145139813321332 q20 641 330 317 317 q21 5142409343684093 q22 421 336 338 336 Total cold run time: 118676 ms Total hot run time: 41839 ms - Round 2, with runtime_filter_mode=off - q1 4660449844304430 q2 374 277 268 268 q3 3193293628872887 q4 1933162116231621 q5 5513549655165496 q6 227 128 131 128 q7 2214183218211821 q8 3263337234163372 q9 8662862287018622 q10 4028388737253725 q11 600 487 488 487 q12 789 621 601 601 q13 16289 314331483143 q14 305 265 281 265 q15 521 482 479 479 q16 493 439 438 438 q17 1862150014801480 q18 8021781572147214 q19 1766155914581458 q20 3071179717901790 q21 4891474247744742 q22 829 542 523 523 Total cold run time: 73504 ms Total hot run time: 54990 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](oom) return error when bloom filter allocate memory failed [doris]
doris-robot commented on PR #35790: URL: https://github.com/apache/doris/pull/35790#issuecomment-2144481687 TPC-H: Total hot run time: 41076 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 87b1a17434497d22e27b5afc0d4cf14afad6a8f1, data reload: false -- Round 1 -- q1 17600 492642904290 q2 2027197 212 197 q3 10425 116411911164 q4 10206 820 780 780 q5 7480275027142714 q6 226 135 140 135 q7 979 635 627 627 q8 9227214721072107 q9 9286668866856685 q10 9256400938763876 q11 465 263 256 256 q12 481 240 233 233 q13 17224 323533603235 q14 279 223 229 223 q15 506 460 489 460 q16 513 389 392 389 q17 998 557 677 557 q18 8552789378487848 q19 7531135815261358 q20 655 339 326 326 q21 5101327941793279 q22 414 348 337 337 Total cold run time: 119431 ms Total hot run time: 41076 ms - Round 2, with runtime_filter_mode=off - q1 4623449344424442 q2 388 259 269 259 q3 3180293030222930 q4 2037163116281628 q5 5445555355395539 q6 219 126 128 126 q7 2229177717971777 q8 3259339134313391 q9 8713864687278646 q10 4119385638443844 q11 603 525 491 491 q12 799 604 603 603 q13 16395 310731993107 q14 312 267 272 267 q15 531 476 484 476 q16 488 443 421 421 q17 1832151515181515 q18 8164774475647564 q19 1780155016341550 q20 3028179418151794 q21 10278 473346884688 q22 759 526 522 522 Total cold run time: 79181 ms Total hot run time: 55580 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](fe-meta) Support skip specified journal to avoid FE can't be start due to a damaged journal [doris]
doris-robot commented on PR #35783: URL: https://github.com/apache/doris/pull/35783#issuecomment-2144481726 TPC-H: Total hot run time: 41394 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4af3039aabaca28b39f96306d1c4a88f8d62576d, data reload: false -- Round 1 -- q1 17601 479343024302 q2 2020200 201 200 q3 10442 126112521252 q4 10190 849 766 766 q5 7505276327422742 q6 228 136 140 136 q7 971 624 618 618 q8 9228214220992099 q9 9504672267676722 q10 9750389938783878 q11 443 255 246 246 q12 521 237 248 237 q13 18595 322532303225 q14 259 227 219 219 q15 521 472 486 472 q16 512 422 408 408 q17 1009666 663 663 q18 8456784977957795 q19 6712144715291447 q20 656 323 326 323 q21 5264329840703298 q22 417 353 346 346 Total cold run time: 120804 ms Total hot run time: 41394 ms - Round 2, with runtime_filter_mode=off - q1 4571444244484442 q2 367 268 276 268 q3 3174292529322925 q4 2041161816381618 q5 5366554855035503 q6 233 128 127 127 q7 2181181518441815 q8 3225340234273402 q9 8787862886508628 q10 4095386539193865 q11 595 502 495 495 q12 770 617 615 615 q13 17039 316832013168 q14 318 270 268 268 q15 515 485 483 483 q16 483 422 435 422 q17 1847152714781478 q18 8140776873507350 q19 1769158314761476 q20 3021183117891789 q21 9108477446544654 q22 614 539 525 525 Total cold run time: 78259 ms Total hot run time: 55316 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) unix_timestamp compute signature and fold const is wrong [doris]
doris-robot commented on PR #35727: URL: https://github.com/apache/doris/pull/35727#issuecomment-2144482270 TPC-H: Total hot run time: 40781 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 95ab9ce68b7e146ec94e79cc3d5f70c225b3d578, data reload: false -- Round 1 -- q1 17625 500843014301 q2 2033191 196 191 q3 10551 127210951095 q4 10187 834 809 809 q5 7557269226882688 q6 223 136 133 133 q7 967 617 626 617 q8 9210213621212121 q9 9224666866806668 q10 9160384939063849 q11 458 240 239 239 q12 446 224 227 224 q13 18250 321831853185 q14 270 216 226 216 q15 524 475 485 475 q16 542 401 390 390 q17 1014621 729 621 q18 8433788077627762 q19 5204126613751266 q20 667 343 344 343 q21 5092324640873246 q22 402 359 342 342 Total cold run time: 118039 ms Total hot run time: 40781 ms - Round 2, with runtime_filter_mode=off - q1 4580446244574457 q2 386 278 282 278 q3 3103293328622862 q4 2085166415931593 q5 5341551354855485 q6 233 129 131 129 q7 2175182418201820 q8 3185334933743349 q9 8651854185858541 q10 4106381737893789 q11 568 477 490 477 q12 775 610 618 610 q13 16904 310731023102 q14 298 258 268 258 q15 521 472 465 465 q16 462 414 419 414 q17 1779150914911491 q18 8062770572637263 q19 1731158915671567 q20 2624179417651765 q21 6919473546424642 q22 674 507 523 507 Total cold run time: 75162 ms Total hot run time: 54864 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](load) use notify to replace sleep for FlushToken [doris]
liaoxin01 opened a new pull request, #35796: URL: https://github.com/apache/doris/pull/35796 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace sleep for FlushToken [doris]
doris-robot commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144484420 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Add check editlog size mechanism for backupJob [doris]
doris-robot commented on PR #35653: URL: https://github.com/apache/doris/pull/35653#issuecomment-2144482716 TPC-H: Total hot run time: 41136 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 581c50f0e003b355ecf07771e748cdaf76490eda, data reload: false -- Round 1 -- q1 17618 430142864286 q2 2035202 201 201 q3 10440 121811951195 q4 10196 832 769 769 q5 7515273927352735 q6 229 135 141 135 q7 979 608 609 608 q8 9231215721302130 q9 9429674068226740 q10 9598391138703870 q11 449 255 247 247 q12 498 233 248 233 q13 18796 326230643064 q14 274 227 231 227 q15 531 490 473 473 q16 538 393 391 391 q17 999 625 670 625 q18 8442788979947889 q19 7543160213691369 q20 666 329 319 319 q21 5272328839383288 q22 407 342 361 342 Total cold run time: 121685 ms Total hot run time: 41136 ms - Round 2, with runtime_filter_mode=off - q1 461244174417 q2 375 275 275 275 q3 3219289627032703 q4 1888168917181689 q5 5559554055105510 q6 225 129 128 128 q7 2150181518731815 q8 3257339934083399 q9 8595865287318652 q10 4108370437253704 q11 578 486 483 483 q12 809 603 631 603 q13 17019 312831903128 q14 315 280 267 267 q15 520 472 474 472 q16 515 429 453 429 q17 1885149314981493 q18 7834761073647364 q19 1699156015951560 q20 2091179417591759 q21 9426466047884660 q22 650 518 550 518 Total cold run time: 77329 ms Total hot run time: 55028 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](function) Fix function for cast string as date/datetime [doris]
yongjinhou commented on PR #35637: URL: https://github.com/apache/doris/pull/35637#issuecomment-2144484379 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace sleep for FlushToken [doris]
liaoxin01 commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144486789 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](build index)Make build index and clone mutually exclusive and add timeout for index change job [doris]
qidaye commented on PR #35724: URL: https://github.com/apache/doris/pull/35724#issuecomment-2144488148 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Cherry-pick]Support kill query in be [doris]
yiguolei merged PR #35794: URL: https://github.com/apache/doris/pull/35794 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [Cherry-pick]Support kill query in be (#35794)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 3e096dda914 [Cherry-pick]Support kill query in be (#35794)
3e096dda914 is described below
commit 3e096dda914d93aaee66f22a47b98588b89c9ae7
Author: wangbo
AuthorDate: Mon Jun 3 15:39:30 2024 +0800
[Cherry-pick]Support kill query in be (#35794)
## Proposed changes
pick #35602
```
mysql [information_schema]>kill query '2047df937c66704d-3ac4cfaf17f65eae';
Query OK, 0 rows affected (0.01 sec)
I20240603 15:21:50.37 3355508 internal_service.cpp:592] Cancel query
2047df937c66704d-3ac4cfaf17f65eae, reason: USER_CANCEL
```
---
.../org/apache/doris/common/util/DebugUtil.java| 24
.../java/org/apache/doris/qe/StmtExecutor.java | 30 ---
.../org/apache/doris/rpc/BackendServiceProxy.java | 18 +
.../apache/doris/common/util/DebugUtilTest.java| 45 ++
4 files changed, 112 insertions(+), 5 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/common/util/DebugUtil.java
b/fe/fe-core/src/main/java/org/apache/doris/common/util/DebugUtil.java
index 75fb331347e..2a52420a96d 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/common/util/DebugUtil.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/common/util/DebugUtil.java
@@ -21,6 +21,8 @@ import org.apache.doris.common.Pair;
import org.apache.doris.proto.Types;
import org.apache.doris.thrift.TUniqueId;
+import com.google.common.base.Strings;
+
import java.io.PrintWriter;
import java.io.StringWriter;
import java.text.DecimalFormat;
@@ -135,6 +137,28 @@ public class DebugUtil {
return builder.toString();
}
+// id is a String generated by DebugUtil.printId(TUniqueId)
+public static TUniqueId parseTUniqueIdFromString(String id) {
+if (Strings.isNullOrEmpty(id)) {
+throw new NumberFormatException("invalid query id");
+}
+
+String[] parts = id.split("-");
+if (parts.length != 2) {
+throw new NumberFormatException("invalid query id");
+}
+
+TUniqueId uniqueId = new TUniqueId();
+try {
+uniqueId.setHi(Long.parseUnsignedLong(parts[0], 16));
+uniqueId.setLo(Long.parseUnsignedLong(parts[1], 16));
+} catch (NumberFormatException e) {
+throw new NumberFormatException("invalid query id:" +
e.getMessage());
+}
+
+return uniqueId;
+}
+
public static String printId(final UUID id) {
TUniqueId tUniqueId = new TUniqueId(id.getMostSignificantBits(),
id.getLeastSignificantBits());
StringBuilder builder = new StringBuilder();
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java
index c90ca0b5ff7..ba6d200847c 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java
@@ -220,6 +220,7 @@ import java.io.IOException;
import java.io.StringReader;
import java.nio.ByteBuffer;
import java.util.ArrayList;
+import java.util.Collection;
import java.util.Collections;
import java.util.HashMap;
import java.util.List;
@@ -1419,16 +1420,15 @@ public class StmtExecutor {
}
// Handle kill statement.
-private void handleKill() throws DdlException {
+private void handleKill() throws UserException {
KillStmt killStmt = (KillStmt) parsedStmt;
ConnectContext killCtx = null;
int id = killStmt.getConnectionId();
String queryId = killStmt.getQueryId();
if (id == -1) {
+// when killCtx == null, this means the query not in FE,
+// then we just send kill signal to BE
killCtx =
context.getConnectScheduler().getContextWithQueryId(queryId);
-if (killCtx == null) {
-ErrorReport.reportDdlException(ErrorCode.ERR_NO_SUCH_QUERY,
queryId);
-}
} else {
killCtx = context.getConnectScheduler().getContext(id);
if (killCtx == null) {
@@ -1436,7 +1436,27 @@ public class StmtExecutor {
}
}
-if (context == killCtx) {
+if (killCtx == null) {
+TUniqueId tQueryId = null;
+try {
+tQueryId = DebugUtil.parseTUniqueIdFromString(queryId);
+} catch (NumberFormatException e) {
+throw new UserException(e.getMessage());
+}
+LOG.info("kill query {}", queryId);
+Collection nodesToPublish =
Env.getCurrentSystemInfo().getIdToBackend().values();
+for (Backend be : nodesToPublish) {
+if (be.isAlive()) {
+try {
+
Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]
doris-robot commented on PR #35093: URL: https://github.com/apache/doris/pull/35093#issuecomment-2144489785 TPC-DS: Total hot run time: 170049 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit b142db98e5ad3741b5e19699e642f3d3785dfa33, data reload: false query1 945 404 383 383 query2 6473241523662366 query3 6874210 209 209 query4 19583 17388 17437 17388 query5 4150469 460 460 query6 249 167 160 160 query7 4599306 291 291 query8 310 282 293 282 query9 8551243123982398 query10 441 296 281 281 query11 11038 10020 10159 10020 query12 142 94 86 86 query13 1657376 365 365 query14 10020 687169366871 query15 236 190 186 186 query16 7638277 272 272 query17 1389529 528 528 query18 1967268 270 268 query19 219 150 156 150 query20 99 86 85 85 query21 204 128 130 128 query22 4272393839183918 query23 33513 32920 33111 32920 query24 12343 285028102810 query25 657 358 359 358 query26 1777160 158 158 query27 3036325 325 325 query28 7629206720712067 query29 1155602 600 600 query30 290 147 151 147 query31 937 745 733 733 query32 92 53 55 53 query33 784 274 282 274 query34 1004473 479 473 query35 727 646 612 612 query36 1096942 919 919 query37 209 72 70 70 query38 2859273927362736 query39 882 788 767 767 query40 279 125 124 124 query41 53 53 52 52 query42 116 100 98 98 query43 603 548 560 548 query44 1222732 749 732 query45 200 168 187 168 query46 1098729 721 721 query47 1868179317611761 query48 393 292 303 292 query49 1249409 414 409 query50 789 392 379 379 query51 6868688567796779 query52 108 91 87 87 query53 355 288 287 287 query54 952 458 448 448 query55 75 71 74 71 query56 275 270 258 258 query57 1125107110221022 query58 249 280 242 242 query59 3414335832413241 query60 295 278 273 273 query61 92 88 89 88 query62 653 439 452 439 query63 321 295 288 288 query64 9892217817291729 query65 3188312731433127 query66 1367334 328 328 query67 15637 15219 14979 14979 query68 4569537 534 534 query69 453 319 325 319 query70 1192114110531053 query71 401 282 286 282 query72 7167288227102710 query73 748 415 323 323 query74 5894556655405540 query75 3344269526642664 query76 2305930 871 871 query77 443 303 292 292 query78 10285 975597569755 query79 3167508 506 506 query80 2052479 452 452 query81 579 228 222 222 query82 780 111 104 104 query83 279 174 178 174 query84 273 94 89 89 query85 2078268 263 263 query86 519 331 315 315 query87 3286306930703069 query88 3948235923382338 query89 504 382 386 382 query90 1835193 192 192 query91 131 144 95 95 query92 58 49 50 49 query93 4349525 520 520 query94 1275196 187 187 query95 420 322 315 315 query96 603 269 267 267 query97 3217302130473021 query98 254 218 212 212 query99 1224847 851 847 Total cold run time: 280414 ms Total hot run time: 170049 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [improve](udf) support java-udf static load [doris]
zhangstar333 commented on PR #34980: URL: https://github.com/apache/doris/pull/34980#issuecomment-2144490677 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](oom) return error when bloom filter allocate memory failed [doris]
doris-robot commented on PR #35790: URL: https://github.com/apache/doris/pull/35790#issuecomment-2144492525 TeamCity be ut coverage result: Function Coverage: 36.29% (9242/25465) Line Coverage: 27.65% (75849/274304) Region Coverage: 26.88% (39297/146214) Branch Coverage: 23.60% (19908/84372) Coverage Report: http://coverage.selectdb-in.cc/coverage/87b1a17434497d22e27b5afc0d4cf14afad6a8f1_87b1a17434497d22e27b5afc0d4cf14afad6a8f1/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) variable enable_odb_tanscation is misspelled [doris]
doris-robot commented on PR #35786: URL: https://github.com/apache/doris/pull/35786#issuecomment-2144492996 TeamCity be ut coverage result: Function Coverage: 36.29% (9242/25465) Line Coverage: 27.65% (75836/274300) Region Coverage: 26.87% (39277/146185) Branch Coverage: 23.59% (19904/84366) Coverage Report: http://coverage.selectdb-in.cc/coverage/ee3d7134645588f062da05af68590e132cf3cd85_ee3d7134645588f062da05af68590e132cf3cd85/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](clone) Fix clone and alter tablet use same tablet path [doris]
github-actions[bot] commented on PR #34889: URL: https://github.com/apache/doris/pull/34889#issuecomment-2144491592 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [doc](routine load) add tips when using Single-task Loading to Multip… [doris-website]
yagagagaga opened a new pull request, #710: URL: https://github.com/apache/doris-website/pull/710 …le Tables -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](exec) Support group by limit opt in BE code [doris]
doris-robot commented on PR #29641: URL: https://github.com/apache/doris/pull/29641#issuecomment-2144493343 TPC-H: Total hot run time: 41441 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 36a6b37475e7b5bcdae7ab60bee5169a2662e4de, data reload: false -- Round 1 -- q1 17613 436642714271 q2 2025188 197 188 q3 10448 132312331233 q4 10191 929 877 877 q5 7521273927362736 q6 243 139 139 139 q7 966 632 618 618 q8 9245214021292129 q9 9421671366976697 q10 9019388838323832 q11 456 241 252 241 q12 461 238 232 232 q13 17642 329332283228 q14 282 227 240 227 q15 520 485 498 485 q16 521 409 410 409 q17 1036761 713 713 q18 8499783178637831 q19 7591130613651306 q20 657 328 320 320 q21 5113399533853385 q22 407 345 344 344 Total cold run time: 119877 ms Total hot run time: 41441 ms - Round 2, with runtime_filter_mode=off - q1 4530447944464446 q2 373 272 254 254 q3 3122285729272857 q4 2036167516121612 q5 5392555255135513 q6 220 128 130 128 q7 2165183218201820 q8 3252337634293376 q9 8706862086798620 q10 4134386638653865 q11 608 473 487 473 q12 774 610 628 610 q13 16998 315531373137 q14 305 265 267 265 q15 528 477 482 477 q16 476 439 421 421 q17 1839147114671467 q18 8189766173817381 q19 1771158515441544 q20 3037179117841784 q21 9947486547914791 q22 630 529 559 529 Total cold run time: 79032 ms Total hot run time: 55370 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](log) refine the FE logger [doris]
morningman commented on PR #35679: URL: https://github.com/apache/doris/pull/35679#issuecomment-2144494845 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace polling for FlushToken [doris]
github-actions[bot] commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144496068 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies)binding a third-party Hadoop component to version 1.2.0 [doris]
doris-robot commented on PR #35093: URL: https://github.com/apache/doris/pull/35093#issuecomment-2144499771 ClickBench: Total hot run time: 30.81 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit b142db98e5ad3741b5e19699e642f3d3785dfa33, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.670.080.06 query5 0.500.490.50 query6 1.120.720.73 query7 0.020.010.02 query8 0.050.040.05 query9 0.520.480.49 query10 0.540.540.53 query11 0.150.120.11 query12 0.160.120.12 query13 0.590.590.60 query14 0.760.760.78 query15 0.840.810.82 query16 0.370.370.38 query17 0.970.950.99 query18 0.220.250.24 query19 1.791.811.76 query20 0.020.010.01 query21 15.56 0.680.64 query22 4.087.582.16 query23 18.32 1.431.35 query24 1.870.220.22 query25 0.150.080.09 query26 0.280.180.18 query27 0.080.080.07 query28 13.28 1.031.01 query29 13.18 3.303.27 query30 0.240.060.06 query31 2.870.380.40 query32 3.260.480.48 query33 2.872.892.87 query34 17.27 4.364.37 query35 4.484.464.51 query36 0.650.460.49 query37 0.190.150.16 query38 0.160.150.15 query39 0.050.040.03 query40 0.160.140.14 query41 0.090.050.04 query42 0.050.050.05 query43 0.040.040.03 Total cold run time: 109.82 s Total hot run time: 30.81 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](clone) Fix clone and alter tablet use same tablet path [doris]
doris-robot commented on PR #34889: URL: https://github.com/apache/doris/pull/34889#issuecomment-2144500848 TPC-DS: Total hot run time: 169299 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6438ef497465829b8314ffbd48e8000d99e0b5f3, data reload: false query1 940 392 368 368 query2 6468254624492449 query3 6647202 204 202 query4 19881 17115 17074 17074 query5 4125451 449 449 query6 262 165 149 149 query7 4576293 294 293 query8 308 294 280 280 query9 8589240524052405 query10 441 296 278 278 query11 10560 10085 10129 10085 query12 137 94 91 91 query13 1647375 364 364 query14 10233 749361216121 query15 229 192 197 192 query16 7712280 270 270 query17 1298540 529 529 query18 1905284 290 284 query19 201 166 162 162 query20 105 89 89 89 query21 215 136 131 131 query22 4274405740704057 query23 33485 33128 32971 32971 query24 11183 283428722834 query25 631 375 384 375 query26 1164156 155 155 query27 2645324 337 324 query28 7285212321062106 query29 897 639 625 625 query30 275 156 155 155 query31 992 739 723 723 query32 97 54 57 54 query33 789 351 276 276 query34 903 477 470 470 query35 784 617 599 599 query36 1115923 948 923 query37 148 67 73 67 query38 2870276127282728 query39 886 793 799 793 query40 201 128 120 120 query41 57 53 53 53 query42 121 94 97 94 query43 597 558 533 533 query44 1153749 769 749 query45 200 177 167 167 query46 1080733 705 705 query47 1874176017441744 query48 372 304 295 295 query49 989 408 407 407 query50 787 378 399 378 query51 6879679167426742 query52 103 94 86 86 query53 361 296 279 279 query54 871 448 446 446 query55 72 73 72 72 query56 288 257 264 257 query57 1187103910741039 query58 260 248 245 245 query59 3408327331113111 query60 292 274 267 267 query61 114 87 85 85 query62 623 448 454 448 query63 311 282 283 282 query64 8899220417301730 query65 3244312631143114 query66 1023325 323 323 query67 15600 15048 15062 15048 query68 4561539 534 534 query69 575 387 363 363 query70 1175112610561056 query71 449 296 281 281 query72 8819532727402740 query73 790 331 316 316 query74 5900547554875475 query75 3530265926432643 query76 2950927 945 927 query77 492 289 291 289 query78 10274 988297989798 query79 2185514 517 514 query80 2673460 452 452 query81 571 221 218 218 query82 907 105 98 98 query83 314 174 174 174 query84 276 91 85 85 query85 2199259 307 259 query86 485 333 302 302 query87 3245310230853085 query88 4210235123442344 query89 489 406 383 383 query90 1967182 187 182 query91 124 102 98 98 query92 61 49 53 49 query93 2618511 496 496 query94 1416187 186 186 query95 423 308 312 308 query96 591 272 267 267 query97 3199301530223015 query98 243 221 216 216 query99 1189844 827 827 Total cold run time: 276768 ms Total hot run time: 169299 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [enhancement](oom) return error when bloom filter allocate memory failed [doris]
doris-robot commented on PR #35790: URL: https://github.com/apache/doris/pull/35790#issuecomment-2144501409 TPC-DS: Total hot run time: 173941 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 87b1a17434497d22e27b5afc0d4cf14afad6a8f1, data reload: false query1 937 392 389 389 query2 6450244924062406 query3 6637203 205 203 query4 20407 17639 17641 17639 query5 4113468 469 468 query6 250 161 154 154 query7 4595297 288 288 query8 312 288 288 288 query9 8543238623842384 query10 455 324 280 280 query11 10671 10209 10109 10109 query12 147 89 106 89 query13 1625364 370 364 query14 10071 779476487648 query15 238 188 189 188 query16 7593276 264 264 query17 1386536 536 536 query18 1933268 268 268 query19 203 164 152 152 query20 96 87 84 84 query21 209 130 131 130 query22 4327425040884088 query23 33571 33131 32991 32991 query24 11272 289528712871 query25 612 356 362 356 query26 1188160 160 160 query27 2964319 337 319 query28 7420204020392039 query29 943 617 613 613 query30 294 153 150 150 query31 945 727 761 727 query32 92 52 53 52 query33 770 298 282 282 query34 945 477 486 477 query35 773 622 622 622 query36 1107930 933 930 query37 157 70 74 70 query38 2844275027442744 query39 874 813 794 794 query40 216 133 133 133 query41 59 55 54 54 query42 123 98 101 98 query43 567 550 542 542 query44 1292740 778 740 query45 224 171 170 170 query46 1078716 725 716 query47 1857176917771769 query48 397 295 293 293 query49 1083419 416 416 query50 793 387 392 387 query51 6891671767136713 query52 102 94 91 91 query53 359 299 303 299 query54 863 449 438 438 query55 74 73 75 73 query56 284 256 267 256 query57 1142102510761025 query58 273 288 248 248 query59 3659326034023260 query60 309 298 280 280 query61 90 89 87 87 query62 634 454 463 454 query63 321 295 293 293 query64 8972229718031803 query65 3162312631253125 query66 869 326 337 326 query67 15486 15316 14860 14860 query68 4482552 533 533 query69 464 301 327 301 query70 1141109911471099 query71 405 290 291 290 query72 7215508656205086 query73 745 325 327 325 query74 5915557054755475 query75 3421263227302632 query76 2387949 920 920 query77 481 308 303 303 query78 10404 976997809769 query79 2441535 512 512 query80 1127485 470 470 query81 557 224 223 223 query82 747 106 104 104 query83 234 177 171 171 query84 244 86 89 86 query85 1887288 279 279 query86 496 305 314 305 query87 3263309131103091 query88 4012234623452345 query89 475 402 389 389 query90 1815194 194 194 query91 142 113 174 113 query92 57 51 51 51 query93 2177506 504 504 query94 1204192 185 185 query95 413 316 319 316 query96 593 274 263 263 query97 3171299329972993 query98 242 215 218 215 query99 1195860 834 834 Total cold run time: 272700 ms Total hot run time: 173941 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](fe) Add check editlog size mechanism for backupJob [doris]
doris-robot commented on PR #35653: URL: https://github.com/apache/doris/pull/35653#issuecomment-2144502312 TPC-DS: Total hot run time: 169986 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 581c50f0e003b355ecf07771e748cdaf76490eda, data reload: false query1 912 393 367 367 query2 6448242923592359 query3 6648202 206 202 query4 20801 17407 17437 17407 query5 4113451 438 438 query6 245 161 160 160 query7 4584309 294 294 query8 316 279 280 279 query9 8559241323952395 query10 454 303 275 275 query11 10742 10058 10027 10027 query12 132 87 88 87 query13 1635354 357 354 query14 10058 758269086908 query15 228 191 183 183 query16 7929273 261 261 query17 1821524 531 524 query18 1996274 274 274 query19 204 154 156 154 query20 94 86 94 86 query21 209 138 130 130 query22 4318389639743896 query23 33572 32999 33170 32999 query24 11071 280728912807 query25 667 376 398 376 query26 1336159 159 159 query27 2978322 322 322 query28 7524207220652065 query29 927 612 595 595 query30 290 147 149 147 query31 920 755 752 752 query32 94 57 64 57 query33 771 287 267 267 query34 973 484 474 474 query35 737 628 652 628 query36 1115950 930 930 query37 159 65 67 65 query38 2884276227512751 query39 866 785 781 781 query40 210 123 121 121 query41 52 50 52 50 query42 117 101 96 96 query43 572 569 574 569 query44 1241723 745 723 query45 193 169 171 169 query46 1062723 701 701 query47 1843177117851771 query48 365 301 300 300 query49 1082411 401 401 query50 778 382 391 382 query51 6985678467536753 query52 106 89 91 89 query53 353 290 283 283 query54 865 456 446 446 query55 75 69 74 69 query56 272 253 279 253 query57 1126105710771057 query58 246 239 254 239 query59 3643331132453245 query60 288 269 281 269 query61 96 92 91 91 query62 633 434 453 434 query63 316 285 285 285 query64 8883233117231723 query65 3183307931303079 query66 920 347 319 319 query67 15495 15068 14916 14916 query68 4582553 533 533 query69 530 409 338 338 query70 1189108511051085 query71 416 283 274 274 query72 7707493427062706 query73 746 323 322 322 query74 5955559454765476 query75 3383264526572645 query76 2690987 841 841 query77 460 292 287 287 query78 10602 991397159715 query79 2189514 507 507 query80 978 451 454 451 query81 600 219 221 219 query82 676 101 102 101 query83 236 170 169 169 query84 249 93 84 84 query85 1932273 265 265 query86 514 317 310 310 query87 3298309530933093 query88 4177237023722370 query89 475 396 383 383 query90 1822192 190 190 query91 138 107 109 107 query92 67 54 50 50 query93 2161511 502 502 query94 1238197 198 197 query95 417 324 322 322 query96 587 279 268 268 query97 3275307430463046 query98 240 216 218 216 query99 1193846 860 846 Total cold run time: 275052 ms Total hot run time: 169986 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [enhancement](fe-meta) Support skip specified journal to avoid FE can't be start due to a damaged journal [doris]
doris-robot commented on PR #35783: URL: https://github.com/apache/doris/pull/35783#issuecomment-2144501276 TPC-DS: Total hot run time: 173360 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4af3039aabaca28b39f96306d1c4a88f8d62576d, data reload: false query1 933 393 376 376 query2 6456253223112311 query3 6659204 201 201 query4 19514 17403 17349 17349 query5 4127454 438 438 query6 246 155 159 155 query7 4589309 284 284 query8 329 288 273 273 query9 8438242023902390 query10 465 305 281 281 query11 10480 10088 99759975 query12 139 96 88 88 query13 1675358 355 355 query14 10155 785477147714 query15 238 190 186 186 query16 7702268 265 265 query17 1733520 533 520 query18 1929268 262 262 query19 197 150 154 150 query20 93 85 86 85 query21 207 139 128 128 query22 4246401940224019 query23 33559 33060 33076 33060 query24 11096 286927892789 query25 604 358 371 358 query26 1205158 156 156 query27 2820323 319 319 query28 7325205520672055 query29 874 592 601 592 query30 269 149 154 149 query31 937 734 724 724 query32 95 52 54 52 query33 746 292 329 292 query34 867 478 475 475 query35 730 636 644 636 query36 1079958 948 948 query37 151 67 76 67 query38 2898272227482722 query39 886 776 809 776 query40 210 123 120 120 query41 54 51 57 51 query42 119 99 96 96 query43 593 552 533 533 query44 1206720 747 720 query45 202 178 169 169 query46 1080729 715 715 query47 1885178217991782 query48 366 293 298 293 query49 1003404 410 404 query50 777 399 382 382 query51 6865686367976797 query52 120 93 91 91 query53 361 301 284 284 query54 841 455 454 454 query55 75 74 74 74 query56 302 289 255 255 query57 1135103710531037 query58 252 252 260 252 query59 3577322031743174 query60 293 274 263 263 query61 89 88 83 83 query62 637 440 445 440 query63 319 291 293 291 query64 8890223217081708 query65 3173309531123095 query66 877 325 331 325 query67 15382 14998 14977 14977 query68 4479542 535 535 query69 455 309 301 301 query70 1178109211561092 query71 407 289 308 289 query72 7159583554905490 query73 740 322 329 322 query74 5925554954695469 query75 3351263026542630 query76 2323931 894 894 query77 454 290 305 290 query78 10313 966297659662 query79 2435523 509 509 query80 1219453 458 453 query81 577 222 228 222 query82 1016117 100 100 query83 239 172 169 169 query84 246 85 88 85 query85 1250273 258 258 query86 453 334 307 307 query87 3259310930843084 query88 3204235224212352 query89 465 392 377 377 query90 1778191 187 187 query91 126 99 97 97 query92 69 50 48 48 query93 1971512 497 497 query94 1204186 186 186 query95 409 314 313 313 query96 592 272 263 263 query97 3173299730182997 query98 242 223 207 207 query99 1363846 835 835 Total cold run time: 269448 ms Total hot run time: 173360 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [opt](scanner) reduce default scanner thread pool thread num [doris]
xzj7019 closed pull request #35795: [opt](scanner) reduce default scanner thread pool thread num URL: https://github.com/apache/doris/pull/35795 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) unix_timestamp compute signature and fold const is wrong [doris]
doris-robot commented on PR #35727: URL: https://github.com/apache/doris/pull/35727#issuecomment-2144501587 TPC-DS: Total hot run time: 169436 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 95ab9ce68b7e146ec94e79cc3d5f70c225b3d578, data reload: false query1 917 376 371 371 query2 6452241223272327 query3 6636206 204 204 query4 19625 17531 17097 17097 query5 4141452 442 442 query6 237 167 158 158 query7 4589284 289 284 query8 307 277 287 277 query9 8596240923692369 query10 435 291 265 265 query11 10568 10046 10028 10028 query12 131 90 88 88 query13 1642369 371 369 query14 8853770275377537 query15 235 181 192 181 query16 7765289 260 260 query17 1733543 511 511 query18 1902266 268 266 query19 208 146 152 146 query20 104 86 89 86 query21 209 135 128 128 query22 4230412038983898 query23 33651 32949 32972 32949 query24 10819 282827802780 query25 603 353 357 353 query26 1194151 151 151 query27 2656322 330 322 query28 7145206820802068 query29 878 609 608 608 query30 246 145 153 145 query31 939 720 733 720 query32 89 51 56 51 query33 754 269 264 264 query34 990 483 472 472 query35 732 632 608 608 query36 1090950 919 919 query37 154 66 68 66 query38 2866272227282722 query39 874 788 772 772 query40 206 122 118 118 query41 53 51 57 51 query42 114 97 93 93 query43 587 552 545 545 query44 1209716 739 716 query45 196 168 166 166 query46 1076735 734 734 query47 1840175817931758 query48 374 298 288 288 query49 904 400 400 400 query50 792 375 372 372 query51 6965678467826782 query52 101 90 90 90 query53 362 282 285 282 query54 863 453 432 432 query55 71 70 72 70 query56 271 256 260 256 query57 1157106110651061 query58 258 248 241 241 query59 3408357730753075 query60 286 264 261 261 query61 90 89 108 89 query62 629 462 473 462 query63 309 285 287 285 query64 8864222416861686 query65 3198307931183079 query66 773 320 317 317 query67 15491 15117 14982 14982 query68 4477533 578 533 query69 452 299 306 299 query70 1113113811341134 query71 395 271 283 271 query72 7374272025372537 query73 751 324 314 314 query74 5921553654855485 query75 3305261626622616 query76 2219882 946 882 query77 423 292 285 285 query78 10304 973396759675 query79 2201508 502 502 query80 873 452 444 444 query81 587 215 215 215 query82 823 100 95 95 query83 232 166 162 162 query84 242 84 88 84 query85 1451326 264 264 query86 454 308 332 308 query87 3303308630903086 query88 3963233023262326 query89 479 380 371 371 query90 1885189 182 182 query91 120 98 98 98 query92 58 48 48 48 query93 2023514 497 497 query94 1263178 183 178 query95 397 314 306 306 query96 596 265 268 265 query97 3183296131032961 query98 242 219 216 216 query99 1157851 844 844 Total cold run time: 267908 ms Total hot run time: 169436 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
[PR] [Chore](materialized-view) enable create mv on mow table [doris]
BiteThet opened a new pull request, #35797: URL: https://github.com/apache/doris/pull/35797 ## Proposed changes enable create mv on mow table -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](materialized-view) enable create mv on mow table [doris]
BiteThet commented on PR #35797: URL: https://github.com/apache/doris/pull/35797#issuecomment-2144505113 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](s3) fix invalid s3 properties checking logic [doris]
morningman merged PR #35762: URL: https://github.com/apache/doris/pull/35762 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](s3) fix invalid s3 properties checking logic (#35762)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 9147c046ce2 [fix](s3) fix invalid s3 properties checking logic (#35762)
9147c046ce2 is described below
commit 9147c046ce29eaec7c8eef9f8843016c7c012fbb
Author: Mingyu Chen
AuthorDate: Mon Jun 3 15:49:51 2024 +0800
[fix](s3) fix invalid s3 properties checking logic (#35762)
## Proposed changes
Introduced from #35515
1. Fix invalid `to_int()` method logic
2. Remove unnecessary properties when creating s3 resource
Before, after recreating s3 resource, there will be some extra
properties being added to the resource properties,
such as AWS_ACCESS_KEY, but this keys are only for s3 client on BE side,
don' t needed when ping s3.
But it will add some invalid properties such as `AWS_TOKEN=null`
---
be/src/util/s3_util.cpp | 9 +
.../main/java/org/apache/doris/catalog/S3Resource.java| 15 +++
.../java/org/apache/doris/fs/remote/S3FileSystem.java | 5 -
.../nereids/trees/expressions/functions/table/Hdfs.java | 3 +--
.../nereids/trees/expressions/functions/table/Local.java | 3 +--
.../nereids/trees/expressions/functions/table/S3.java | 3 +--
.../apache/doris/tablefunction/S3TableValuedFunction.java | 10 --
.../tvf/test_s3_tvf_with_resource.groovy | 3 ++-
8 files changed, 25 insertions(+), 26 deletions(-)
diff --git a/be/src/util/s3_util.cpp b/be/src/util/s3_util.cpp
index f5d50e56899..6cf8e97962e 100644
--- a/be/src/util/s3_util.cpp
+++ b/be/src/util/s3_util.cpp
@@ -66,7 +66,7 @@ bool is_s3_conf_valid(const S3ClientConf& conf) {
// Return true is convert `str` to int successfully
bool to_int(std::string_view str, int& res) {
auto [_, ec] = std::from_chars(str.data(), str.data() + str.size(), res);
-return ec != std::errc {};
+return ec == std::errc {};
}
const std::string USE_PATH_STYLE = "use_path_style";
@@ -258,18 +258,19 @@ Status S3ClientFactory::convert_properties_to_s3_conf(
}
if (auto it = properties.find(S3_MAX_CONN_SIZE); it != properties.end()) {
if (!to_int(it->second, s3_conf->client_conf.max_connections)) {
-return Status::InvalidArgument("invalid {} value {}",
S3_MAX_CONN_SIZE, it->second);
+return Status::InvalidArgument("invalid {} value \"{}\"",
S3_MAX_CONN_SIZE, it->second);
}
}
if (auto it = properties.find(S3_REQUEST_TIMEOUT_MS); it !=
properties.end()) {
if (!to_int(it->second, s3_conf->client_conf.request_timeout_ms)) {
-return Status::InvalidArgument("invalid {} value {}",
S3_REQUEST_TIMEOUT_MS,
+return Status::InvalidArgument("invalid {} value \"{}\"",
S3_REQUEST_TIMEOUT_MS,
it->second);
}
}
if (auto it = properties.find(S3_CONN_TIMEOUT_MS); it != properties.end())
{
if (!to_int(it->second, s3_conf->client_conf.connect_timeout_ms)) {
-return Status::InvalidArgument("invalid {} value {}",
S3_CONN_TIMEOUT_MS, it->second);
+return Status::InvalidArgument("invalid {} value \"{}\"",
S3_CONN_TIMEOUT_MS,
+ it->second);
}
}
diff --git a/fe/fe-core/src/main/java/org/apache/doris/catalog/S3Resource.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/S3Resource.java
index 739f7f2ff5f..e1cde40c4ad 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/S3Resource.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/S3Resource.java
@@ -23,7 +23,6 @@ import org.apache.doris.common.FeConstants;
import org.apache.doris.common.credentials.CloudCredentialWithEndpoint;
import org.apache.doris.common.proc.BaseProcResult;
import org.apache.doris.common.util.PrintableMap;
-import org.apache.doris.datasource.property.PropertyConverter;
import org.apache.doris.datasource.property.constants.S3Properties;
import org.apache.doris.fs.remote.S3FileSystem;
@@ -121,15 +120,6 @@ public class S3Resource extends Resource {
private static void pingS3(CloudCredentialWithEndpoint credential, String
bucketName, String rootPath,
Map properties) throws DdlException {
String bucket = "s3://" + bucketName + "/";
-Map propertiesPing = new HashMap<>();
-propertiesPing.put(S3Properties.Env.ACCESS_KEY,
credential.getAccessKey());
-propertiesPing.put(S3Properties.Env.SECRET_KEY,
credential.getSecretKey());
-propertiesPing.put(S3Properties.Env.TOKEN,
credential.getSessionToken());
-propertiesPing.put(S3Properties.Env.ENDPOINT,
credential.getEndpoint());
-propertiesPing.put(S3Properties.Env.REGION, credential.getRegion());
-propertiesPing.put(P
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
zy-kkk commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2144508975 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](clone) Fix clone and alter tablet use same tablet path [doris]
doris-robot commented on PR #34889: URL: https://github.com/apache/doris/pull/34889#issuecomment-2144510784 ClickBench: Total hot run time: 30.44 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6438ef497465829b8314ffbd48e8000d99e0b5f3, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.04 query4 1.680.060.07 query5 0.510.490.49 query6 1.140.720.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.560.490.50 query10 0.550.560.54 query11 0.160.120.11 query12 0.150.120.12 query13 0.590.580.60 query14 0.790.770.79 query15 0.830.810.81 query16 0.370.370.36 query17 0.970.961.03 query18 0.210.230.23 query19 1.871.691.65 query20 0.010.020.01 query21 15.56 0.660.65 query22 4.556.942.02 query23 18.26 1.321.25 query24 1.950.250.20 query25 0.140.080.08 query26 0.260.170.18 query27 0.080.090.07 query28 13.30 1.021.00 query29 13.75 3.343.26 query30 0.250.050.05 query31 2.860.380.39 query32 3.280.480.46 query33 2.882.902.94 query34 17.09 4.384.41 query35 4.464.454.57 query36 0.670.470.46 query37 0.180.160.16 query38 0.160.150.14 query39 0.040.040.03 query40 0.160.140.14 query41 0.090.060.05 query42 0.060.050.05 query43 0.040.040.03 Total cold run time: 110.88 s Total hot run time: 30.44 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](fe-meta) Support skip specified journal to avoid FE can't be start due to a damaged journal [doris]
doris-robot commented on PR #35783: URL: https://github.com/apache/doris/pull/35783#issuecomment-2144511215 ClickBench: Total hot run time: 30.68 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4af3039aabaca28b39f96306d1c4a88f8d62576d, data reload: false query1 0.040.030.04 query2 0.080.030.04 query3 0.230.060.05 query4 1.660.080.08 query5 0.490.480.53 query6 1.120.730.73 query7 0.020.020.02 query8 0.050.040.04 query9 0.530.490.50 query10 0.540.540.53 query11 0.170.110.12 query12 0.150.120.12 query13 0.600.600.59 query14 0.790.760.78 query15 0.830.810.82 query16 0.360.360.35 query17 1.001.031.05 query18 0.230.220.24 query19 1.781.741.73 query20 0.010.020.01 query21 15.48 0.690.67 query22 4.457.181.99 query23 18.31 1.441.28 query24 1.920.250.21 query25 0.160.090.08 query26 0.270.180.18 query27 0.080.080.08 query28 13.28 1.031.00 query29 12.94 3.353.29 query30 0.240.060.06 query31 2.870.390.39 query32 3.270.480.47 query33 2.942.872.93 query34 17.10 4.394.40 query35 4.504.464.49 query36 0.700.490.47 query37 0.170.150.16 query38 0.150.150.15 query39 0.050.040.03 query40 0.170.140.14 query41 0.090.050.04 query42 0.060.040.04 query43 0.040.040.03 Total cold run time: 109.92 s Total hot run time: 30.68 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](oom) return error when bloom filter allocate memory failed [doris]
doris-robot commented on PR #35790: URL: https://github.com/apache/doris/pull/35790#issuecomment-2144511349 ClickBench: Total hot run time: 30.41 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 87b1a17434497d22e27b5afc0d4cf14afad6a8f1, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.220.050.05 query4 1.680.070.10 query5 0.510.480.49 query6 1.130.730.72 query7 0.020.020.01 query8 0.040.040.04 query9 0.550.470.49 query10 0.530.540.52 query11 0.150.120.11 query12 0.150.120.11 query13 0.600.590.59 query14 0.780.780.78 query15 0.850.820.81 query16 0.350.360.37 query17 0.991.000.95 query18 0.240.230.26 query19 1.911.671.71 query20 0.010.010.01 query21 15.44 0.690.67 query22 4.727.201.78 query23 18.32 1.331.32 query24 1.420.350.19 query25 0.150.080.08 query26 0.270.180.18 query27 0.080.080.09 query28 13.48 1.021.00 query29 12.76 3.423.31 query30 0.230.060.05 query31 2.860.400.39 query32 3.280.480.48 query33 2.902.912.90 query34 16.98 4.424.46 query35 4.484.454.52 query36 0.710.520.47 query37 0.170.160.16 query38 0.150.150.15 query39 0.050.040.03 query40 0.170.160.14 query41 0.090.040.04 query42 0.060.040.04 query43 0.040.040.03 Total cold run time: 109.64 s Total hot run time: 30.41 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](workloadgroup)Add workload condition query used memory [doris]
wangbo commented on PR #35662: URL: https://github.com/apache/doris/pull/35662#issuecomment-2144509972 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) unix_timestamp compute signature and fold const is wrong [doris]
doris-robot commented on PR #35727: URL: https://github.com/apache/doris/pull/35727#issuecomment-2144511491 ClickBench: Total hot run time: 30.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 95ab9ce68b7e146ec94e79cc3d5f70c225b3d578, data reload: false query1 0.040.030.04 query2 0.080.040.04 query3 0.220.040.05 query4 1.680.070.07 query5 0.500.480.50 query6 1.130.720.73 query7 0.020.010.02 query8 0.050.040.04 query9 0.540.480.49 query10 0.540.550.52 query11 0.160.110.11 query12 0.150.120.11 query13 0.590.580.60 query14 0.790.780.76 query15 0.820.810.81 query16 0.360.340.36 query17 1.030.950.94 query18 0.200.240.23 query19 1.811.681.70 query20 0.010.020.01 query21 15.49 0.680.67 query22 4.826.192.26 query23 18.31 1.281.23 query24 1.920.210.22 query25 0.150.080.08 query26 0.260.170.18 query27 0.070.080.09 query28 13.35 1.021.00 query29 12.75 3.333.30 query30 0.240.050.05 query31 2.880.380.40 query32 3.270.470.47 query33 2.932.832.89 query34 17.07 4.414.37 query35 4.544.454.51 query36 0.710.490.47 query37 0.170.150.15 query38 0.160.150.15 query39 0.050.040.04 query40 0.160.140.15 query41 0.090.050.04 query42 0.060.050.05 query43 0.040.030.04 Total cold run time: 110.21 s Total hot run time: 30.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Add check editlog size mechanism for backupJob [doris]
doris-robot commented on PR #35653: URL: https://github.com/apache/doris/pull/35653#issuecomment-2144512265 ClickBench: Total hot run time: 30.92 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 581c50f0e003b355ecf07771e748cdaf76490eda, data reload: false query1 0.040.030.04 query2 0.080.040.04 query3 0.230.040.05 query4 1.680.070.07 query5 0.490.490.52 query6 1.120.720.72 query7 0.020.020.01 query8 0.050.040.05 query9 0.530.480.49 query10 0.560.540.54 query11 0.150.120.11 query12 0.150.120.13 query13 0.600.590.60 query14 0.800.780.77 query15 0.830.800.82 query16 0.360.360.37 query17 1.060.990.99 query18 0.220.240.26 query19 1.801.681.67 query20 0.020.010.01 query21 15.74 0.650.65 query22 4.126.572.33 query23 18.27 1.371.30 query24 1.330.350.25 query25 0.150.080.09 query26 0.260.190.17 query27 0.080.070.08 query28 13.39 1.021.00 query29 13.27 3.353.28 query30 0.240.050.05 query31 2.870.380.40 query32 3.280.470.47 query33 2.902.892.90 query34 16.96 4.384.46 query35 4.534.454.51 query36 0.760.490.47 query37 0.180.160.15 query38 0.150.140.15 query39 0.050.040.04 query40 0.160.140.14 query41 0.080.050.04 query42 0.050.040.04 query43 0.040.030.03 Total cold run time: 109.65 s Total hot run time: 30.92 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](exec) Support group by limit opt in BE code [doris]
doris-robot commented on PR #29641: URL: https://github.com/apache/doris/pull/29641#issuecomment-2144512891 TPC-DS: Total hot run time: 170292 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 36a6b37475e7b5bcdae7ab60bee5169a2662e4de, data reload: false query1 936 396 372 372 query2 6469248623692369 query3 6648204 206 204 query4 19509 17594 17512 17512 query5 4129444 463 444 query6 250 162 162 162 query7 4588313 289 289 query8 302 285 290 285 query9 8376242424012401 query10 450 307 282 282 query11 10578 10131 10099 10099 query12 139 93 88 88 query13 1661363 355 355 query14 10243 714077027140 query15 246 187 188 187 query16 7785267 273 267 query17 1530536 546 536 query18 1898265 262 262 query19 196 156 158 156 query20 97 89 88 88 query21 205 125 129 125 query22 4451408341514083 query23 33676 8 33046 33046 query24 11070 284928302830 query25 601 357 358 357 query26 1210156 154 154 query27 2623322 320 320 query28 7259211220862086 query29 906 600 593 593 query30 270 149 157 149 query31 967 732 750 732 query32 89 51 56 51 query33 756 279 280 279 query34 982 486 469 469 query35 743 617 605 605 query36 1076918 918 918 query37 154 72 69 69 query38 2898272427302724 query39 873 792 777 777 query40 210 126 123 123 query41 56 51 55 51 query42 115 98 96 96 query43 579 556 541 541 query44 1243737 751 737 query45 241 169 170 169 query46 1075734 714 714 query47 1899178518131785 query48 364 289 289 289 query49 1007401 401 401 query50 790 389 374 374 query51 6987685967936793 query52 98 99 87 87 query53 353 288 283 283 query54 882 447 441 441 query55 75 73 72 72 query56 280 249 257 249 query57 1144102310531023 query58 250 245 246 245 query59 3537309531823095 query60 293 269 268 268 query61 90 89 92 89 query62 655 447 454 447 query63 313 281 292 281 query64 8902227217131713 query65 3160310331263103 query66 813 323 329 323 query67 15497 14908 15419 14908 query68 4458527 537 527 query69 469 290 302 290 query70 1171116511401140 query71 388 286 285 285 query72 7070276825352535 query73 755 316 317 316 query74 5911549155295491 query75 3361263326812633 query76 2489943 865 865 query77 438 337 293 293 query78 10330 984497889788 query79 2728515 509 509 query80 1267454 456 454 query81 596 223 222 222 query82 776 101 101 101 query83 250 172 188 172 query84 250 82 82 82 query85 1565270 263 263 query86 505 299 307 299 query87 3284310031283100 query88 4290234623452345 query89 473 403 376 376 query90 1772185 184 184 query91 125 98 99 98 query92 68 52 48 48 query93 1916519 500 500 query94 1187244 185 185 query95 402 314 309 309 query96 581 264 267 264 query97 3237300031123000 query98 235 222 214 214 query99 1322839 851 839 Total cold run time: 271416 ms Total hot run time: 170292 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [feature](workloadgroup)Add workload condition query used memory [doris]
github-actions[bot] commented on PR #35662: URL: https://github.com/apache/doris/pull/35662#issuecomment-2144519120 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](exec) Support group by limit opt in BE code [doris]
doris-robot commented on PR #29641: URL: https://github.com/apache/doris/pull/29641#issuecomment-2144522523 TeamCity be ut coverage result: Function Coverage: 36.24% (9242/25503) Line Coverage: 27.57% (75836/275056) Region Coverage: 26.82% (39276/146454) Branch Coverage: 23.55% (19904/84506) Coverage Report: http://coverage.selectdb-in.cc/coverage/36a6b37475e7b5bcdae7ab60bee5169a2662e4de_36a6b37475e7b5bcdae7ab60bee5169a2662e4de/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](exec) Support group by limit opt in BE code [doris]
doris-robot commented on PR #29641: URL: https://github.com/apache/doris/pull/29641#issuecomment-2144522868 ClickBench: Total hot run time: 31.03 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 36a6b37475e7b5bcdae7ab60bee5169a2662e4de, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.04 query4 1.670.060.07 query5 0.510.470.50 query6 1.120.730.73 query7 0.010.010.02 query8 0.050.040.04 query9 0.520.480.48 query10 0.540.530.54 query11 0.150.110.11 query12 0.140.120.12 query13 0.590.580.60 query14 0.800.750.80 query15 0.840.830.81 query16 0.370.390.35 query17 0.991.051.03 query18 0.230.240.26 query19 1.831.731.72 query20 0.020.010.01 query21 15.46 0.700.67 query22 4.506.462.45 query23 18.28 1.341.26 query24 1.410.270.28 query25 0.140.090.07 query26 0.260.180.18 query27 0.070.080.08 query28 13.39 1.040.99 query29 13.23 3.333.30 query30 0.240.060.05 query31 2.880.400.38 query32 3.270.470.46 query33 2.882.902.82 query34 17.12 4.394.46 query35 4.424.474.57 query36 0.680.460.46 query37 0.180.150.15 query38 0.150.150.14 query39 0.050.030.04 query40 0.190.140.15 query41 0.080.040.04 query42 0.050.050.05 query43 0.040.030.04 Total cold run time: 109.7 s Total hot run time: 31.03 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) fix move memtable core when use multi table load [doris]
dataroaring commented on code in PR #35458:
URL: https://github.com/apache/doris/pull/35458#discussion_r1623943391
##
be/src/io/fs/multi_table_pipe.cpp:
##
@@ -61,9 +61,9 @@ Status MultiTablePipe::append_json(const char* data, size_t
size) {
}
KafkaConsumerPipePtr MultiTablePipe::get_pipe_by_table(const std::string&
table) {
-auto pipe = _planned_pipes.find(table);
-DCHECK(pipe != _planned_pipes.end());
-return pipe->second;
+auto pair = _planned_tables.find(table);
+DCHECK(pair != _planned_tables.end());
+return std::static_pointer_cast(pair->second->pipe);
Review Comment:
dynamic_cast?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) fix move memtable core when use multi table load [doris]
github-actions[bot] commented on PR #35458: URL: https://github.com/apache/doris/pull/35458#issuecomment-2144534459 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace polling for FlushToken [doris]
doris-robot commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144538860 TPC-H: Total hot run time: 39890 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ae078628e60d07579afca746062d690b77eb686d, data reload: false -- Round 1 -- q1 17691 425742424242 q2 2032195 191 191 q3 10796 131212241224 q4 10701 786 814 786 q5 7536269826302630 q6 222 138 149 138 q7 984 635 611 611 q8 9561207821322078 q9 9242665665276527 q10 9444371537413715 q11 463 246 243 243 q12 521 236 232 232 q13 1 298929522952 q14 268 216 231 216 q15 511 475 472 472 q16 510 382 385 382 q17 967 718 695 695 q18 7932768773297329 q19 1645141415421414 q20 648 308 304 304 q21 4934383031703170 q22 392 348 339 339 Total cold run time: 114777 ms Total hot run time: 39890 ms - Round 2, with runtime_filter_mode=off - q1 4330423142694231 q2 383 276 276 276 q3 2948272327142714 q4 1863160316091603 q5 5245526552805265 q6 213 129 131 129 q7 2149173617091709 q8 3161332332563256 q9 8312832183278321 q10 3879365136523651 q11 601 498 496 496 q12 783 622 607 607 q13 17590 303830263026 q14 293 276 246 246 q15 511 482 487 482 q16 476 409 428 409 q17 1760147614601460 q18 7606757373037303 q19 1667157816101578 q20 2005178717751775 q21 4857475146604660 q22 647 564 536 536 Total cold run time: 71279 ms Total hot run time: 53733 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](dynamic partition) fix dynamic partition thread met uncatch exception [doris]
doris-robot commented on PR #35778: URL: https://github.com/apache/doris/pull/35778#issuecomment-2144544279 TPC-H: Total hot run time: 41967 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2799ded39298dc55b1c399a42f0bc94976e157f4, data reload: false -- Round 1 -- q1 17610 436043514351 q2 2028190 198 190 q3 10440 115411011101 q4 10201 836 830 830 q5 7500274327612743 q6 227 139 142 139 q7 1005633 616 616 q8 9236210320982098 q9 9118669067296690 q10 9338390038583858 q11 461 258 244 244 q12 479 229 228 228 q13 17314 317032773170 q14 288 221 222 221 q15 511 467 501 467 q16 478 383 386 383 q17 998 674 718 674 q18 8614781578287815 q19 7797152514191419 q20 644 324 316 316 q21 5157418140774077 q22 400 337 338 337 Total cold run time: 119844 ms Total hot run time: 41967 ms - Round 2, with runtime_filter_mode=off - q1 4652448744344434 q2 385 271 272 271 q3 3120292229202920 q4 1893160415961596 q5 5432552154705470 q6 231 126 126 126 q7 2161181818121812 q8 3248338933713371 q9 8613854686738546 q10 4076382037993799 q11 585 483 471 471 q12 771 585 614 585 q13 16152 309331583093 q14 293 291 278 278 q15 531 487 485 485 q16 479 445 427 427 q17 1805150415131504 q18 8055777374817481 q19 1754164916001600 q20 3018178818011788 q21 4802476347084708 q22 719 542 555 542 Total cold run time: 72775 ms Total hot run time: 55307 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace polling for FlushToken [doris]
doris-robot commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144543583 TeamCity be ut coverage result: Function Coverage: 36.29% (9241/25461) Line Coverage: 27.66% (75857/274275) Region Coverage: 26.88% (39284/146160) Branch Coverage: 23.61% (19913/84352) Coverage Report: http://coverage.selectdb-in.cc/coverage/ae078628e60d07579afca746062d690b77eb686d_ae078628e60d07579afca746062d690b77eb686d/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](materialized-view) enable create mv on mow table [doris]
github-actions[bot] commented on PR #35797: URL: https://github.com/apache/doris/pull/35797#issuecomment-2144544039 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](materialized-view) enable create mv on mow table [doris]
github-actions[bot] commented on PR #35797: URL: https://github.com/apache/doris/pull/35797#issuecomment-2144544110 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
doris-robot commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2144552563 TPC-H: Total hot run time: 40262 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ebc2033a6c7266baefedb430ede8a63a4c70ea7f, data reload: false -- Round 1 -- q1 17928 461044154415 q2 2650204 189 189 q3 11468 118311171117 q4 10608 784 889 784 q5 7578272626732673 q6 224 141 143 141 q7 957 625 608 608 q8 9596209021092090 q9 8896654864506450 q10 8906378537003700 q11 476 241 241 241 q12 419 230 225 225 q13 17765 296629912966 q14 265 209 213 209 q15 515 464 472 464 q16 504 380 387 380 q17 975 681 817 681 q18 8132753375247524 q19 5098152715281527 q20 641 304 307 304 q21 5010323639303236 q22 392 340 338 338 Total cold run time: 119003 ms Total hot run time: 40262 ms - Round 2, with runtime_filter_mode=off - q1 4379429842354235 q2 364 277 266 266 q3 3037276327232723 q4 1848163016721630 q5 5252529652585258 q6 223 132 131 131 q7 2156177617231723 q8 3231335632943294 q9 8361831783278317 q10 3940370536933693 q11 580 487 485 485 q12 770 597 611 597 q13 17524 301129702970 q14 292 263 255 255 q15 523 488 471 471 q16 485 408 428 408 q17 1771150814511451 q18 7751744973567356 q19 4419164716841647 q20 2023182217701770 q21 4947480248164802 q22 609 534 525 525 Total cold run time: 74485 ms Total hot run time: 54007 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
doris-robot commented on PR #35798: URL: https://github.com/apache/doris/pull/35798#issuecomment-2144556373 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Bug] file upload failed after the cumulative upload exceeded 1g [doris]
fornaix opened a new issue, #35799: URL: https://github.com/apache/doris/issues/35799 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 2.1.0 ### What's Wrong? There is a "Data Import" menu in the Web UI, we can upload files and import data into the table. When we cumulative upload exceeds 1g, it will fail, even if we delete the file.  ### What You Expected? No such exception. ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
yiguolei opened a new pull request, #35798: URL: https://github.com/apache/doris/pull/35798 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
yiguolei commented on PR #35798: URL: https://github.com/apache/doris/pull/35798#issuecomment-2144557188 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe ui) fix the file upload failed after the cumulative upload exceeded 1g [doris]
doris-robot commented on PR #35800: URL: https://github.com/apache/doris/pull/35800#issuecomment-2144564845 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace polling for FlushToken [doris]
doris-robot commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144567639 TPC-DS: Total hot run time: 172589 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ae078628e60d07579afca746062d690b77eb686d, data reload: false query1 918 389 377 377 query2 6459240522872287 query3 6648202 207 202 query4 19338 17771 17218 17218 query5 4141437 453 437 query6 256 171 153 153 query7 4594304 287 287 query8 303 268 274 268 query9 8506240123842384 query10 439 294 270 270 query11 10420 10088 10010 10010 query12 135 90 92 90 query13 1632368 365 365 query14 9633749171057105 query15 223 190 195 190 query16 7915271 267 267 query17 1837542 535 535 query18 2008290 280 280 query19 202 161 155 155 query20 92 87 92 87 query21 218 136 135 135 query22 4329394438933893 query23 33770 33074 32871 32871 query24 11905 272427452724 query25 674 375 354 354 query26 1777159 151 151 query27 2966308 315 308 query28 7290205320712053 query29 1073608 596 596 query30 277 148 158 148 query31 933 737 738 737 query32 100 56 54 54 query33 774 278 282 278 query34 968 483 475 475 query35 779 630 603 603 query36 1096917 934 917 query37 199 70 70 70 query38 2865274027142714 query39 869 807 812 807 query40 286 127 123 123 query41 56 51 54 51 query42 115 97 99 97 query43 583 536 546 536 query44 1185726 734 726 query45 196 168 168 168 query46 1073739 715 715 query47 1838176017661760 query48 361 290 290 290 query49 1184408 401 401 query50 788 385 389 385 query51 6907684968096809 query52 102 92 93 92 query53 352 282 291 282 query54 1023449 428 428 query55 72 71 71 71 query56 272 256 258 256 query57 1163102810401028 query58 269 262 249 249 query59 3297344332313231 query60 284 265 277 265 query61 88 87 88 87 query62 630 465 444 444 query63 326 291 292 291 query64 9887223517121712 query65 3227311831333118 query66 1338328 347 328 query67 15510 15126 14910 14910 query68 4622526 532 526 query69 442 301 306 301 query70 1211109511181095 query71 419 278 276 276 query72 7046561757525617 query73 746 327 323 323 query74 5858549554635463 query75 3488261826722618 query76 2792936 958 936 query77 417 281 287 281 query78 10185 989898669866 query79 1809515 523 515 query80 2068476 496 476 query81 616 219 212 212 query82 1092108 104 104 query83 324 167 173 167 query84 271 87 90 87 query85 1364282 268 268 query86 419 314 309 309 query87 3232308230643064 query88 3219234723592347 query89 480 393 392 392 query90 1760191 189 189 query91 138 97 168 97 query92 62 50 49 49 query93 1411523 500 500 query94 1231189 185 185 query95 407 312 305 305 query96 583 264 271 264 query97 3157305630183018 query98 243 216 217 216 query99 1225854 815 815 Total cold run time: 273310 ms Total hot run time: 172589 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
[PR] [fix](fe ui) fix the file upload failed after the cumulative upload exceeded 1g [doris]
fornaix opened a new pull request, #35800: URL: https://github.com/apache/doris/pull/35800 ## Proposed changes Issue Number: close #35799 When removing a file, update the totalFileSize variable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
github-actions[bot] commented on PR #35798: URL: https://github.com/apache/doris/pull/35798#issuecomment-2144570820 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
github-actions[bot] commented on PR #35798: URL: https://github.com/apache/doris/pull/35798#issuecomment-2144571014 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](log) refine the FE logger [doris]
doris-robot commented on PR #35679: URL: https://github.com/apache/doris/pull/35679#issuecomment-2144571613 TPC-H: Total hot run time: 41472 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fc7bb66f4c5094c8674ad6afaa018292ec82f2be, data reload: false -- Round 1 -- q1 17604 435042724272 q2 2022190 194 190 q3 10459 122511251125 q4 10207 857 787 787 q5 7493271326782678 q6 227 134 138 134 q7 958 617 623 617 q8 9232213220942094 q9 9223667467156674 q10 9103395638993899 q11 475 235 248 235 q12 456 233 241 233 q13 18355 324231613161 q14 260 221 237 221 q15 513 481 484 481 q16 526 404 390 390 q17 1022653 675 653 q18 8416773478957734 q19 8455129612131213 q20 664 320 314 314 q21 5039403040934030 q22 407 337 350 337 Total cold run time: 121116 ms Total hot run time: 41472 ms - Round 2, with runtime_filter_mode=off - q1 4502446744894467 q2 363 277 267 267 q3 3139293229112911 q4 2031164716161616 q5 5342551854685468 q6 223 127 128 127 q7 2158178318061783 q8 3232333534043335 q9 8650855885968558 q10 4099387338443844 q11 585 498 501 498 q12 755 614 602 602 q13 16672 305831273058 q14 300 272 262 262 q15 518 490 486 486 q16 475 440 433 433 q17 1819152315161516 q18 7908763872927292 q19 1772158415991584 q20 3020179417911791 q21 5042475946534653 q22 681 562 554 554 Total cold run time: 73286 ms Total hot run time: 55105 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](build index)Make build index and clone mutually exclusive and add timeout for index change job [doris]
doris-robot commented on PR #35724: URL: https://github.com/apache/doris/pull/35724#issuecomment-2144574641 TPC-H: Total hot run time: 40624 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fd5a041b7762c62cce08ba8c0f8f8fc97a739a35, data reload: false -- Round 1 -- q1 17637 435542044204 q2 2029185 203 185 q3 10448 118311491149 q4 10186 843 880 843 q5 7489269826522652 q6 231 140 141 140 q7 963 633 612 612 q8 9250212321092109 q9 9160665866836658 q10 9209389638293829 q11 448 243 235 235 q12 448 228 226 226 q13 17283 321532363215 q14 274 215 210 210 q15 503 477 470 470 q16 516 383 388 383 q17 960 649 534 534 q18 8324776176917691 q19 3960129714191297 q20 652 325 323 323 q21 5052332740893327 q22 416 341 332 332 Total cold run time: 115438 ms Total hot run time: 40624 ms - Round 2, with runtime_filter_mode=off - q1 4575444943924392 q2 379 277 252 252 q3 3158289728832883 q4 2001161715731573 q5 5349549054915490 q6 224 128 129 128 q7 2150177717861777 q8 3181335933713359 q9 8509859085778577 q10 4118380538623805 q11 583 474 484 474 q12 749 615 567 567 q13 17096 309931523099 q14 286 275 262 262 q15 518 484 477 477 q16 493 420 448 420 q17 1791150515001500 q18 7948776674937493 q19 1748163415831583 q20 3028181717821782 q21 8534474747114711 q22 768 554 573 554 Total cold run time: 77186 ms Total hot run time: 55158 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [BugFix](TabletInvertedIndex) fix replica not found in TabletInvertedIndex [doris]
Johnnyssc commented on PR #35791: URL: https://github.com/apache/doris/pull/35791#issuecomment-2144575311 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](debugtimeout) should print debug stack when timeout [doris]
github-actions[bot] commented on PR #35798: URL: https://github.com/apache/doris/pull/35798#issuecomment-2144575833 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) support generated column [doris]
feiniaofeiafei commented on PR #35284: URL: https://github.com/apache/doris/pull/35284#issuecomment-2144575968 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](dynamic partition) fix dynamic partition thread met uncatch exception [doris]
doris-robot commented on PR #35778: URL: https://github.com/apache/doris/pull/35778#issuecomment-2144576948 TPC-DS: Total hot run time: 172339 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2799ded39298dc55b1c399a42f0bc94976e157f4, data reload: false query1 915 395 369 369 query2 6466240123852385 query3 6644210 203 203 query4 20538 17526 17383 17383 query5 4120450 436 436 query6 241 170 170 170 query7 4583307 292 292 query8 301 273 276 273 query9 8580242024112411 query10 450 299 284 284 query11 10636 10113 99779977 query12 133 88 88 88 query13 1635358 359 358 query14 8444716669446944 query15 229 181 185 181 query16 7143276 266 266 query17 1019535 515 515 query18 1907275 266 266 query19 201 157 143 143 query20 95 88 91 88 query21 211 152 127 127 query22 4213407540644064 query23 33592 32929 33006 32929 query24 11292 291228242824 query25 644 355 361 355 query26 1237156 157 156 query27 2384310 318 310 query28 6794209420912091 query29 929 620 580 580 query30 290 149 154 149 query31 951 747 720 720 query32 95 53 56 53 query33 764 290 301 290 query34 967 472 463 463 query35 745 614 628 614 query36 1116934 935 934 query37 142 67 70 67 query38 2849281027232723 query39 859 801 822 801 query40 204 125 124 124 query41 52 50 54 50 query42 117 100 98 98 query43 612 538 532 532 query44 1229720 728 720 query45 200 171 170 170 query46 1054741 693 693 query47 1870177318221773 query48 366 295 304 295 query49 1051408 413 408 query50 780 394 375 375 query51 6909669767166697 query52 101 90 86 86 query53 349 288 284 284 query54 936 438 449 438 query55 71 76 73 73 query56 279 249 254 249 query57 1115106310701063 query58 251 248 237 237 query59 3553314633903146 query60 322 272 268 268 query61 101 93 90 90 query62 659 437 462 437 query63 320 290 289 289 query64 8913219017421742 query65 3159311930993099 query66 1059334 325 325 query67 15284 15134 15040 15040 query68 4562535 523 523 query69 479 316 303 303 query70 1112103611361036 query71 371 340 273 273 query72 6963603753735373 query73 744 325 319 319 query74 5980552155005500 query75 3355267526302630 query76 2344940 850 850 query77 430 286 287 286 query78 10210 966997439669 query79 2365516 499 499 query80 1116455 461 455 query81 597 222 218 218 query82 695 103 103 103 query83 240 166 167 166 query84 270 84 83 83 query85 1723280 315 280 query86 486 319 313 313 query87 3309318730503050 query88 4280233923272327 query89 462 395 370 370 query90 1791185 187 185 query91 127 98 100 98 query92 60 49 50 49 query93 2470503 491 491 query94 1051189 186 186 query95 402 309 321 309 query96 598 267 260 260 query97 3181298429842984 query98 240 221 218 218 query99 1253861 850 850 Total cold run time: 268536 ms Total hot run time: 172339 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [Improvement](coldheat) add statment to show objects which use storage policy [doris]
github-actions[bot] commented on PR #35741: URL: https://github.com/apache/doris/pull/35741#issuecomment-2144579614 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](coldheat) add statment to show objects which use storage policy [doris]
github-actions[bot] commented on PR #35741: URL: https://github.com/apache/doris/pull/35741#issuecomment-2144579691 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression) Fix txn_insert execute timeout [doris]
mymeiyi commented on PR #35801: URL: https://github.com/apache/doris/pull/35801#issuecomment-2144581167 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](regression) Fix txn_insert execute timeout [doris]
mymeiyi opened a new pull request, #35801: URL: https://github.com/apache/doris/pull/35801 ## Proposed changes 1. The execuete timeout is set to 5 seconds and forget to rest, this will make `txn_insert` execute timeout. 2. Add a `insert overwrite` case which is not supported in txn insert. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression) Fix txn_insert execute timeout [doris]
doris-robot commented on PR #35801: URL: https://github.com/apache/doris/pull/35801#issuecomment-2144579294 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](load) use notify to replace polling for FlushToken [doris]
doris-robot commented on PR #35796: URL: https://github.com/apache/doris/pull/35796#issuecomment-2144582928 ClickBench: Total hot run time: 29.97 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ae078628e60d07579afca746062d690b77eb686d, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.220.060.05 query4 1.660.070.07 query5 0.500.470.48 query6 1.150.740.71 query7 0.020.020.02 query8 0.050.040.04 query9 0.550.480.48 query10 0.540.550.52 query11 0.160.110.11 query12 0.150.120.11 query13 0.590.580.59 query14 0.780.750.77 query15 0.840.810.81 query16 0.370.350.35 query17 0.990.940.99 query18 0.230.250.23 query19 1.801.721.78 query20 0.020.010.01 query21 15.46 0.690.66 query22 4.318.181.42 query23 18.29 1.391.27 query24 1.500.350.22 query25 0.150.080.09 query26 0.280.170.17 query27 0.090.090.08 query28 13.35 1.021.00 query29 13.00 3.343.32 query30 0.250.060.05 query31 2.880.380.39 query32 3.290.460.46 query33 2.932.912.90 query34 16.81 4.404.39 query35 4.454.464.49 query36 0.650.460.47 query37 0.170.150.15 query38 0.160.150.15 query39 0.050.040.04 query40 0.170.160.15 query41 0.100.050.05 query42 0.060.050.04 query43 0.040.030.04 Total cold run time: 109.18 s Total hot run time: 29.97 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hive) support hive3 timestamp with local time zone [doris]
morningman commented on PR #35664: URL: https://github.com/apache/doris/pull/35664#issuecomment-2144583408 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbcScan) Change the mysql function that does not support pushdown in JdbcScan to Config [doris]
doris-robot commented on PR #35196: URL: https://github.com/apache/doris/pull/35196#issuecomment-2144584514 TPC-DS: Total hot run time: 170328 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ebc2033a6c7266baefedb430ede8a63a4c70ea7f, data reload: false query1 943 380 374 374 query2 6480245923532353 query3 6651206 201 201 query4 19276 17361 17298 17298 query5 4118482 501 482 query6 245 165 192 165 query7 4584290 291 290 query8 333 290 291 290 query9 8426238923722372 query10 451 291 283 283 query11 10464 10089 query12 132 94 87 87 query13 1633371 358 358 query14 10177 71487148 query15 229 195 185 185 query16 7887282 283 282 query17 1816543 524 524 query18 1997280 277 277 query19 208 163 161 161 query20 95 92 95 92 query21 205 131 131 131 query22 4222398939983989 query23 34114 33092 33221 33092 query24 12106 288428232823 query25 697 389 424 389 query26 1790159 159 159 query27 2990320 320 320 query28 7697206320592059 query29 1109624 587 587 query30 292 155 148 148 query31 979 737 746 737 query32 96 57 53 53 query33 770 296 295 295 query34 976 470 500 470 query35 764 622 626 622 query36 1079929 956 929 query37 288 69 71 69 query38 2856275127312731 query39 863 803 798 798 query40 284 129 129 129 query41 58 57 59 57 query42 126 97 100 97 query43 632 562 557 557 query44 1230742 752 742 query45 202 165 168 165 query46 1079696 696 696 query47 1855176517551755 query48 386 297 294 294 query49 1188410 415 410 query50 777 395 405 395 query51 6951680567836783 query52 99 94 88 88 query53 356 299 288 288 query54 979 460 447 447 query55 76 74 78 74 query56 289 265 284 265 query57 1171106610281028 query58 262 288 251 251 query59 3542326234913262 query60 305 295 270 270 query61 97 94 93 93 query62 664 471 459 459 query63 317 292 293 292 query64 980918251825 query65 3223311131243111 query66 1374337 320 320 query67 15407 14852 14920 14852 query68 5370550 539 539 query69 606 464 400 400 query70 1122102511381025 query71 469 284 280 280 query72 7622272725942594 query73 767 327 327 327 query74 5912556154795479 query75 3842266926992669 query76 3745948 873 873 query77 650 311 291 291 query78 10382 994996689668 query79 2500518 515 515 query80 2481481 474 474 query81 565 221 221 221 query82 1353109 103 103 query83 317 179 174 174 query84 267 92 86 86 query85 1565343 275 275 query86 486 326 300 300 query87 3250304230803042 query88 3714236323482348 query89 493 401 387 387 query90 1798189 192 189 query91 134 98 98 98 query92 66 50 50 50 query93 2195518 494 494 query94 1230187 187 187 query95 403 314 315 314 query96 593 268 272 268 query97 3229301629762976 query98 245 219 217 217 query99 1328866 838 838 Total cold run time: 281475 ms Total hot run time: 170328 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [fix](move-memtable) fix move memtable core when use multi table load [doris]
liaoxin01 commented on code in PR #35458:
URL: https://github.com/apache/doris/pull/35458#discussion_r1624004047
##
be/src/io/fs/multi_table_pipe.cpp:
##
@@ -151,112 +161,106 @@ Status MultiTablePipe::dispatch(const std::string&
table, const char* data, size
#ifndef BE_TEST
Status MultiTablePipe::request_and_exec_plans() {
-if (_unplanned_pipes.empty()) {
+if (_unplanned_tables.empty()) {
return Status::OK();
}
-// get list of table names in unplanned pipes
-std::vector tables;
fmt::memory_buffer log_buffer;
log_buffer.clear();
-fmt::format_to(log_buffer, "request plans for {} tables: [ ",
_unplanned_pipes.size());
-for (auto& pair : _unplanned_pipes) {
-tables.push_back(pair.first);
+fmt::format_to(log_buffer, "request plans for {} tables: [ ",
_unplanned_tables.size());
+for (auto& pair : _unplanned_tables) {
fmt::format_to(log_buffer, "{} ", pair.first);
}
fmt::format_to(log_buffer, "]");
LOG(INFO) << fmt::to_string(log_buffer);
-TStreamLoadPutRequest request;
-set_request_auth(&request, _ctx->auth);
-request.db = _ctx->db;
-request.table_names = tables;
-request.__isset.table_names = true;
-request.txnId = _ctx->txn_id;
-request.formatType = _ctx->format;
-request.__set_compress_type(_ctx->compress_type);
-request.__set_header_type(_ctx->header_type);
-request.__set_loadId(_ctx->id.to_thrift());
-request.fileType = TFileType::FILE_STREAM;
-request.__set_thrift_rpc_timeout_ms(config::thrift_rpc_timeout_ms);
-request.__set_memtable_on_sink_node(_ctx->memtable_on_sink_node);
-request.__set_user(_ctx->qualified_user);
-request.__set_cloud_cluster(_ctx->cloud_cluster);
-// no need to register new_load_stream_mgr coz it is already done in
routineload submit task
-
-// plan this load
-ExecEnv* exec_env = doris::ExecEnv::GetInstance();
-TNetworkAddress master_addr = exec_env->master_info()->network_address;
-int64_t stream_load_put_start_time = MonotonicNanos();
-RETURN_IF_ERROR(ThriftRpcHelper::rpc(
-master_addr.hostname, master_addr.port,
-[&request, this](FrontendServiceConnection& client) {
-client->streamLoadMultiTablePut(_ctx->multi_table_put_result,
request);
-}));
-_ctx->stream_load_put_cost_nanos = MonotonicNanos() -
stream_load_put_start_time;
-
-Status plan_status(Status::create(_ctx->multi_table_put_result.status));
-if (!plan_status.ok()) {
-LOG(WARNING) << "plan streaming load failed. errmsg=" << plan_status
<< _ctx->brief();
-return plan_status;
-}
-
Status st;
-if (_ctx->multi_table_put_result.__isset.params &&
-!_ctx->multi_table_put_result.__isset.pipeline_params) {
-st = exec_plans(exec_env, _ctx->multi_table_put_result.params);
-} else if (!_ctx->multi_table_put_result.__isset.params &&
- _ctx->multi_table_put_result.__isset.pipeline_params) {
-st = exec_plans(exec_env,
_ctx->multi_table_put_result.pipeline_params);
-} else {
-return Status::Aborted("too many or too few params are set in
multi_table_put_result.");
-}
+for (auto& pair : _unplanned_tables) {
+TStreamLoadPutRequest request;
+set_request_auth(&request, _ctx->auth);
+std::vector tables;
+tables.push_back(pair.first);
+request.db = _ctx->db;
+request.table_names = tables;
+request.__isset.table_names = true;
+request.txnId = _ctx->txn_id;
+request.formatType = _ctx->format;
+request.__set_compress_type(_ctx->compress_type);
+request.__set_header_type(_ctx->header_type);
+request.__set_loadId((pair.second->id).to_thrift());
+request.fileType = TFileType::FILE_STREAM;
+request.__set_thrift_rpc_timeout_ms(config::thrift_rpc_timeout_ms);
+request.__set_memtable_on_sink_node(_ctx->memtable_on_sink_node);
+request.__set_user(_ctx->qualified_user);
+request.__set_cloud_cluster(_ctx->cloud_cluster);
+// no need to register new_load_stream_mgr coz it is already done in
routineload submit task
+
+// plan this load
+ExecEnv* exec_env = doris::ExecEnv::GetInstance();
+TNetworkAddress master_addr = exec_env->master_info()->network_address;
+int64_t stream_load_put_start_time = MonotonicNanos();
+RETURN_IF_ERROR(ThriftRpcHelper::rpc(
Review Comment:
Can't retrieve execution plans for multiple tables in one RPC now？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
Re: [PR] [fix](mtmv) Mapping materialization statistics's expressionToColumnStats to mv scan plan based [doris]
morrySnow merged PR #35749: URL: https://github.com/apache/doris/pull/35749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](dynamic partition) fix dynamic partition thread met uncatch exception [doris]
doris-robot commented on PR #35778: URL: https://github.com/apache/doris/pull/35778#issuecomment-2144588355 ClickBench: Total hot run time: 30.97 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2799ded39298dc55b1c399a42f0bc94976e157f4, data reload: false query1 0.040.040.04 query2 0.080.040.04 query3 0.230.060.06 query4 1.670.080.07 query5 0.510.480.50 query6 1.120.720.72 query7 0.020.020.01 query8 0.050.040.05 query9 0.550.480.49 query10 0.530.540.54 query11 0.150.120.11 query12 0.150.120.12 query13 0.600.600.60 query14 0.790.760.78 query15 0.840.820.82 query16 0.370.370.37 query17 1.021.031.00 query18 0.220.240.26 query19 1.811.671.67 query20 0.020.010.01 query21 15.72 0.660.64 query22 4.066.782.18 query23 18.29 1.411.30 query24 1.790.300.24 query25 0.130.090.08 query26 0.270.170.17 query27 0.080.070.08 query28 13.21 1.011.00 query29 13.12 3.403.41 query30 0.240.060.05 query31 2.850.390.38 query32 3.280.470.47 query33 2.892.872.93 query34 16.92 4.394.38 query35 4.584.494.52 query36 0.720.510.49 query37 0.180.150.16 query38 0.150.150.15 query39 0.040.030.04 query40 0.170.140.15 query41 0.090.040.05 query42 0.050.050.04 query43 0.040.040.03 Total cold run time: 109.64 s Total hot run time: 30.97 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](mtmv) Mapping materialization statistics's expressionToColumnStats to mv scan plan based (#35749)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new f744276c77d [fix](mtmv) Mapping materialization statistics's
expressionToColumnStats to mv scan plan based (#35749)
f744276c77d is described below
commit f744276c77d05256e9dd7a3a8b0601fd50e60f42
Author: seawinde <149132972+seawi...@users.noreply.github.com>
AuthorDate: Mon Jun 3 16:25:52 2024 +0800
[fix](mtmv) Mapping materialization statistics's expressionToColumnStats to
mv scan plan based (#35749)
this is brought by #35436
in the method `MaterializationContext#getPlanStatistics` this get the
materialization context orginal plan statistics.
but the `expressionToColumnStats` in statistics is the slot of original
plan.
We want the statistics of original plan but the
`expressionToColumnStats` in which should be mv scan plan based actually.
So add the method
`MaterializationContext#normalizeStatisticsColumnExpression`. when after
generate the PlanStatistics in MaterializationContext, should call the
normalizeStatisticsColumnExpression method.
---
.../mv/AbstractMaterializedViewAggregateRule.java | 6 +-
.../mv/AbstractMaterializedViewJoinRule.java | 4 +-
.../mv/AbstractMaterializedViewRule.java | 23 ---
.../mv/AsyncMaterializationContext.java| 6 +-
.../exploration/mv/MaterializationContext.java | 74 +-
.../exploration/mv/MaterializedViewScanRule.java | 4 +-
.../org/apache/doris/statistics/Statistics.java| 4 ++
.../doris/nereids/mv/IdStatisticsMapTest.java | 16 +++--
8 files changed, 97 insertions(+), 40 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewAggregateRule.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewAggregateRule.java
index 9a8b2fd0243..6883247ce16 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewAggregateRule.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewAggregateRule.java
@@ -97,7 +97,7 @@ public abstract class AbstractMaterializedViewAggregateRule
extends AbstractMate
viewStructInfo, materializationContext)) {
List rewrittenQueryExpressions =
rewriteExpression(queryTopPlan.getOutput(),
queryTopPlan,
-materializationContext.getExprToScanExprMapping(),
+materializationContext.getShuttledExprToScanExprMapping(),
viewToQuerySlotMapping,
true,
queryStructInfo.getTableBitSet());
@@ -121,7 +121,7 @@ public abstract class AbstractMaterializedViewAggregateRule
extends AbstractMate
() -> String.format("expressionToWrite = %s,\n
mvExprToMvScanExprMapping = %s,\n"
+ "viewToQuerySlotMapping = %s",
queryTopPlan.getOutput(),
-materializationContext.getExprToScanExprMapping(),
+
materializationContext.getShuttledExprToScanExprMapping(),
viewToQuerySlotMapping));
}
// if view is scalar aggregate but query is not. Or if query is scalar
aggregate but view is not
@@ -150,7 +150,7 @@ public abstract class AbstractMaterializedViewAggregateRule
extends AbstractMate
List queryExpressions = queryTopPlan.getOutput();
// permute the mv expr mapping to query based
Map mvExprToMvScanExprQueryBased =
-
materializationContext.getExprToScanExprMapping().keyPermute(viewToQuerySlotMapping)
+
materializationContext.getShuttledExprToScanExprMapping().keyPermute(viewToQuerySlotMapping)
.flattenMap().get(0);
for (Expression topExpression : queryExpressions) {
// if agg function, try to roll up and rewrite
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewJoinRule.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewJoinRule.java
index 4f95c248eca..3bf037e0189 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewJoinRule.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/AbstractMaterializedViewJoinRule.java
@@ -46,7 +46,7 @@ public abstract class AbstractMaterializedViewJoinRule
extends AbstractMateriali
List expressionsRewritten = rewriteExpression(
queryStructInfo.getExpressions(),
queryStructInfo.getTopPlan(),
[PR] [improvement](partial update)add more logs for partial update [doris]
zhannngchen opened a new pull request, #35802: URL: https://github.com/apache/doris/pull/35802 ## Proposed changes Issue Number: close #xxx To make us to pinpoint the issues of partial update easier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](log) refine the FE logger [doris]
github-actions[bot] commented on PR #35679: URL: https://github.com/apache/doris/pull/35679#issuecomment-2144594864 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
