Re: [PR] [opt](nereids) refine left semi/anti shortcut cost [doris]
xzj7019 commented on PR #37060: URL: https://github.com/apache/doris/pull/37060#issuecomment-2205239396 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) partition not exists error msg is not contain table name [doris]
doris-robot commented on PR #37160: URL: https://github.com/apache/doris/pull/37160#issuecomment-2205243503 TPC-H: Total hot run time: 39601 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit da3a28003e908a90ea1b8a4a8d0fdb7c4a514e7a, data reload: false -- Round 1 -- q1 17620 428242604260 q2 2011186 183 183 q3 10490 116510831083 q4 10192 802 796 796 q5 7498263425842584 q6 223 136 140 136 q7 939 597 611 597 q8 9230205720462046 q9 8976650464506450 q10 9045373137393731 q11 464 240 242 240 q12 489 242 238 238 q13 17767 301930023002 q14 268 230 234 230 q15 536 478 498 478 q16 516 380 385 380 q17 970 644 582 582 q18 7953759174467446 q19 5450154113261326 q20 650 323 334 323 q21 4985314838413148 q22 394 342 344 342 Total cold run time: 11 ms Total hot run time: 39601 ms - Round 2, with runtime_filter_mode=off - q1 4387428243134282 q2 384 273 267 267 q3 3040285028872850 q4 2010174616501650 q5 5665557854865486 q6 235 132 130 130 q7 2153180319091803 q8 3329344234213421 q9 8927886390768863 q10 4250408238943894 q11 593 516 510 510 q12 869 676 689 676 q13 16466 318731693169 q14 303 299 299 299 q15 551 517 492 492 q16 498 435 417 417 q17 1819152715301527 q18 8339779478407794 q19 2922157717471577 q20 2081184618821846 q21 7824506647914791 q22 657 529 556 529 Total cold run time: 77302 ms Total hot run time: 56273 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
CalvinKirs opened a new pull request, #37205: URL: https://github.com/apache/doris/pull/37205 ## Proposed changes FYI https://github.com/apache/doris-shade/pull/46 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids)push Limit to local agg [doris]
englefly commented on PR #34853: URL: https://github.com/apache/doris/pull/34853#issuecomment-2205248264 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
doris-robot commented on PR #37205: URL: https://github.com/apache/doris/pull/37205#issuecomment-2205248378 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
CalvinKirs commented on PR #37205: URL: https://github.com/apache/doris/pull/37205#issuecomment-2205248626 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [feat](nereids) support explain delete from clause #36782 (#37100)
This is an automated email from the ASF dual-hosted git repository.
englefly pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new b3f2bd20e32 [feat](nereids) support explain delete from clause #36782
(#37100)
b3f2bd20e32 is described below
commit b3f2bd20e3254a3021834671ee2af9ca77ba6646
Author: minghong
AuthorDate: Wed Jul 3 15:08:08 2024 +0800
[feat](nereids) support explain delete from clause #36782 (#37100)
## Proposed changes
pick from #36782
support explain like:
explain delete from T where A=1
Issue Number: close #xxx
(cherry picked from commit dc369cd13096dbb90700f7fbf8f35a9059d9906f)
## Proposed changes
Issue Number: close #xxx
---
.../doris/nereids/parser/LogicalPlanBuilder.java | 16 ++-
.../trees/plans/commands/DeleteFromCommand.java| 92 ++-
.../plans/commands/DeleteFromUsingCommand.java | 90 +++
.../data/delete_p0/test_delete_on_value.out| 2 +-
.../delete/delete_mow_partial_update.out | 12 +-
.../partial_update/test_partial_update_delete.out | 12 +-
.../delete/delete_mow_partial_update.groovy| 2 +-
.../suites/nereids_p0/explain/explain_dml.groovy | 124 +
8 files changed, 252 insertions(+), 98 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
index 27d0e4cbd3c..543a5630243 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
@@ -925,9 +925,12 @@ public class LogicalPlanBuilder extends
DorisParserBaseVisitor {
if (ctx.tableAlias().strictIdentifier() != null) {
tableAlias = ctx.tableAlias().getText();
}
-if (ctx.USING() == null && ctx.cte() == null && ctx.explain() == null)
{
+
+Command deleteCommand;
+if (ctx.USING() == null && ctx.cte() == null) {
query = withFilter(query, Optional.ofNullable(ctx.whereClause()));
-return new DeleteFromCommand(tableName, tableAlias,
partitionSpec.first, partitionSpec.second, query);
+deleteCommand = new DeleteFromCommand(tableName, tableAlias,
partitionSpec.first,
+partitionSpec.second, query);
} else {
// convert to insert into select
query = withRelations(query, ctx.relations().relation());
@@ -936,8 +939,13 @@ public class LogicalPlanBuilder extends
DorisParserBaseVisitor {
if (ctx.cte() != null) {
cte = Optional.ofNullable(withCte(query, ctx.cte()));
}
-return withExplain(new DeleteFromUsingCommand(tableName,
tableAlias,
-partitionSpec.first, partitionSpec.second, query, cte),
ctx.explain());
+deleteCommand = new DeleteFromUsingCommand(tableName, tableAlias,
+partitionSpec.first, partitionSpec.second, query, cte);
+}
+if (ctx.explain() != null) {
+return withExplain(deleteCommand, ctx.explain());
+} else {
+return deleteCommand;
}
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DeleteFromCommand.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DeleteFromCommand.java
index 6563d815382..c485802ae2e 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DeleteFromCommand.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DeleteFromCommand.java
@@ -28,11 +28,15 @@ import org.apache.doris.catalog.Env;
import org.apache.doris.catalog.KeysType;
import org.apache.doris.catalog.MaterializedIndexMeta;
import org.apache.doris.catalog.OlapTable;
+import org.apache.doris.catalog.TableIf;
import org.apache.doris.common.Config;
import org.apache.doris.common.ErrorCode;
import org.apache.doris.mysql.privilege.PrivPredicate;
import org.apache.doris.nereids.NereidsPlanner;
+import org.apache.doris.nereids.analyzer.UnboundAlias;
import org.apache.doris.nereids.analyzer.UnboundRelation;
+import org.apache.doris.nereids.analyzer.UnboundSlot;
+import org.apache.doris.nereids.analyzer.UnboundTableSinkCreator;
import org.apache.doris.nereids.exceptions.AnalysisException;
import org.apache.doris.nereids.glue.LogicalPlanAdapter;
import org.apache.doris.nereids.rules.RuleType;
@@ -41,12 +45,17 @@ import
org.apache.doris.nereids.trees.expressions.ComparisonPredicate;
import org.apache.doris.nereids.trees.expressions.Expression;
import org.apache.doris.nereids.trees.expressions.InPredicate;
import org.apache.doris.nereids.trees.expressions.I
Re: [PR] [minor](dependencies) Incorporate BOMs for Jetty, gRPC, Netty, and Jackson to enhance dependency management [doris]
CalvinKirs commented on PR #36138: URL: https://github.com/apache/doris/pull/36138#issuecomment-2205249487 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [mv](nereids) mv cost related PRs (#35652 #35701 #35864 #36368 #36789 #34970) [doris]
englefly commented on PR #37097: URL: https://github.com/apache/doris/pull/37097#issuecomment-2205251482 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids) support explain delete from clause #36782 [doris]
englefly merged PR #37100: URL: https://github.com/apache/doris/pull/37100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies) Incorporate BOMs for Jetty, gRPC, Netty, and Jackson to enhance dependency management [doris]
CalvinKirs commented on PR #36138: URL: https://github.com/apache/doris/pull/36138#issuecomment-2205250489 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore][fe] Get meta returns dropped partitions in binlog manager [doris]
doris-robot commented on PR #37196: URL: https://github.com/apache/doris/pull/37196#issuecomment-2205251220 TPC-DS: Total hot run time: 174373 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 60785964359f524c451afa8f671cb285fb505505, data reload: false query1 915 397 374 374 query2 6469259223922392 query3 6645207 213 207 query4 18742 17651 17475 17475 query5 4198486 499 486 query6 265 177 165 165 query7 4598306 306 306 query8 308 311 290 290 query9 8853240123732373 query10 604 315 288 288 query11 10533 10230 10165 10165 query12 138 89 91 89 query13 1641380 374 374 query14 10238 765379167653 query15 267 187 198 187 query16 8172273 266 266 query17 1896553 538 538 query18 2127275 288 275 query19 199 145 155 145 query20 95 84 86 84 query21 214 136 139 136 query22 4355432040424042 query23 33811 33228 33121 33121 query24 11155 287429202874 query25 598 367 364 364 query26 1127158 158 158 query27 2957321 320 320 query28 7465208620602060 query29 853 634 619 619 query30 278 154 158 154 query31 961 736 759 736 query32 98 53 53 53 query33 765 295 324 295 query34 892 484 479 479 query35 755 633 629 629 query36 1106948 944 944 query37 152 76 75 75 query38 2849275227432743 query39 854 816 837 816 query40 213 126 131 126 query41 53 53 56 53 query42 115 100 101 100 query43 605 550 565 550 query44 1194738 757 738 query45 206 162 167 162 query46 1082717 733 717 query47 1852175417681754 query48 382 309 298 298 query49 1091426 425 425 query50 765 391 402 391 query51 6938691167546754 query52 109 95 95 95 query53 357 293 297 293 query54 912 456 460 456 query55 78 75 75 75 query56 331 259 273 259 query57 1119104210381038 query58 262 254 275 254 query59 3564325734963257 query60 334 286 288 286 query61 95 96 105 96 query62 641 448 452 448 query63 330 293 296 293 query64 8948229117611761 query65 3177314531293129 query66 797 343 326 326 query67 15484 15041 15083 15041 query68 4968546 558 546 query69 602 463 337 337 query70 1199116310841084 query71 468 286 288 286 query72 7887511752265117 query73 768 331 328 328 query74 5948547055625470 query75 3775263126692631 query76 3661998 895 895 query77 677 317 306 306 query78 10359 986496119611 query79 2433528 526 526 query80 1504502 484 484 query81 576 222 231 222 query82 760 113 112 112 query83 207 186 244 186 query84 270 91 89 89 query85 1396288 276 276 query86 467 328 331 328 query87 3312309231253092 query88 3924246124342434 query89 481 388 380 380 query90 1832194 194 194 query91 128 101 102 101 query92 59 51 49 49 query93 2836524 516 516 query94 1148200 195 195 query95 410 329 324 324 query96 604 275 267 267 query97 3201304330583043 query98 229 206 199 199 query99 1257846 820 820 Total cold run time: 276528 ms Total hot run time: 174373 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](fe) Remove cloudWarmUpJob from DEPRECATED_MODULES_NAMES [doris]
w41ter commented on PR #37203: URL: https://github.com/apache/doris/pull/37203#issuecomment-2205255926 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore][fe] Get meta returns dropped partitions in binlog manager [doris]
doris-robot commented on PR #37196: URL: https://github.com/apache/doris/pull/37196#issuecomment-2205260475 ClickBench: Total hot run time: 30.88 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 60785964359f524c451afa8f671cb285fb505505, data reload: false query1 0.040.040.02 query2 0.080.040.05 query3 0.230.060.06 query4 1.660.080.10 query5 0.500.490.48 query6 1.140.720.72 query7 0.020.020.01 query8 0.060.040.04 query9 0.550.500.49 query10 0.560.550.55 query11 0.160.110.12 query12 0.150.120.12 query13 0.600.590.59 query14 0.830.790.78 query15 0.850.820.82 query16 0.370.360.36 query17 1.020.981.00 query18 0.220.260.26 query19 1.801.691.68 query20 0.010.010.01 query21 15.44 0.770.64 query22 3.816.892.18 query23 18.29 1.371.31 query24 2.060.250.22 query25 0.140.100.08 query26 0.260.180.17 query27 0.080.080.07 query28 13.26 1.020.98 query29 12.67 3.283.25 query30 0.260.060.06 query31 2.940.390.39 query32 3.240.480.46 query33 2.892.922.94 query34 16.81 4.424.41 query35 4.474.504.46 query36 0.640.460.47 query37 0.190.160.16 query38 0.160.150.15 query39 0.040.040.04 query40 0.180.150.15 query41 0.080.040.04 query42 0.060.040.05 query43 0.040.040.04 Total cold run time: 108.86 s Total hot run time: 30.88 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) recover adoptive bucket shuffle [doris]
xzj7019 commented on PR #36784: URL: https://github.com/apache/doris/pull/36784#issuecomment-2205260741 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) partition not exists error msg is not contain table name [doris]
doris-robot commented on PR #37160: URL: https://github.com/apache/doris/pull/37160#issuecomment-2205262073 TPC-DS: Total hot run time: 171330 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit da3a28003e908a90ea1b8a4a8d0fdb7c4a514e7a, data reload: false query1 925 383 371 371 query2 6469239623692369 query3 6635208 216 208 query4 19192 17579 17348 17348 query5 3623469 477 469 query6 249 166 164 164 query7 4596294 288 288 query8 308 296 284 284 query9 8502236023372337 query10 571 327 278 278 query11 10599 10079 10060 10060 query12 119 84 86 84 query13 1677377 379 377 query14 10208 758976397589 query15 237 194 193 193 query16 7997277 259 259 query17 1884526 520 520 query18 2073277 266 266 query19 191 145 147 145 query20 88 79 81 79 query21 206 129 130 129 query22 4567406639553955 query23 33965 33609 33731 33609 query24 10808 285328762853 query25 578 379 409 379 query26 702 154 154 154 query27 2267324 334 324 query28 5878210421232104 query29 906 629 603 603 query30 253 173 157 157 query31 981 766 744 744 query32 101 54 57 54 query33 749 295 278 278 query34 1088492 480 480 query35 756 639 632 632 query36 1124992 969 969 query37 132 80 80 80 query38 2968287228432843 query39 900 833 835 833 query40 204 129 129 129 query41 54 49 55 49 query42 110 98 100 98 query43 606 524 532 524 query44 1197746 729 729 query45 203 158 156 156 query46 1060720 710 710 query47 1834180617391739 query48 387 289 296 289 query49 835 404 403 403 query50 768 380 393 380 query51 6881677167516751 query52 107 90 89 89 query53 362 295 288 288 query54 938 445 445 445 query55 72 71 74 71 query56 282 256 263 256 query57 1094106210621062 query58 248 241 241 241 query59 3336311533353115 query60 326 272 280 272 query61 93 92 95 92 query62 628 446 456 446 query63 325 283 285 283 query64 8484221217191719 query65 3168310230553055 query66 755 334 344 334 query67 15427 15037 14957 14957 query68 4486545 544 544 query69 480 314 314 314 query70 1180107111651071 query71 415 277 285 277 query72 7131408425962596 query73 739 324 328 324 query74 5870543454465434 query75 3332264626822646 query76 22101011881 881 query77 430 298 291 291 query78 10474 984298759842 query79 2900516 497 497 query80 2258460 460 460 query81 588 217 221 217 query82 783 102 103 102 query83 300 168 165 165 query84 264 154 85 85 query85 1485270 264 264 query86 467 333 312 312 query87 3261304630953046 query88 3888244824432443 query89 471 366 382 366 query90 1689182 180 180 query91 127 96 97 96 query92 58 48 46 46 query93 2124515 512 512 query94 1082189 190 189 query95 416 309 323 309 query96 588 273 272 272 query97 3227299229852985 query98 216 197 197 197 query99 1290860 817 817 Total cold run time: 269085 ms Total hot run time: 171330 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
[PR] [Fix](auth)add user cluster USAGE_PRIV in CloudMode [doris]
zfr9527 opened a new pull request, #37206: URL: https://github.com/apache/doris/pull/37206 ## Proposed changes [Fix](auth)add user cluster USAGE_PRIV in CloudMode -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](auth)add user cluster USAGE_PRIV in CloudMode [doris]
doris-robot commented on PR #37206: URL: https://github.com/apache/doris/pull/37206#issuecomment-2205262243 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](auth)add user cluster USAGE_PRIV in CloudMode [doris]
zfr9527 commented on PR #37206: URL: https://github.com/apache/doris/pull/37206#issuecomment-2205263991 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) partition not exists error msg is not contain table name [doris]
doris-robot commented on PR #37160: URL: https://github.com/apache/doris/pull/37160#issuecomment-2205272550 ClickBench: Total hot run time: 30.72 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit da3a28003e908a90ea1b8a4a8d0fdb7c4a514e7a, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.670.060.06 query5 0.500.470.47 query6 1.120.730.73 query7 0.020.020.02 query8 0.050.040.04 query9 0.550.480.48 query10 0.540.560.54 query11 0.150.120.12 query12 0.160.130.12 query13 0.600.590.58 query14 0.760.790.77 query15 0.850.800.82 query16 0.360.370.37 query17 1.021.041.00 query18 0.230.220.24 query19 1.891.801.73 query20 0.010.010.01 query21 15.43 0.760.66 query22 4.167.462.22 query23 18.29 1.341.22 query24 2.160.240.22 query25 0.160.090.09 query26 0.270.180.17 query27 0.080.090.08 query28 13.16 1.021.01 query29 12.65 3.253.25 query30 0.250.050.07 query31 2.870.370.39 query32 3.320.470.47 query33 2.882.862.95 query34 17.17 4.384.42 query35 4.514.484.44 query36 0.650.450.51 query37 0.190.160.16 query38 0.160.150.15 query39 0.040.030.03 query40 0.180.130.15 query41 0.100.050.05 query42 0.060.040.04 query43 0.050.040.04 Total cold run time: 109.62 s Total hot run time: 30.72 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Short Circuit) fix no project list in OlapScanNode [doris]
eldenmoon merged PR #37121: URL: https://github.com/apache/doris/pull/37121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Fix](Short Circuit) fix no project list in OlapScanNode (#37121)
This is an automated email from the ASF dual-hosted git repository. eldenmoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new def48d5e13b [Fix](Short Circuit) fix no project list in OlapScanNode (#37121) def48d5e13b is described below commit def48d5e13bc74fb4c518a8cd579dc6544f5d0ef Author: lihangyu <15605149...@163.com> AuthorDate: Wed Jul 3 15:23:08 2024 +0800 [Fix](Short Circuit) fix no project list in OlapScanNode (#37121) query like ``` select a, `__DORIS_DELETE_SIGN__` from `test_tbl` WHERE k = '111' ``` will not contain project list on top of OlapScanNode, so for short circuit queries, we should use output exprs on top of plan fragment. ``` ++ | Explain String(Nereids Planner) | ++ | PLAN FRAGMENT 0 | | OUTPUT EXPRS: | | k1[#0] | | k2[#1] | | k3[#2] | | k4[#3] | | k5[#4] | | k6[#5] | | k7[#6] | | k8[#7] | | k9[#8] | | k10[#9] | | k11[#10] | | k12[#11] | | new_column0[#12] | | new_column1[#13] | | __DORIS_DELETE_SIGN__[#14] | | PARTITION: UNPARTITIONED | | | | HAS_COLO_PLAN_NODE: false | | | | VRESULT SINK | | MYSQL_PROTOCAL | | | | 1:VEXCHANGE | | offset: 0 | | distribute expr lists: k1[#0], k2[#1], k3[#2] | | | | PLAN FRAGMENT 1
(doris) branch master updated: [Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table (#37067)
This is an automated email from the ASF dual-hosted git repository.
zhangchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 4984222d8eb [Fix](schema change) Fix can't do reorder column schema
change for MOW table and duplicate key table (#37067)
4984222d8eb is described below
commit 4984222d8eb55ebf6c7674ffa17e98331553f2e9
Author: bobhan1
AuthorDate: Wed Jul 3 15:28:45 2024 +0800
[Fix](schema change) Fix can't do reorder column schema change for MOW
table and duplicate key table (#37067)
## Proposed changes
1. set column's field `isAggregationTypeImplicit` correctly for mow
table and duplicate key table to let `SchemaChangeHandler::createJob`
can recognize that the schema change is a column reorder case.
2. remove useless test cases `test_schema_change_datev2_with_delete`,
`test_dup_keys_schema_change_datev2`. These two cases wanted to test
schema change from `datev1`/`datetimev1` to `datev2`/`datetimev2`. But
the default type of columns created as `date`/`datetime` are already
`datev2`/`datetimev2` now. Thest test cases should have met error
"Nothing is changed. please check your alter stmt." when doris enable
`datev2`/`datetimev2` by default but it didn't because
`isAggregationTypeImplicit` is wrongly set for duplicate table column.
---
.../apache/doris/alter/SchemaChangeHandler.java| 10 +-
.../plans/commands/info/ColumnDefinition.java | 2 +-
.../test_schema_change_datev2_with_delete.out | 81 --
.../datev2/test_dup_keys_schema_change_datev2.out | 70 -
.../test_modify_reorder_column.out | 22 +++
.../alter_column_test_generated_column.groovy | 4 -
.../test_schema_change_datev2_with_delete.groovy | 121 ---
.../test_dup_keys_schema_change_datev2.groovy | 167 -
.../test_modify_reorder_column.groovy | 131
9 files changed, 163 insertions(+), 445 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
b/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
index b3b04bce21a..b9fd4acca79 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/alter/SchemaChangeHandler.java
@@ -562,7 +562,7 @@ public class SchemaChangeHandler extends AlterHandler {
}
if (!modColumn.isKey()) {
if (olapTable.getEnableUniqueKeyMergeOnWrite()) {
-modColumn.setAggregationType(AggregateType.NONE, false);
+modColumn.setAggregationType(AggregateType.NONE, true);
} else {
modColumn.setAggregationType(AggregateType.REPLACE, true);
}
@@ -1387,6 +1387,14 @@ public class SchemaChangeHandler extends AlterHandler {
if (!alterColumn.equals(originSchema.get(i))) {
needAlterColumns.add(alterColumn);
hasColumnChange = true;
+} else {
+Column oriColumn = originSchema.get(i);
+if ((oriColumn.getGeneratedColumnInfo() != null
+|| alterColumn.getGeneratedColumnInfo() !=
null)
+&&
!oriColumn.getGeneratedColumnInfo().getExprSql()
+
.equals(alterColumn.getGeneratedColumnInfo().getExprSql())) {
+throw new DdlException("Not supporting alter table
modify generated columns.");
+}
}
}
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/ColumnDefinition.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/ColumnDefinition.java
index 569151430cb..8b8a4e0e5e3 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/ColumnDefinition.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/ColumnDefinition.java
@@ -288,7 +288,7 @@ public class ColumnDefinition {
}
if (isOlap) {
-if (!isKey && keysType.equals(KeysType.UNIQUE_KEYS)) {
+if (!isKey && (keysType.equals(KeysType.UNIQUE_KEYS) ||
keysType.equals(KeysType.DUP_KEYS))) {
aggTypeImplicit = true;
}
diff --git
a/regression-test/data/schema_change/test_schema_change_datev2_with_delete.out
b/regression-test/data/schema_change/test_schema_change_datev2_with_delete.out
deleted file mode 100644
index 2ef72df7c71..000
---
a/regression-test/data/schema_change/test_schema_change_datev2_with_delete.out
+++ /dev/null
@@ -1,81 +0,0 @@
--- This
Re: [PR] [Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table [doris]
zhannngchen merged PR #37067: URL: https://github.com/apache/doris/pull/37067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids)push Limit to local agg [doris]
doris-robot commented on PR #34853: URL: https://github.com/apache/doris/pull/34853#issuecomment-2205289776 TPC-H: Total hot run time: 39942 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 774a94b676576d7a81f265c613319dea5f758a9a, data reload: false -- Round 1 -- q1 17838 635943094309 q2 2023194 192 192 q3 10625 121310701070 q4 10562 710 900 710 q5 7573266426792664 q6 230 145 145 145 q7 955 604 625 604 q8 9640210620912091 q9 8964652464776477 q10 8955376237213721 q11 449 241 236 236 q12 468 244 236 236 q13 17772 304030263026 q14 262 236 222 222 q15 519 476 507 476 q16 510 369 378 369 q17 971 655 704 655 q18 8003743773687368 q19 7235157314621462 q20 663 326 342 326 q21 4903324533413245 q22 392 347 338 338 Total cold run time: 119512 ms Total hot run time: 39942 ms - Round 2, with runtime_filter_mode=off - q1 4412428142514251 q2 363 266 265 265 q3 2998266527172665 q4 1849154716571547 q5 5445528752545254 q6 246 133 135 133 q7 2099172717201720 q8 3203332533023302 q9 8362833883298329 q10 3900366536903665 q11 565 490 484 484 q12 796 634 626 626 q13 17578 301130143011 q14 293 253 263 253 q15 513 491 477 477 q16 473 409 420 409 q17 1779148214621462 q18 7625764173087308 q19 1698152316121523 q20 1995178817811781 q21 4865470747954707 q22 621 553 539 539 Total cold run time: 71678 ms Total hot run time: 53711 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Bug] Wrong synchronized materialized view is selected [doris]
liutang123 opened a new issue, #37207:
URL: https://github.com/apache/doris/issues/37207
### Search before asking
- [X] I had searched in the
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no
similar issues.
### Version
master
### What's Wrong?
```
CREATE TABLE advertiser_view_record(
time date not null,
advertiser varchar(10),
dt date not null,
channel varchar(10),
user_id int)
DUPLICATE KEY(`time`, `advertiser`)
PARTITION BY RANGE (dt)(FROM ("2024-07-02") TO ("2024-07-04") INTERVAL 1
DAY)
-- AUTO PARTITION BY RANGE (date_trunc(`time`, 'day'))()
distributed BY hash(time)
properties("replication_num" = "1");
```
```
CREATE materialized VIEW advertiser_uv AS
SELECT advertiser,
channel,
dt,
bitmap_union(to_bitmap(user_id))
FROM advertiser_view_record
GROUP BY advertiser,
channel,
dt;
```
```
insert into advertiser_view_record values("2024-07-02",'a', "2024-07-02",
'a',1);
insert into advertiser_view_record values("2024-07-03",'b', "2024-07-03",
'b',1);
```
```
EXPLAIN
SELECT dt,advertiser,
count(DISTINCT user_id)
FROM advertiser_view_record
GROUP BY dt,advertiser
```
The `advertiser_uv` can not be selected and the result is:
```
| 0:VOlapScanNode(421)
|
| TABLE: test7.advertiser_view_record(advertiser_view_record),
PREAGGREGATION: ON|
| partitions=2/2 (p_20240702,p_20240703)
|
```
### What You Expected?
In version 2.1.4, `advertiser_uv ` will be selected.
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](OSS) Retry when encountering TooManyRequest response [doris]
doris-robot commented on PR #37199: URL: https://github.com/apache/doris/pull/37199#issuecomment-2205299062 TPC-H: Total hot run time: 39989 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8a7b24228c155e6b3092c22ef056e9d2877a0b78, data reload: false -- Round 1 -- q1 18045 450043524352 q2 2576195 193 193 q3 11336 128611401140 q4 10544 816 728 728 q5 7537273825522552 q6 223 140 143 140 q7 971 603 620 603 q8 9655212220982098 q9 8988649065646490 q10 9041376437133713 q11 461 242 238 238 q12 431 226 230 226 q13 17767 295129872951 q14 268 238 241 238 q15 526 492 491 491 q16 511 375 382 375 q17 982 687 742 687 q18 8109751574527452 q19 2710140515711405 q20 657 337 334 334 q21 5035332532533253 q22 383 330 349 330 Total cold run time: 116756 ms Total hot run time: 39989 ms - Round 2, with runtime_filter_mode=off - q1 4383418442154184 q2 380 262 264 262 q3 2963276127532753 q4 1858158315791579 q5 5246531452565256 q6 225 137 133 133 q7 2140173517361735 q8 3216331633093309 q9 8368832884208328 q10 3908366136493649 q11 573 480 486 480 q12 744 621 583 583 q13 16376 299929792979 q14 278 270 274 270 q15 531 494 472 472 q16 458 408 423 408 q17 1800148014891480 q18 7690736173497349 q19 4841154415791544 q20 1989179117631763 q21 4911459446474594 q22 617 562 553 553 Total cold run time: 73495 ms Total hot run time: 53663 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) recover adoptive bucket shuffle [doris]
doris-robot commented on PR #36784: URL: https://github.com/apache/doris/pull/36784#issuecomment-2205299766 TPC-H: Total hot run time: 40177 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 450f4c6ca901ea69501a0b840e7368dc50eddfbc, data reload: false -- Round 1 -- q1 17833 449844174417 q2 2360205 200 200 q3 10404 119810681068 q4 10190 743 829 743 q5 7526263826372637 q6 227 139 138 138 q7 957 616 619 616 q8 9242208020992080 q9 8935642765236427 q10 9010378137443744 q11 463 243 237 237 q12 474 237 246 237 q13 18936 297529852975 q14 279 230 218 218 q15 530 484 492 484 q16 539 378 382 378 q17 975 715 761 715 q18 8167751575457515 q19 8407145314721453 q20 663 332 327 327 q21 4917323532683235 q22 420 338 333 333 Total cold run time: 121454 ms Total hot run time: 40177 ms - Round 2, with runtime_filter_mode=off - q1 4462430542874287 q2 377 265 254 254 q3 2972273027272727 q4 1911167215771577 q5 5249524352495243 q6 215 130 130 130 q7 2081172517271725 q8 3196335232923292 q9 8326831283198312 q10 3923367136713671 q11 581 496 491 491 q12 786 605 616 605 q13 17250 301730103010 q14 306 258 255 255 q15 530 502 476 476 q16 484 407 426 407 q17 1764147014911470 q18 7566752975577529 q19 1719160015641564 q20 1987178817741774 q21 4862472948204729 q22 624 531 522 522 Total cold run time: 71171 ms Total hot run time: 54050 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)mv selection should rule out shadow index from schema change [doris]
starocean999 commented on PR #37154: URL: https://github.com/apache/doris/pull/37154#issuecomment-2205297297 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) refine left semi/anti shortcut cost [doris]
doris-robot commented on PR #37060: URL: https://github.com/apache/doris/pull/37060#issuecomment-2205306602 TPC-H: Total hot run time: 39834 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 622dc814f78031a15710180cdeb9cbf7bceca1da, data reload: false -- Round 1 -- q1 17614 438043304330 q2 2009187 181 181 q3 10473 121410651065 q4 10197 756 773 756 q5 7507262425832583 q6 222 138 135 135 q7 957 586 598 586 q8 9229208320582058 q9 9008647264426442 q10 8995377338133773 q11 473 247 248 247 q12 474 229 230 229 q13 17783 300529982998 q14 278 227 221 221 q15 509 479 500 479 q16 494 377 375 375 q17 969 646 663 646 q18 7989744974157415 q19 3692145315431453 q20 647 329 316 316 q21 4948376932203220 q22 407 329 326 326 Total cold run time: 114874 ms Total hot run time: 39834 ms - Round 2, with runtime_filter_mode=off - q1 4393433142834283 q2 370 260 257 257 q3 2938271731212717 q4 2024175717311731 q5 5574553654825482 q6 235 138 129 129 q7 2172184018501840 q8 3271339634113396 q9 8658857087308570 q10 4111391238733873 q11 583 512 478 478 q12 778 643 670 643 q13 16061 319231633163 q14 302 294 267 267 q15 545 498 475 475 q16 479 423 438 423 q17 1803152214641464 q18 8093787177887788 q19 3248167916121612 q20 2228182618601826 q21 5130490748414841 q22 604 522 524 522 Total cold run time: 73600 ms Total hot run time: 55780 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature]add ignore-incompatible option [doris-flink-connector]
JNSimba merged PR #371: URL: https://github.com/apache/doris-flink-connector/pull/371 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-flink-connector) branch master updated: [feature](cdc) add ignore-incompatible option (#371)
This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-flink-connector.git
The following commit(s) were added to refs/heads/master by this push:
new 060e13da [feature](cdc) add ignore-incompatible option (#371)
060e13da is described below
commit 060e13dad0b7a7c94fee1c397739f0df29da1e2b
Author: Petrichor <31833513+vinle...@users.noreply.github.com>
AuthorDate: Wed Jul 3 15:40:26 2024 +0800
[feature](cdc) add ignore-incompatible option (#371)
---
.../doris/flink/catalog/doris/DorisSystem.java | 3 +-
.../org/apache/doris/flink/tools/cdc/CdcTools.java | 2 +
.../apache/doris/flink/tools/cdc/DatabaseSync.java | 65 ++
.../flink/tools/cdc/CdcMysqlSyncDatabaseCase.java | 2 +
.../tools/cdc/CdcOraclelSyncDatabaseCase.java | 2 +
.../tools/cdc/CdcPostgresSyncDatabaseCase.java | 2 +
.../tools/cdc/CdcSqlServerSyncDatabaseCase.java| 2 +
7 files changed, 64 insertions(+), 14 deletions(-)
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/catalog/doris/DorisSystem.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/catalog/doris/DorisSystem.java
index 31d32e01..ab26e308 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/catalog/doris/DorisSystem.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/catalog/doris/DorisSystem.java
@@ -281,8 +281,7 @@ public class DorisSystem implements Serializable {
}
private static List identifier(List name) {
-List result = name.stream().map(m ->
identifier(m)).collect(Collectors.toList());
-return result;
+return
name.stream().map(DorisSystem::identifier).collect(Collectors.toList());
}
public static String identifier(String name) {
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/CdcTools.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/CdcTools.java
index 7443ef8a..38b942ea 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/CdcTools.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/CdcTools.java
@@ -132,6 +132,7 @@ public class CdcTools {
String multiToOneTarget = params.get("multi-to-one-target");
boolean createTableOnly = params.has("create-table-only");
boolean ignoreDefaultValue = params.has("ignore-default-value");
+boolean ignoreIncompatible = params.has("ignore-incompatible");
boolean singleSink = params.has("single-sink");
Preconditions.checkArgument(params.has("sink-conf"));
@@ -155,6 +156,7 @@ public class CdcTools {
.setTableConfig(tableMap)
.setCreateTableOnly(createTableOnly)
.setSingleSink(singleSink)
+.setIgnoreIncompatible(ignoreIncompatible)
.create();
databaseSync.build();
if (StringUtils.isNullOrWhitespaceOnly(jobName)) {
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/DatabaseSync.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/DatabaseSync.java
index 691eaafa..a4d0511b 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/DatabaseSync.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/tools/cdc/DatabaseSync.java
@@ -34,6 +34,7 @@ import org.apache.doris.flink.cfg.DorisConnectionOptions;
import org.apache.doris.flink.cfg.DorisExecutionOptions;
import org.apache.doris.flink.cfg.DorisOptions;
import org.apache.doris.flink.cfg.DorisReadOptions;
+import org.apache.doris.flink.exception.DorisSystemException;
import org.apache.doris.flink.sink.DorisSink;
import org.apache.doris.flink.sink.writer.WriteMode;
import org.apache.doris.flink.sink.writer.serializer.DorisRecordSerializer;
@@ -45,6 +46,7 @@ import org.slf4j.LoggerFactory;
import java.io.Serializable;
import java.sql.Connection;
import java.sql.SQLException;
+import java.sql.SQLSyntaxErrorException;
import java.util.ArrayList;
import java.util.HashMap;
import java.util.HashSet;
@@ -71,6 +73,7 @@ public abstract class DatabaseSync {
protected Map tableConfig = new HashMap<>();
protected Configuration sinkConfig;
protected boolean ignoreDefaultValue;
+protected boolean ignoreIncompatible;
public StreamExecutionEnvironment env;
private boolean createTableOnly = false;
@@ -128,7 +131,9 @@ public abstract class DatabaseSync {
if (tableConfig.containsKey("table-buckets")) {
tableBucketsMap =
getTableBuckets(tableConfig.get("table-buckets"));
}
-Set bucketsTable = new HashSet<>();
+
+// Set of table names that have assigned bucket numbers.
+Set tablesWithBucketsAssigned = new HashSet<>();
Set targetDbSet = new HashSet<>();
Re: [PR] [feat](nereids)push Limit to local agg [doris]
doris-robot commented on PR #34853: URL: https://github.com/apache/doris/pull/34853#issuecomment-2205310201 TPC-DS: Total hot run time: 170725 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 774a94b676576d7a81f265c613319dea5f758a9a, data reload: false query1 942 375 383 375 query2 6470229922192219 query3 6660205 211 205 query4 19780 17431 17154 17154 query5 4164484 485 484 query6 271 175 164 164 query7 4584289 285 285 query8 312 317 314 314 query9 8628236423552355 query10 617 305 286 286 query11 10320 10005 99259925 query12 129 89 85 85 query13 1656378 365 365 query14 10197 735577617355 query15 238 192 195 192 query16 7889264 268 264 query17 1909559 536 536 query18 1959279 267 267 query19 199 162 153 153 query20 91 80 92 80 query21 223 143 125 125 query22 4303402142664021 query23 33569 33199 32971 32971 query24 11943 278727992787 query25 680 368 362 362 query26 1777150 148 148 query27 2902264 271 264 query28 7741206120532053 query29 1141641 611 611 query30 285 152 156 152 query31 959 726 725 725 query32 95 50 52 50 query33 770 286 293 286 query34 951 467 466 466 query35 694 596 561 561 query36 1079940 930 930 query37 195 78 80 78 query38 2862273227612732 query39 843 809 799 799 query40 282 120 125 120 query41 56 56 59 56 query42 123 102 105 102 query43 587 558 548 548 query44 1269734 736 734 query45 184 159 163 159 query46 1069713 702 702 query47 1857176017551755 query48 367 311 290 290 query49 1186409 411 409 query50 784 403 399 399 query51 6892686767456745 query52 110 88 95 88 query53 361 304 288 288 query54 1031451 445 445 query55 76 73 74 73 query56 297 268 264 264 query57 1144105210631052 query58 263 252 258 252 query59 3502348032133213 query60 319 315 284 284 query61 98 96 91 91 query62 807 635 661 635 query63 321 292 295 292 query64 9856226217781778 query65 3174310131023101 query66 1387334 330 330 query67 15535 14877 14919 14877 query68 4630542 544 542 query69 460 322 317 317 query70 1163116011351135 query71 383 274 269 269 query72 7063281326412641 query73 736 324 329 324 query74 5907555055305530 query75 3376268326712671 query76 2572982 954 954 query77 462 305 309 305 query78 10219 976896299629 query79 2215511 508 508 query80 1110481 469 469 query81 549 220 224 220 query82 723 141 141 141 query83 252 171 175 171 query84 245 85 85 85 query85 1957344 267 267 query86 492 340 317 317 query87 3294305131093051 query88 3877246324492449 query89 472 378 377 377 query90 1847190 192 190 query91 129 99 99 99 query92 69 48 48 48 query93 2418519 510 510 query94 1281188 191 188 query95 409 315 315 315 query96 600 279 277 277 query97 3154301030113010 query98 213 198 200 198 query99 1696125212721252 Total cold run time: 276937 ms Total hot run time: 170725 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
doris-robot commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205311271 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
Mryange opened a new pull request, #37208: URL: https://github.com/apache/doris/pull/37208 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
Mryange commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205311580 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](env) remove has_varlen_slots in sort [doris]
Mryange commented on PR #37162: URL: https://github.com/apache/doris/pull/37162#issuecomment-2205315430 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
Mryange commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205315613 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [regression-test](group commit) enable wait_internal_group_commit_finish [doris]
doris-robot commented on PR #26856: URL: https://github.com/apache/doris/pull/26856#issuecomment-2205315788 TPC-H: Total hot run time: 39948 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 956d7799fae4161088e79f8d4070355317f7cd09, data reload: false -- Round 1 -- q1 18239 466042904290 q2 2014200 190 190 q3 10543 122111461146 q4 10263 754 787 754 q5 7498267026492649 q6 223 134 136 134 q7 960 601 608 601 q8 9237209420962094 q9 8998650665506506 q10 8986372537383725 q11 455 242 235 235 q12 485 238 232 232 q13 18718 300729602960 q14 267 223 205 205 q15 530 485 495 485 q16 515 373 378 373 q17 973 719 697 697 q18 8125740173987398 q19 4085136414701364 q20 649 317 330 317 q21 4971325339143253 q22 407 347 340 340 Total cold run time: 117141 ms Total hot run time: 39948 ms - Round 2, with runtime_filter_mode=off - q1 4363421642684216 q2 374 261 264 261 q3 2971284528612845 q4 2043172518031725 q5 5533548454325432 q6 221 137 128 128 q7 2204187118631863 q8 3289342334723423 q9 8633872087808720 q10 4166384436733673 q11 597 492 488 488 q12 837 640 663 640 q13 17334 315031773150 q14 295 276 281 276 q15 525 472 479 472 q16 488 437 422 422 q17 1816152315121512 q18 8212813280808080 q19 2462167215771577 q20 2125184618751846 q21 5058481447924792 q22 647 541 535 535 Total cold run time: 74193 ms Total hot run time: 56076 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies) Incorporate BOMs for Jetty, gRPC, Netty, and Jackson to enhance dependency management [doris]
doris-robot commented on PR #36138: URL: https://github.com/apache/doris/pull/36138#issuecomment-2205317834 TPC-H: Total hot run time: 40253 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4a0636f6c68a230fe9603149261edcb9ad6b06b0, data reload: false -- Round 1 -- q1 17615 432542704270 q2 2029192 186 186 q3 10445 118911981189 q4 10193 784 825 784 q5 7497262826352628 q6 222 137 139 137 q7 953 616 591 591 q8 9257206120582058 q9 8808646564306430 q10 9012371737213717 q11 448 235 234 234 q12 462 235 221 221 q13 17775 296529572957 q14 261 216 216 216 q15 513 480 488 480 q16 500 376 378 376 q17 965 680 643 643 q18 7961734973107310 q19 5285142714331427 q20 637 333 319 319 q21 4996373239913732 q22 413 348 352 348 Total cold run time: 116247 ms Total hot run time: 40253 ms - Round 2, with runtime_filter_mode=off - q1 4397430542814281 q2 365 268 256 256 q3 2957288328412841 q4 1988173216711671 q5 5624544554755445 q6 224 132 129 129 q7 2208178818221788 q8 3268338633753375 q9 8651863486958634 q10 4083393336493649 q11 565 503 471 471 q12 829 669 669 669 q13 16141 315431083108 q14 308 271 266 266 q15 536 488 480 480 q16 492 417 420 417 q17 1814150614891489 q18 7911793076777677 q19 1768157416171574 q20 2118192918781878 q21 4998483749434837 q22 608 553 551 551 Total cold run time: 71853 ms Total hot run time: 55486 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
doris-robot commented on PR #37205: URL: https://github.com/apache/doris/pull/37205#issuecomment-2205317995 TPC-H: Total hot run time: 39515 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false -- Round 1 -- q1 17646 437742424242 q2 2026191 189 189 q3 10461 117210971097 q4 10191 805 700 700 q5 7494264726112611 q6 220 137 136 136 q7 946 599 607 599 q8 9225208320482048 q9 8663646464876464 q10 8903369636483648 q11 447 248 238 238 q12 502 232 228 228 q13 17769 298729642964 q14 276 227 212 212 q15 540 481 483 481 q16 509 382 371 371 q17 951 727 742 727 q18 8205748473367336 q19 7700147914051405 q20 685 322 316 316 q21 4868319831743174 q22 390 329 340 329 Total cold run time: 118617 ms Total hot run time: 39515 ms - Round 2, with runtime_filter_mode=off - q1 4357423842594238 q2 379 264 256 256 q3 2940289029232890 q4 1989167317821673 q5 5584548154255425 q6 227 139 139 139 q7 2206189118531853 q8 3301342334003400 q9 8694875387298729 q10 4194376237733762 q11 594 493 501 493 q12 816 637 647 637 q13 17081 315532023155 q14 307 281 267 267 q15 522 495 511 495 q16 478 436 426 426 q17 1812149914861486 q18 8041794379327932 q19 1761161817231618 q20 2952187818271827 q21 8364480448534804 q22 640 584 547 547 Total cold run time: 77239 ms Total hot run time: 56052 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](OSS) Retry when encountering TooManyRequest response [doris]
doris-robot commented on PR #37199: URL: https://github.com/apache/doris/pull/37199#issuecomment-2205318572 TPC-DS: Total hot run time: 172722 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8a7b24228c155e6b3092c22ef056e9d2877a0b78, data reload: false query1 932 385 375 375 query2 6475267425002500 query3 6648206 216 206 query4 18956 17474 17327 17327 query5 4203514 498 498 query6 284 190 169 169 query7 4604293 292 292 query8 317 287 279 279 query9 8818249224832483 query10 615 282 293 282 query11 10521 10006 10025 10006 query12 141 89 87 87 query13 1654385 377 377 query14 8522609567236095 query15 229 187 186 186 query16 7664283 271 271 query17 1379557 549 549 query18 1974285 284 284 query19 203 161 161 161 query20 95 86 88 86 query21 209 138 124 124 query22 4372420039753975 query23 33846 33021 32917 32917 query24 12683 281828452818 query25 701 387 389 387 query26 1891164 159 159 query27 3105323 329 323 query28 7725213321312131 query29 1253656 630 630 query30 301 160 157 157 query31 948 738 753 738 query32 96 56 57 56 query33 793 374 291 291 query34 920 475 488 475 query35 748 615 616 615 query36 1112941 915 915 query37 296 77 77 77 query38 2886274527502745 query39 846 805 813 805 query40 285 129 127 127 query41 58 52 50 50 query42 125 96 105 96 query43 619 568 575 568 query44 1248729 730 729 query45 187 166 167 166 query46 1070767 747 747 query47 1840174117441741 query48 367 308 307 307 query49 1219433 417 417 query50 756 389 399 389 query51 6825682666766676 query52 106 92 97 92 query53 363 294 297 294 query54 993 462 461 461 query55 77 77 76 76 query56 299 276 280 276 query57 1151104810291029 query58 258 263 266 263 query59 3382325332653253 query60 323 298 283 283 query61 92 91 91 91 query62 659 426 465 426 query63 327 296 301 296 query64 9880226618041804 query65 3155310930983098 query66 1395342 333 333 query67 15564 15019 14999 14999 query68 4720559 583 559 query69 590 310 319 310 query70 1169116511781165 query71 473 288 277 277 query72 8661517054705170 query73 774 329 335 329 query74 6007548254625462 query75 4213267627202676 query76 3439934 961 934 query77 699 329 323 323 query78 10575 985898119811 query79 2875522 530 522 query80 977 496 533 496 query81 548 219 235 219 query82 814 113 107 107 query83 355 172 171 171 query84 258 96 93 93 query85 1966290 280 280 query86 461 328 315 315 query87 3293309630903090 query88 4234244024542440 query89 470 378 379 378 query90 1982188 189 188 query91 130 100 99 99 query92 62 51 50 50 query93 3378532 531 531 query94 1353197 192 192 query95 408 316 368 316 query96 593 266 272 266 query97 3160302229952995 query98 221 210 197 197 query99 1234823 834 823 Total cold run time: 281680 ms Total hot run time: 172722 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [feat](job)Internal job cancellation immediately and the strong association with the STARTS parameter [doris]
github-actions[bot] commented on PR #36805: URL: https://github.com/apache/doris/pull/36805#issuecomment-2205319562 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) recover adoptive bucket shuffle [doris]
doris-robot commented on PR #36784: URL: https://github.com/apache/doris/pull/36784#issuecomment-2205319171 TPC-DS: Total hot run time: 172242 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 450f4c6ca901ea69501a0b840e7368dc50eddfbc, data reload: false query1 928 380 378 378 query2 6462256822292229 query3 6662210 210 210 query4 18977 17605 17353 17353 query5 4237492 495 492 query6 288 171 171 171 query7 4593310 290 290 query8 315 285 280 280 query9 8433238223532353 query10 615 291 280 280 query11 10599 10231 99199919 query12 139 84 84 84 query13 1635373 374 373 query14 8714654170556541 query15 227 185 186 185 query16 7755275 271 271 query17 1387567 549 549 query18 1924285 279 279 query19 209 160 161 160 query20 91 83 88 83 query21 210 129 130 129 query22 4165421539323932 query23 33664 33126 33076 33076 query24 12323 292427902790 query25 699 383 422 383 query26 1879153 150 150 query27 3082311 313 311 query28 7881206120572057 query29 1198626 614 614 query30 291 154 158 154 query31 942 745 774 745 query32 99 55 55 55 query33 769 284 289 284 query34 987 478 475 475 query35 766 614 600 600 query36 1093961 940 940 query37 291 73 76 73 query38 2862278627922786 query39 873 801 822 801 query40 274 131 121 121 query41 53 51 51 51 query42 122 101 103 101 query43 592 557 547 547 query44 1231733 729 729 query45 194 171 163 163 query46 1094749 712 712 query47 1900178717821782 query48 384 311 310 310 query49 1214425 401 401 query50 774 388 396 388 query51 6922682667526752 query52 97 101 92 92 query53 363 311 299 299 query54 938 445 445 445 query55 75 74 71 71 query56 290 270 274 270 query57 1153104110621041 query58 255 249 254 249 query59 3497321330313031 query60 304 285 282 282 query61 102 92 94 92 query62 662 451 454 451 query63 315 292 294 292 query64 9962225117511751 query65 3167312431263124 query66 1367329 340 329 query67 15574 14991 15017 14991 query68 4501542 572 542 query69 462 306 317 306 query70 1061105711351057 query71 459 277 273 273 query72 7264558052505250 query73 760 330 330 330 query74 5937549954205420 query75 3596271826702670 query76 2901970 991 970 query77 456 298 299 298 query78 10472 991997379737 query79 2373523 529 523 query80 2110472 466 466 query81 581 217 222 217 query82 773 107 103 103 query83 290 175 170 170 query84 255 89 87 87 query85 2243292 337 292 query86 500 337 286 286 query87 3265308230583058 query88 3803244424532444 query89 495 379 378 378 query90 2000189 195 189 query91 130 99 105 99 query92 70 49 52 49 query93 2417525 513 513 query94 1429197 196 196 query95 417 319 318 318 query96 609 270 273 270 query97 3214299530082995 query98 220 200 197 197 query99 1311837 849 837 Total cold run time: 277513 ms Total hot run time: 172242 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [feat](nereids)push Limit to local agg [doris]
doris-robot commented on PR #34853: URL: https://github.com/apache/doris/pull/34853#issuecomment-2205319708 ClickBench: Total hot run time: 30.1 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 774a94b676576d7a81f265c613319dea5f758a9a, data reload: false query1 0.040.040.04 query2 0.080.030.04 query3 0.220.040.04 query4 1.690.060.06 query5 0.500.490.49 query6 1.130.710.72 query7 0.020.020.02 query8 0.050.040.05 query9 0.550.480.49 query10 0.550.540.54 query11 0.160.120.11 query12 0.150.120.12 query13 0.580.590.60 query14 0.780.760.77 query15 0.850.800.81 query16 0.360.370.37 query17 1.031.031.05 query18 0.220.200.21 query19 1.791.711.70 query20 0.010.000.01 query21 15.46 0.770.66 query22 4.237.131.56 query23 18.32 1.481.27 query24 2.080.230.22 query25 0.160.090.09 query26 0.260.170.18 query27 0.090.080.08 query28 13.33 1.021.00 query29 12.59 3.233.24 query30 0.250.060.06 query31 2.870.380.38 query32 3.300.480.46 query33 2.872.912.88 query34 17.11 4.424.41 query35 4.464.444.52 query36 0.650.470.46 query37 0.180.160.16 query38 0.160.140.16 query39 0.040.030.04 query40 0.170.150.14 query41 0.090.040.05 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 109.54 s Total hot run time: 30.1 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
github-actions[bot] commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205320620 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
github-actions[bot] commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205326151 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](env) remove has_varlen_slots in sort [doris]
github-actions[bot] commented on PR #37162: URL: https://github.com/apache/doris/pull/37162#issuecomment-2205326827 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) refine left semi/anti shortcut cost [doris]
doris-robot commented on PR #37060: URL: https://github.com/apache/doris/pull/37060#issuecomment-2205327755 TPC-DS: Total hot run time: 169884 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 622dc814f78031a15710180cdeb9cbf7bceca1da, data reload: false query1 932 387 374 374 query2 6465242223012301 query3 6637205 219 205 query4 18809 17464 17160 17160 query5 3607488 489 488 query6 262 174 167 167 query7 4587292 288 288 query8 330 280 275 275 query9 8583235323352335 query10 560 275 278 275 query11 10488 10232 1 1 query12 109 90 82 82 query13 1646373 353 353 query14 10119 717076037170 query15 245 187 184 184 query16 7737309 293 293 query17 1814530 521 521 query18 1951275 269 269 query19 199 151 146 146 query20 90 80 81 80 query21 211 125 124 124 query22 4360396140763961 query23 33710 33564 33467 33467 query24 10975 280927992799 query25 652 391 365 365 query26 919 152 149 149 query27 2331330 323 323 query28 6438214121162116 query29 863 651 634 634 query30 230 157 153 153 query31 968 746 752 746 query32 103 57 57 57 query33 740 282 300 282 query34 991 466 475 466 query35 737 629 640 629 query36 1124972 960 960 query37 145 74 89 74 query38 2917283528202820 query39 950 843 846 843 query40 209 124 122 122 query41 53 50 54 50 query42 107 98 104 98 query43 579 575 542 542 query44 1211752 728 728 query45 186 164 162 162 query46 1084726 727 726 query47 1879176117951761 query48 380 308 313 308 query49 844 401 409 401 query50 772 378 381 378 query51 6902672667606726 query52 98 97 89 89 query53 360 291 281 281 query54 897 453 444 444 query55 72 71 74 71 query56 281 272 303 272 query57 1114105810651058 query58 250 247 245 245 query59 3258330830733073 query60 300 281 271 271 query61 96 92 92 92 query62 613 450 455 450 query63 321 287 285 285 query64 8514231318581858 query65 3162307230993072 query66 774 333 357 333 query67 15253 15010 14896 14896 query68 4473537 542 537 query69 522 424 321 321 query70 1201115610871087 query71 387 289 284 284 query72 7072295627662766 query73 748 328 331 328 query74 5785556154355435 query75 3431268426592659 query76 2820933 909 909 query77 440 314 305 305 query78 9580889089038890 query79 3819512 517 512 query80 2856486 490 486 query81 585 228 224 224 query82 977 105 108 105 query83 314 181 177 177 query84 278 92 107 92 query85 1997462 264 264 query86 484 274 323 274 query87 3288310430563056 query88 4419243624372436 query89 501 365 376 365 query90 1866190 184 184 query91 126 96 100 96 query92 67 49 49 49 query93 5251508 502 502 query94 1214207 270 207 query95 403 307 313 307 query96 588 273 265 265 query97 3134300430293004 query98 221 207 195 195 query99 1220847 837 837 Total cold run time: 274170 ms Total hot run time: 169884 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
[PR] [chore](Regression) Add one property to specify the bucket [doris]
ByteYue opened a new pull request, #37209: URL: https://github.com/apache/doris/pull/37209 ## Proposed changes Add property to specify the bucket used for s3 load. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) recover adoptive bucket shuffle [doris]
doris-robot commented on PR #36784: URL: https://github.com/apache/doris/pull/36784#issuecomment-2205331075 ClickBench: Total hot run time: 30.18 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 450f4c6ca901ea69501a0b840e7368dc50eddfbc, data reload: false query1 0.040.030.04 query2 0.070.040.05 query3 0.230.050.04 query4 1.680.070.07 query5 0.500.470.49 query6 1.140.730.72 query7 0.020.010.02 query8 0.060.040.05 query9 0.550.490.49 query10 0.540.550.54 query11 0.170.120.12 query12 0.150.130.13 query13 0.590.600.59 query14 0.770.770.80 query15 0.850.810.83 query16 0.360.360.37 query17 1.020.950.98 query18 0.230.250.26 query19 1.781.811.72 query20 0.010.000.01 query21 15.45 0.740.67 query22 4.396.741.57 query23 18.31 1.301.26 query24 2.090.240.22 query25 0.150.080.08 query26 0.260.180.18 query27 0.090.080.07 query28 13.26 1.021.01 query29 12.63 3.253.24 query30 0.260.060.05 query31 2.880.380.38 query32 3.270.490.47 query33 2.882.902.94 query34 17.16 4.434.47 query35 4.474.474.55 query36 0.660.450.50 query37 0.200.160.16 query38 0.160.160.14 query39 0.040.040.03 query40 0.180.140.17 query41 0.100.040.05 query42 0.060.040.04 query43 0.040.030.04 Total cold run time: 109.75 s Total hot run time: 30.18 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](Regression) Add one property to specify the bucket [doris]
doris-robot commented on PR #37209: URL: https://github.com/apache/doris/pull/37209#issuecomment-2205330286 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](OSS) Retry when encountering TooManyRequest response [doris]
doris-robot commented on PR #37199: URL: https://github.com/apache/doris/pull/37199#issuecomment-2205330462 ClickBench: Total hot run time: 30.9 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 8a7b24228c155e6b3092c22ef056e9d2877a0b78, data reload: false query1 0.040.030.03 query2 0.070.040.05 query3 0.230.050.05 query4 1.690.090.10 query5 0.490.500.49 query6 1.130.730.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.540.500.51 query10 0.550.550.56 query11 0.150.120.11 query12 0.150.120.12 query13 0.590.590.59 query14 0.770.780.79 query15 0.850.800.81 query16 0.360.360.35 query17 0.991.040.95 query18 0.210.220.27 query19 1.781.751.67 query20 0.010.000.00 query21 15.46 0.740.66 query22 4.626.912.28 query23 18.30 1.351.21 query24 2.100.250.22 query25 0.160.090.08 query26 0.260.180.17 query27 0.070.080.08 query28 13.16 1.020.99 query29 12.64 3.363.33 query30 0.250.060.05 query31 2.890.390.39 query32 3.270.500.47 query33 2.862.942.92 query34 17.07 4.454.36 query35 4.474.544.51 query36 0.650.470.49 query37 0.190.160.15 query38 0.160.140.16 query39 0.040.040.03 query40 0.160.160.14 query41 0.090.050.06 query42 0.050.040.05 query43 0.050.040.04 Total cold run time: 109.64 s Total hot run time: 30.9 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [regression-test](group commit) enable wait_internal_group_commit_finish [doris]
doris-robot commented on PR #26856: URL: https://github.com/apache/doris/pull/26856#issuecomment-2205337056 TPC-DS: Total hot run time: 174033 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 956d7799fae4161088e79f8d4070355317f7cd09, data reload: false query1 915 379 366 366 query2 6439239122412241 query3 6637214 213 213 query4 19127 17465 17364 17364 query5 3642481 465 465 query6 269 170 180 170 query7 4593292 301 292 query8 314 289 299 289 query9 8800234223302330 query10 577 313 302 302 query11 10559 10261 10054 10054 query12 116 83 81 81 query13 1642375 377 375 query14 10229 762376567623 query15 251 182 186 182 query16 7850267 270 267 query17 1912557 517 517 query18 2002276 270 270 query19 192 149 148 148 query20 89 80 77 77 query21 204 142 128 128 query22 4261419740604060 query23 33887 33370 33497 33370 query24 9981287527942794 query25 577 379 385 379 query26 705 153 153 153 query27 2254319 314 314 query28 5782212921252125 query29 876 614 636 614 query30 251 163 159 159 query31 977 759 746 746 query32 101 53 53 53 query33 663 289 295 289 query34 870 474 470 470 query35 722 636 666 636 query36 1121999 993 993 query37 130 78 80 78 query38 2947288628092809 query39 866 822 821 821 query40 207 127 123 123 query41 54 50 58 50 query42 120 102 99 99 query43 604 559 541 541 query44 1069755 726 726 query45 189 169 170 169 query46 1064712 714 712 query47 1881177918221779 query48 367 311 298 298 query49 833 400 410 400 query50 771 384 389 384 query51 6781682266926692 query52 104 94 106 94 query53 359 283 290 283 query54 874 477 440 440 query55 77 73 73 73 query56 271 266 258 258 query57 1149107010591059 query58 238 230 246 230 query59 3322332431993199 query60 297 275 271 271 query61 93 91 90 90 query62 580 444 443 443 query63 314 284 285 284 query64 8446232217361736 query65 3162309330913091 query66 739 315 317 315 query67 15427 15030 15018 15018 query68 4481525 533 525 query69 522 440 330 330 query70 1169115211201120 query71 370 285 274 274 query72 6754572252795279 query73 738 326 318 318 query74 5880545655385456 query75 3321268426912684 query76 2100964 876 876 query77 428 293 296 293 query78 10370 10062 97519751 query79 2623513 506 506 query80 2038453 522 453 query81 597 219 220 219 query82 1012106 101 101 query83 298 175 165 165 query84 253 84 84 84 query85 1133278 265 265 query86 461 306 311 306 query87 3273309230983092 query88 3465244324392439 query89 460 385 368 368 query90 1707186 185 185 query91 125 99 100 99 query92 57 47 47 47 query93 1848516 512 512 query94 1131189 185 185 query95 408 314 322 314 query96 586 274 267 267 query97 3183308030293029 query98 218 200 187 187 query99 1173831 830 830 Total cold run time: 264904 ms Total hot run time: 174033 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [opt](nereids) refine left semi/anti shortcut cost [doris]
doris-robot commented on PR #37060: URL: https://github.com/apache/doris/pull/37060#issuecomment-2205337532 ClickBench: Total hot run time: 30.38 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 622dc814f78031a15710180cdeb9cbf7bceca1da, data reload: false query1 0.030.030.04 query2 0.080.040.04 query3 0.230.060.05 query4 1.650.070.06 query5 0.460.500.49 query6 1.130.720.70 query7 0.020.010.01 query8 0.050.040.04 query9 0.550.490.51 query10 0.550.550.53 query11 0.150.120.11 query12 0.140.120.12 query13 0.590.590.59 query14 0.770.780.78 query15 0.850.810.82 query16 0.360.350.36 query17 0.971.021.05 query18 0.230.250.24 query19 1.871.831.82 query20 0.020.010.01 query21 15.43 0.760.66 query22 3.497.931.78 query23 18.23 1.411.23 query24 2.130.250.22 query25 0.160.100.08 query26 0.270.170.17 query27 0.090.080.08 query28 13.23 1.030.99 query29 12.58 3.213.21 query30 0.250.060.06 query31 2.860.380.38 query32 3.300.460.46 query33 2.902.842.90 query34 17.17 4.434.43 query35 4.474.484.54 query36 0.650.450.46 query37 0.200.150.15 query38 0.160.150.14 query39 0.040.030.04 query40 0.170.130.13 query41 0.100.040.04 query42 0.060.040.05 query43 0.050.040.04 Total cold run time: 108.69 s Total hot run time: 30.38 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies) Incorporate BOMs for Jetty, gRPC, Netty, and Jackson to enhance dependency management [doris]
doris-robot commented on PR #36138: URL: https://github.com/apache/doris/pull/36138#issuecomment-2205339887 TPC-DS: Total hot run time: 173239 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4a0636f6c68a230fe9603149261edcb9ad6b06b0, data reload: false query1 912 372 367 367 query2 6448248323192319 query3 6639202 210 202 query4 20757 17407 17378 17378 query5 3699482 484 482 query6 273 185 153 153 query7 4583286 303 286 query8 324 303 293 293 query9 8491237623442344 query10 574 293 302 293 query11 10509 997110077 9971 query12 126 86 81 81 query13 1660382 390 382 query14 8581728077567280 query15 234 188 193 188 query16 7706277 274 274 query17 1884546 549 546 query18 1851279 283 279 query19 205 150 165 150 query20 88 84 84 84 query21 208 129 123 123 query22 4274413539513951 query23 33924 33502 33560 33502 query24 10698 289528392839 query25 627 414 389 389 query26 711 159 167 159 query27 2200333 335 333 query28 6141216221252125 query29 935 665 676 665 query30 317 155 159 155 query31 968 762 766 762 query32 98 56 55 55 query33 671 321 319 319 query34 886 476 482 476 query35 747 663 645 645 query36 1144984 998 984 query37 149 82 81 81 query38 2948284328212821 query39 899 866 845 845 query40 216 129 125 125 query41 55 56 52 52 query42 114 96 101 96 query43 589 516 529 516 query44 1069738 732 732 query45 199 163 165 163 query46 1080756 720 720 query47 1867177117971771 query48 367 311 301 301 query49 863 520 428 428 query50 755 391 403 391 query51 6794672067306720 query52 102 96 86 86 query53 361 303 296 296 query54 840 453 454 453 query55 75 73 73 73 query56 299 263 262 262 query57 1122104910791049 query58 242 235 254 235 query59 3472318230513051 query60 298 276 291 276 query61 92 91 97 91 query62 606 452 437 437 query63 319 288 295 288 query64 8471222417221722 query65 3165310630753075 query66 751 322 320 320 query67 15667 15050 14735 14735 query68 8657560 565 560 query69 764 423 325 325 query70 1298106011461060 query71 541 279 275 275 query72 8750554451035103 query73 1822328 326 326 query74 5863542954795429 query75 5240268026462646 query76 4879981 868 868 query77 778 302 292 292 query78 10407 976896559655 query79 8440528 520 520 query80 2308490 493 490 query81 551 225 212 212 query82 438 111 102 102 query83 291 218 166 166 query84 267 85 90 85 query85 891 285 264 264 query86 358 282 305 282 query87 3366310730613061 query88 4159245724662457 query89 524 387 375 375 query90 2086189 185 185 query91 131 97 101 97 query92 63 48 53 48 query93 6199519 526 519 query94 1350189 185 185 query95 405 316 318 316 query96 619 265 273 265 query97 3134300330123003 query98 221 199 235 199 query99 1192824 826 824 Total cold run time: 289931 ms Total hot run time: 173239 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
Re: [PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
doris-robot commented on PR #37205: URL: https://github.com/apache/doris/pull/37205#issuecomment-2205339650 TPC-DS: Total hot run time: 173265 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false query1 909 382 370 370 query2 6454240423332333 query3 6638205 218 205 query4 20386 17547 17252 17252 query5 3731495 472 472 query6 260 160 173 160 query7 4596297 289 289 query8 322 282 282 282 query9 8470236223632362 query10 563 312 288 288 query11 10497 992599859925 query12 113 94 80 80 query13 1638395 364 364 query14 10339 693877156938 query15 233 186 195 186 query16 7749277 284 277 query17 1841592 541 541 query18 1877290 277 277 query19 198 152 155 152 query20 93 85 85 85 query21 213 147 129 129 query22 4307395539323932 query23 33942 33592 33496 33496 query24 10940 291028662866 query25 619 398 390 390 query26 711 158 158 158 query27 2244317 334 317 query28 6309215021522150 query29 919 660 664 660 query30 255 221 165 165 query31 986 751 781 751 query32 93 50 52 50 query33 748 290 285 285 query34 1062488 483 483 query35 758 640 656 640 query36 1118994 983 983 query37 137 81 79 79 query38 2999281127972797 query39 904 859 841 841 query40 200 124 124 124 query41 53 50 54 50 query42 115 98 100 98 query43 599 540 558 540 query44 1191733 729 729 query45 196 161 163 161 query46 1082718 730 718 query47 1808176717421742 query48 371 318 305 305 query49 822 417 413 413 query50 788 384 389 384 query51 6829681167376737 query52 110 92 98 92 query53 365 291 283 283 query54 906 452 448 448 query55 74 70 73 70 query56 287 260 270 260 query57 1090105610191019 query58 243 248 239 239 query59 3397333631923192 query60 307 274 281 274 query61 92 88 89 88 query62 608 458 440 440 query63 311 299 290 290 query64 8694227017431743 query65 3149305531543055 query66 749 322 333 322 query67 15407 14893 14932 14893 query68 4888557 543 543 query69 660 408 325 325 query70 1136107611631076 query71 439 295 287 287 query72 8525523155025231 query73 769 326 324 324 query74 5840553954715471 query75 4113266126752661 query76 3476897 897 897 query77 669 300 302 300 query78 10411 998296569656 query79 2858519 523 519 query80 2308477 484 477 query81 568 220 217 217 query82 1434109 107 107 query83 305 172 183 172 query84 273 89 94 89 query85 1262286 282 282 query86 457 310 335 310 query87 3284308231033082 query88 4284246524922465 query89 486 393 386 386 query90 1853190 189 189 query91 127 101 103 101 query92 59 51 49 49 query93 2882524 523 523 query94 1149193 186 186 query95 408 318 320 318 query96 594 273 272 272 query97 3169307729882988 query98 228 204 198 198 query99 1123845 854 845 Total cold run time: 276051 ms Total hot run time: 173265 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [fix](Nereids) partition not exists error msg is not contain table name [doris]
morrySnow commented on PR #37160: URL: https://github.com/apache/doris/pull/37160#issuecomment-2205340186 run cloud_p1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](statistics)Enable record partition update rows by default. [doris]
Jibing-Li opened a new pull request, #37210: URL: https://github.com/apache/doris/pull/37210 Add a session variable to enable record partition level update rows by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics)Enable record partition update rows by default. [doris]
doris-robot commented on PR #37210: URL: https://github.com/apache/doris/pull/37210#issuecomment-2205345501 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [regression-test](group commit) enable wait_internal_group_commit_finish [doris]
doris-robot commented on PR #26856: URL: https://github.com/apache/doris/pull/26856#issuecomment-2205346971 ClickBench: Total hot run time: 30.84 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 956d7799fae4161088e79f8d4070355317f7cd09, data reload: false query1 0.040.030.03 query2 0.080.030.04 query3 0.230.070.05 query4 1.660.080.10 query5 0.510.480.48 query6 1.150.730.73 query7 0.020.010.01 query8 0.060.050.05 query9 0.530.480.48 query10 0.540.530.53 query11 0.150.110.12 query12 0.150.130.12 query13 0.580.580.59 query14 0.750.780.78 query15 0.850.810.81 query16 0.360.350.37 query17 1.000.961.04 query18 0.240.240.24 query19 1.791.791.84 query20 0.020.010.00 query21 15.46 0.740.66 query22 4.157.092.19 query23 18.40 1.351.28 query24 2.140.220.22 query25 0.150.080.09 query26 0.260.170.16 query27 0.090.080.08 query28 13.25 1.020.99 query29 12.61 3.283.35 query30 0.250.060.06 query31 2.870.380.38 query32 3.320.470.46 query33 2.892.852.90 query34 17.11 4.474.41 query35 4.534.534.44 query36 0.650.470.48 query37 0.180.160.15 query38 0.150.160.15 query39 0.040.040.04 query40 0.170.140.14 query41 0.090.050.05 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 109.58 s Total hot run time: 30.84 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Remove cloudWarmUpJob from DEPRECATED_MODULES_NAMES [doris]
doris-robot commented on PR #37203: URL: https://github.com/apache/doris/pull/37203#issuecomment-2205347255 TPC-H: Total hot run time: 39706 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit dd8d5f857bfec11ffc5f09ffdeeeaca66178b19a, data reload: false -- Round 1 -- q1 17616 434243504342 q2 2017197 192 192 q3 10459 119010541054 q4 10217 723 811 723 q5 7474273625902590 q6 220 136 136 136 q7 944 597 605 597 q8 9237207020482048 q9 8591647665996476 q10 8955373637033703 q11 435 236 246 236 q12 488 228 218 218 q13 18852 293829672938 q14 280 222 227 222 q15 533 468 500 468 q16 531 381 371 371 q17 971 653 672 653 q18 8012748474287428 q19 4663146514801465 q20 673 312 336 312 q21 4854319838583198 q22 395 336 353 336 Total cold run time: 116417 ms Total hot run time: 39706 ms - Round 2, with runtime_filter_mode=off - q1 4409421642824216 q2 379 268 262 262 q3 2972282428562824 q4 1973176816801680 q5 5633551555135513 q6 230 128 139 128 q7 2181182718961827 q8 3281341834293418 q9 8727864988498649 q10 4038387736863686 q11 585 495 470 470 q12 803 655 647 647 q13 17208 310731663107 q14 314 277 269 269 q15 543 507 487 487 q16 492 438 432 432 q17 1841155114981498 q18 8021797379377937 q19 1796162317411623 q20 2090186818461846 q21 5224491447854785 q22 585 536 551 536 Total cold run time: 73325 ms Total hot run time: 55840 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](Regression) Add one property to specify the bucket [doris]
ByteYue commented on PR #37209: URL: https://github.com/apache/doris/pull/37209#issuecomment-2205348125 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [dependencies](fe)upgrade paimon to 0.8.1 [doris]
doris-robot commented on PR #37205: URL: https://github.com/apache/doris/pull/37205#issuecomment-2205351315 ClickBench: Total hot run time: 30.74 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 77afaacf97dc7945090ba13149ccef5b0b963ea4, data reload: false query1 0.040.030.03 query2 0.090.040.04 query3 0.220.050.06 query4 1.680.080.10 query5 0.500.500.48 query6 1.140.740.73 query7 0.020.020.01 query8 0.050.050.05 query9 0.550.490.49 query10 0.550.540.54 query11 0.150.110.12 query12 0.150.120.12 query13 0.600.590.59 query14 0.770.780.79 query15 0.850.830.82 query16 0.350.370.36 query17 0.971.001.03 query18 0.240.250.24 query19 1.801.711.66 query20 0.010.010.00 query21 15.46 0.780.66 query22 4.397.362.05 query23 18.34 1.451.24 query24 2.110.250.22 query25 0.160.090.07 query26 0.250.170.18 query27 0.070.080.08 query28 13.24 1.021.00 query29 12.63 3.273.24 query30 0.250.060.05 query31 2.870.400.40 query32 3.250.470.47 query33 2.912.952.90 query34 17.24 4.404.43 query35 4.564.544.56 query36 0.660.480.51 query37 0.200.160.17 query38 0.170.160.15 query39 0.050.030.03 query40 0.180.140.13 query41 0.090.040.05 query42 0.050.060.05 query43 0.050.040.03 Total cold run time: 109.91 s Total hot run time: 30.74 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [minor](dependencies) Incorporate BOMs for Jetty, gRPC, Netty, and Jackson to enhance dependency management [doris]
doris-robot commented on PR #36138: URL: https://github.com/apache/doris/pull/36138#issuecomment-2205351778 ClickBench: Total hot run time: 30.96 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4a0636f6c68a230fe9603149261edcb9ad6b06b0, data reload: false query1 0.040.030.03 query2 0.070.040.04 query3 0.230.060.06 query4 1.650.090.10 query5 0.500.480.48 query6 1.140.720.72 query7 0.020.020.02 query8 0.060.050.05 query9 0.550.470.48 query10 0.540.550.55 query11 0.150.110.12 query12 0.150.130.12 query13 0.600.580.58 query14 0.770.770.79 query15 0.840.810.80 query16 0.360.350.37 query17 0.980.951.01 query18 0.230.270.24 query19 1.811.701.68 query20 0.020.010.01 query21 15.45 0.760.66 query22 4.666.212.49 query23 18.31 1.391.28 query24 2.120.230.22 query25 0.160.080.08 query26 0.260.170.17 query27 0.080.090.08 query28 13.24 1.010.99 query29 12.61 3.253.19 query30 0.250.060.06 query31 2.870.390.39 query32 3.280.480.47 query33 2.882.912.86 query34 17.51 4.394.36 query35 4.494.564.48 query36 0.650.460.50 query37 0.190.160.15 query38 0.160.150.14 query39 0.040.040.03 query40 0.160.140.15 query41 0.090.050.05 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 110.28 s Total hot run time: 30.96 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](gson) Fix GSON pretty printting setting [doris]
doris-robot commented on PR #37211: URL: https://github.com/apache/doris/pull/37211#issuecomment-2205352518 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](gson) Fix GSON pretty printting setting [doris]
w41ter commented on PR #37211: URL: https://github.com/apache/doris/pull/37211#issuecomment-2205352806 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](gson) Fix GSON pretty printting setting [doris]
w41ter opened a new pull request, #37211: URL: https://github.com/apache/doris/pull/37211 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [INTERNAL_ERROR][INTERNAL_ERROR]close wait failed coz rpc error [doris]
xiaoL1211 closed issue #37189: [INTERNAL_ERROR][INTERNAL_ERROR]close wait failed coz rpc error URL: https://github.com/apache/doris/issues/37189 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](gson) Fix GSON pretty printting setting [doris]
github-actions[bot] commented on PR #37211: URL: https://github.com/apache/doris/pull/37211#issuecomment-2205363471 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](gson) Fix GSON pretty printting setting [doris]
github-actions[bot] commented on PR #37211: URL: https://github.com/apache/doris/pull/37211#issuecomment-2205363398 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics)Enable record partition update rows by default. [doris]
Jibing-Li closed pull request #37210: [feature](statistics)Enable record partition update rows by default. URL: https://github.com/apache/doris/pull/37210 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)mv selection should rule out shadow index from schema change [doris]
doris-robot commented on PR #37154: URL: https://github.com/apache/doris/pull/37154#issuecomment-2205373881 TPC-H: Total hot run time: 40563 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit afb00eee5e6c0679316a0e04ab050896008cd7b3, data reload: false -- Round 1 -- q1 17605 426342564256 q2 2014193 185 185 q3 10453 121011421142 q4 10189 738 772 738 q5 7565264526312631 q6 219 137 137 137 q7 945 587 592 587 q8 9225206520462046 q9 8964647264576457 q10 8891368936723672 q11 468 240 232 232 q12 494 245 232 232 q13 17765 299929802980 q14 270 230 227 227 q15 521 472 478 472 q16 514 371 375 371 q17 964 663 638 638 q18 8061739974077399 q19 7599151315081508 q20 649 329 321 321 q21 4971402439933993 q22 398 349 339 339 Total cold run time: 118744 ms Total hot run time: 40563 ms - Round 2, with runtime_filter_mode=off - q1 4400421542294215 q2 382 268 275 268 q3 3043288729202887 q4 1970172317661723 q5 5479550054185418 q6 223 136 128 128 q7 2239183318261826 q8 3218342934393429 q9 8693879686768676 q10 4133366638353666 q11 579 508 522 508 q12 808 661 636 636 q13 17110 311731763117 q14 300 271 284 271 q15 513 485 502 485 q16 483 444 423 423 q17 1791149814821482 q18 8081784778447844 q19 1790175315121512 q20 2123186718471847 q21 5079479948354799 q22 622 534 541 534 Total cold run time: 73059 ms Total hot run time: 55694 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Remove cloudWarmUpJob from DEPRECATED_MODULES_NAMES [doris]
doris-robot commented on PR #37203: URL: https://github.com/apache/doris/pull/37203#issuecomment-2205374654 TPC-DS: Total hot run time: 173352 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit dd8d5f857bfec11ffc5f09ffdeeeaca66178b19a, data reload: false query1 925 387 369 369 query2 6443232823302328 query3 6635210 231 210 query4 18740 17450 17362 17362 query5 3639486 476 476 query6 260 169 176 169 query7 4597291 292 291 query8 341 294 305 294 query9 8476236524342365 query10 562 289 266 266 query11 10629 10246 99329932 query12 111 79 88 79 query13 1640368 362 362 query14 10159 766071127112 query15 231 198 201 198 query16 7941273 258 258 query17 1941541 513 513 query18 2042266 265 265 query19 196 148 152 148 query20 89 82 86 82 query21 210 142 125 125 query22 4363399341693993 query23 33925 33727 33704 33704 query24 10802 287929232879 query25 581 388 375 375 query26 699 150 151 150 query27 2202313 329 313 query28 6141214821302130 query29 904 651 638 638 query30 243 159 152 152 query31 963 755 729 729 query32 95 52 60 52 query33 648 298 283 283 query34 869 476 488 476 query35 758 623 618 618 query36 1133998 986 986 query37 141 75 81 75 query38 2927285628732856 query39 890 855 831 831 query40 220 129 127 127 query41 60 56 54 54 query42 121 102 98 98 query43 590 554 515 515 query44 1084732 766 732 query45 193 168 161 161 query46 1076712 734 712 query47 1842178717651765 query48 367 302 306 302 query49 843 408 418 408 query50 756 381 377 377 query51 6836670866646664 query52 105 93 93 93 query53 356 304 285 285 query54 873 457 441 441 query55 74 72 72 72 query56 291 254 257 254 query57 1126104410581044 query58 257 242 244 242 query59 3540345030623062 query60 306 296 277 277 query61 95 90 88 88 query62 620 444 456 444 query63 324 284 286 284 query64 8538222817421742 query65 3195312030503050 query66 748 319 331 319 query67 15516 14926 15037 14926 query68 5335542 537 537 query69 658 404 318 318 query70 11581152 query71 467 279 274 274 query72 6957578351865186 query73 761 325 323 323 query74 5911547255295472 query75 3792260426862604 query76 3577932 849 849 query77 661 295 290 290 query78 10367 981898229818 query79 1267515 516 515 query80 2124476 461 461 query81 588 218 224 218 query82 756 103 108 103 query83 274 166 163 163 query84 253 89 85 85 query85 1320291 267 267 query86 468 319 312 312 query87 3305318330633063 query88 3796242324512423 query89 462 374 381 374 query90 1880190 186 186 query91 122 100 98 98 query92 59 49 48 48 query93 1993512 510 510 query94 1119193 186 186 query95 403 321 303 303 query96 584 277 263 263 query97 3191298230252982 query98 236 197 191 191 query99 1137840 837 837 Total cold run time: 269024 ms Total hot run time: 173352 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp
[PR] [fix](spill) handle possible filesystem exception [doris]
jacktengg opened a new pull request, #37212: URL: https://github.com/apache/doris/pull/37212 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size [doris]
github-actions[bot] commented on PR #37193: URL: https://github.com/apache/doris/pull/37193#issuecomment-2205376753 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) handle possible filesystem exception [doris]
doris-robot commented on PR #37212: URL: https://github.com/apache/doris/pull/37212#issuecomment-2205376791 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size [doris]
github-actions[bot] commented on PR #37193: URL: https://github.com/apache/doris/pull/37193#issuecomment-2205376803 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
doris-robot commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2205379686 TPC-H: Total hot run time: 39874 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 667a71f84ef53875b3e4eddb635bb4bc85f34c8f, data reload: false -- Round 1 -- q1 17738 441342654265 q2 2027194 191 191 q3 10598 122111181118 q4 10887 830 785 785 q5 8335272326352635 q6 225 138 140 138 q7 967 618 614 614 q8 9785212320932093 q9 9488658565966585 q10 8967375337273727 q11 450 236 236 236 q12 480 236 239 236 q13 17842 298229732973 q14 277 222 220 220 q15 518 493 486 486 q16 509 375 366 366 q17 961 712 658 658 q18 7987745073697369 q19 1967141114611411 q20 639 319 331 319 q21 4940310340223103 q22 411 351 346 346 Total cold run time: 115998 ms Total hot run time: 39874 ms - Round 2, with runtime_filter_mode=off - q1 4349429143064291 q2 381 266 259 259 q3 3009280627502750 q4 1888161615881588 q5 5275529252545254 q6 223 132 132 132 q7 2107169817381698 q8 3174337733223322 q9 8252832582978297 q10 3856364937213649 q11 577 495 504 495 q12 788 626 621 621 q13 16704 299129622962 q14 310 268 259 259 q15 524 498 473 473 q16 469 421 432 421 q17 1778149014421442 q18 7597747774877477 q19 1761170014991499 q20 2012179117551755 q21 4820480047334733 q22 651 560 562 560 Total cold run time: 70505 ms Total hot run time: 53937 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) handle possible filesystem exception [doris]
jacktengg commented on PR #37212: URL: https://github.com/apache/doris/pull/37212#issuecomment-2205378231 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](paritial update) Fix the case of partial update failing in cloud mode [doris]
github-actions[bot] commented on PR #37151: URL: https://github.com/apache/doris/pull/37151#issuecomment-2205382447 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size #37193 [doris]
jacktengg opened a new pull request, #37213: URL: https://github.com/apache/doris/pull/37213 ## Proposed changes Bp #37193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size #37193 [doris]
doris-robot commented on PR #37213: URL: https://github.com/apache/doris/pull/37213#issuecomment-2205385097 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size #37193 [doris]
jacktengg commented on PR #37213: URL: https://github.com/apache/doris/pull/37213#issuecomment-2205385468 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Remove cloudWarmUpJob from DEPRECATED_MODULES_NAMES [doris]
doris-robot commented on PR #37203: URL: https://github.com/apache/doris/pull/37203#issuecomment-2205385700 ClickBench: Total hot run time: 30.6 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit dd8d5f857bfec11ffc5f09ffdeeeaca66178b19a, data reload: false query1 0.040.040.03 query2 0.070.040.04 query3 0.220.060.06 query4 1.670.080.09 query5 0.500.500.48 query6 1.140.740.74 query7 0.020.010.02 query8 0.050.040.04 query9 0.540.490.49 query10 0.540.530.55 query11 0.150.100.11 query12 0.150.110.12 query13 0.610.580.59 query14 0.760.760.78 query15 0.860.820.83 query16 0.360.380.36 query17 1.001.011.00 query18 0.210.250.26 query19 1.751.731.73 query20 0.020.010.01 query21 15.41 0.760.66 query22 4.186.891.95 query23 18.27 1.411.32 query24 2.080.240.22 query25 0.160.090.09 query26 0.260.170.18 query27 0.090.080.08 query28 13.28 1.021.00 query29 12.60 3.203.20 query30 0.270.060.05 query31 2.890.390.39 query32 3.280.490.46 query33 2.882.922.90 query34 17.18 4.384.43 query35 4.514.434.47 query36 0.650.470.49 query37 0.180.170.16 query38 0.160.150.15 query39 0.040.040.03 query40 0.170.140.16 query41 0.100.050.05 query42 0.060.050.04 query43 0.040.040.04 Total cold run time: 109.4 s Total hot run time: 30.6 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Performance](func) Opt the any_value agg function no group by [doris]
github-actions[bot] commented on PR #37156: URL: https://github.com/apache/doris/pull/37156#issuecomment-2205387455 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Performance](func) Opt the any_value agg function no group by [doris]
HappenLee merged PR #37156: URL: https://github.com/apache/doris/pull/37156 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (4984222d8eb -> cb795bd4b73)
This is an automated email from the ASF dual-hosted git repository. lihaopeng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 4984222d8eb [Fix](schema change) Fix can't do reorder column schema change for MOW table and duplicate key table (#37067) add cb795bd4b73 [Performance](func) Opt the any_value agg function no group by (#37156) No new revisions were added by this update. Summary of changes: be/src/vec/aggregate_functions/aggregate_function_min_max.h | 13 + 1 file changed, 13 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](paritial update) Fix the case of partial update failing in cloud mode [doris]
github-actions[bot] commented on PR #37151: URL: https://github.com/apache/doris/pull/37151#issuecomment-2205387931 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) handle possible filesystem exception [doris]
github-actions[bot] commented on PR #37212: URL: https://github.com/apache/doris/pull/37212#issuecomment-2205388626 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) handle possible filesystem exception [doris]
github-actions[bot] commented on PR #37212: URL: https://github.com/apache/doris/pull/37212#issuecomment-2205391053 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](gson) Fix GSON pretty printting setting [doris]
doris-robot commented on PR #37211: URL: https://github.com/apache/doris/pull/37211#issuecomment-2205392695 TPC-H: Total hot run time: 39847 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 776c1dd4b0d4040722c86102ae24a3c0281f7edc, data reload: false -- Round 1 -- q1 17745 439142684268 q2 2011187 188 187 q3 11172 126211651165 q4 10725 767 876 767 q5 7832269626172617 q6 230 143 142 142 q7 985 610 612 610 q8 9599209220912091 q9 9006661766036603 q10 9062370536983698 q11 441 241 239 239 q12 441 239 228 228 q13 17785 298129572957 q14 275 223 225 223 q15 528 494 489 489 q16 532 379 379 379 q17 954 644 719 644 q18 7942756974467446 q19 1959128712351235 q20 658 332 328 328 q21 4876319039083190 q22 397 351 341 341 Total cold run time: 115155 ms Total hot run time: 39847 ms - Round 2, with runtime_filter_mode=off - q1 4387426142564256 q2 382 264 268 264 q3 3000273029062730 q4 1979167617181676 q5 5484542754375427 q6 234 139 135 135 q7 2258187118741871 q8 3259340734093407 q9 8633870487198704 q10 4061386938293829 q11 590 504 495 495 q12 835 648 640 640 q13 16316 317032143170 q14 309 288 283 283 q15 542 486 487 486 q16 517 450 429 429 q17 1828154815091509 q18 8113793178097809 q19 1696147416161474 q20 2074186418141814 q21 10412 491450074914 q22 634 539 564 539 Total cold run time: 77543 ms Total hot run time: 55861 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](datatype) add BE config to allow zero date (#34961) [doris]
kaijchen opened a new pull request, #37214: URL: https://github.com/apache/doris/pull/37214 ## Proposed changes cherry-pick #34961 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](datatype) add BE config to allow zero date (#34961) [doris]
doris-robot commented on PR #37214: URL: https://github.com/apache/doris/pull/37214#issuecomment-2205395680 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)mv selection should rule out shadow index from schema change [doris]
doris-robot commented on PR #37154: URL: https://github.com/apache/doris/pull/37154#issuecomment-2205395888 TPC-DS: Total hot run time: 171283 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit afb00eee5e6c0679316a0e04ab050896008cd7b3, data reload: false query1 935 373 362 362 query2 6433247422792279 query3 6626201 223 201 query4 19125 17619 17175 17175 query5 3767463 466 463 query6 258 165 168 165 query7 4585300 297 297 query8 343 304 296 296 query9 8523239223632363 query10 585 324 294 294 query11 10480 994999239923 query12 115 91 83 83 query13 1653377 383 377 query14 10254 688776976887 query15 239 194 188 188 query16 7746273 281 273 query17 1885556 546 546 query18 1878288 281 281 query19 197 154 163 154 query20 92 81 83 81 query21 218 160 131 131 query22 4255403439343934 query23 33634 33639 33635 33635 query24 11030 289228722872 query25 608 410 404 404 query26 735 160 160 160 query27 2246327 343 327 query28 6239216921392139 query29 937 659 683 659 query30 265 165 168 165 query31 997 767 762 762 query32 98 59 58 58 query33 762 316 313 313 query34 918 481 493 481 query35 776 656 629 629 query36 1180987 977 977 query37 138 79 88 79 query38 2956289127952795 query39 892 841 804 804 query40 211 129 128 128 query41 58 59 58 58 query42 120 104 102 102 query43 570 552 548 548 query44 1245765 744 744 query45 282 163 166 163 query46 1078730 697 697 query47 1842177517621762 query48 391 311 304 304 query49 856 421 446 421 query50 774 389 388 388 query51 6989663667036636 query52 106 91 96 91 query53 355 284 299 284 query54 904 458 450 450 query55 74 73 80 73 query56 289 257 267 257 query57 1120104610381038 query58 259 262 246 246 query59 3338321935063219 query60 312 278 279 278 query61 96 92 92 92 query62 600 437 442 437 query63 314 298 296 296 query64 8933239518771877 query65 3149309830903090 query66 769 338 338 338 query67 15603 15127 15005 15005 query68 7844572 555 555 query69 704 446 362 362 query70 1186106210711062 query71 518 289 281 281 query72 8647534427902790 query73 803 327 326 326 query74 5885553655625536 query75 5191262027182620 query76 4523973 972 972 query77 790 299 306 299 query78 10333 981896939693 query79 8618523 524 523 query80 1108474 473 473 query81 546 219 221 219 query82 749 107 107 107 query83 354 175 171 171 query84 273 83 85 83 query85 1316291 281 281 query86 432 334 304 304 query87 3309312230923092 query88 4510246724662466 query89 548 401 405 401 query90 1952191 189 189 query91 132 102 100 100 query92 66 51 49 49 query93 6587531 513 513 query94 1211191 194 191 query95 418 320 323 320 query96 615 272 270 270 query97 3229300529872987 query98 216 201 196 196 query99 1191818 852 818 Total cold run time: 289044 ms Total hot run time: 171283 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [feature](datatype) add BE config to allow zero date (#34961) [doris]
kaijchen commented on PR #37214: URL: https://github.com/apache/doris/pull/37214#issuecomment-2205396336 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)adjust aggregate function's nullable property [doris]
starocean999 commented on PR #37215: URL: https://github.com/apache/doris/pull/37215#issuecomment-2205397937 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](nereids)adjust aggregate function's nullable property [doris]
starocean999 opened a new pull request, #37215: URL: https://github.com/apache/doris/pull/37215 aggregate functions can be divided into 3 types by their nullable properties: - AlwaysNullable - AlwaysNotNullable - NullableAggregateFunction this pr correct the wrong nullable properties -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)adjust aggregate function's nullable property [doris]
doris-robot commented on PR #37215: URL: https://github.com/apache/doris/pull/37215#issuecomment-2205397864 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hash join) fix numeric overflow when calculating hash table bucket size #37193 [doris]
github-actions[bot] commented on code in PR #37213: URL: https://github.com/apache/doris/pull/37213#discussion_r1663760574 ## be/src/vec/common/hash_table/join_hash_table.h: ## @@ -19,6 +19,8 @@ #include Review Comment: warning: 'gen_cpp/PlanNodes_types.h' file not found [clang-diagnostic-error] ```cpp #include ^ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
