Re: [PR] [Fix](group commit) Fix table not found fault when disable group commit [doris]
Yukang-Lian commented on PR #39731: URL: https://github.com/apache/doris/pull/39731#issuecomment-2309481062 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](parquet-reader) Fix definition level rle decode dead loop in parquet-reader. [doris]
doris-robot commented on PR #39523: URL: https://github.com/apache/doris/pull/39523#issuecomment-2309481629 TPC-H: Total hot run time: 37788 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1d1ade546d9fa6541b771ae5dbcabddda566eaff, data reload: false -- Round 1 -- q1 17914 461543294329 q2 2027182 187 182 q3 11653 948 1148948 q4 10448 709 741 709 q5 7745290828752875 q6 221 139 134 134 q7 971 620 608 608 q8 9310209820922092 q9 7199655565736555 q10 7015213421932134 q11 440 234 242 234 q12 390 220 224 220 q13 17782 304529952995 q14 276 242 233 233 q15 530 482 492 482 q16 507 396 384 384 q17 992 685 683 683 q18 7602674768276747 q19 1394105610691056 q20 703 335 332 332 q21 4062284330682843 q22 1112103310131013 Total cold run time: 110293 ms Total hot run time: 37788 ms - Round 2, with runtime_filter_mode=off - q1 4377430242764276 q2 385 281 269 269 q3 2884265326142614 q4 2012170216971697 q5 5637566257275662 q6 222 141 138 138 q7 2290180818101808 q8 3322341634843416 q9 8914885088018801 q10 3583340633513351 q11 624 503 509 503 q12 851 660 654 654 q13 13805 311232093112 q14 313 281 290 281 q15 540 498 473 473 q16 504 453 443 443 q17 1852157515701570 q18 8085768778187687 q19 1758167714521452 q20 2163192718841884 q21 5717543455205434 q22 1118102410441024 Total cold run time: 70956 ms Total hot run time: 56549 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](doris-future) Support REGR_AVGX_AVGY_COUNT aggregation functions [doris]
doris-robot commented on PR #39278: URL: https://github.com/apache/doris/pull/39278#issuecomment-2309483873 TPC-H: Total hot run time: 38302 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ed7841c8102cc08c8cbb4c4aab80b2036642e36e, data reload: false -- Round 1 -- q1 17628 462443514351 q2 2023189 177 177 q3 11779 989 1119989 q4 10506 830 756 756 q5 7766287028522852 q6 226 137 137 137 q7 994 611 603 603 q8 9343213321002100 q9 7506658766056587 q10 7003226522052205 q11 451 248 244 244 q12 397 221 223 221 q13 17778 301130393011 q14 295 236 231 231 q15 506 479 486 479 q16 494 407 387 387 q17 1009681 658 658 q18 7431696468776877 q19 1383108411291084 q20 705 339 346 339 q21 4064299330752993 q22 1117102110331021 Total cold run time: 110404 ms Total hot run time: 38302 ms - Round 2, with runtime_filter_mode=off - q1 4434439643174317 q2 388 275 273 273 q3 2878261526312615 q4 1927171816921692 q5 5697569357165693 q6 234 138 136 136 q7 2244180717861786 q8 3360344934703449 q9 8881885988348834 q10 3640344133703370 q11 636 496 496 496 q12 831 622 662 622 q13 15022 318331973183 q14 344 312 286 286 q15 526 495 493 493 q16 497 459 445 445 q17 1860155415701554 q18 8234781279327812 q19 1744160216781602 q20 2168194918931893 q21 5899541354665413 q22 1120104910391039 Total cold run time: 72564 ms Total hot run time: 57003 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [case](mtmv)fix test_base_mtmv failed [doris]
github-actions[bot] commented on PR #39794: URL: https://github.com/apache/doris/pull/39794#issuecomment-2309487973 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [case](mtmv)fix test_base_mtmv failed [doris]
github-actions[bot] commented on PR #39794: URL: https://github.com/apache/doris/pull/39794#issuecomment-2309488036 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) Remove Nondeterministic to avoid ambiguity when decidea expression is nondeterministic or not [doris]
starocean999 merged PR #39801: URL: https://github.com/apache/doris/pull/39801 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](nereids) Remove Nondeterministic to avoid ambiguity when decidea expression is nondeterministic or not (#39801)
This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 2b715a7ef64 [fix](nereids) Remove Nondeterministic to avoid ambiguity
when decidea expression is nondeterministic or not (#39801)
2b715a7ef64 is described below
commit 2b715a7ef6477410b2a0fb20bc63bb4a831926e2
Author: seawinde <149132972+seawi...@users.noreply.github.com>
AuthorDate: Mon Aug 26 15:06:28 2024 +0800
[fix](nereids) Remove Nondeterministic to avoid ambiguity when decidea
expression is nondeterministic or not (#39801)
## Proposed changes
In https://github.com/apache/doris/pull/36111, we add `isDeterministic`
method in class `ExpressionTrait` to identify the expression is
deterministic or not.
But `unix_timestamp` doesn't extend Nondeterministic, but it is not
deterministic when it's children is empty. and is not deterministic when
children is not empty. If we use` instanceOf Nondeterministic `to
indentify if expression is is not deterministic, that is confused.
So we do something as fllowing:
1. Remove Nondeterministic class, and use `isDeterministic` to indentify
it's deterministic.
2. Add `containsNondeterministic` method in `ExpressionTrait` to
identify it contains nondeterministic expression or not.
3. `isDeterministic` only identify current expression is deterministic
or not. would identify if contains nondeterministic or not
---
.../doris/common/NereidsSqlCacheManager.java | 5 +++--
.../nereids/rules/analysis/ExpressionAnalyzer.java | 7 +++---
.../nereids/trees/expressions/Expression.java | 3 +--
.../expressions/functions/ExpressionTrait.java | 26 --
.../expressions/functions/scalar/ConnectionId.java | 8 +--
.../expressions/functions/scalar/CurrentDate.java | 8 +--
.../expressions/functions/scalar/CurrentTime.java | 8 +--
.../expressions/functions/scalar/CurrentUser.java | 8 +--
.../expressions/functions/scalar/Database.java | 8 +--
.../trees/expressions/functions/scalar/Now.java| 8 +--
.../trees/expressions/functions/scalar/Random.java | 8 +--
.../trees/expressions/functions/scalar/User.java | 8 +--
.../expressions/functions/scalar/UtcTimestamp.java | 8 +--
.../trees/expressions/functions/scalar/Uuid.java | 8 +--
.../expressions/functions/scalar/UuidNumeric.java | 8 +--
.../functions/table/TableValuedFunction.java | 8 +--
.../nereids/rules/analysis/GenerateFunction.java | 4
.../nereids/trees/expressions/ExpressionTest.java | 26 ++
.../doris/nereids/trees/plans/PlanVisitorTest.java | 16 +
19 files changed, 130 insertions(+), 53 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/common/NereidsSqlCacheManager.java
b/fe/fe-core/src/main/java/org/apache/doris/common/NereidsSqlCacheManager.java
index a74e7e10b97..ba2c978830a 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/common/NereidsSqlCacheManager.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/common/NereidsSqlCacheManager.java
@@ -45,7 +45,7 @@ import
org.apache.doris.nereids.rules.expression.ExpressionRewriteContext;
import org.apache.doris.nereids.rules.expression.rules.FoldConstantRuleOnFE;
import org.apache.doris.nereids.trees.expressions.Expression;
import org.apache.doris.nereids.trees.expressions.Variable;
-import org.apache.doris.nereids.trees.expressions.functions.Nondeterministic;
+import org.apache.doris.nereids.trees.expressions.functions.ExpressionTrait;
import org.apache.doris.nereids.trees.plans.Plan;
import org.apache.doris.nereids.trees.plans.RelationId;
import org.apache.doris.nereids.trees.plans.logical.LogicalEmptyRelation;
@@ -396,7 +396,8 @@ public class NereidsSqlCacheManager {
Variable currentVariable = currentVariables.get(i);
Variable cachedVariable = cachedUsedVariables.get(i);
if (!Objects.equals(currentVariable, cachedVariable)
-||
cachedVariable.getRealExpression().anyMatch(Nondeterministic.class::isInstance))
{
+|| cachedVariable.getRealExpression().anyMatch(
+expr -> !((ExpressionTrait)
expr).isDeterministic())) {
return true;
}
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
index 91b5bf671ca..8624ba205c5 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
@@ -65,7 +65,6 @@ import org.apache.doris.nereids.trees.ex
Re: [PR] [test](migrate) move mc cases from p2 to p0 [doris]
doris-robot commented on PR #39706: URL: https://github.com/apache/doris/pull/39706#issuecomment-2309491121 TPC-H: Total hot run time: 38697 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 096f581e5759af594d21edccce62ab3fe9ec403f, data reload: false -- Round 1 -- q1 17872 438043334333 q2 2018187 171 171 q3 12115 100310981003 q4 10527 784 804 784 q5 7756288428742874 q6 235 149 150 149 q7 995 649 632 632 q8 10149 217621412141 q9 7284669866996698 q10 7199221321972197 q11 455 247 251 247 q12 419 234 235 234 q13 18307 319230773077 q14 279 270 249 249 q15 534 501 518 501 q16 750 414 399 399 q17 1189733 702 702 q18 7417687269396872 q19 1420110611191106 q20 661 342 334 334 q21 3915296831132968 q22 1099104010261026 Total cold run time: 112595 ms Total hot run time: 38697 ms - Round 2, with runtime_filter_mode=off - q1 4374429342664266 q2 376 272 265 265 q3 2866268426662666 q4 1922164917351649 q5 5697563657425636 q6 230 137 143 137 q7 2295186918451845 q8 3289349934853485 q9 8866873888908738 q10 3655336933403340 q11 599 482 512 482 q12 868 742 619 619 q13 15149 327932973279 q14 333 287 299 287 q15 541 485 508 485 q16 497 469 474 469 q17 1860158415401540 q18 8068788678807880 q19 1731163615721572 q20 2194189519691895 q21 5798553355615533 q22 1130104210201020 Total cold run time: 72338 ms Total hot run time: 57088 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](ES Catalog)Only push down literal expr in binary predicate [doris]
qidaye commented on code in PR #39845:
URL: https://github.com/apache/doris/pull/39845#discussion_r1730786973
##
fe/fe-core/src/main/java/org/apache/doris/datasource/es/QueryBuilders.java:
##
@@ -223,6 +239,20 @@ private static QueryBuilder parseFunctionCallExpr(Expr
expr) {
return new QueryBuilders.EsQueryBuilder(stringValue);
}
+private static String getColumnFromExpr(Expr expr) {
+// Type transformed cast can not pushdown
+if (expr instanceof CastExpr) {
+Expr withoutCastExpr = exprWithoutCast(expr);
+if (withoutCastExpr.getType().equals(expr.getType())
+|| (withoutCastExpr.getType().isFloatingPointType() &&
expr.getType().isFloatingPointType())) {
+return ((SlotRef) withoutCastExpr).getColumnName();
+}
+} else if (expr instanceof SlotRef) {
+return ((SlotRef) expr).getColumnName();
+}
+return null;
Review Comment:
`column` will be checked in line 285.
And if `column` is `null`, `toESDsl` will return `null` and it will be
handled by the caller.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Optimize get available mv logic to avoid unnecessary rewrite [doris]
github-actions[bot] commented on PR #39734: URL: https://github.com/apache/doris/pull/39734#issuecomment-2309494015 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](backup) Read db name from BackupJobInfo #39855 [doris]
w41ter merged PR #39900: URL: https://github.com/apache/doris/pull/39900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [fix](backup) Read db name from BackupJobInfo #39855 (#39900)
This is an automated email from the ASF dual-hosted git repository.
w41ter pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new f1e2b066370 [fix](backup) Read db name from BackupJobInfo #39855
(#39900)
f1e2b066370 is described below
commit f1e2b066370979eb76a6180b68d09329d545a0f3
Author: walter
AuthorDate: Mon Aug 26 15:09:30 2024 +0800
[fix](backup) Read db name from BackupJobInfo #39855 (#39900)
cherry pick from #39855
---
.../src/main/java/org/apache/doris/backup/BackupJob.java | 2 +-
.../src/main/java/org/apache/doris/backup/BackupMeta.java | 10 +-
.../src/main/java/org/apache/doris/backup/RestoreJob.java | 4 ++--
.../test/java/org/apache/doris/backup/BackupHandlerTest.java | 2 +-
.../src/test/java/org/apache/doris/backup/RestoreJobTest.java | 2 +-
5 files changed, 6 insertions(+), 14 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/backup/BackupJob.java
b/fe/fe-core/src/main/java/org/apache/doris/backup/BackupJob.java
index 4d8648bc664..97c6e4930e0 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/backup/BackupJob.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/backup/BackupJob.java
@@ -471,7 +471,7 @@ public class BackupJob extends AbstractJob {
}
}
-backupMeta = new BackupMeta(db.getName(), copiedTables,
copiedResources);
+backupMeta = new BackupMeta(copiedTables, copiedResources);
// send tasks
for (AgentTask task : batchTask.getAllTasks()) {
diff --git a/fe/fe-core/src/main/java/org/apache/doris/backup/BackupMeta.java
b/fe/fe-core/src/main/java/org/apache/doris/backup/BackupMeta.java
index 9e9da7a2764..6a973ea45a2 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/backup/BackupMeta.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/backup/BackupMeta.java
@@ -41,8 +41,6 @@ import java.util.Map;
public class BackupMeta implements Writable {
-@SerializedName(value = "db")
-private String dbName;
// tbl name -> tbl
@SerializedName(value = "tblNameMap")
private Map tblNameMap = Maps.newHashMap();
@@ -56,9 +54,7 @@ public class BackupMeta implements Writable {
private BackupMeta() {
}
-public BackupMeta(String dbName, List tables, List
resources) {
-this.dbName = dbName;
-
+public BackupMeta(List tables, List resources) {
for (Table table : tables) {
tblNameMap.put(table.getName(), table);
tblIdMap.put(table.getId(), table);
@@ -68,10 +64,6 @@ public class BackupMeta implements Writable {
}
}
-public String getDbName() {
-return dbName;
-}
-
public Map getTables() {
return tblNameMap;
}
diff --git a/fe/fe-core/src/main/java/org/apache/doris/backup/RestoreJob.java
b/fe/fe-core/src/main/java/org/apache/doris/backup/RestoreJob.java
index 725fe392b1a..e52aab93823 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/backup/RestoreJob.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/backup/RestoreJob.java
@@ -721,7 +721,7 @@ public class RestoreJob extends AbstractJob {
}
// reset all ids in this table
-String srcDbName = backupMeta.getDbName();
+String srcDbName = jobInfo.dbName;
Status st = remoteOlapTbl.resetIdsForRestore(env, db,
replicaAlloc, reserveReplica, srcDbName);
if (!st.ok()) {
status = st;
@@ -756,7 +756,7 @@ public class RestoreJob extends AbstractJob {
return;
}
} else {
-String srcDbName = backupMeta.getDbName();
+String srcDbName = jobInfo.dbName;
remoteView.resetIdsForRestore(env, srcDbName,
db.getFullName());
restoredTbls.add(remoteView);
}
diff --git
a/fe/fe-core/src/test/java/org/apache/doris/backup/BackupHandlerTest.java
b/fe/fe-core/src/test/java/org/apache/doris/backup/BackupHandlerTest.java
index 5de2be6c9ee..97e689b6972 100644
--- a/fe/fe-core/src/test/java/org/apache/doris/backup/BackupHandlerTest.java
+++ b/fe/fe-core/src/test/java/org/apache/doris/backup/BackupHandlerTest.java
@@ -212,7 +212,7 @@ public class BackupHandlerTest {
List tbls = Lists.newArrayList();
tbls.add(tbl);
List resources = Lists.newArrayList();
-BackupMeta backupMeta = new BackupMeta(null, tbls, resources);
+BackupMeta backupMeta = new BackupMeta(tbls, resources);
Map snapshotInfos = Maps.newHashMap();
for (Partition part : tbl.getPartitions()) {
for (MaterializedIndex idx :
part.getMaterializedIndices(IndexExtState.VISIBLE)) {
diff --gi
Re: [PR] [improvement](mtmv) Optimize get available mv logic to avoid unnecessary rewrite [doris]
github-actions[bot] commented on PR #39734: URL: https://github.com/apache/doris/pull/39734#issuecomment-2309494070 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Fix result wrong when query rewrite by mv if query contains null_unsafe equals expression [doris]
github-actions[bot] commented on PR #39629: URL: https://github.com/apache/doris/pull/39629#issuecomment-2309501829 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Fix result wrong when query rewrite by mv if query contains null_unsafe equals expression [doris]
github-actions[bot] commented on PR #39629: URL: https://github.com/apache/doris/pull/39629#issuecomment-2309501781 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](parquet-reader) Fix definition level rle decode dead loop in parquet-reader. [doris]
doris-robot commented on PR #39523: URL: https://github.com/apache/doris/pull/39523#issuecomment-2309502569 TPC-DS: Total hot run time: 191313 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1d1ade546d9fa6541b771ae5dbcabddda566eaff, data reload: false query1 1263863 853 853 query2 6323190719341907 query3 10597 408340364036 query4 59421 24081 23127 23127 query5 5389500 498 498 query6 405 159 162 159 query7 5871293 302 293 query8 283 208 204 204 query9 8901246424552455 query10 476 276 262 262 query11 17327 14937 15083 14937 query12 157 113 109 109 query13 1558380 386 380 query14 11063 718875027188 query15 234 235 179 179 query16 7176494 531 494 query17 1143568 575 568 query18 1930303 297 297 query19 299 146 153 146 query20 113 111 116 111 query21 214 104 106 104 query22 4829437843894378 query23 34170 33699 33267 33267 query24 5943278728302787 query25 545 410 399 399 query26 705 152 155 152 query27 1796278 279 278 query28 3550205420312031 query29 658 398 396 396 query30 212 148 146 146 query31 925 757 734 734 query32 79 55 57 55 query33 471 289 281 281 query34 848 471 473 471 query35 845 723 714 714 query36 1041958 925 925 query37 134 80 81 80 query38 3979384838363836 query39 1422139514021395 query40 195 113 113 113 query41 47 49 45 45 query42 115 94 93 93 query43 513 469 485 469 query44 1107735 745 735 query45 195 169 166 166 query46 1085769 741 741 query47 1912182818331828 query48 367 304 289 289 query49 769 444 475 444 query50 820 417 403 403 query51 7219707870057005 query52 97 87 87 87 query53 250 180 177 177 query54 565 464 448 448 query55 78 76 77 76 query56 283 270 256 256 query57 1178105910541054 query58 231 227 234 227 query59 3010276128682761 query60 296 275 267 267 query61 121 120 119 119 query62 763 666 668 666 query63 221 183 186 183 query64 3427182117801780 query65 3196317731203120 query66 699 347 344 344 query67 15428 15145 15120 15120 query68 3247569 582 569 query69 417 283 289 283 query70 1131112810661066 query71 353 278 278 278 query72 2828225423312254 query73 715 324 320 320 query74 9252866187078661 query75 269726952695 query76 1409943 966 943 query77 523 321 308 308 query78 10294 933690359035 query79 1252533 533 533 query80 967 503 514 503 query81 552 230 228 228 query82 559 139 132 132 query83 233 146 144 144 query84 259 77 73 73 query85 912 289 285 285 query86 400 295 306 295 query87 4384424044314240 query88 2989234723242324 query89 389 291 286 286 query90 1878194 191 191 query91 117 96 101 96 query92 63 49 48 48 query93 1175526 532 526 query94 829 290 293 290 query95 355 262 259 259 query96 588 270 265 265 query97 3194307630783076 query98 214 201 198 198 query99 1752128112611261 Total cold run time: 303045 ms Total hot run time: 191313 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [Enhancement](doris-future) Support REGR_AVGX_AVGY_COUNT aggregation functions [doris]
doris-robot commented on PR #39278: URL: https://github.com/apache/doris/pull/39278#issuecomment-2309505036 TPC-DS: Total hot run time: 191900 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ed7841c8102cc08c8cbb4c4aab80b2036642e36e, data reload: false query1 1227885 866 866 query2 6283190418731873 query3 10612 408140304030 query4 60025 24204 23283 23283 query5 5419509 480 480 query6 403 158 167 158 query7 5773294 304 294 query8 291 214 213 213 query9 8975249024942490 query10 482 281 267 267 query11 17992 15025 15248 15025 query12 147 101 104 101 query13 1587392 388 388 query14 11364 758569976997 query15 241 176 177 176 query16 7078486 523 486 query17 1098599 600 599 query18 1225318 310 310 query19 293 152 151 151 query20 122 111 113 111 query21 214 107 105 105 query22 4919450048164500 query23 3 33272 33345 33272 query24 5987289029152890 query25 543 405 400 400 query26 688 159 159 159 query27 1769285 283 283 query28 3852205520392039 query29 663 430 421 421 query30 246 159 146 146 query31 924 770 757 757 query32 89 56 57 56 query33 450 302 292 292 query34 874 475 495 475 query35 822 733 731 731 query36 1065916 958 916 query37 143 89 82 82 query38 4014377838493778 query39 1445141113901390 query40 206 116 119 116 query41 48 54 46 46 query42 117 99 101 99 query43 513 450 473 450 query44 1096748 745 745 query45 194 170 173 170 query46 1109757 745 745 query47 1911182218101810 query48 376 300 304 300 query49 784 444 450 444 query50 821 423 436 423 query51 7219703170787031 query52 101 89 86 86 query53 252 185 181 181 query54 579 473 464 464 query55 79 78 75 75 query56 296 273 266 266 query57 1179106611011066 query58 227 235 244 235 query59 2994281927192719 query60 286 265 263 263 query61 100 96 100 96 query62 774 646 644 644 query63 220 183 184 183 query64 3260174617841746 query65 3184317131343134 query66 657 332 343 332 query67 15568 15310 15397 15310 query68 4434556 558 556 query69 422 280 269 269 query70 1089112711031103 query71 424 276 274 274 query72 6395230120722072 query73 777 326 331 326 query74 9433875488778754 query75 3349266727332667 query76 17761033983 983 query77 563 319 335 319 query78 9727930390649064 query79 1081539 532 532 query80 798 508 511 508 query81 553 237 226 226 query82 257 135 144 135 query83 173 150 151 150 query84 309 83 73 73 query85 831 276 278 276 query86 340 297 301 297 query87 4376433642654265 query88 3127234223512342 query89 398 293 283 283 query90 2062198 193 193 query91 124 98 98 98 query92 60 51 50 50 query93 1361538 547 538 query94 769 329 299 299 query95 353 264 259 259 query96 593 275 270 270 query97 3234308130963081 query98 217 212 199 199 query99 1536128312701270 Total cold run time: 308879 ms Total hot run time: 191900 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39910: URL: https://github.com/apache/doris/pull/39910#issuecomment-2309507671 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
w41ter commented on PR #39910: URL: https://github.com/apache/doris/pull/39910#issuecomment-2309507876 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [WIP](Load) Supports synchronizing MySQL data through Cdc [doris]
github-actions[bot] commented on PR #35181:
URL: https://github.com/apache/doris/pull/35181#issuecomment-2309510069
`sh-checker report`
To get the full details, please check in the
[job]("https://github.com/apache/doris/actions/runs/10555371582";) output.
shellcheck errors
```
'shellcheck ' returned error 1 finding the following syntactical issues:
--
In bin/stop_be.sh line 76:
pgid=$(eval echo $(ps -o pgid= -p ${pid}))
^--^ SC2046 (warning): Quote this
to prevent word splitting.
^^ SC2086 (info): Double quote to
prevent globbing and word splitting.
Did you mean:
pgid=$(eval echo $(ps -o pgid= -p "${pid}"))
For more information:
https://www.shellcheck.net/wiki/SC2046 -- Quote this to prevent word
splitt...
https://www.shellcheck.net/wiki/SC2086 -- Double quote to prevent globbing
...
--
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=
above the line that contains the issue, where is the error code;
3. Add '-e ' to the SHELLCHECK_OPTS setting in your .yml action file.
```
shfmt errors
```
'shfmt ' found no issues.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309511083 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
w41ter opened a new pull request, #39911: URL: https://github.com/apache/doris/pull/39911 The field partition ID of DropPartitionInfo was added in PR: apache/doris#37196, the old version doesn't contain this field so it will be null. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
w41ter commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309511218 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](migrate) move mc cases from p2 to p0 [doris]
doris-robot commented on PR #39706: URL: https://github.com/apache/doris/pull/39706#issuecomment-2309512244 TPC-DS: Total hot run time: 192045 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 096f581e5759af594d21edccce62ab3fe9ec403f, data reload: false query1 1308898 874 874 query2 6363192618651865 query3 10628 405840684058 query4 59537 26524 23242 23242 query5 5379489 488 488 query6 409 163 156 156 query7 5777299 291 291 query8 283 210 219 210 query9 8832248824772477 query10 512 291 261 261 query11 18097 14995 15352 14995 query12 160 107 104 104 query13 1546400 405 400 query14 10691 719372057193 query15 239 175 174 174 query16 7175470 505 470 query17 1122568 575 568 query18 1873316 292 292 query19 284 149 157 149 query20 124 121 134 121 query21 210 110 109 109 query22 4633437843834378 query23 34517 33566 33755 33566 query24 6042282328332823 query25 509 379 365 365 query26 668 152 154 152 query27 1773280 277 277 query28 3914204120262026 query29 643 396 401 396 query30 244 157 148 148 query31 907 771 763 763 query32 90 54 55 54 query33 457 281 268 268 query34 856 467 471 467 query35 844 727 738 727 query36 1065936 939 936 query37 147 87 83 83 query38 3948389038653865 query39 1443140413811381 query40 202 113 113 113 query41 44 43 43 43 query42 113 99 97 97 query43 486 462 467 462 query44 1082737 740 737 query45 198 169 163 163 query46 1087718 746 718 query47 1886181317861786 query48 363 294 301 294 query49 761 422 425 422 query50 811 419 426 419 query51 7217717771067106 query52 99 88 88 88 query53 252 174 175 174 query54 566 463 451 451 query55 77 73 78 73 query56 269 249 257 249 query57 1165106510761065 query58 217 232 235 232 query59 3097287327472747 query60 311 308 263 263 query61 101 107 102 102 query62 774 645 621 621 query63 215 184 186 184 query64 2984176717861767 query65 3190312931503129 query66 667 372 339 339 query67 15414 15239 15237 15237 query68 2983570 570 570 query69 415 273 274 273 query70 1140111411051105 query71 353 269 268 268 query72 2566209720892089 query73 712 321 328 321 query74 9255894288258825 query75 3356265127352651 query76 14511005998 998 query77 508 319 307 307 query78 9782906710292 9067 query79 1117544 523 523 query80 712 509 517 509 query81 508 223 223 223 query82 296 134 131 131 query83 168 152 150 150 query84 257 79 75 75 query85 687 287 318 287 query86 311 297 299 297 query87 4547425143064251 query88 3144236823622362 query89 381 295 292 292 query90 1928202 200 200 query91 139 114 111 111 query92 63 54 53 53 query93 1053529 613 529 query94 730 308 288 288 query95 333 260 263 260 query96 590 268 274 268 query97 3226308530473047 query98 223 216 195 195 query99 1515129612671267 Total cold run time: 301346 ms Total hot run time: 192045 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Fix](parquet-reader) Fix definition level rle decode dead loop in parquet-reader. [doris]
doris-robot commented on PR #39523: URL: https://github.com/apache/doris/pull/39523#issuecomment-2309512392 ClickBench: Total hot run time: 30.53 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1d1ade546d9fa6541b771ae5dbcabddda566eaff, data reload: false query1 0.040.040.04 query2 0.080.040.04 query3 0.230.050.05 query4 1.680.080.08 query5 0.500.480.49 query6 1.130.740.72 query7 0.020.020.02 query8 0.050.050.05 query9 0.550.470.50 query10 0.530.520.53 query11 0.160.120.12 query12 0.140.120.12 query13 0.600.580.58 query14 0.770.800.79 query15 0.850.830.81 query16 0.370.370.38 query17 0.991.060.97 query18 0.230.210.21 query19 1.871.811.74 query20 0.010.000.01 query21 15.39 0.650.64 query22 4.796.921.75 query23 18.22 1.331.28 query24 2.070.230.22 query25 0.150.080.07 query26 0.270.180.18 query27 0.080.070.08 query28 13.27 1.031.00 query29 12.61 3.313.31 query30 0.240.050.05 query31 2.870.410.42 query32 3.240.470.47 query33 2.943.063.01 query34 16.97 4.404.39 query35 4.444.454.43 query36 0.660.470.47 query37 0.190.160.16 query38 0.160.150.16 query39 0.040.040.03 query40 0.160.120.12 query41 0.090.060.05 query42 0.060.050.05 query43 0.050.040.05 Total cold run time: 109.76 s Total hot run time: 30.53 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](doris-future) Support REGR_AVGX_AVGY_COUNT aggregation functions [doris]
doris-robot commented on PR #39278: URL: https://github.com/apache/doris/pull/39278#issuecomment-2309515478 ClickBench: Total hot run time: 31.42 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ed7841c8102cc08c8cbb4c4aab80b2036642e36e, data reload: false query1 0.050.040.04 query2 0.070.030.04 query3 0.220.040.05 query4 1.680.080.07 query5 0.500.500.50 query6 1.140.740.72 query7 0.020.020.01 query8 0.060.040.04 query9 0.540.490.48 query10 0.550.550.54 query11 0.170.120.11 query12 0.160.130.12 query13 0.600.590.59 query14 0.770.800.77 query15 0.850.820.81 query16 0.380.370.41 query17 1.071.071.02 query18 0.220.210.22 query19 1.971.861.86 query20 0.010.010.01 query21 15.42 0.650.64 query22 3.687.032.54 query23 18.23 1.411.31 query24 2.040.220.23 query25 0.150.090.08 query26 0.270.190.18 query27 0.080.080.07 query28 13.34 1.041.01 query29 12.58 3.373.29 query30 0.250.060.05 query31 2.890.400.39 query32 3.260.480.48 query33 2.963.023.00 query34 17.28 4.344.40 query35 4.464.454.42 query36 0.660.470.50 query37 0.190.170.16 query38 0.150.140.15 query39 0.050.040.04 query40 0.160.120.13 query41 0.090.050.05 query42 0.050.040.05 query43 0.050.040.04 Total cold run time: 109.32 s Total hot run time: 31.42 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)allow load data to the other partitions when some partitions are restoring [doris]
w41ter merged PR #39595: URL: https://github.com/apache/doris/pull/39595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (2b715a7ef64 -> 658098170f7)
This is an automated email from the ASF dual-hosted git repository. w41ter pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 2b715a7ef64 [fix](nereids) Remove Nondeterministic to avoid ambiguity when decidea expression is nondeterministic or not (#39801) add 658098170f7 [enhancement](Load)allow load data to the other partitions when some partitions are restoring (#39595) No new revisions were added by this update. Summary of changes: .../java/org/apache/doris/load/BrokerFileGroup.java | 12 +++- .../doris/transaction/DatabaseTransactionMgr.java| 20 +++- 2 files changed, 26 insertions(+), 6 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [only draft now] opt in expr [doris]
Mryange opened a new pull request, #39912: URL: https://github.com/apache/doris/pull/39912 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only draft now] opt in expr [doris]
doris-robot commented on PR #39912: URL: https://github.com/apache/doris/pull/39912#issuecomment-2309518665 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)allow load data to the other partitions when some partitions are restoring [doris]
w41ter merged PR #39411: URL: https://github.com/apache/doris/pull/39411 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [enhancement](Load)allow load data to the other partitions when some partitions are restoring (#39411)
This is an automated email from the ASF dual-hosted git repository.
w41ter pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new ab4d81a6761 [enhancement](Load)allow load data to the other partitions
when some partitions are restoring (#39411)
ab4d81a6761 is described below
commit ab4d81a6761a6dea7bb6634bca2ae1f99c192bdb
Author: shouchengShen <50309488+johnny...@users.noreply.github.com>
AuthorDate: Mon Aug 26 15:22:47 2024 +0800
[enhancement](Load)allow load data to the other partitions when some
partitions are restoring (#39411)
If broker load or stream load task execute in one table that is
restoring data, load task will failed with Exception.
Exception info :"Table [xxx] is under restore" or "Table [xxx] is in
restore process, can't load into it".
But mostly restoreJob only effects some partitions in this table, not
all of them, so that the other partitions still need to load data
successfully.
To achieve this goal, before checking olap table state, check partition
state first.
ps: set restore status for partitions in this
pr:https://github.com/apache/doris/pull/8245
## test case for this pr
### restore tbl's partition p202408
$ RESTORE SNAPSHOT db.tbl_p202408_test
FROM repo
ON(
`tbl` PARTITION (p202408)
)
PROPERTIES(
"backup_timestamp"="2024-08-22-20-32-37",
"replication_num" = "1"
);
### check restore job state\G
$ SHOW RESTORE\G
*** 1. row ***
JobId: 21741
Label: tbl_p202408_test
Timestamp: 2024-08-22-20-32-37
State: DOWNLOADING
RestoreObjs: {
"name": "tbl_p202408_test",
"database": "db",
"olap_table_list": [
{
"name": "tbl",
"partition_names": ["p202408"]
}
]
### load to partition p202408, failed with exception
curl --location-trusted -u root:"" \
> -H "label:tbl_test_load_19" \
> -H "timeout:300" \
> -H "format: parquet" \
> -T data_for_p202408.parquet \
> -XPUT http://fe_ip:8030/api/db/tbl/_stream_load
{
"TxnId": 3042,
"Label": "tbl_test_load_19",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Fail",
"Message": "[ANALYSIS_ERROR]TStatus: errCode = 2, detailMessage = Table
[zt_order_detail_v3], Partition [p202408] is in restore process. Can not
load into it.etc.",
"NumberTotalRows": 682,
"NumberLoadedRows": 682,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 82025,
"LoadTimeMs": 48,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 7,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 38,
"CommitAndPublishTimeMs": 0
}
### load to partition p202408, successfully
$ curl --location-trusted -u root:"" \
> -H "timeout:300" \
> -H "format: json" \
> -H "read_json_by_line:true" \
> -T data_for_p202407.json \
> -XPUT http://fe_ip:8030/api/db/tbl/_stream_load
{
"TxnId": 3043,
"Label": "2f2dae38-a495-4c22-9492-419ea70b724e",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Success",
"Message": "OK",
"NumberTotalRows": 1,
"NumberLoadedRows": 1,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 1128,
"LoadTimeMs": 51,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 6,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 30,
"CommitAndPublishTimeMs": 13
}
Co-authored-by: shenshoucheng
---
.../org/apache/doris/load/BrokerFileGroup.java | 13 -
.../doris/transaction/DatabaseTransactionMgr.java | 22 --
2 files changed, 28 insertions(+), 7 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/load/BrokerFileGroup.java
b/fe/fe-core/src/main/java/org/apache/doris/load/BrokerFileGroup.java
index 2b493eefb45..35bd0b8db7d 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/load/BrokerFileGroup.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/load/BrokerFileGroup.java
@@ -31,6 +31,7 @@ import org.apache.doris.catalog.KeysType;
import org.apache.doris.catalog.OlapTable;
import org.apache.doris.catalog.OlapTable.OlapTableState;
import org.apache.doris.catalog.Partition;
+import org.apache.doris.catalog.Partition.PartitionState;
import org.apache.doris.catalog.Table;
import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.DdlException;
@@ -181,11 +182,21 @@ public class BrokerFileGroup implements Writable {
throw new DdlException("Unknown partition '" + pName
+ "' in t
Re: [PR] [test](migrate) move mc cases from p2 to p0 [doris]
doris-robot commented on PR #39706: URL: https://github.com/apache/doris/pull/39706#issuecomment-2309522832 ClickBench: Total hot run time: 30.81 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 096f581e5759af594d21edccce62ab3fe9ec403f, data reload: false query1 0.050.040.03 query2 0.070.040.04 query3 0.230.050.05 query4 1.670.080.08 query5 0.500.500.50 query6 1.120.720.74 query7 0.020.010.01 query8 0.060.050.04 query9 0.550.490.49 query10 0.530.550.54 query11 0.150.120.11 query12 0.150.130.12 query13 0.610.590.59 query14 0.770.790.79 query15 0.850.830.82 query16 0.360.350.37 query17 1.060.971.01 query18 0.210.200.20 query19 1.811.741.74 query20 0.010.010.01 query21 15.40 0.670.66 query22 4.036.862.06 query23 18.29 1.341.25 query24 2.040.220.24 query25 0.150.080.08 query26 0.260.180.17 query27 0.070.080.08 query28 13.30 1.011.01 query29 12.62 3.303.36 query30 0.250.050.05 query31 2.860.400.40 query32 3.260.480.48 query33 2.973.013.02 query34 17.13 4.364.35 query35 4.414.414.45 query36 0.670.490.50 query37 0.190.160.16 query38 0.160.150.15 query39 0.050.040.03 query40 0.160.130.12 query41 0.090.040.04 query42 0.050.050.06 query43 0.050.040.04 Total cold run time: 109.24 s Total hot run time: 30.81 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [enhancement](memory) add exception handle logic in memtable flush [doris]
yiguolei opened a new pull request, #39913: URL: https://github.com/apache/doris/pull/39913 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
eldenmoon commented on PR #39841: URL: https://github.com/apache/doris/pull/39841#issuecomment-2309526746 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](memory) add exception handle logic in memtable flush [doris]
doris-robot commented on PR #39913: URL: https://github.com/apache/doris/pull/39913#issuecomment-2309526726 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](memory) add exception handle logic in memtable flush [doris]
yiguolei commented on PR #39913: URL: https://github.com/apache/doris/pull/39913#issuecomment-2309527079 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
eldenmoon commented on code in PR #39841:
URL: https://github.com/apache/doris/pull/39841#discussion_r1730811381
##
be/src/olap/rowset/segment_v2/hierarchical_data_reader.cpp:
##
@@ -34,14 +36,15 @@ namespace segment_v2 {
Status HierarchicalDataReader::create(std::unique_ptr* reader,
vectorized::PathInData path,
const SubcolumnColumnReaders::Node* node,
- const SubcolumnColumnReaders::Node*
root) {
+ const SubcolumnColumnReaders::Node* root,
+ const vectorized::DataTypePtr&
root_type) {
Review Comment:
done
##
be/src/olap/field.h:
##
@@ -28,6 +28,7 @@
#include "olap/types.h"
#include "olap/utils.h"
#include "runtime/collection_value.h"
+#include "runtime/descriptors.h"
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only draft now] opt in expr [doris]
github-actions[bot] commented on PR #39912: URL: https://github.com/apache/doris/pull/39912#issuecomment-2309530395 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](memory) add exception handle logic in memtable flush [doris]
github-actions[bot] commented on PR #39913: URL: https://github.com/apache/doris/pull/39913#issuecomment-2309539516 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
github-actions[bot] commented on PR #39841: URL: https://github.com/apache/doris/pull/39841#issuecomment-2309539779 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs [doris]
doris-robot commented on PR #39909: URL: https://github.com/apache/doris/pull/39909#issuecomment-2309542310 TPC-H: Total hot run time: 38089 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 00033eb1bd022154727c5e968828220cc7c9cbef, data reload: false -- Round 1 -- q1 17610 432742944294 q2 2017186 176 176 q3 11809 954 1144954 q4 10502 724 714 714 q5 7747286728702867 q6 224 136 137 136 q7 981 628 617 617 q8 9355206020972060 q9 7163652465096509 q10 6985222922112211 q11 461 247 254 247 q12 393 229 230 229 q13 17992 308730353035 q14 278 232 239 232 q15 515 491 487 487 q16 504 405 389 389 q17 991 688 775 688 q18 7317685469176854 q19 1398107910021002 q20 692 336 342 336 q21 4185307430423042 q22 1103101010161010 Total cold run time: 110222 ms Total hot run time: 38089 ms - Round 2, with runtime_filter_mode=off - q1 4363431442574257 q2 376 281 272 272 q3 2908270927172709 q4 1960162116661621 q5 5633572457655724 q6 235 142 142 142 q7 2246193318551855 q8 3257354435063506 q9 8919890788478847 q10 3641343033543354 q11 599 516 521 516 q12 856 709 660 660 q13 14629 313532373135 q14 330 295 316 295 q15 533 503 498 498 q16 505 444 446 444 q17 1838155215721552 q18 8169775778047757 q19 1751155414931493 q20 2167196318701870 q21 5799536057625360 q22 1134102110411021 Total cold run time: 71848 ms Total hot run time: 56888 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids)adjust aggregation cost to make it compatible to the cost of join and shuffle [doris]
doris-robot commented on PR #39175: URL: https://github.com/apache/doris/pull/39175#issuecomment-2309553450 TPC-H: Total hot run time: 37705 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ffa0b851d9518c55cf3ef28d7b7cea1484597585, data reload: false -- Round 1 -- q1 17667 479642824282 q2 2011181 180 180 q3 11789 100811151008 q4 10510 748 732 732 q5 7774283727882788 q6 223 139 133 133 q7 946 610 594 594 q8 9333205320012001 q9 7244658365406540 q10 6995225521792179 q11 482 254 245 245 q12 396 230 227 227 q13 17765 307130123012 q14 291 231 235 231 q15 517 477 491 477 q16 502 381 393 381 q17 972 648 689 648 q18 7200687067616761 q19 1389938 996 938 q20 666 320 331 320 q21 3947300730723007 q22 1141105410211021 Total cold run time: 109760 ms Total hot run time: 37705 ms - Round 2, with runtime_filter_mode=off - q1 4327426542484248 q2 377 262 277 262 q3 2899265626572656 q4 1923170216601660 q5 5518565856875658 q6 240 138 132 132 q7 2248185718501850 q8 3305338634403386 q9 8725880187848784 q10 3537340633713371 q11 637 526 530 526 q12 841 670 659 659 q13 15264 325132193219 q14 323 298 285 285 q15 534 498 493 493 q16 497 473 440 440 q17 1800152815221522 q18 8166775078437750 q19 1739157915561556 q20 2111190619111906 q21 5732556955785569 q22 1178103110501031 Total cold run time: 71921 ms Total hot run time: 56963 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
seawinde opened a new pull request, #39914: URL: https://github.com/apache/doris/pull/39914 ## Proposed changes In method `AbstractMaterializedViewRule#isMaterializationValid` Should add `LOG.isDebugEnabled()` before print debug log. Because `Plan#treeString` in debug log is performance consume. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [enhancement](Load)allow load data to the other partitions when some … [doris]
Johnnyssc opened a new pull request, #39915: URL: https://github.com/apache/doris/pull/39915 If broker load or stream load task execute in one table that is restoring data, load task will failed with Exception. Exception info :"Table [xxx] is under restore" or "Table [xxx] is in restore process, can't load into it". But mostly restoreJob only effects some partitions in this table, not all of them, so that the other partitions still need to load data successfully. To achieve this goal, before checking olap table state, check partition state first. cherry pick from master branch, pr has been merged: https://github.com/apache/doris/pull/39595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309555770 TPC-H: Total hot run time: 49232 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4d6209c6cb80de6e6a6afecfe635cdb660296f50, data reload: false -- Round 1 -- q1 17992 447643574357 q2 2076155 148 148 q3 10252 189318951893 q4 10102 122313311223 q5 8511384138883841 q6 239 124 123 123 q7 2022163315921592 q8 9476271527142714 q9 13895 10364 10112 10112 q10 8685351834583458 q11 405 236 256 236 q12 457 299 299 299 q13 18352 391440013914 q14 346 325 324 324 q15 516 451 461 451 q16 665 574 565 565 q17 1126966 926 926 q18 7170677067536753 q19 1680155015491549 q20 528 311 321 311 q21 4391411840534053 q22 500 395 390 390 Total cold run time: 119386 ms Total hot run time: 49232 ms - Round 2, with runtime_filter_mode=off - q1 4318431643614316 q2 323 225 224 224 q3 4199411941494119 q4 2738273027412730 q5 7103706170637061 q6 240 120 121 120 q7 3213282928062806 q8 4375445844744458 q9 16884 16634 16739 16634 q10 4216423542554235 q11 749 680 692 680 q12 1030880 880 880 q13 6858373737063706 q14 447 428 415 415 q15 497 457 453 453 q16 734 684 680 680 q17 3883383338963833 q18 8801877088068770 q19 1729166516401640 q20 2382209821052098 q21 8634853184268426 q22 1025927 945 927 Total cold run time: 84378 ms Total hot run time: 79211 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
doris-robot commented on PR #39914: URL: https://github.com/apache/doris/pull/39914#issuecomment-2309555842 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)allow load data to the other partitions when some … [doris]
doris-robot commented on PR #39915: URL: https://github.com/apache/doris/pull/39915#issuecomment-2309555892 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)allow load data to the other partitions when some partitions are restoring [doris]
Johnnyssc commented on PR #39915: URL: https://github.com/apache/doris/pull/39915#issuecomment-2309557600 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
seawinde commented on PR #39914: URL: https://github.com/apache/doris/pull/39914#issuecomment-2309558420 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) Reserve memory print failure reason [doris]
doris-robot commented on PR #39862: URL: https://github.com/apache/doris/pull/39862#issuecomment-2309560324 TPC-H: Total hot run time: 38422 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9fea662fb6452c84915940403ac8bc9f6b3dabf9, data reload: false -- Round 1 -- q1 17620 451543134313 q2 2019188 181 181 q3 11707 102411041024 q4 10523 767 788 767 q5 7758287928242824 q6 229 137 141 137 q7 974 626 613 613 q8 9346210421052104 q9 7278654465736544 q10 7011226522692265 q11 460 243 248 243 q12 393 227 230 227 q13 17761 304430053005 q14 310 236 242 236 q15 511 485 504 485 q16 506 390 391 390 q17 992 708 723 708 q18 7507707570227022 q19 1399107810871078 q20 680 329 347 329 q21 3965303829192919 q22 1140104810081008 Total cold run time: 110089 ms Total hot run time: 38422 ms - Round 2, with runtime_filter_mode=off - q1 4346428042824280 q2 372 283 269 269 q3 2955273126422642 q4 1926162716691627 q5 5664571057915710 q6 237 143 143 143 q7 2249186218061806 q8 3300342835473428 q9 8903897489378937 q10 3666340033683368 q11 597 513 508 508 q12 854 675 659 659 q13 13283 311132553111 q14 316 309 290 290 q15 535 493 487 487 q16 500 451 438 438 q17 1860156115571557 q18 8168778678187786 q19 1775158116311581 q20 2148189418911891 q21 5804545553745374 q22 1187104010261026 Total cold run time: 70645 ms Total hot run time: 56918 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs [doris]
doris-robot commented on PR #39909: URL: https://github.com/apache/doris/pull/39909#issuecomment-2309565437 TPC-DS: Total hot run time: 192456 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 00033eb1bd022154727c5e968828220cc7c9cbef, data reload: false query1 1261898 867 867 query2 6339193619411936 query3 10596 393640133936 query4 60151 25810 23411 23411 query5 5444498 485 485 query6 404 161 168 161 query7 5766303 307 303 query8 283 202 212 202 query9 8856249724652465 query10 500 270 262 262 query11 18457 14971 15418 14971 query12 172 102 101 101 query13 1542396 395 395 query14 11012 736074487360 query15 232 170 168 168 query16 7532463 507 463 query17 1115569 584 569 query18 1978287 297 287 query19 282 151 142 142 query20 116 111 110 110 query21 208 103 106 103 query22 4653458246664582 query23 34527 33416 33250 33250 query24 5941288728842884 query25 527 374 371 371 query26 682 160 158 158 query27 1789283 282 282 query28 3738204920222022 query29 695 402 409 402 query30 233 149 150 149 query31 937 781 753 753 query32 84 56 57 56 query33 451 285 280 280 query34 857 493 477 477 query35 859 727 700 700 query36 1100954 946 946 query37 145 83 85 83 query38 3957385238953852 query39 1439143714121412 query40 206 118 121 118 query41 50 47 45 45 query42 119 103 103 103 query43 515 468 459 459 query44 1096742 764 742 query45 201 165 170 165 query46 1096746 745 745 query47 1871180518221805 query48 370 301 296 296 query49 788 448 461 448 query50 839 437 440 437 query51 7275721171697169 query52 101 92 89 89 query53 256 187 189 187 query54 577 469 466 466 query55 81 79 78 78 query56 304 269 271 269 query57 1223108110631063 query58 228 238 272 238 query59 2898286726312631 query60 304 279 283 279 query61 129 127 124 124 query62 759 643 664 643 query63 214 189 182 182 query64 3391187218691869 query65 3221316031823160 query66 655 346 348 346 query67 15417 15086 15384 15086 query68 3431574 581 574 query69 422 294 296 294 query70 1130112910811081 query71 375 277 274 274 query72 5871246422332233 query73 759 324 321 321 query74 9383872388878723 query75 3395272727282727 query76 1489103110131013 query77 544 330 332 330 query78 9810915490529052 query79 1592533 526 526 query80 822 506 513 506 query81 561 231 230 230 query82 272 139 138 138 query83 181 148 150 148 query84 272 74 78 74 query85 910 314 278 278 query86 406 304 300 300 query87 4452416443394164 query88 4126235623282328 query89 399 289 286 286 query90 2032199 199 199 query91 123 100 99 99 query92 61 54 52 52 query93 1917539 544 539 query94 830 301 288 288 query95 350 271 268 268 query96 616 275 276 275 query97 3237308730423042 query98 221 201 196 196 query99 1723130213001300 Total cold run time: 310756 ms Total hot run time: 192456 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [Fix](group commit) Fix table not found fault when disable group commit [doris]
doris-robot commented on PR #39731: URL: https://github.com/apache/doris/pull/39731#issuecomment-2309566098 TPC-H: Total hot run time: 37737 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 66698bd9ba346686e7241eca861100c3628abafa, data reload: false -- Round 1 -- q1 17613 461242414241 q2 2019195 183 183 q3 11779 965 1164965 q4 10514 810 651 651 q5 7745282528202820 q6 222 136 137 136 q7 970 617 595 595 q8 9533206720532053 q9 7909651465206514 q10 6993216521862165 q11 456 242 240 240 q12 388 231 230 230 q13 17791 304730183018 q14 290 245 237 237 q15 520 474 488 474 q16 507 417 399 399 q17 979 668 740 668 q18 7309677168496771 q19 1389111010101010 q20 701 341 340 340 q21 3895301230083008 q22 1146103210191019 Total cold run time: 110668 ms Total hot run time: 37737 ms - Round 2, with runtime_filter_mode=off - q1 4336432042724272 q2 385 270 269 269 q3 2887263426442634 q4 1931167516761675 q5 5598567657095676 q6 227 142 137 137 q7 2236186818281828 q8 3289347834753475 q9 8932883788258825 q10 3641341433363336 q11 617 504 501 501 q12 824 689 661 661 q13 13074 316632823166 q14 321 304 313 304 q15 537 483 489 483 q16 515 457 436 436 q17 1824152515251525 q18 8052771177627711 q19 1755162815501550 q20 2160194518971897 q21 5735546053605360 q22 1125106110581058 Total cold run time: 70001 ms Total hot run time: 56779 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [doc] cumu compaction threads had changed [doris-website]
yagagagaga opened a new pull request, #1049: URL: https://github.com/apache/doris-website/pull/1049 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs [doris]
doris-robot commented on PR #39909: URL: https://github.com/apache/doris/pull/39909#issuecomment-2309576053 ClickBench: Total hot run time: 30.9 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 00033eb1bd022154727c5e968828220cc7c9cbef, data reload: false query1 0.050.040.04 query2 0.080.040.04 query3 0.230.040.05 query4 1.670.100.08 query5 0.500.510.48 query6 1.120.730.73 query7 0.020.010.01 query8 0.060.050.05 query9 0.540.500.47 query10 0.550.540.54 query11 0.160.120.11 query12 0.140.120.12 query13 0.630.580.58 query14 0.760.800.78 query15 0.840.830.83 query16 0.370.370.37 query17 1.021.061.02 query18 0.210.200.21 query19 1.991.761.84 query20 0.010.010.02 query21 15.41 0.670.66 query22 4.216.512.16 query23 18.32 1.361.29 query24 2.070.220.24 query25 0.140.080.08 query26 0.270.180.18 query27 0.070.080.08 query28 13.25 1.021.00 query29 12.63 3.373.28 query30 0.240.060.06 query31 2.880.410.39 query32 3.260.480.47 query33 2.963.032.97 query34 17.05 4.344.31 query35 4.404.404.45 query36 0.650.480.49 query37 0.190.160.16 query38 0.160.150.15 query39 0.050.040.03 query40 0.160.140.13 query41 0.100.050.05 query42 0.050.050.05 query43 0.050.040.04 Total cold run time: 109.52 s Total hot run time: 30.9 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids)adjust aggregation cost to make it compatible to the cost of join and shuffle [doris]
doris-robot commented on PR #39175: URL: https://github.com/apache/doris/pull/39175#issuecomment-2309576980 TPC-DS: Total hot run time: 193231 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ffa0b851d9518c55cf3ef28d7b7cea1484597585, data reload: false query1 1253859 852 852 query2 6296191518641864 query3 10733 399940433999 query4 59899 26611 23200 23200 query5 5361493 497 493 query6 396 165 177 165 query7 5756296 293 293 query8 285 205 198 198 query9 8814247324902473 query10 467 271 260 260 query11 18129 15061 15374 15061 query12 155 103 98 98 query13 1530391 383 383 query14 11025 722768866886 query15 261 173 179 173 query16 7539449 469 449 query17 1159581 596 581 query18 2032304 311 304 query19 305 160 152 152 query20 129 113 110 110 query21 207 117 108 108 query22 4573469046574657 query23 34023 33819 33540 33540 query24 5971289128712871 query25 522 404 396 396 query26 676 161 160 160 query27 1768282 281 281 query28 3771206920512051 query29 656 423 427 423 query30 243 147 155 147 query31 924 758 776 758 query32 75 55 59 55 query33 465 293 283 283 query34 839 473 483 473 query35 832 765 721 721 query36 1043913 914 913 query37 140 81 83 81 query38 3945392038943894 query39 1431139813861386 query40 193 119 117 117 query41 50 49 45 45 query42 113 98 96 96 query43 497 462 476 462 query44 1072745 732 732 query45 198 168 170 168 query46 1092750 756 750 query47 1912184918291829 query48 393 292 298 292 query49 767 432 453 432 query50 811 430 408 408 query51 7126707069916991 query52 103 88 88 88 query53 252 185 177 177 query54 568 467 458 458 query55 78 76 78 76 query56 293 255 267 255 query57 1151106310641063 query58 228 239 260 239 query59 2951268127922681 query60 301 275 282 275 query61 127 122 118 118 query62 758 648 673 648 query63 222 183 187 183 query64 2919821 697 697 query65 3194311831213118 query66 688 342 333 333 query67 15593 15293 15258 15258 query68 4325574 552 552 query69 432 276 281 276 query70 1167110911191109 query71 403 277 262 262 query72 6228397040253970 query73 753 321 326 321 query74 9133875888048758 query75 3381270027532700 query76 14841035924 924 query77 551 331 330 330 query78 9713961610221 9616 query79 2422527 537 527 query80 886 558 484 484 query81 557 222 226 222 query82 287 131 137 131 query83 198 146 147 146 query84 276 73 76 73 query85 1043283 286 283 query86 338 289 307 289 query87 4405435042264226 query88 3431233423272327 query89 396 285 285 285 query90 1630191 186 186 query91 125 101 98 98 query92 60 51 54 51 query93 1769533 535 533 query94 598 297 303 297 query95 350 265 267 265 query96 600 272 267 267 query97 3202310530733073 query98 219 202 193 193 query99 1682127612821276 Total cold run time: 309322 ms Total hot run time: 193231 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309580034 TPC-DS: Total hot run time: 201886 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4d6209c6cb80de6e6a6afecfe635cdb660296f50, data reload: false query1 943 394 412 394 query2 6526219920782078 query3 6922208 201 201 query4 20511 17960 18021 17960 query5 19727 651065116510 query6 291 224 241 224 query7 4157292 299 292 query8 266 258 250 250 query9 3114266326242624 query10 416 319 307 307 query11 11259 10770 10786 10770 query12 126 77 75 75 query13 5606640 645 640 query14 17352 13598 13804 13598 query15 366 219 230 219 query16 6475289 265 265 query17 16791491876 876 query18 2311423 413 413 query19 211 156 148 148 query20 73 75 82 75 query21 192 98 94 94 query22 5178498250724982 query23 32647 31951 31808 31808 query24 7019646465546464 query25 546 432 418 418 query26 529 164 158 158 query27 1877296 291 291 query28 6170228022542254 query29 2837276126762676 query30 244 172 164 164 query31 881 725 751 725 query32 72 64 59 59 query33 405 267 255 255 query34 852 478 482 478 query35 1141907 931 907 query36 1416130712111211 query37 93 61 60 60 query38 3123296028812881 query39 1350130313181303 query40 206 89 92 89 query41 38 37 36 36 query42 84 87 85 85 query43 635 678 635 635 query44 1115716 718 716 query45 238 237 230 230 query46 1221955 984 955 query47 1823166816951668 query48 977 675 662 662 query49 634 382 366 366 query50 861 625 598 598 query51 4724471747164716 query52 93 77 80 77 query53 450 326 333 326 query54 2657246925192469 query55 92 72 71 71 query56 251 211 203 203 query57 1173118310611061 query58 219 198 195 195 query59 3464330831233123 query60 218 217 213 213 query61 101 96 98 96 query62 888 456 489 456 query63 481 339 340 339 query64 2285153014761476 query65 3624354635693546 query66 846 383 370 370 query67 16215 15878 15464 15464 query68 9141633 635 633 query69 568 367 341 341 query70 1536154113681368 query71 410 300 319 300 query72 6511352635343526 query73 734 314 317 314 query74 6236592058845884 query75 5334368835723572 query76 5870118911841184 query77 1007245 249 245 query78 12967 11424 11453 11424 query79 10560 630 636 630 query80 962 397 397 397 query81 496 235 240 235 query82 154297 100 97 query83 159 131 131 131 query84 260 72 70 70 query85 880 326 320 320 query86 327 297 292 292 query87 3194302730853027 query88 4972229222802280 query89 471 282 278 278 query90 2046206 211 206 query91 151 123 140 123 query92 60 55 49 49 query93 6864600 587 587 query94 646 204 207 204 query95 1110109510691069 query96 641 334 321 321 query97 6517634263796342 query98 190 173 169 169 query99 3087920 965 920 Total cold run time: 315965 ms Total hot run time: 201886 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [opt](memory) Reserve memory print failure reason [doris]
doris-robot commented on PR #39862: URL: https://github.com/apache/doris/pull/39862#issuecomment-2309583523 TPC-DS: Total hot run time: 190679 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9fea662fb6452c84915940403ac8bc9f6b3dabf9, data reload: false query1 1261892 845 845 query2 6410198518991899 query3 10581 405039363936 query4 59532 23752 23182 23182 query5 5395494 479 479 query6 406 156 162 156 query7 5774300 312 300 query8 300 214 214 214 query9 8935245924372437 query10 497 284 265 265 query11 17423 15154 15227 15154 query12 160 115 110 110 query13 1586424 386 386 query14 11010 739269086908 query15 254 168 171 168 query16 7546454 446 446 query17 1137578 557 557 query18 2063289 289 289 query19 278 148 146 146 query20 120 114 119 114 query21 206 102 102 102 query22 4475445145004451 query23 34461 33674 33176 33176 query24 6033291429202914 query25 530 384 375 375 query26 690 153 157 153 query27 1803275 280 275 query28 3599205520172017 query29 706 400 393 393 query30 232 153 144 144 query31 946 768 724 724 query32 85 57 55 55 query33 440 289 280 280 query34 859 474 465 465 query35 852 694 726 694 query36 1048947 929 929 query37 139 85 83 83 query38 3943392338373837 query39 1439139014021390 query40 205 116 117 116 query41 46 46 44 44 query42 115 98 94 94 query43 496 466 464 464 query44 1078740 744 740 query45 191 167 165 165 query46 1134757 745 745 query47 1887179217931792 query48 390 292 285 285 query49 764 423 438 423 query50 835 404 405 404 query51 7368712269346934 query52 97 88 91 88 query53 260 181 180 180 query54 570 448 440 440 query55 77 74 75 74 query56 276 248 248 248 query57 1203107110391039 query58 223 228 237 228 query59 3021282727732773 query60 286 274 260 260 query61 100 100 103 100 query62 768 661 651 651 query63 226 180 215 180 query64 4979232917221722 query65 3244314832043148 query66 672 319 330 319 query67 15449 15067 15217 15067 query68 2904601 571 571 query69 401 275 281 275 query70 1174110411131104 query71 350 269 276 269 query72 2625209120762076 query73 705 325 318 318 query74 9089884487018701 query75 3371271026962696 query76 1325969 949 949 query77 537 330 306 306 query78 9623909190629062 query79 1040542 528 528 query80 712 525 513 513 query81 458 229 225 225 query82 301 143 139 139 query83 176 144 150 144 query84 259 72 73 72 query85 669 289 292 289 query86 305 291 302 291 query87 4395420742334207 query88 2953231023232310 query89 396 289 285 285 query90 1934196 190 190 query91 123 100 101 100 query92 59 53 49 49 query93 1068528 530 528 query94 678 270 374 270 query95 327 261 259 259 query96 585 270 266 266 query97 3186311730493049 query98 220 207 195 195 query99 1540129512721272 Total cold run time: 302602 ms Total hot run time: 190679 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature](cloud) Add lazy commit mechanism for `commit_txn` [doris]
SWJTU-ZhangLei commented on code in PR #38243:
URL: https://github.com/apache/doris/pull/38243#discussion_r1730850089
##
cloud/src/meta-service/meta_service_txn.cpp:
##
@@ -974,353 +1361,476 @@ void commit_txn_immediately(
LOG(WARNING) << msg << " err=" << err << " txn_id=" << txn_id;
return;
}
-if
(!tablet_ids[tablet_id].ParseFromString(tablet_idx_values[i].value()))
[[unlikely]] {
+if
(!(*tablet_ids)[tablet_id].ParseFromString(tablet_idx_values[i].value()))
[[unlikely]] {
code = MetaServiceCode::PROTOBUF_PARSE_ERR;
ss << "malformed tablet index value tablet_id=" << tablet_id << "
txn_id=" << txn_id;
msg = ss.str();
LOG(WARNING) << msg;
return;
}
-
table_id_tablet_ids[tablet_ids[tablet_id].table_id()].push_back(tablet_id);
+if (!(*tablet_ids)[tablet_id].has_db_id()) {
+*need_repair_tablet_idx = true;
+}
+
(*table_id_tablet_ids)[(*tablet_ids)[tablet_id].table_id()].push_back(tablet_id);
VLOG_DEBUG << "tablet_id:" << tablet_id
- << " value:" << tablet_ids[tablet_id].ShortDebugString();
+ << " value:" << (*tablet_ids)[tablet_id].ShortDebugString();
}
tablet_idx_keys.clear();
tablet_idx_values.clear();
+}
-// {table/partition} -> version
-std::unordered_map new_versions;
-std::vector version_keys;
+void repair_tablet_index(
+std::shared_ptr& txn_kv, MetaServiceCode& code, std::string&
msg,
+const std::string& instance_id, int64_t db_id, int64_t txn_id,
+const std::vector>&
tmp_rowsets_meta) {
+std::stringstream ss;
+std::vector tablet_idx_keys;
for (auto& [_, i] : tmp_rowsets_meta) {
-int64_t tablet_id = i.tablet_id();
-int64_t table_id = tablet_ids[tablet_id].table_id();
-int64_t partition_id = i.partition_id();
-std::string ver_key = partition_version_key({instance_id, db_id,
table_id, partition_id});
-if (new_versions.count(ver_key) == 0) {
-new_versions.insert({ver_key, 0});
-version_keys.push_back(std::move(ver_key));
-}
-}
-std::vector> version_values;
-err = txn->batch_get(&version_values, version_keys);
-if (err != TxnErrorCode::TXN_OK) {
-code = cast_as(err);
-ss << "failed to get partition versions, err=" << err;
-msg = ss.str();
-LOG(WARNING) << msg << " txn_id=" << txn_id;
-return;
+tablet_idx_keys.push_back(meta_tablet_idx_key({instance_id,
i.tablet_id()}));
}
-size_t total_versions = version_keys.size();
-for (size_t i = 0; i < total_versions; i++) {
-int64_t version;
-if (version_values[i].has_value()) {
-VersionPB version_pb;
-if (!version_pb.ParseFromString(version_values[i].value())) {
+
+#define MAX_TABLET_INDEX_NUM 2048
+for (size_t i = 0; i < tablet_idx_keys.size(); i += MAX_TABLET_INDEX_NUM) {
+size_t end = (i + MAX_TABLET_INDEX_NUM) > tablet_idx_keys.size() ?
tablet_idx_keys.size()
+ : i +
MAX_TABLET_INDEX_NUM;
+const std::vector
sub_tablet_idx_keys(tablet_idx_keys.begin() + i,
+
tablet_idx_keys.begin() + end);
+std::unique_ptr txn;
+TxnErrorCode err = txn_kv->create_txn(&txn);
+if (err != TxnErrorCode::TXN_OK) {
+code = cast_as(err);
+ss << "failed to create txn, txn_id=" << txn_id << " err=" << err;
+msg = ss.str();
+LOG(WARNING) << msg;
+return;
+}
+
+std::vector> tablet_idx_values;
+// batch get snapshot is false
+err = txn->batch_get(&tablet_idx_values, tablet_idx_keys,
Review Comment:
> and it should be a snapshot GET, concurrent updating does not matter,
otherwise the update procedure may no succeed if there are other reads on
tablet_idx.
it maybe conflict with recycler, cannot snapshot read
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids)adjust aggregation cost to make it compatible to the cost of join and shuffle [doris]
doris-robot commented on PR #39175: URL: https://github.com/apache/doris/pull/39175#issuecomment-2309587650 ClickBench: Total hot run time: 30.97 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ffa0b851d9518c55cf3ef28d7b7cea1484597585, data reload: false query1 0.040.050.04 query2 0.070.040.04 query3 0.230.050.06 query4 1.680.080.08 query5 0.510.490.49 query6 1.130.740.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.560.480.49 query10 0.550.560.54 query11 0.160.110.11 query12 0.150.120.12 query13 0.610.580.58 query14 0.760.780.80 query15 0.830.800.81 query16 0.360.380.39 query17 1.040.980.97 query18 0.230.210.22 query19 1.911.801.74 query20 0.010.010.01 query21 15.40 0.670.66 query22 4.187.442.13 query23 18.28 1.351.24 query24 2.060.220.23 query25 0.140.090.09 query26 0.270.180.17 query27 0.080.080.08 query28 13.30 1.011.01 query29 12.61 3.353.30 query30 0.250.050.05 query31 2.880.400.39 query32 3.270.480.48 query33 2.973.033.00 query34 17.21 4.434.39 query35 4.454.494.49 query36 0.670.470.49 query37 0.200.150.15 query38 0.160.150.15 query39 0.050.040.04 query40 0.160.130.13 query41 0.090.040.04 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 109.69 s Total hot run time: 30.97 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [regression-test](PreparedStatement) fix unstable cases when session var changed [doris]
eldenmoon merged PR #39903: URL: https://github.com/apache/doris/pull/39903 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (658098170f7 -> 99b3437e73d)
This is an automated email from the ASF dual-hosted git repository. eldenmoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 658098170f7 [enhancement](Load)allow load data to the other partitions when some partitions are restoring (#39595) add 99b3437e73d [regression-test](PreparedStatement) fix unstable cases when session var changed (#39903) No new revisions were added by this update. Summary of changes: regression-test/suites/prepared_stmt_p0/prepared_stmt.groovy | 7 +++ .../suites/prepared_stmt_p0/prepared_stmt_in_list.groovy | 1 + 2 files changed, 8 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](group commit) Fix table not found fault when disable group commit [doris]
doris-robot commented on PR #39731: URL: https://github.com/apache/doris/pull/39731#issuecomment-2309589627 TPC-DS: Total hot run time: 192231 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 66698bd9ba346686e7241eca861100c3628abafa, data reload: false query1 1275897 872 872 query2 6330197918591859 query3 10735 414839673967 query4 60325 26330 23278 23278 query5 5523492 503 492 query6 406 163 159 159 query7 5852292 293 292 query8 285 208 213 208 query9 9028250824772477 query10 502 268 259 259 query11 17848 15126 15421 15126 query12 154 101 98 98 query13 1579396 391 391 query14 11160 729973957299 query15 231 176 177 176 query16 7102472 467 467 query17 1130567 555 555 query18 1932309 294 294 query19 282 148 148 148 query20 128 117 120 117 query21 206 102 105 102 query22 4621432146364321 query23 34375 33590 34148 33590 query24 5898289728112811 query25 511 403 399 399 query26 680 159 158 158 query27 1763290 298 290 query28 3709205120252025 query29 658 432 432 432 query30 239 156 154 154 query31 927 784 760 760 query32 79 58 57 57 query33 447 337 285 285 query34 835 480 495 480 query35 821 737 719 719 query36 1063918 926 918 query37 151 79 77 77 query38 3977393938093809 query39 1433139913941394 query40 199 117 112 112 query41 47 45 46 45 query42 111 96 98 96 query43 512 466 462 462 query44 1088745 735 735 query45 198 165 164 164 query46 1080762 757 757 query47 1909184018121812 query48 371 289 295 289 query49 770 424 452 424 query50 822 416 436 416 query51 7174702870777028 query52 101 90 86 86 query53 255 179 184 179 query54 568 458 471 458 query55 79 76 78 76 query56 283 244 250 244 query57 1164112610681068 query58 215 230 242 230 query59 2905280426742674 query60 305 271 275 271 query61 101 98 96 96 query62 763 659 668 659 query63 213 186 190 186 query64 3648208417571757 query65 3171315031543150 query66 644 335 335 335 query67 15498 15388 15395 15388 query68 3036587 577 577 query69 404 291 283 283 query70 1145112311181118 query71 389 273 275 273 query72 2484205720732057 query73 703 320 323 320 query74 9136883287558755 query75 3325270627432706 query76 14601036955 955 query77 559 330 311 311 query78 9670904994819049 query79 1030554 522 522 query80 685 523 502 502 query81 455 224 220 220 query82 296 145 139 139 query83 168 144 146 144 query84 252 78 76 76 query85 675 298 284 284 query86 300 297 303 297 query87 4355422242524222 query88 3050235323502350 query89 380 293 286 286 query90 1767198 198 198 query91 123 100 100 100 query92 59 122 52 52 query93 1058539 533 533 query94 559 304 304 304 query95 347 273 271 271 query96 586 270 273 270 query97 3220310531183105 query98 216 206 197 197 query99 1507124312811243 Total cold run time: 301793 ms Total hot run time: 192231 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309590627 ClickBench: Total hot run time: 30.42 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4d6209c6cb80de6e6a6afecfe635cdb660296f50, data reload: false query1 0.020.020.02 query2 0.080.030.02 query3 0.240.040.04 query4 1.800.070.06 query5 0.550.530.52 query6 1.230.620.61 query7 0.010.020.01 query8 0.040.030.02 query9 0.490.480.48 query10 0.530.520.54 query11 0.120.090.09 query12 0.110.090.10 query13 0.620.620.61 query14 0.780.790.80 query15 0.780.760.78 query16 0.380.380.38 query17 1.031.011.02 query18 0.220.240.23 query19 1.901.841.85 query20 0.010.010.01 query21 15.45 0.550.55 query22 2.161.841.46 query23 17.34 0.860.85 query24 6.710.861.59 query25 0.400.100.04 query26 0.760.140.14 query27 0.040.030.04 query28 6.030.710.76 query29 12.65 2.392.34 query30 0.580.530.53 query31 2.800.380.37 query32 3.400.490.50 query33 3.083.053.10 query34 15.24 4.784.79 query35 4.874.844.84 query36 1.061.021.03 query37 0.060.040.05 query38 0.030.020.03 query39 0.020.010.02 query40 0.160.140.14 query41 0.070.020.01 query42 0.020.010.01 query43 0.030.020.02 Total cold run time: 103.9 s Total hot run time: 30.42 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](memory) Reserve memory print failure reason [doris]
doris-robot commented on PR #39862: URL: https://github.com/apache/doris/pull/39862#issuecomment-2309594203 ClickBench: Total hot run time: 30.89 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9fea662fb6452c84915940403ac8bc9f6b3dabf9, data reload: false query1 0.050.050.04 query2 0.080.040.04 query3 0.230.060.06 query4 1.660.100.10 query5 0.490.480.49 query6 1.120.730.73 query7 0.020.010.01 query8 0.050.050.04 query9 0.540.480.48 query10 0.530.540.54 query11 0.150.120.11 query12 0.160.120.13 query13 0.630.590.58 query14 0.780.790.80 query15 0.840.830.81 query16 0.350.380.36 query17 0.980.990.98 query18 0.220.200.20 query19 1.921.791.83 query20 0.010.010.01 query21 15.40 0.670.65 query22 4.057.172.06 query23 18.32 1.411.24 query24 2.070.220.22 query25 0.150.080.09 query26 0.260.180.18 query27 0.080.080.07 query28 13.28 1.011.00 query29 12.94 3.363.33 query30 0.240.070.05 query31 2.870.400.39 query32 3.260.490.47 query33 2.993.013.00 query34 17.15 4.384.39 query35 4.444.434.44 query36 0.660.500.49 query37 0.190.160.15 query38 0.160.140.16 query39 0.040.030.04 query40 0.150.120.13 query41 0.100.060.05 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 109.72 s Total hot run time: 30.89 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](binlog) Fix NPE when recover binlogs (#39909) [doris]
doris-robot commented on PR #39911: URL: https://github.com/apache/doris/pull/39911#issuecomment-2309596801 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 4d6209c6cb80de6e6a6afecfe635cdb660296f50 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.3 seconds inserted 1000 Rows, about 469K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [BugFix](StoragePolicy) fix modify partition's storage policy with different resource issue succeed with execption [doris]
Johnnyssc closed pull request #35969: [BugFix](StoragePolicy) fix modify partition's storage policy with different resource issue succeed with execption URL: https://github.com/apache/doris/pull/35969 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](group commit) Fix table not found fault when disable group commit [doris]
doris-robot commented on PR #39731: URL: https://github.com/apache/doris/pull/39731#issuecomment-2309600256 ClickBench: Total hot run time: 31 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 66698bd9ba346686e7241eca861100c3628abafa, data reload: false query1 0.050.040.04 query2 0.080.040.04 query3 0.240.050.05 query4 1.660.080.09 query5 0.500.480.50 query6 1.130.730.73 query7 0.020.020.02 query8 0.050.050.05 query9 0.540.490.50 query10 0.530.540.53 query11 0.170.120.11 query12 0.140.120.12 query13 0.610.590.60 query14 0.760.810.77 query15 0.880.820.83 query16 0.380.370.38 query17 1.061.041.04 query18 0.230.210.21 query19 1.951.781.78 query20 0.010.010.02 query21 15.41 0.670.66 query22 4.617.061.88 query23 18.22 1.401.33 query24 2.070.230.23 query25 0.160.080.08 query26 0.270.190.19 query27 0.080.080.08 query28 13.28 1.031.01 query29 12.64 3.403.38 query30 0.240.060.06 query31 2.870.400.39 query32 3.250.480.48 query33 3.003.002.97 query34 17.07 4.414.41 query35 4.554.454.48 query36 0.650.460.50 query37 0.200.160.16 query38 0.160.150.15 query39 0.040.030.04 query40 0.150.130.14 query41 0.080.040.04 query42 0.050.060.06 query43 0.040.040.04 Total cold run time: 110.08 s Total hot run time: 31 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
doris-robot commented on PR #39841: URL: https://github.com/apache/doris/pull/39841#issuecomment-2309613065 TPC-H: Total hot run time: 38847 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3c05735810a444057938265dd52bbe0b7abf44b7, data reload: false -- Round 1 -- q1 18060 459045834583 q2 2519195 180 180 q3 11181 117012191170 q4 10483 772 717 717 q5 7768296428882888 q6 225 139 146 139 q7 994 633 618 618 q8 9680212920792079 q9 7167656065826560 q10 7000230422172217 q11 449 250 254 250 q12 399 226 221 221 q13 17771 300330333003 q14 271 229 239 229 q15 516 490 499 490 q16 492 387 395 387 q17 989 708 710 708 q18 7479690469736904 q19 1392107110581058 q20 704 340 336 336 q21 3896317430923092 q22 1122101810351018 Total cold run time: 110557 ms Total hot run time: 38847 ms - Round 2, with runtime_filter_mode=off - q1 4390428043004280 q2 375 291 275 275 q3 2889263826332633 q4 1894166416541654 q5 5469542454165416 q6 218 130 131 130 q7 2139174017391739 q8 3248340733433343 q9 8462843284868432 q10 3475324131743174 q11 598 509 500 500 q12 790 612 619 612 q13 8693309430643064 q14 319 285 286 285 q15 530 494 483 483 q16 480 441 426 426 q17 1815149814781478 q18 7831741976617419 q19 1671160415681568 q20 2078185818431843 q21 5430518253565182 q22 1134102610431026 Total cold run time: 63928 ms Total hot run time: 54962 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](followup) Fix wrong parition num [doris]
Gabriel39 opened a new pull request, #39916: URL: https://github.com/apache/doris/pull/39916 ## Proposed changes Follow-up for #39568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong parition num [doris]
Gabriel39 commented on PR #39916: URL: https://github.com/apache/doris/pull/39916#issuecomment-2309618275 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong parition num [doris]
doris-robot commented on PR #39916: URL: https://github.com/apache/doris/pull/39916#issuecomment-2309618225 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](followup) Fix wrong parition num [doris]
Gabriel39 opened a new pull request, #39917: URL: https://github.com/apache/doris/pull/39917 ## Proposed changes Pick #39916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong parition num [doris]
doris-robot commented on PR #39917: URL: https://github.com/apache/doris/pull/39917#issuecomment-2309619920 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong partition num [doris]
Gabriel39 commented on PR #39917: URL: https://github.com/apache/doris/pull/39917#issuecomment-2309620146 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](thrift) fix thrift for variables when version compatibility [doris]
nextdreamblue commented on PR #39904: URL: https://github.com/apache/doris/pull/39904#issuecomment-2309621466 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong partition num [doris]
github-actions[bot] commented on PR #39916: URL: https://github.com/apache/doris/pull/39916#issuecomment-2309631765 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](followup) Fix wrong partition num [doris]
github-actions[bot] commented on PR #39917: URL: https://github.com/apache/doris/pull/39917#issuecomment-2309633002 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](thrift) fix thrift for variables when version compatibility [doris]
github-actions[bot] commented on PR #39904: URL: https://github.com/apache/doris/pull/39904#issuecomment-2309634273 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
doris-robot commented on PR #39914: URL: https://github.com/apache/doris/pull/39914#issuecomment-2309635624 TPC-H: Total hot run time: 37749 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 16ab2acf4a725ade2ade1cb0498cb0c3e7a76167, data reload: false -- Round 1 -- q1 17608 500142874287 q2 2030180 176 176 q3 11707 952 1097952 q4 10524 786 735 735 q5 7752283528332833 q6 225 139 137 137 q7 941 618 606 606 q8 9327207020862070 q9 7179651364806480 q10 7001214822512148 q11 464 251 250 250 q12 388 222 228 222 q13 18587 302830973028 q14 284 229 235 229 q15 519 505 488 488 q16 504 408 389 389 q17 1013658 722 658 q18 7280675868286758 q19 1395102710021002 q20 679 325 343 325 q21 3922298730482987 q22 1099992 989 989 Total cold run time: 110428 ms Total hot run time: 37749 ms - Round 2, with runtime_filter_mode=off - q1 4361432642684268 q2 372 270 270 270 q3 2925265726562656 q4 1902163516121612 q5 5573568157155681 q6 230 140 140 140 q7 2260185818461846 q8 3288338434803384 q9 8835881588068806 q10 3635341833143314 q11 613 528 508 508 q12 842 660 702 660 q13 15932 322432613224 q14 315 283 299 283 q15 529 486 499 486 q16 488 440 438 438 q17 1842155215461546 q18 8153782679287826 q19 1698159216541592 q20 2148188618751875 q21 5822537555055375 q22 10881024997 997 Total cold run time: 72851 ms Total hot run time: 56787 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
doris-robot commented on PR #39841: URL: https://github.com/apache/doris/pull/39841#issuecomment-2309636419 TPC-DS: Total hot run time: 187233 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3c05735810a444057938265dd52bbe0b7abf44b7, data reload: false query1 915 380 378 378 query2 6448207718761876 query3 6639211 217 211 query4 33948 23188 23236 23188 query5 4166508 524 508 query6 260 162 172 162 query7 4585305 296 296 query8 250 213 200 200 query9 8499250024822482 query10 436 271 279 271 query11 15821 15037 15055 15037 query12 150 98 97 97 query13 1629383 378 378 query14 9514706371417063 query15 269 164 175 164 query16 8090453 491 453 query17 1594578 563 563 query18 2134296 298 296 query19 223 151 148 148 query20 117 112 111 111 query21 213 105 104 104 query22 414940744074 query23 34073 33703 33762 33703 query24 11320 285127932793 query25 622 386 402 386 query26 1387157 169 157 query27 2874282 279 279 query28 7665208820532053 query29 858 416 400 400 query30 306 158 150 150 query31 1008788 761 761 query32 102 56 57 56 query33 755 285 276 276 query34 989 478 483 478 query35 850 726 727 726 query36 1101941 929 929 query37 166 85 82 82 query38 3983391538163816 query39 1450139213951392 query40 274 120 115 115 query41 47 70 46 46 query42 117 96 98 96 query43 512 484 463 463 query44 1242745 753 745 query45 201 170 175 170 query46 1112748 742 742 query47 1886178417991784 query48 372 289 294 289 query49 1098413 426 413 query50 804 424 410 410 query51 7268701370567013 query52 98 88 89 88 query53 254 180 181 180 query54 942 454 455 454 query55 77 77 81 77 query56 280 249 261 249 query57 1211106210431043 query58 243 221 239 221 query59 2976274827362736 query60 300 260 300 260 query61 97 101 99 99 query62 834 648 677 648 query63 215 182 179 179 query64 6472226717101710 query65 3232340731543154 query66 1357359 341 341 query67 15496 15306 15289 15289 query68 4070549 567 549 query69 402 272 286 272 query70 1195108611221086 query71 347 270 275 270 query72 6421234720422042 query73 766 325 329 325 query74 9152888388858883 query75 3400266127112661 query76 22411047985 985 query77 476 309 324 309 query78 9649893590588935 query79 1027550 545 545 query80 692 493 492 492 query81 451 238 229 229 query82 231 137 140 137 query83 177 150 154 150 query84 217 76 79 76 query85 738 287 282 282 query86 304 309 309 309 query87 4383426343014263 query88 3017235323522352 query89 374 296 285 285 query90 1825204 195 195 query91 125 100 97 97 query92 64 53 50 50 query93 1030537 539 537 query94 803 304 294 294 query95 362 271 271 271 query96 592 275 275 275 query97 3224308531023085 query98 213 210 212 210 query99 1500127112891271 Total cold run time: 288338 ms Total hot run time: 187233 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [fix](thrift) fix thrift for variables when version compatibility [doris]
nextdreamblue commented on PR #39904: URL: https://github.com/apache/doris/pull/39904#issuecomment-2309638645 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Variant) use uinque id to access column reader [doris]
doris-robot commented on PR #39841: URL: https://github.com/apache/doris/pull/39841#issuecomment-2309647083 ClickBench: Total hot run time: 31.59 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3c05735810a444057938265dd52bbe0b7abf44b7, data reload: false query1 0.050.040.04 query2 0.080.040.04 query3 0.230.050.06 query4 1.660.080.07 query5 0.500.510.51 query6 1.140.730.74 query7 0.020.010.01 query8 0.050.040.04 query9 0.540.500.50 query10 0.550.550.55 query11 0.150.120.12 query12 0.150.120.12 query13 0.610.580.58 query14 0.760.800.79 query15 0.880.820.81 query16 0.380.370.36 query17 1.041.051.01 query18 0.210.200.21 query19 1.931.761.81 query20 0.020.010.01 query21 15.40 0.670.66 query22 4.006.622.52 query23 18.27 1.331.33 query24 2.100.260.23 query25 0.160.090.08 query26 0.270.190.19 query27 0.090.080.08 query28 13.19 1.031.00 query29 12.64 3.383.36 query30 0.230.050.06 query31 2.890.420.40 query32 3.230.470.48 query33 2.953.033.01 query34 16.93 4.414.44 query35 4.494.414.50 query36 0.660.480.49 query37 0.190.160.16 query38 0.160.150.15 query39 0.050.040.04 query40 0.160.120.12 query41 0.100.050.05 query42 0.050.050.05 query43 0.050.040.04 Total cold run time: 109.21 s Total hot run time: 31.59 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [flinkconnector] update flink connector version [doris-website]
JNSimba opened a new pull request, #1050: URL: https://github.com/apache/doris-website/pull/1050 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](thrift) fix thrift for variables when version compatibility [doris]
github-actions[bot] commented on PR #39904: URL: https://github.com/apache/doris/pull/39904#issuecomment-2309650695 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
doris-robot commented on PR #39914: URL: https://github.com/apache/doris/pull/39914#issuecomment-2309659624 TPC-DS: Total hot run time: 192187 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 16ab2acf4a725ade2ade1cb0498cb0c3e7a76167, data reload: false query1 1261907 871 871 query2 6158186919261869 query3 10611 404839853985 query4 59672 23933 23302 23302 query5 5442505 503 503 query6 412 169 166 166 query7 5880298 294 294 query8 291 226 221 221 query9 8956249824822482 query10 495 283 265 265 query11 18000 15125 15164 15125 query12 165 114 114 114 query13 1577394 382 382 query14 11342 738774237387 query15 229 175 192 175 query16 7534467 448 448 query17 1208585 576 576 query18 2034305 297 297 query19 308 149 144 144 query20 119 114 114 114 query21 206 100 100 100 query22 4779450842794279 query23 34492 33802 33711 33711 query24 5880290428482848 query25 550 402 397 397 query26 693 165 184 165 query27 1764292 280 280 query28 3682205020112011 query29 688 400 403 400 query30 239 155 152 152 query31 923 778 758 758 query32 81 55 58 55 query33 457 284 281 281 query34 851 464 484 464 query35 844 742 708 708 query36 1062905 916 905 query37 143 83 86 83 query38 3991394938373837 query39 1452143614341434 query40 205 117 115 115 query41 46 45 47 45 query42 114 100 94 94 query43 510 448 476 448 query44 1080741 751 741 query45 193 166 164 164 query46 1098734 744 734 query47 1894178217861782 query48 371 296 298 296 query49 766 441 444 441 query50 818 418 429 418 query51 7168704170847041 query52 104 87 87 87 query53 265 184 188 184 query54 571 487 447 447 query55 74 77 75 75 query56 285 249 255 249 query57 1206106010851060 query58 207 218 242 218 query59 3128277127662766 query60 288 266 268 266 query61 103 98 114 98 query62 755 645 657 645 query63 215 180 185 180 query64 4205230117901790 query65 3197317331713171 query66 666 323 343 323 query67 15379 15166 15181 15166 query68 2997572 563 563 query69 403 287 280 280 query70 1146107210161016 query71 356 277 273 273 query72 2626211420222022 query73 700 325 323 323 query74 9245890087798779 query75 3343269526792679 query76 1440950 1057950 query77 570 324 340 324 query78 9687904392419043 query79 1038548 539 539 query80 675 499 492 492 query81 462 229 228 228 query82 293 141 137 137 query83 174 154 151 151 query84 254 133 78 78 query85 670 280 279 279 query86 308 252 289 252 query87 4395427242744272 query88 3185234523502345 query89 375 285 290 285 query90 1967199 200 199 query91 123 121 101 101 query92 61 53 53 53 query93 1077528 542 528 query94 702 300 296 296 query95 335 269 263 263 query96 594 272 277 272 query97 3196306330593059 query98 218 218 206 206 query99 1517127712681268 Total cold run time: 303514 ms Total hot run time: 192187 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
[PR] [fix](replay) fix replay ReplicaPersistInfo no update lastFailedVersion and lastSuccVersion [doris]
yujun777 opened a new pull request, #39918: URL: https://github.com/apache/doris/pull/39918 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](replay) fix replay ReplicaPersistInfo no update lastFailedVersion and lastSuccVersion [doris]
doris-robot commented on PR #39918: URL: https://github.com/apache/doris/pull/39918#issuecomment-2309663438 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](replay) fix replay ReplicaPersistInfo no update lastFailedVersion and lastSuccVersion [doris]
yujun777 commented on PR #39918: URL: https://github.com/apache/doris/pull/39918#issuecomment-2309663538 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Bug](case) fix some mv unstable case [doris]
BiteThet opened a new pull request, #39919: URL: https://github.com/apache/doris/pull/39919 ## Proposed changes fix some mv unstable case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](case) fix some mv unstable case [doris]
BiteThet commented on PR #39919: URL: https://github.com/apache/doris/pull/39919#issuecomment-2309668240 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Add debug log decide for performance when query rewrite by materialized view [doris]
doris-robot commented on PR #39914: URL: https://github.com/apache/doris/pull/39914#issuecomment-2309670275 ClickBench: Total hot run time: 30.09 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 16ab2acf4a725ade2ade1cb0498cb0c3e7a76167, data reload: false query1 0.040.050.04 query2 0.080.030.04 query3 0.220.050.05 query4 1.680.070.07 query5 0.480.480.48 query6 1.130.720.71 query7 0.020.020.01 query8 0.050.040.04 query9 0.550.490.48 query10 0.540.540.52 query11 0.160.110.12 query12 0.140.120.12 query13 0.600.580.59 query14 0.760.830.78 query15 0.880.810.82 query16 0.380.380.35 query17 1.021.070.98 query18 0.220.210.22 query19 1.841.861.79 query20 0.010.010.01 query21 15.38 0.670.66 query22 4.507.771.31 query23 18.22 1.521.35 query24 2.070.240.22 query25 0.170.080.08 query26 0.270.180.18 query27 0.080.070.07 query28 13.27 1.031.00 query29 12.58 3.353.32 query30 0.240.060.06 query31 2.890.400.38 query32 3.260.480.48 query33 2.962.983.04 query34 17.00 4.374.39 query35 4.474.434.42 query36 0.660.460.48 query37 0.190.170.16 query38 0.160.140.14 query39 0.050.030.03 query40 0.160.120.13 query41 0.090.060.05 query42 0.060.040.05 query43 0.050.040.04 Total cold run time: 109.58 s Total hot run time: 30.09 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](replay) fix replay ReplicaPersistInfo no update lastFailedVersion and lastSuccVersion [doris]
github-actions[bot] commented on PR #39918: URL: https://github.com/apache/doris/pull/39918#issuecomment-2309675053 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
starocean999 opened a new pull request, #39920: URL: https://github.com/apache/doris/pull/39920 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
doris-robot commented on PR #39920: URL: https://github.com/apache/doris/pull/39920#issuecomment-2309682391 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
starocean999 commented on PR #39920: URL: https://github.com/apache/doris/pull/39920#issuecomment-2309682561 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
starocean999 opened a new pull request, #39921: URL: https://github.com/apache/doris/pull/39921 ## Proposed changes pick from master https://github.com/apache/doris/pull/39920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
doris-robot commented on PR #39921: URL: https://github.com/apache/doris/pull/39921#issuecomment-2309684334 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)fix failure of select_random_distributed_tbl test case [doris]
starocean999 commented on PR #39921: URL: https://github.com/apache/doris/pull/39921#issuecomment-230968 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [doc](mtmv)Description of Catalog in MTMV [doris-website]
luzhijing merged PR #949: URL: https://github.com/apache/doris-website/pull/949 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
