Re: [PR] [opt](regression-test) More test case to trace problem of datetime v2 round [doris]
zhiqiang- commented on PR #37520: URL: https://github.com/apache/doris/pull/37520#issuecomment-2216751272 https://github.com/apache/doris/assets/42906151/81edc7f5-cdc4-4cef-a33c-b2e21d4ce7c6";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](planner)fix bug of char(255) toSql [doris]
feiniaofeiafei commented on PR #37340: URL: https://github.com/apache/doris/pull/37340#issuecomment-2216752367 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](hash_join) Merging all build blocks at once will cause performance issue [doris]
doris-robot commented on PR #37471: URL: https://github.com/apache/doris/pull/37471#issuecomment-2216751610 TPC-H: Total hot run time: 39759 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 34af1619476c952e9e29c256726cfb9ca4cffd96, data reload: false -- Round 1 -- q1 17639 427542884275 q2 2013202 201 201 q3 10433 115011521150 q4 10213 800 841 800 q5 7525269126482648 q6 219 141 141 141 q7 959 598 616 598 q8 9219207620752075 q9 8707651465756514 q10 8808376737373737 q11 476 244 228 228 q12 422 218 219 218 q13 17802 292829872928 q14 281 225 238 225 q15 525 472 498 472 q16 510 379 369 369 q17 981 645 678 645 q18 8029740173257325 q19 8607140114131401 q20 679 308 313 308 q21 4811321731653165 q22 375 339 336 336 Total cold run time: 119233 ms Total hot run time: 39759 ms - Round 2, with runtime_filter_mode=off - q1 4442421341994199 q2 388 279 265 265 q3 3008295429132913 q4 2000164917371649 q5 5653551854475447 q6 225 139 132 132 q7 2166187318181818 q8 3269340434413404 q9 8794877088998770 q10 4109383237303730 q11 592 483 500 483 q12 825 639 643 639 q13 17140 318931823182 q14 319 286 281 281 q15 548 476 491 476 q16 486 426 436 426 q17 1833154015351535 q18 8176793078417841 q19 1871155216111552 q20 3064190518661866 q21 7454492147384738 q22 651 559 526 526 Total cold run time: 77013 ms Total hot run time: 55872 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) The NodeChannel should be canceled when failed to add block #37500 [doris]
github-actions[bot] commented on PR #37527: URL: https://github.com/apache/doris/pull/37527#issuecomment-2216759542 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](constant-folding) disable folding by be by default (#37517)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 0833dbe62c5 [fix](constant-folding) disable folding by be by default
(#37517)
0833dbe62c5 is described below
commit 0833dbe62c5360c06afc96ac2a0a4ed78e9f724f
Author: morrySnow <101034200+morrys...@users.noreply.github.com>
AuthorDate: Tue Jul 9 15:08:11 2024 +0800
[fix](constant-folding) disable folding by be by default (#37517)
---
fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
index 61761fce775..4aa310cc56f 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
@@ -1039,7 +1039,7 @@ public class SessionVariable implements Serializable,
Writable {
private boolean enableJoinReorderBasedCost = false;
@VariableMgr.VarAttr(name = ENABLE_FOLD_CONSTANT_BY_BE, fuzzy = true)
-public boolean enableFoldConstantByBe = true;
+public boolean enableFoldConstantByBe = false;
@VariableMgr.VarAttr(name = DEBUG_SKIP_FOLD_CONSTANT)
public boolean debugSkipFoldConstant = false;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](constant-folding) disable folding by be by default [doris]
morrySnow merged PR #37517: URL: https://github.com/apache/doris/pull/37517 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
doris-robot commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2216763480 TPC-H: Total hot run time: 40336 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7eca21a2d268845ed80241196171c5d174e859b1, data reload: false -- Round 1 -- q1 17640 431542564256 q2 2024195 187 187 q3 10436 115710461046 q4 10204 809 938 809 q5 7515269626192619 q6 226 139 139 139 q7 960 598 620 598 q8 9229204721082047 q9 8928647664866476 q10 9081376137103710 q11 467 244 249 244 q12 417 238 234 234 q13 17948 297430082974 q14 273 234 239 234 q15 524 499 488 488 q16 514 386 372 372 q17 960 624 644 624 q18 8037749973817381 q19 7523156414261426 q20 678 322 331 322 q21 4918381940173819 q22 406 344 331 331 Total cold run time: 118908 ms Total hot run time: 40336 ms - Round 2, with runtime_filter_mode=off - q1 4486422642384226 q2 377 266 270 266 q3 3059284329442843 q4 1980177917361736 q5 5580551854395439 q6 228 133 133 133 q7 2273188018321832 q8 3274341334053405 q9 8728885887468746 q10 4156374838663748 q11 631 518 521 518 q12 835 639 632 632 q13 16050 314332683143 q14 301 278 286 278 q15 530 506 484 484 q16 500 432 468 432 q17 1860152115121512 q18 8029816677287728 q19 1811156116071561 q20 2157186418981864 q21 5255505647754775 q22 671 574 558 558 Total cold run time: 72771 ms Total hot run time: 55859 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](rpc) set grpc channel's keepAliveTime and remove proxy on InterruptedExcep… [doris]
morningman commented on code in PR #37304:
URL: https://github.com/apache/doris/pull/37304#discussion_r1669867458
##
fe/fe-common/src/main/java/org/apache/doris/common/Config.java:
##
@@ -1465,6 +1465,12 @@ public class Config extends ConfigBase {
@ConfField
public static int grpc_threadmgr_threads_nums = 4096;
+/**
+ * sets the time without read activity before sending a keepalive ping
+ */
+@ConfField
Review Comment:
add `description` field and give some guidance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](hash_join) Merging all build blocks at once will cause performance issue [doris]
doris-robot commented on PR #37471: URL: https://github.com/apache/doris/pull/37471#issuecomment-2216774817 TPC-DS: Total hot run time: 173918 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 34af1619476c952e9e29c256726cfb9ca4cffd96, data reload: false query1 914 379 357 357 query2 6455239723452345 query3 6631214 216 214 query4 28150 17525 17261 17261 query5 3709503 495 495 query6 268 179 168 168 query7 4599271 283 271 query8 314 299 298 298 query9 8641240924022402 query10 573 313 284 284 query11 11073 997210019 9972 query12 125 91 80 80 query13 1652362 363 362 query14 9940750575727505 query15 239 184 181 181 query16 7407337 314 314 query17 1344561 520 520 query18 1948267 265 265 query19 201 145 143 143 query20 83 82 77 77 query21 204 136 132 132 query22 4317406039913991 query23 33832 33957 33578 33578 query24 11159 291128742874 query25 594 408 386 386 query26 709 145 146 145 query27 2335264 307 264 query28 6083210020932093 query29 901 632 632 632 query30 256 161 152 152 query31 975 792 762 762 query32 97 56 54 54 query33 643 302 300 300 query34 937 479 509 479 query35 702 603 621 603 query36 1151984 967 967 query37 151 86 82 82 query38 2852274127982741 query39 869 804 797 797 query40 201 119 115 115 query41 53 52 51 51 query42 125 98 99 98 query43 589 537 578 537 query44 1125736 736 736 query45 199 168 163 163 query46 1070693 709 693 query47 1822175517671755 query48 357 291 285 285 query49 817 406 426 406 query50 770 382 397 382 query51 6915680466856685 query52 98 96 92 92 query53 363 287 286 286 query54 850 446 430 430 query55 74 71 74 71 query56 286 268 270 268 query57 1137105210311031 query58 238 240 284 240 query59 3490327932073207 query60 309 275 290 275 query61 120 117 115 115 query62 791 651 652 651 query63 324 289 291 289 query64 9206218516401640 query65 3151312330973097 query66 799 326 331 326 query67 15383 14915 14871 14871 query68 4534522 522 522 query69 589 462 359 359 query70 1100115311251125 query71 396 288 276 276 query72 7169561057125610 query73 744 316 320 316 query74 5920545454535453 query75 3384268626692669 query76 2324957 915 915 query77 636 296 305 296 query78 10393 952489768976 query79 2270507 502 502 query80 2069544 477 477 query81 598 219 216 216 query82 745 133 128 128 query83 285 165 169 165 query84 247 88 85 85 query85 1496330 311 311 query86 473 319 308 308 query87 3308310130773077 query88 4103234323342334 query89 472 392 389 389 query90 1764185 188 185 query91 132 104 103 103 query92 65 49 50 49 query93 2108492 495 492 query94 1106210 219 210 query95 408 312 309 309 query96 596 263 266 263 query97 3203305430163016 query98 218 201 201 201 query99 1734124013031240 Total cold run time: 278284 ms Total hot run time: 173918 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [chore](nereids) Default set enable_nereids_distribute_planner=true [doris]
924060929 commented on PR #37219: URL: https://github.com/apache/doris/pull/37219#issuecomment-2216776271 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature]support stream load with group commit mode [doris-kafka-connector]
JNSimba merged PR #35: URL: https://github.com/apache/doris-kafka-connector/pull/35 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-kafka-connector) branch master updated: [feature]support stream load with group commit mode (#35)
This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-kafka-connector.git
The following commit(s) were added to refs/heads/master by this push:
new 4ace2e6 [feature]support stream load with group commit mode (#35)
4ace2e6 is described below
commit 4ace2e65a7c0bf383c14010e7a4823e5fd5e0aaf
Author: Petrichor <31833513+vinle...@users.noreply.github.com>
AuthorDate: Tue Jul 9 15:13:16 2024 +0800
[feature]support stream load with group commit mode (#35)
---
.../doris/kafka/connector/cfg/DorisOptions.java| 27 +++
.../kafka/connector/utils/ConfigCheckUtils.java| 27 +++
.../kafka/connector/writer/LoadConstants.java | 4 ++
.../connector/writer/load/DorisStreamLoad.java | 23 +++--
.../GroupCommitMode.java} | 32 ++---
.../cfg/TestDorisSinkConnectorConfig.java | 52
.../e2e/sink/stringconverter/StringMsgE2ETest.java | 55 --
.../string_converter/group_commit_connector.json | 23 +
.../e2e/string_converter/group_commit_tab.sql | 13 +
9 files changed, 234 insertions(+), 22 deletions(-)
diff --git
a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
index 69cbb80..e8c1933 100644
--- a/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
+++ b/src/main/java/org/apache/doris/kafka/connector/cfg/DorisOptions.java
@@ -55,8 +55,9 @@ public class DorisOptions {
private boolean autoRedirect = true;
private int requestReadTimeoutMs;
private int requestConnectTimeoutMs;
+private boolean enableGroupCommit;
/** Properties for the StreamLoad. */
-private final Properties streamLoadProp = new Properties();
+private final Properties streamLoadProp;
@Deprecated private String labelPrefix;
private final String databaseTimeZone;
@@ -113,25 +114,31 @@ public class DorisOptions {
this.requestReadTimeoutMs =
Integer.parseInt(config.get(DorisSinkConnectorConfig.REQUEST_READ_TIMEOUT_MS));
}
-getStreamLoadPropFromConfig(config);
+this.streamLoadProp = getStreamLoadPropFromConfig(config);
+this.enableGroupCommit =
+ConfigCheckUtils.validateGroupCommitMode(getStreamLoadProp(),
enable2PC());
}
-private void getStreamLoadPropFromConfig(Map config) {
-setStreamLoadDefaultValues();
+private Properties getStreamLoadPropFromConfig(Map config)
{
+Properties properties = new Properties();
+properties.putAll(getStreamLoadDefaultValues());
for (Map.Entry entry : config.entrySet()) {
if
(entry.getKey().startsWith(DorisSinkConnectorConfig.STREAM_LOAD_PROP_PREFIX)) {
String subKey =
entry.getKey()
.substring(
DorisSinkConnectorConfig.STREAM_LOAD_PROP_PREFIX.length());
-streamLoadProp.put(subKey, entry.getValue());
+properties.put(subKey, entry.getValue());
}
}
+return properties;
}
-private void setStreamLoadDefaultValues() {
-streamLoadProp.setProperty("format", "json");
-streamLoadProp.setProperty("read_json_by_line", "true");
+private Properties getStreamLoadDefaultValues() {
+Properties properties = new Properties();
+properties.setProperty("format", "json");
+properties.setProperty("read_json_by_line", "true");
+return properties;
}
public String getName() {
@@ -182,6 +189,10 @@ public class DorisOptions {
return enable2PC;
}
+public boolean enableGroupCommit() {
+return enableGroupCommit;
+}
+
public Map getTopicMap() {
return topicMap;
}
diff --git
a/src/main/java/org/apache/doris/kafka/connector/utils/ConfigCheckUtils.java
b/src/main/java/org/apache/doris/kafka/connector/utils/ConfigCheckUtils.java
index ca8ec31..51b8b06 100644
--- a/src/main/java/org/apache/doris/kafka/connector/utils/ConfigCheckUtils.java
+++ b/src/main/java/org/apache/doris/kafka/connector/utils/ConfigCheckUtils.java
@@ -19,8 +19,11 @@
package org.apache.doris.kafka.connector.utils;
+import static
org.apache.doris.kafka.connector.writer.LoadConstants.PARTIAL_COLUMNS;
+
import java.util.HashMap;
import java.util.Map;
+import java.util.Properties;
import java.util.regex.Pattern;
import org.apache.doris.kafka.connector.cfg.DorisSinkConnectorConfig;
import org.apache.doris.kafka.connector.converter.ConverterMode;
@@ -28,6 +31,8 @@ import
org.apache.doris.kafka.connector.converter.schema.SchemaEvolutionMode;
import org.apache.doris.kafka.connector.exception.ArgumentsException;
import org.apache.doris.kafka.connec
[PR] [fix](memory) Disable Arrow Jemalloc [doris]
xinyiZzz opened a new pull request, #37528: URL: https://github.com/apache/doris/pull/37528 ## Proposed changes Currently, Arrow use separate Jemalloc, and use non-standard methods `mallocx`, `sdallocx`, `rallocx` in `memory_pool_jemalloc.cc` to optimize memory allocation. But this may be incompatible with older versions of the Linux kernel. when we use Arrow on Arm Kirin v10 or Centos 7.4, it will get stuck on the Jemalloc Lock, with the stack below, it will appear when calling `arrow::RecordBatch::MakeEmpty`. the kernel version of Arm Kylin v10 is 4.19.90, and the kernel version of Centos 7.4 is 4.14. ``` #0 0xae3ceff8 in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0xae3c9b50 in pthread_mutex_lock () from /lib64/libpthread.so.0 #2 0xae61c834 in pthread_mutex_lock () from /lib64/libc.so.6 #3 0xc99bc1e0 in je_arrow_private_je_malloc_mutex_lock_slow () #4 0xc99af3a4 in ?? () #5 0xc99b576c in je_arrow_mallocx () #6 0xc99a8aec in ?? () #7 0xc99a9858 in arrow::AllocateResizableBuffer(long, arrow::MemoryPool*) () #8 0xc399f8b8 in arrow::BufferBuilder::Resize(long, bool) () #9 0xc983715c in arrow::BaseBinaryBuilder::Resize(long) () #10 0xc39a47e0 in arrow::BaseBinaryBuilder::Append(unsigned char const*, int) () ``` After disable separate Jemalloc when compiling Arrow, the above error disappeared, and Arrow will use the default memory allocator, which is Doris Jemalloc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc [doris]
doris-robot commented on PR #37528: URL: https://github.com/apache/doris/pull/37528#issuecomment-2216786381 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc [doris]
xinyiZzz commented on PR #37528: URL: https://github.com/apache/doris/pull/37528#issuecomment-2216786426 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. [doris]
morningman merged PR #37377: URL: https://github.com/apache/doris/pull/37377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (0833dbe62c5 -> b48b5da0f7c)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 0833dbe62c5 [fix](constant-folding) disable folding by be by default (#37517) add b48b5da0f7c [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. (#37377) No new revisions were added by this update. Summary of changes: .../serde/data_type_datetimev2_serde.cpp | 21 + .../data_types/serde/data_type_datetimev2_serde.h | 5 + .../data_types/serde/data_type_datev2_serde.cpp| 21 + .../vec/data_types/serde/data_type_datev2_serde.h | 6 + .../data_types/serde/data_type_decimal_serde.cpp | 26 ++ .../vec/data_types/serde/data_type_decimal_serde.h | 6 + .../data_types/serde/data_type_nullable_serde.cpp | 20 + .../data_types/serde/data_type_nullable_serde.h| 3 +++ .../data_types/serde/data_type_number_serde.cpp| 22 ++ .../vec/data_types/serde/data_type_number_serde.h | 6 + be/src/vec/data_types/serde/data_type_serde.h | 21 + .../vec/data_types/serde/data_type_string_serde.h | 25 + be/src/vec/exec/format/orc/vorc_reader.cpp | 9 +++- .../exec/format/parquet/vparquet_group_reader.cpp | 9 +++- be/src/vec/exec/scan/vfile_scanner.cpp | 9 +++- 15 files changed, 191 insertions(+), 18 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](Agg nullable) [doris]
doris-robot commented on PR #37330: URL: https://github.com/apache/doris/pull/37330#issuecomment-2216787929 TPC-H: Total hot run time: 39921 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit acadf88a0563bb4d0c3a10380f52f77a618bfb7e, data reload: false -- Round 1 -- q1 17622 433042624262 q2 2016195 192 192 q3 10454 117010231023 q4 10179 816 807 807 q5 7588267026332633 q6 226 144 150 144 q7 992 612 614 612 q8 9522211020652065 q9 8638646364606460 q10 8923368737023687 q11 476 248 237 237 q12 403 237 225 225 q13 17780 299330062993 q14 281 233 236 233 q15 539 503 495 495 q16 521 371 379 371 q17 958 642 695 642 q18 8138751474287428 q19 3060149915151499 q20 688 329 353 329 q21 4925324239853242 q22 401 344 342 342 Total cold run time: 114330 ms Total hot run time: 39921 ms - Round 2, with runtime_filter_mode=off - q1 4326426342854263 q2 361 276 273 273 q3 2928272227492722 q4 1870159415931593 q5 5260528453105284 q6 222 131 134 131 q7 2075175517191719 q8 3223337833253325 q9 8368835683468346 q10 3896367036503650 q11 587 495 517 495 q12 788 637 622 622 q13 16367 301529962996 q14 300 258 283 258 q15 519 465 483 465 q16 492 426 417 417 q17 1788147714701470 q18 7729768272087208 q19 2514157915821579 q20 1985181817931793 q21 4829485347124712 q22 622 572 570 570 Total cold run time: 71049 ms Total hot run time: 53891 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Modified low water mark=min(6.4G, MemTotal * 5%) [doris]
doris-robot commented on PR #37525: URL: https://github.com/apache/doris/pull/37525#issuecomment-2216788116 TPC-H: Total hot run time: 40489 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c69d162c7fca2a5a5b2b9a8e328bc46a9090c80c, data reload: false -- Round 1 -- q1 17631 433243144314 q2 2018197 194 194 q3 10462 113511701135 q4 10195 764 827 764 q5 7515269926432643 q6 223 140 141 140 q7 954 599 612 599 q8 9216208120762076 q9 8761649064706470 q10 8976376937143714 q11 458 244 242 242 q12 471 220 223 220 q13 17816 295529722955 q14 264 227 225 225 q15 531 469 471 469 q16 481 371 379 371 q17 967 667 737 667 q18 8053746173477347 q19 5348152015021502 q20 670 322 330 322 q21 5038378739593787 q22 407 333 341 333 Total cold run time: 116455 ms Total hot run time: 40489 ms - Round 2, with runtime_filter_mode=off - q1 4379422842114211 q2 385 277 269 269 q3 2994292528362836 q4 1994174416831683 q5 5683552254735473 q6 226 136 134 134 q7 2170191318431843 q8 3266341934213419 q9 8694869987928699 q10 4074380737763776 q11 599 513 506 506 q12 847 671 636 636 q13 16207 321632213216 q14 299 276 274 274 q15 551 496 481 481 q16 482 428 428 428 q17 1812149915121499 q18 8174812179087908 q19 1890175816401640 q20 2153188418861884 q21 10136 479547024702 q22 628 566 571 566 Total cold run time: 77643 ms Total hot run time: 56083 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](hash_join) Merging all build blocks at once will cause performance issue [doris]
doris-robot commented on PR #37471: URL: https://github.com/apache/doris/pull/37471#issuecomment-2216790380 ClickBench: Total hot run time: 29.82 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 34af1619476c952e9e29c256726cfb9ca4cffd96, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.220.060.05 query4 1.670.080.08 query5 0.500.490.50 query6 1.130.740.74 query7 0.020.010.01 query8 0.060.040.04 query9 0.550.500.49 query10 0.550.550.54 query11 0.150.120.11 query12 0.140.120.12 query13 0.590.580.58 query14 0.770.770.78 query15 0.830.800.81 query16 0.370.370.36 query17 0.960.940.99 query18 0.230.210.21 query19 1.761.731.73 query20 0.010.010.01 query21 15.42 0.760.66 query22 4.617.771.20 query23 18.24 1.341.27 query24 2.130.210.22 query25 0.160.090.09 query26 0.290.210.21 query27 0.460.230.24 query28 13.22 1.021.00 query29 12.58 3.303.28 query30 0.250.060.06 query31 2.860.390.40 query32 3.270.480.46 query33 2.852.902.87 query34 16.97 4.344.37 query35 4.424.444.38 query36 0.650.450.46 query37 0.190.150.15 query38 0.150.150.15 query39 0.040.030.04 query40 0.150.130.12 query41 0.100.050.05 query42 0.060.040.05 query43 0.040.040.04 Total cold run time: 109.74 s Total hot run time: 29.82 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1](memory) Disable Arrow Jemalloc [doris]
doris-robot commented on PR #37529: URL: https://github.com/apache/doris/pull/37529#issuecomment-2216791153 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [branch-2.1](memory) Disable Arrow Jemalloc [doris]
xinyiZzz opened a new pull request, #37529: URL: https://github.com/apache/doris/pull/37529 ## Proposed changes pick ##37528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1](memory) Disable Arrow Jemalloc [doris]
xinyiZzz commented on PR #37529: URL: https://github.com/apache/doris/pull/37529#issuecomment-2216791202 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
doris-robot commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2216793982 TPC-DS: Total hot run time: 174985 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7eca21a2d268845ed80241196171c5d174e859b1, data reload: false query1 924 363 366 363 query2 6444230123082301 query3 6643207 217 207 query4 27659 17536 17509 17509 query5 3662482 485 482 query6 252 180 162 162 query7 4584282 286 282 query8 339 287 293 287 query9 8389242724072407 query10 572 317 290 290 query11 11514 10051 10108 10051 query12 120 85 84 84 query13 1650380 394 380 query14 10225 777878757778 query15 238 194 207 194 query16 7637316 299 299 query17 1824545 523 523 query18 1948275 274 274 query19 185 149 149 149 query20 88 84 82 82 query21 215 145 135 135 query22 4378403840634038 query23 34404 33760 33680 33680 query24 11144 294428592859 query25 578 376 388 376 query26 698 153 151 151 query27 2302277 271 271 query28 6351211721122112 query29 867 645 644 644 query30 248 156 157 156 query31 963 769 784 769 query32 99 59 62 59 query33 769 312 304 304 query34 899 485 496 485 query35 714 627 601 601 query36 1143948 969 948 query37 145 85 85 85 query38 3030281827802780 query39 862 785 797 785 query40 200 124 124 124 query41 55 54 51 51 query42 128 100 101 100 query43 587 522 550 522 query44 1281744 730 730 query45 196 161 159 159 query46 1069721 713 713 query47 1889180217991799 query48 361 296 300 296 query49 840 421 427 421 query50 780 430 403 403 query51 7191686467706770 query52 104 95 95 95 query53 364 300 303 300 query54 893 448 452 448 query55 74 72 74 72 query56 303 266 277 266 query57 1141105310691053 query58 260 251 271 251 query59 3298323930663066 query60 304 281 281 281 query61 98 92 95 92 query62 789 644 636 636 query63 325 293 289 289 query64 9115217717131713 query65 3167310431143104 query66 747 325 337 325 query67 15615 15072 14845 14845 query68 5345525 531 525 query69 687 440 340 340 query70 1199117910921092 query71 439 288 280 280 query72 7182532461655324 query73 770 318 321 318 query74 5944562955605560 query75 3658267827002678 query76 3133995 954 954 query77 630 306 293 293 query78 12636 931691849184 query79 3573509 519 509 query80 1302478 491 478 query81 586 224 224 224 query82 724 141 136 136 query83 195 174 171 171 query84 275 90 109 90 query85 717 370 300 300 query86 468 314 289 289 query87 3329311031183110 query88 4351235323572353 query89 478 400 386 386 query90 1830191 186 186 query91 132 102 102 102 query92 59 51 50 50 query93 3762504 491 491 query94 1116213 210 210 query95 410 320 317 317 query96 610 274 263 263 query97 3170306730413041 query98 224 205 195 195 query99 1558127712701270 Total cold run time: 286372 ms Total hot run time: 174985 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [Feature](multi-catalog) Add memory tracker for orc reader and writer. [doris]
github-actions[bot] commented on code in PR #37257:
URL: https://github.com/apache/doris/pull/37257#discussion_r1669884992
##
be/src/vec/common/allocator.h:
##
@@ -23,6 +23,7 @@
// TODO: Readable
#include
Review Comment:
warning: 'fmt/format.h' file not found [clang-diagnostic-error]
```cpp
#include
^
```
##
be/src/vec/common/allocator.cpp:
##
@@ -37,8 +40,9 @@
#include "util/stack_util.h"
#include "util/uid_util.h"
-template
-void Allocator::sys_memory_check(size_t size) const {
+template
+void Allocator::sys_memory_check(
Review Comment:
warning: function 'sys_memory_check' exceeds recommended size/complexity
thresholds [readability-function-size]
```cpp
void Allocator::sys_memory_check(
^
```
Additional context
**be/src/vec/common/allocator.cpp:43:** 112 lines including whitespace and
comments (threshold 80)
```cpp
void Allocator::sys_memory_check(
^
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. (#37377) [doris]
hubgeter opened a new pull request, #37530:
URL: https://github.com/apache/doris/pull/37530
bp #37377
## Proposed changes
Since the value of the partition column is fixed when querying the partition
table, we can deserialize the value only once and then repeatedly insert the
value into the block.
```sql
in Hive:
CREATE TABLE parquet_partition_tb (
col1 STRING,
col2 INT,
col3 DOUBLE
) PARTITIONED BY (
partition_col1 STRING,
partition_col2 INT
)
STORED AS PARQUET;
insert into parquet_partition_tb partition
(partition_col1="hello",partition_col2=1) values("word",2,2.3);
insert into parquet_partition_tb
partition(partition_col1="hello",partition_col2=1 )
select col1,col2,col3 from parquet_partition_tb where
partition_col1="hello" and partition_col2=1;
Repeat the `insert into xxx select xxx`operation several times.
Doris :
before:
mysql> select count(partition_col1) from parquet_partition_tb;
+---+
| count(partition_col1) |
+---+
| 33554432 |
+---+
1 row in set (3.24 sec)
mysql> select count(partition_col2) from parquet_partition_tb;
+---+
| count(partition_col2) |
+---+
| 33554432 |
+---+
1 row in set (3.34 sec)
after:
mysql> select count(partition_col1) from parquet_partition_tb ;
+---+
| count(partition_col1) |
+---+
| 33554432 |
+---+
1 row in set (0.79 sec)
mysql> select count(partition_col2) from parquet_partition_tb;
+---+
| count(partition_col2) |
+---+
| 33554432 |
+---+
1 row in set (0.51 sec)
```
## Summary：
test sql `select count(partition_col) from tbl;`
Number of lines ： 33554432
| |before | after|
|---|---|--|
|boolean | 3.96|0.47 |
|tinyint | 3.39|0.47 |
|smallint | 3.14|0.50 |
|int|3.34|0.51 |
|bigint | 3.61|0.51 |
|float | 4.59 |0.51 |
|double |4.60| 0.55 |
|decimal(5,2)| 3.96 |0.61 |
|date | 5.80|0.52|
|timestamp | 7.68 | 0.52 |
|string | 3.24 |0.79 |
Issue Number: close #xxx
## Proposed changes
Issue Number: close #xxx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. (#37377) [doris]
doris-robot commented on PR #37530: URL: https://github.com/apache/doris/pull/37530#issuecomment-2216798344 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](publish) Fix publish failed because because "task" is null [doris]
doris-robot commented on PR #37531: URL: https://github.com/apache/doris/pull/37531#issuecomment-2216798644 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](publish) Fix publish failed because because "task" is null [doris]
mymeiyi opened a new pull request, #37531: URL: https://github.com/apache/doris/pull/37531 ## Proposed changes ``` 2024-07-08 00:43:27,149 ERROR (PUBLISH_VERSION|33) [PublishVersionDaemon.runAfterCatalogReady():73] errors while publish version to all backends java.lang.NullPointerException: Cannot invoke "org.apache.doris.task.PublishVersionTask.isFinished()" because "task" is null at org.apache.doris.transaction.PublishVersionDaemon.lambda$tryFinishTxn$0(PublishVersionDaemon.java:163) ~[doris-fe.jar:1.2-SNAPSHOT] at java.util.HashMap.forEach(HashMap.java:1421) ~[?:?] at org.apache.doris.transaction.PublishVersionDaemon.tryFinishTxn(PublishVersionDaemon.java:160) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.transaction.PublishVersionDaemon.publishVersion(PublishVersionDaemon.java:96) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.transaction.PublishVersionDaemon.runAfterCatalogReady(PublishVersionDaemon.java:70) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.common.util.MasterDaemon.runOneCycle(MasterDaemon.java:58) ~[doris-fe.jar:1.2-SNAPSHOT] at org.apache.doris.common.util.Daemon.run(Daemon.java:116) ~[doris-fe.jar:1.2-SNAPSHOT] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](multi-catalog) Add memory tracker for orc reader and writer. [doris]
kaka11chen commented on PR #37257: URL: https://github.com/apache/doris/pull/37257#issuecomment-2216798596 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. (#37377) [doris]
hubgeter commented on PR #37530: URL: https://github.com/apache/doris/pull/37530#issuecomment-2216799160 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.1](memory) Disable Arrow Jemalloc [doris]
github-actions[bot] commented on PR #37529: URL: https://github.com/apache/doris/pull/37529#issuecomment-2216802970 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] disk_info_mac DiskInfo::get_device_names sort [doris]
doris-robot commented on PR #37441: URL: https://github.com/apache/doris/pull/37441#issuecomment-2216805481 TPC-H: Total hot run time: 39741 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 064510e2883327e33b8aa730e93e4619ae9e3e9b, data reload: false -- Round 1 -- q1 17615 437043194319 q2 2012192 185 185 q3 10450 121011081108 q4 10186 757 751 751 q5 7500264725332533 q6 218 137 136 136 q7 953 595 593 593 q8 9232206120702061 q9 8816650164866486 q10 9041373137123712 q11 464 240 234 234 q12 444 231 223 223 q13 17757 298529862985 q14 260 226 229 226 q15 518 489 492 489 q16 510 371 385 371 q17 958 615 703 615 q18 7935745773937393 q19 2135147914671467 q20 679 340 324 324 q21 4977325931953195 q22 388 335 339 335 Total cold run time: 113048 ms Total hot run time: 39741 ms - Round 2, with runtime_filter_mode=off - q1 4280423642144214 q2 382 264 275 264 q3 2978269227402692 q4 1968173116601660 q5 5572562354955495 q6 225 131 141 131 q7 2224191818311831 q8 3257338233953382 q9 8714873487178717 q10 4154380939163809 q11 574 481 482 481 q12 797 644 640 640 q13 15790 319231383138 q14 305 264 281 264 q15 535 499 501 499 q16 506 442 458 442 q17 1817150215111502 q18 8070785177287728 q19 4735151816451518 q20 2074183718681837 q21 5053489249434892 q22 650 566 567 566 Total cold run time: 74660 ms Total hot run time: 55702 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
doris-robot commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2216805563 ClickBench: Total hot run time: 31.21 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7eca21a2d268845ed80241196171c5d174e859b1, data reload: false query1 0.040.040.03 query2 0.080.030.04 query3 0.220.050.05 query4 1.680.070.07 query5 0.500.480.49 query6 1.130.720.72 query7 0.020.010.01 query8 0.060.040.04 query9 0.550.500.50 query10 0.560.560.55 query11 0.150.110.12 query12 0.140.120.13 query13 0.600.600.59 query14 0.760.800.78 query15 0.850.820.82 query16 0.360.370.37 query17 1.050.980.94 query18 0.220.220.21 query19 1.781.711.74 query20 0.010.010.01 query21 15.39 0.770.66 query22 4.006.582.53 query23 18.37 1.431.31 query24 2.140.240.22 query25 0.160.090.08 query26 0.300.210.21 query27 0.450.220.22 query28 13.24 1.021.00 query29 12.60 3.303.29 query30 0.250.080.06 query31 2.830.400.40 query32 3.260.470.46 query33 2.972.882.93 query34 16.94 4.354.34 query35 4.434.374.44 query36 0.660.490.47 query37 0.190.150.15 query38 0.150.140.14 query39 0.050.030.04 query40 0.140.120.12 query41 0.090.050.05 query42 0.050.040.04 query43 0.050.040.04 Total cold run time: 109.47 s Total hot run time: 31.21 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](rpc) set grpc channel's keepAliveTime and remove proxy on InterruptedExcep… [doris]
BiteThet commented on PR #37304: URL: https://github.com/apache/doris/pull/37304#issuecomment-2216806469 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) The NodeChannel should be canceled when failed to add block #37500 [doris]
doris-robot commented on PR #37527: URL: https://github.com/apache/doris/pull/37527#issuecomment-2216807175 TeamCity be ut coverage result: Function Coverage: 36.33% (9152/25193) Line Coverage: 27.87% (74737/268176) Region Coverage: 26.76% (38549/144054) Branch Coverage: 23.46% (19535/83282) Coverage Report: http://coverage.selectdb-in.cc/coverage/a252ea4f8e9ad5c69b97c63dbe3cd186b5853cef_a252ea4f8e9ad5c69b97c63dbe3cd186b5853cef/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Modified low water mark=min(6.4G, MemTotal * 5%) [doris]
doris-robot commented on PR #37525: URL: https://github.com/apache/doris/pull/37525#issuecomment-2216811679 TPC-DS: Total hot run time: 173323 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit c69d162c7fca2a5a5b2b9a8e328bc46a9090c80c, data reload: false query1 911 370 371 370 query2 6450229723182297 query3 6638206 227 206 query4 28162 17542 17331 17331 query5 3669466 484 466 query6 254 163 168 163 query7 4593284 280 280 query8 321 306 307 306 query9 8533241724012401 query10 593 304 291 291 query11 11959 10048 10075 10048 query12 116 90 81 81 query13 1644378 364 364 query14 10193 735976657359 query15 259 192 189 189 query16 7842321 308 308 query17 1796558 514 514 query18 2006274 270 270 query19 191 145 142 142 query20 86 80 78 78 query21 200 135 126 126 query22 4574402639013901 query23 34016 33305 33574 33305 query24 10881 285030032850 query25 571 399 396 396 query26 728 148 146 146 query27 2272284 283 283 query28 6047211921392119 query29 904 611 633 611 query30 247 151 158 151 query31 987 763 769 763 query32 97 54 52 52 query33 750 301 293 293 query34 975 483 504 483 query35 678 589 573 573 query36 1131962 992 962 query37 147 82 80 80 query38 2983286828122812 query39 909 830 857 830 query40 209 131 121 121 query41 58 52 58 52 query42 111 103 101 101 query43 625 560 547 547 query44 1229729 724 724 query45 195 156 159 156 query46 1087694 737 694 query47 1854175317861753 query48 378 292 294 292 query49 831 408 402 402 query50 771 392 391 391 query51 6911676867596759 query52 113 91 93 91 query53 358 285 288 285 query54 885 442 435 435 query55 73 74 71 71 query56 291 277 273 273 query57 1135104810801048 query58 245 237 247 237 query59 3478326429292929 query60 301 271 273 271 query61 99 92 94 92 query62 793 671 644 644 query63 322 296 294 294 query64 9058218316531653 query65 3129312131183118 query66 757 331 327 327 query67 15659 14904 14900 14900 query68 4516528 518 518 query69 550 400 394 394 query70 1186111511801115 query71 391 281 280 280 query72 7576505053355050 query73 749 319 315 315 query74 5891553454755475 query75 3345265926502650 query76 2150959 999 959 query77 467 297 306 297 query78 968311866 93559355 query79 2543514 512 512 query80 1825467 487 467 query81 604 215 216 215 query82 285 131 131 131 query83 322 167 163 163 query84 284 91 83 83 query85 706 312 309 309 query86 475 315 323 315 query87 3294306730533053 query88 3632234924072349 query89 490 376 371 371 query90 1839187 183 183 query91 134 100 100 100 query92 60 48 48 48 query93 1066487 495 487 query94 1081207 209 207 query95 413 316 311 311 query96 578 276 259 259 query97 3236303430363034 query98 217 213 194 194 query99 1554126712641264 Total cold run time: 277410 ms Total hot run time: 173323 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [test](Agg nullable) [doris]
doris-robot commented on PR #37330: URL: https://github.com/apache/doris/pull/37330#issuecomment-2216811780 TPC-DS: Total hot run time: 173601 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit acadf88a0563bb4d0c3a10380f52f77a618bfb7e, data reload: false query1 925 373 364 364 query2 6456237323812373 query3 6651211 226 211 query4 24338 17773 17320 17320 query5 4188500 493 493 query6 288 199 168 168 query7 4596300 289 289 query8 312 295 294 294 query9 8512240323902390 query10 618 295 268 268 query11 11609 10121 10159 10121 query12 133 83 80 80 query13 1650370 366 366 query14 10322 704776887047 query15 248 183 183 183 query16 7686306 313 306 query17 1591536 541 536 query18 1739292 288 288 query19 203 159 156 156 query20 92 83 82 82 query21 237 133 126 126 query22 4251421539823982 query23 33896 33142 33201 33142 query24 12185 294928092809 query25 686 395 391 391 query26 1851155 150 150 query27 2958267 275 267 query28 7711205220512051 query29 1169626 621 621 query30 304 149 145 145 query31 950 739 746 739 query32 94 53 56 53 query33 779 291 290 290 query34 1020474 487 474 query35 699 590 587 587 query36 1069973 964 964 query37 276 79 81 79 query38 2907276127492749 query39 868 820 824 820 query40 284 127 123 123 query41 55 57 54 54 query42 118 99 103 99 query43 576 546 559 546 query44 1239738 723 723 query45 189 166 161 161 query46 1098723 744 723 query47 1838178917781778 query48 359 290 299 290 query49 1194425 409 409 query50 787 404 401 401 query51 6903678268236782 query52 107 96 96 96 query53 366 300 296 296 query54 986 453 440 440 query55 75 76 75 75 query56 283 269 277 269 query57 1168104410311031 query58 249 258 263 258 query59 3635321732303217 query60 312 274 280 274 query61 99 95 95 95 query62 855 658 658 658 query63 321 294 304 294 query64 10457 217116701670 query65 3216315030943094 query66 1367362 339 339 query67 15609 15156 14864 14864 query68 5362538 540 538 query69 646 490 354 354 query70 1149118411701170 query71 454 280 287 280 query72 7058549358595493 query73 779 323 322 322 query74 6126570857185708 query75 3752270226582658 query76 3607887 945 887 query77 673 312 326 312 query78 9631966688978897 query79 2090516 496 496 query80 1731483 472 472 query81 595 219 220 219 query82 1115139 141 139 query83 291 176 170 170 query84 268 90 98 90 query85 1680369 315 315 query86 488 335 297 297 query87 3274313731053105 query88 3945234723402340 query89 492 393 395 393 query90 1952192 194 192 query91 139 108 105 105 query92 68 48 55 48 query93 2112517 506 506 query94 1317219 216 216 query95 408 317 322 317 query96 607 281 275 275 query97 3202306030113011 query98 221 206 195 195 query99 1712127712481248 Total cold run time: 286756 ms Total hot run time: 173601 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] (cloud-merge) Fix index data cannot be writed into ttl dir [doris]
Lchangliang commented on PR #37485: URL: https://github.com/apache/doris/pull/37485#issuecomment-2216811803 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](serde)Optimize the filling of fixed values into block columns without repeated deserialization. (#37377) [doris]
github-actions[bot] commented on PR #37530: URL: https://github.com/apache/doris/pull/37530#issuecomment-2216816035 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [datalake](hudi) add hudi docker compose to run hudi examples [doris]
AshinGau merged PR #37451: URL: https://github.com/apache/doris/pull/37451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [datalake](hudi) add hudi docker compose to run hudi examples (#37451)
This is an automated email from the ASF dual-hosted git repository. ashingau pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new e338cceb2fa [datalake](hudi) add hudi docker compose to run hudi examples (#37451) e338cceb2fa is described below commit e338cceb2fa83cc6d8272a704b6ff9b00d399278 Author: Ashin Gau AuthorDate: Tue Jul 9 15:30:04 2024 +0800 [datalake](hudi) add hudi docker compose to run hudi examples (#37451) ## Proposed changes **Doris+Hudi+MINIO Environments**: Launch spark/doris/hive/hudi/minio test environments, and give examples to query hudi in Doris. ## Launch Docker Compose **Create Network** ```shell sudo docker network create -d bridge hudi-net ``` **Launch all components in docker** ```shell sudo ./start-hudi-compose.sh ``` **Login into Spark** ```shell sudo ./login-spark.sh ``` **Login into Doris** ```shell sudo ./login-doris.sh ``` --- .licenserc.yaml| 1 + samples/datalake/hudi/README.md| 207 + .../datalake/hudi/data/customer/00_0.parquet | Bin 0 -> 740686 bytes .../datalake/hudi/data/customer/01_0.parquet | Bin 0 -> 739823 bytes .../datalake/hudi/data/customer/02_0.parquet | Bin 0 -> 740700 bytes .../datalake/hudi/data/customer/03_0.parquet | Bin 0 -> 739592 bytes samples/datalake/hudi/hudi-compose.env | 21 +++ samples/datalake/hudi/hudi-compose.yml | 109 +++ samples/datalake/hudi/login-doris.sh | 20 ++ samples/datalake/hudi/login-spark.sh | 20 ++ samples/datalake/hudi/scripts/doris-hudi.sql | 11 ++ samples/datalake/hudi/scripts/hive-minio.sql | 13 ++ samples/datalake/hudi/scripts/spark-hudi.sh| 38 samples/datalake/hudi/scripts/start_doris.sh | 24 +++ samples/datalake/hudi/start-hudi-compose.sh| 118 samples/datalake/hudi/stop-hudi-compose.sh | 20 ++ 16 files changed, 602 insertions(+) diff --git a/.licenserc.yaml b/.licenserc.yaml index a355b70bcb8..e458f812bd4 100644 --- a/.licenserc.yaml +++ b/.licenserc.yaml @@ -40,6 +40,7 @@ header: - "**/*.sql" - "**/*.lock" - "**/*.out" +- "**/*.parquet" - "docs/.markdownlintignore" - "fe/fe-core/src/test/resources/data/net_snmp_normal" - "fe/fe-core/src/main/antlr4/org/apache/doris/nereids/JavaLexer.g4" diff --git a/samples/datalake/hudi/README.md b/samples/datalake/hudi/README.md new file mode 100644 index 000..507c5902c5e --- /dev/null +++ b/samples/datalake/hudi/README.md @@ -0,0 +1,207 @@ + + +# Doris+Hudi+MINIO Environments +Launch spark/doris/hive/hudi/minio test environments, and give examples to query hudi in Doris. + +## Launch Docker Compose +**Create Network** +```shell +sudo docker network create -d bridge hudi-net +``` +**Launch all components in docker** +```shell +sudo ./start-hudi-compose.sh +``` +**Login into Spark** +```shell +sudo ./login-spark.sh +``` +**Login into Doris** +```shell +sudo ./login-doris.sh +``` + +## Prepare Hudi Data +There's already a hive table named `customer` in hive default. Create a hudi table from the hive table: +```sql +-- ./login-spark.sh +use default; + +-- create a COW table +CREATE TABLE customer_cow +USING hudi +TBLPROPERTIES ( + type = 'cow', + primaryKey = 'c_custkey', + preCombineField = 'c_name' +) +PARTITIONED BY (c_nationkey) +AS SELECT * FROM customer; + +-- create a MOR table +CREATE TABLE customer_mor +USING hudi +TBLPROPERTIES ( + type = 'mor', + primaryKey = 'c_custkey', + preCombineField = 'c_name' +) +PARTITIONED BY (c_nationkey) +AS SELECT * FROM customer; +``` + +## Query Data +Doris refresh hive catalog in [10min in default](https://doris.apache.org/docs/lakehouse/datalake-analytics/hive/#metadata-cache--refresh), +users can refresh directly to access the hudi table in Doris by `doris> refresh catalog hive;` + +After hudi table is ready in Doris, all operations in hudi table will be detected by Doris, and there's no need to refresh catalog or tables. + +Insert new data into hudi tables in spark-sql: +```sql +spark-sql> insert into customer_cow values (100, "Customer#00100", "jD2xZzi", "25-430-914-2194", 3471.59, "BUILDING", "cial ideas. final, furious requests", 25); +spark-sql> insert into customer_mor values (100, "Customer#00100", "jD2xZzi", "25-430-914-2194", 3471.59, "BUILDING", "cial ideas. final, furious requests", 25); +``` +`c_nationkey=25` is a new partition, doris can query the new data at once without refresh: +```sql +doris> use hive.default; +doris> select * from customer_cow where c_custkey = 100; +doris> select * from customer_mor where c_custkey = 100; +``` +Insert a record with `c_custkey=32`(primary key, already in table) wil
Re: [PR] (cloud-merge) Fix index data cannot be writed into ttl dir [doris]
github-actions[bot] commented on PR #37485: URL: https://github.com/apache/doris/pull/37485#issuecomment-2216823919 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Modified low water mark=min(6.4G, MemTotal * 5%) [doris]
doris-robot commented on PR #37525: URL: https://github.com/apache/doris/pull/37525#issuecomment-2216823852 ClickBench: Total hot run time: 30.32 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c69d162c7fca2a5a5b2b9a8e328bc46a9090c80c, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.220.050.05 query4 1.670.070.07 query5 0.500.480.49 query6 1.140.730.73 query7 0.030.010.02 query8 0.040.040.04 query9 0.550.480.48 query10 0.530.530.54 query11 0.170.110.11 query12 0.150.130.12 query13 0.590.580.59 query14 0.760.790.78 query15 0.850.800.82 query16 0.370.370.36 query17 1.031.021.06 query18 0.230.220.22 query19 1.891.681.75 query20 0.010.010.02 query21 15.39 0.770.67 query22 4.367.881.66 query23 18.64 1.341.32 query24 2.090.250.21 query25 0.150.100.09 query26 0.300.220.21 query27 0.450.220.23 query28 13.29 1.021.02 query29 12.62 3.243.29 query30 0.250.060.06 query31 2.860.390.38 query32 3.290.480.47 query33 2.882.982.91 query34 16.90 4.314.35 query35 4.424.464.38 query36 0.660.450.46 query37 0.180.150.15 query38 0.140.140.15 query39 0.040.030.04 query40 0.150.130.13 query41 0.090.040.05 query42 0.060.050.05 query43 0.040.040.04 Total cold run time: 110.1 s Total hot run time: 30.32 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](Agg nullable) [doris]
doris-robot commented on PR #37330: URL: https://github.com/apache/doris/pull/37330#issuecomment-2216823906 ClickBench: Total hot run time: 31 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit acadf88a0563bb4d0c3a10380f52f77a618bfb7e, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.230.060.05 query4 1.670.100.08 query5 0.500.490.48 query6 1.130.720.73 query7 0.020.010.02 query8 0.050.040.04 query9 0.550.500.50 query10 0.550.560.55 query11 0.160.120.11 query12 0.140.120.12 query13 0.580.590.58 query14 0.800.780.79 query15 0.850.830.82 query16 0.370.360.36 query17 0.970.971.00 query18 0.240.220.22 query19 1.851.711.75 query20 0.010.010.01 query21 15.40 0.750.65 query22 4.526.572.14 query23 18.65 1.351.40 query24 2.130.230.22 query25 0.140.090.09 query26 0.300.210.20 query27 0.450.230.23 query28 13.25 1.011.00 query29 12.64 3.363.33 query30 0.260.060.06 query31 2.890.390.39 query32 3.270.490.47 query33 2.902.872.94 query34 17.05 4.344.40 query35 4.474.424.42 query36 0.660.500.49 query37 0.190.150.15 query38 0.150.150.14 query39 0.050.030.04 query40 0.150.130.11 query41 0.090.050.05 query42 0.060.050.05 query43 0.040.040.04 Total cold run time: 110.5 s Total hot run time: 31 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](test) shorten the external p0 running time (#37320) [doris]
morningman merged PR #37473: URL: https://github.com/apache/doris/pull/37473 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] disk_info_mac DiskInfo::get_device_names sort [doris]
doris-robot commented on PR #37441: URL: https://github.com/apache/doris/pull/37441#issuecomment-2216829786 TPC-DS: Total hot run time: 174527 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 064510e2883327e33b8aa730e93e4619ae9e3e9b, data reload: false query1 899 371 381 371 query2 6450246023322332 query3 6653203 212 203 query4 28031 17491 17325 17325 query5 3636473 473 473 query6 247 163 159 159 query7 4580276 290 276 query8 326 301 308 301 query9 8623242624012401 query10 581 328 281 281 query11 11223 10239 10149 10149 query12 117 94 83 83 query13 1656362 367 362 query14 10196 754277187542 query15 238 183 191 183 query16 7528325 320 320 query17 1802573 534 534 query18 1584286 288 286 query19 196 156 151 151 query20 91 85 91 85 query21 215 141 132 132 query22 4546436041704170 query23 33985 33766 33812 33766 query24 10726 287728922877 query25 617 435 415 415 query26 709 152 147 147 query27 2218268 272 268 query28 6232211320952095 query29 918 730 639 639 query30 250 155 151 151 query31 985 759 762 759 query32 98 55 58 55 query33 668 300 308 300 query34 919 473 496 473 query35 679 605 602 602 query36 1140949 955 949 query37 135 77 81 77 query38 2922277726802680 query39 858 821 800 800 query40 195 118 117 117 query41 56 51 51 51 query42 121 98 99 98 query43 571 548 528 528 query44 1055712 710 710 query45 189 155 158 155 query46 1069698 697 697 query47 1871177017781770 query48 374 294 295 294 query49 835 411 422 411 query50 767 387 380 380 query51 6800681766696669 query52 111 90 94 90 query53 359 284 280 280 query54 879 454 435 435 query55 77 71 72 71 query56 285 261 280 261 query57 1133103110421031 query58 253 238 246 238 query59 3347311033153110 query60 301 296 270 270 query61 98 91 93 91 query62 755 658 660 658 query63 319 287 283 283 query64 9132221415971597 query65 3190312631243124 query66 718 327 320 320 query67 15645 14972 15010 14972 query68 4895509 516 509 query69 683 436 355 355 query70 1201114711031103 query71 426 282 279 279 query72 8468542953115311 query73 761 322 313 313 query74 5928551455225514 query75 3650264326972643 query76 3283942 935 935 query77 687 301 295 295 query78 11428 929497009294 query79 8039509 508 508 query80 1153471 472 471 query81 585 217 216 216 query82 714 136 134 134 query83 345 167 167 167 query84 274 85 90 85 query85 932 325 359 325 query86 468 286 340 286 query87 3324307230973072 query88 5113233623572336 query89 482 379 386 379 query90 1865182 185 182 query91 131 100 106 100 query92 62 47 48 47 query93 5074491 499 491 query94 1261210 208 208 query95 396 311 308 308 query96 595 269 258 258 query97 3211306130673061 query98 241 199 201 199 query99 1564127012601260 Total cold run time: 291221 ms Total hot run time: 174527 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
[PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
morrySnow opened a new pull request, #37532: URL: https://github.com/apache/doris/pull/37532 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
doris-robot commented on PR #37532: URL: https://github.com/apache/doris/pull/37532#issuecomment-2216832828 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
morrySnow commented on PR #37532: URL: https://github.com/apache/doris/pull/37532#issuecomment-2216833093 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](nereids) Default set enable_nereids_distribute_planner=true [doris]
doris-robot commented on PR #37219: URL: https://github.com/apache/doris/pull/37219#issuecomment-2216833079 TPC-H: Total hot run time: 40730 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 69faef1bcbfe3387c5ae4028139c2f9bd1acddf2, data reload: false -- Round 1 -- q1 17876 439443734373 q2 2531196 188 188 q3 11540 124012051205 q4 10637 771 794 771 q5 9774263126542631 q6 218 134 136 134 q7 950 603 607 603 q8 9227209521152095 q9 9193697469876974 q10 8934369137203691 q11 467 234 238 234 q12 394 230 225 225 q13 17743 299729612961 q14 264 236 227 227 q15 524 491 487 487 q16 503 375 376 375 q17 958 680 703 680 q18 8098751975527519 q19 1702148115071481 q20 624 321 322 321 q21 5082320739283207 q22 406 348 350 348 Total cold run time: 117645 ms Total hot run time: 40730 ms - Round 2, with runtime_filter_mode=off - q1 4340425442354235 q2 376 273 274 273 q3 3009280227992799 q4 1844157916231579 q5 5224524752155215 q6 219 129 129 129 q7 2119170617581706 q8 3168334733183318 q9 8846884588508845 q10 3893359436183594 q11 590 469 507 469 q12 783 621 603 603 q13 16335 296629602960 q14 293 276 250 250 q15 520 483 464 464 q16 470 405 411 405 q17 1747145414561454 q18 7640752974277427 q19 1682156515171517 q20 2129192419261924 q21 4894472747664727 q22 648 579 582 579 Total cold run time: 70769 ms Total hot run time: 54472 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [doc] fix mysql ssl pack server-key common [doris-website]
cjj2010 opened a new pull request, #845: URL: https://github.com/apache/doris-website/pull/845 close #844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Add insert overwriter partiton(*) version support [doris-website]
luzhijing merged PR #809: URL: https://github.com/apache/doris-website/pull/809 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Error while running notifications feature from refs/heads/master:.asf.yaml in doris-website!
An error occurred while running notifications feature in .asf.yaml!: Invalid notification target 'comm...@foo.apache.org'. Must be a valid @doris.apache.org list! - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch master updated: Add insert overwriter partiton(*) version support (#809)
This is an automated email from the ASF dual-hosted git repository. luzhijing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git The following commit(s) were added to refs/heads/master by this push: new 47ba1bd48de Add insert overwriter partiton(*) version support (#809) 47ba1bd48de is described below commit 47ba1bd48debee0f5489343773ff76ad547f7fc0 Author: caoliang-web <71004656+caoliang-...@users.noreply.github.com> AuthorDate: Tue Jul 9 15:41:38 2024 +0800 Add insert overwriter partiton(*) version support (#809) Add insert overwriter partiton(*) version support - Co-authored-by: Luzhijing <82810928+luzhij...@users.noreply.github.com> --- .../Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md | 3 ++- .../Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md | 2 +- 2 files changed, 3 insertions(+), 2 deletions(-) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md index 587a981c24b..3e64b4ea49f 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md @@ -51,7 +51,8 @@ INSERT OVERWRITE table table_name > partitions: 需要重写的目标分区，支持两种形式： > >> 1. 分区名。必须是 `table_name` 中存在的分区，多个分区名称用逗号分隔。 ->> 2. 星号(*)。开启[自动检测分区](#overwrite-auto-detect-partition)功能。写入操作将会自动检测数据所涉及的分区，并覆写这些分区。 +>> 2. 星号(*)。开启[自动检测分区](#overwrite-auto-detect-partition)功能。写入操作将会自动检测数据所涉及的分区，并覆写这些分区。该功能自 Apache Doris 2.1.3 版本开始支持。 +>> > > label: 为 Insert 任务指定一个 label > diff --git a/versioned_docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md b/versioned_docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md index afa1e5e6e79..febf43beb15 100644 --- a/versioned_docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md +++ b/versioned_docs/version-2.1/sql-manual/sql-statements/Data-Manipulation-Statements/Manipulation/INSERT-OVERWRITE.md @@ -51,7 +51,7 @@ INSERT OVERWRITE table table_name > partitions: the table partitions that needs to be overwritten. The following > two formats are supported > >> 1. partition names. must be one of the existing partitions in `table_name` >> separated by a comma ->> 2. asterisk(*)。Enable [auto-detect-partition](#overwrite-auto-detect-partition). The write operation will automatically detect the partitions involved in the data and overwrite those partitions. +>> 2. asterisk(*)。Enable [auto-detect-partition](#overwrite-auto-detect-partition). The write operation will automatically detect the partitions involved in the data and overwrite those partitions. This format is supported since Apache Doris 2.1.3 version. > > label: specify a label for the Insert task > - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] disk_info_mac DiskInfo::get_device_names sort [doris]
doris-robot commented on PR #37441: URL: https://github.com/apache/doris/pull/37441#issuecomment-2216839784 ClickBench: Total hot run time: 30.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 064510e2883327e33b8aa730e93e4619ae9e3e9b, data reload: false query1 0.040.030.03 query2 0.070.030.04 query3 0.230.050.05 query4 1.680.090.09 query5 0.480.490.49 query6 1.140.720.73 query7 0.020.010.01 query8 0.050.040.04 query9 0.560.500.49 query10 0.550.530.55 query11 0.140.110.11 query12 0.140.110.12 query13 0.590.590.58 query14 0.750.760.79 query15 0.840.810.81 query16 0.380.360.36 query17 0.970.970.96 query18 0.230.210.23 query19 1.741.671.68 query20 0.020.010.01 query21 15.40 0.800.70 query22 4.377.342.02 query23 18.29 1.351.27 query24 2.180.220.22 query25 0.160.100.09 query26 0.300.210.20 query27 0.450.230.23 query28 13.21 1.000.98 query29 12.60 3.293.24 query30 0.270.060.06 query31 2.850.380.38 query32 3.290.480.47 query33 2.912.912.89 query34 17.01 4.324.33 query35 4.444.384.42 query36 0.660.470.47 query37 0.180.150.15 query38 0.150.140.14 query39 0.040.040.04 query40 0.150.120.12 query41 0.100.050.04 query42 0.050.040.05 query43 0.040.040.04 Total cold run time: 109.72 s Total hot run time: 30.55 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc [doris]
xinyiZzz commented on PR #37528: URL: https://github.com/apache/doris/pull/37528#issuecomment-2216842962 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc step 2 [doris]
doris-robot commented on PR #37533: URL: https://github.com/apache/doris/pull/37533#issuecomment-2216847387 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](memory) Disable Arrow Jemalloc step 2 [doris]
xinyiZzz opened a new pull request, #37533: URL: https://github.com/apache/doris/pull/37533 ## Proposed changes after #37528 update third-party library -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](nereids) Default set enable_nereids_distribute_planner=true [doris]
doris-robot commented on PR #37219: URL: https://github.com/apache/doris/pull/37219#issuecomment-2216853440 TPC-DS: Total hot run time: 172840 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 69faef1bcbfe3387c5ae4028139c2f9bd1acddf2, data reload: false query1 919 368 356 356 query2 6454243223282328 query3 6676205 223 205 query4 28519 17400 17281 17281 query5 4225472 461 461 query6 260 185 157 157 query7 4575292 289 289 query8 308 302 296 296 query9 8427240924112409 query10 444 289 273 273 query11 11836 995710046 9957 query12 135 90 82 82 query13 1647371 366 366 query14 10307 788476617661 query15 238 190 198 190 query16 7848330 328 328 query17 1748578 544 544 query18 1903289 282 282 query19 204 154 154 154 query20 92 83 83 83 query21 209 133 169 133 query22 4384406339203920 query23 33669 32945 32798 32798 query24 12177 303629922992 query25 636 358 351 351 query26 1634154 151 151 query27 2769258 267 258 query28 7426207820712071 query29 1015647 613 613 query30 280 141 138 138 query31 1123817 886 817 query32 88 51 59 51 query33 758 303 294 294 query34 943 477 493 477 query35 689 572 591 572 query36 1119945 907 907 query37 266 83 89 83 query38 2845273127112711 query39 857 776 795 776 query40 300 120 114 114 query41 54 51 47 47 query42 111 94 95 94 query43 602 529 551 529 query44 1222704 709 704 query45 199 177 168 168 query46 1100748 767 748 query47 1861177017811770 query48 358 295 302 295 query49 1196402 404 402 query50 777 406 414 406 query51 6992672267686722 query52 105 100 92 92 query53 359 282 284 282 query54 986 441 447 441 query55 74 72 74 72 query56 286 263 282 263 query57 1159105110331033 query58 237 234 251 234 query59 3280301433053014 query60 312 277 266 266 query61 96 96 96 96 query62 805 628 626 626 query63 332 286 283 283 query64 10466 221116621662 query65 3189314431433143 query66 1371332 329 329 query67 15251 14950 14938 14938 query68 4652548 539 539 query69 508 326 331 326 query70 1161115210531053 query71 380 281 283 281 query72 7822576453755375 query73 759 333 332 332 query74 5888553355435533 query75 3433269726832683 query76 30311009950 950 query77 490 300 304 300 query78 9586881387488748 query79 2612511 501 501 query80 1908468 465 465 query81 588 222 214 214 query82 959 134 133 133 query83 301 171 174 171 query84 286 84 98 84 query85 2106294 298 294 query86 483 348 374 348 query87 3280307031133070 query88 3561243524222422 query89 477 378 404 378 query90 1934189 197 189 query91 192 105 101 101 query92 60 48 47 47 query93 3429500 503 500 query94 1346213 211 211 query95 411 326 318 318 query96 592 278 268 268 query97 3209299030022990 query98 221 196 205 196 query99 1569123212511232 Total cold run time: 289966 ms Total hot run time: 172840 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
[PR] [doc] Fix accuracy issues for Log Storage and Analysis docs [doris-website]
shasevendow opened a new pull request, #846: URL: https://github.com/apache/doris-website/pull/846 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Bug](agg) fix for_each agg function core dump with nullable result column [doris]
zhangstar333 opened a new pull request, #37534: URL: https://github.com/apache/doris/pull/37534 ## Proposed changes ``` F20240709 15:45:46.355324 2952783 assert_cast.h:58] Bad cast from type:doris::vectorized::ColumnNullable to doris::vectorized::ColumnArray 6# google::LogMessage::SendToLog() in /mnt/disk2/zhangsida/doris/output/be/lib/doris_be 7# google::LogMessage::Flush() in /mnt/disk2/zhangsida/doris/output/be/lib/doris_be 8# google::LogMessageFatal::~LogMessageFatal() in /mnt/disk2/zhangsida/doris/output/be/lib/doris_be 9# doris::vectorized::ColumnArray& assert_cast(doris::vectorized::IColumn&) in /mnt/disk2/zhangsida/doris/output/be/lib/doris_be 10# doris::vectorized::AggregateFunctionForEach::insert_result_into(char const*, doris::vectorized::IColumn&) const at /mnt/disk2/zhangsida/doris/be/src/vec/aggregate_functions/aggregate_function_foreach.h:217 11# doris::vectorized::IAggregateFunctionHelper::insert_result_into_vec(std::vector > const&, unsigned long, doris::vectorized::IColumn&, unsigned long) const at /mnt/disk2/zhangsida/doris/be/src/vec/aggregate_functions/aggregate_function.h:315 12# doris::vectorized::AggFnEvaluator::insert_result_info_vec(std::vector > const&, unsigned long, doris::vectorized::IColumn*, unsigned long) at /mnt/disk2/zhangsida/doris/be/src/vec/exprs/vectorized_agg_fn.cpp:273 13# void doris::pipeline::AggLocalState::_get_with_serialized_key_result(doris::RuntimeState*, doris::vectorized::Block*, bool*)::$_1::operator(), false> > >(doris::vectorized::MethodOneNumber, false> >&) const at /mnt/disk2/zhangsida/doris/be/src/pipeline/exec/aggregation_source_operator.cpp:288 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](agg) fix for_each agg function core dump with nullable result column [doris]
doris-robot commented on PR #37534: URL: https://github.com/apache/doris/pull/37534#issuecomment-2216859866 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](agg) fix for_each agg function core dump with nullable result column [doris]
zhangstar333 commented on PR #37534: URL: https://github.com/apache/doris/pull/37534#issuecomment-2216861836 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](nereids) Default set enable_nereids_distribute_planner=true [doris]
doris-robot commented on PR #37219: URL: https://github.com/apache/doris/pull/37219#issuecomment-2216864248 ClickBench: Total hot run time: 30.93 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 69faef1bcbfe3387c5ae4028139c2f9bd1acddf2, data reload: false query1 0.040.040.03 query2 0.080.030.04 query3 0.230.050.06 query4 1.680.070.07 query5 0.500.480.48 query6 1.140.740.72 query7 0.030.020.01 query8 0.050.050.04 query9 0.540.480.48 query10 0.550.550.54 query11 0.150.120.11 query12 0.140.110.12 query13 0.590.590.58 query14 0.750.760.78 query15 0.860.820.80 query16 0.370.370.36 query17 0.930.990.95 query18 0.230.220.22 query19 1.751.711.70 query20 0.010.010.01 query21 15.39 0.760.66 query22 4.885.402.35 query23 18.37 1.391.25 query24 2.180.240.21 query25 0.140.080.09 query26 0.300.210.21 query27 0.460.240.24 query28 13.23 1.031.01 query29 12.59 3.393.32 query30 0.260.060.06 query31 2.870.390.38 query32 3.280.470.47 query33 2.922.932.92 query34 17.07 4.344.29 query35 4.394.404.44 query36 0.650.460.47 query37 0.180.160.15 query38 0.150.140.14 query39 0.040.040.03 query40 0.160.110.13 query41 0.090.050.05 query42 0.060.050.05 query43 0.040.040.04 Total cold run time: 110.32 s Total hot run time: 30.93 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
doris-robot commented on PR #37532: URL: https://github.com/apache/doris/pull/37532#issuecomment-2216866010 TPC-H: Total hot run time: 40907 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 76d36ebbeead3d31c8ce05f3024f5ea8b04b0a63, data reload: false -- Round 1 -- q1 17791 446943784378 q2 3270198 192 192 q3 11633 117612121176 q4 10524 764 769 764 q5 7725273026522652 q6 224 140 138 138 q7 971 597 600 597 q8 9224206320982063 q9 8986654565336533 q10 9070375037183718 q11 459 241 243 241 q12 454 226 228 226 q13 1 301230203012 q14 262 224 235 224 q15 522 481 495 481 q16 510 379 375 375 q17 965 709 742 709 q18 8022743174827431 q19 8586145914541454 q20 708 336 345 336 q21 4982387339603873 q22 403 338 334 334 Total cold run time: 123068 ms Total hot run time: 40907 ms - Round 2, with runtime_filter_mode=off - q1 425042734250 q2 365 260 272 260 q3 2963275527232723 q4 1860161015661566 q5 5319532852925292 q6 218 128 131 128 q7 2145176117771761 q8 3195332133363321 q9 8341835183288328 q10 3868370436753675 q11 591 504 502 502 q12 773 654 594 594 q13 17277 297530112975 q14 289 253 254 253 q15 517 494 480 480 q16 463 414 411 411 q17 1781146914381438 q18 7679761573597359 q19 1738156915041504 q20 2041179217731773 q21 10517 472846144614 q22 650 508 520 508 Total cold run time: 77034 ms Total hot run time: 53715 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](job)Support batch Insert job [doris]
CalvinKirs commented on code in PR #36606:
URL: https://github.com/apache/doris/pull/36606#discussion_r1669943706
##
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/BindDynamicSplit.java:
##
@@ -0,0 +1,196 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.rules.analysis;
+
+import org.apache.doris.analysis.TableName;
+import org.apache.doris.catalog.TableIf;
+import org.apache.doris.catalog.View;
+import org.apache.doris.nereids.rules.Rule;
+import org.apache.doris.nereids.rules.RuleType;
+import org.apache.doris.nereids.trees.expressions.GreaterThanEqual;
+import org.apache.doris.nereids.trees.expressions.LessThanEqual;
+import org.apache.doris.nereids.trees.expressions.Slot;
+import org.apache.doris.nereids.trees.expressions.SlotReference;
+import org.apache.doris.nereids.trees.expressions.literal.Literal;
+import org.apache.doris.nereids.trees.plans.Plan;
+import org.apache.doris.nereids.trees.plans.commands.info.SplitColumnInfo;
+import org.apache.doris.nereids.trees.plans.logical.LogicalCatalogRelation;
+import org.apache.doris.nereids.trees.plans.logical.LogicalDynamicSplit;
+import org.apache.doris.nereids.trees.plans.logical.LogicalFilter;
+import org.apache.doris.nereids.trees.plans.logical.LogicalProject;
+import org.apache.doris.nereids.trees.plans.logical.LogicalRelation;
+import org.apache.doris.nereids.trees.plans.logical.LogicalSubQueryAlias;
+import org.apache.doris.nereids.trees.plans.logical.LogicalView;
+
+import com.google.common.collect.ImmutableList;
+import com.google.common.collect.ImmutableSet;
+import org.apache.commons.lang3.Range;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.util.List;
+
+/**
+ * This class defines the rule to bind a dynamic split operation in the query
plan.
+ */
+public class BindDynamicSplit implements AnalysisRuleFactory {
+private static final Logger LOG =
LoggerFactory.getLogger(BindDynamicSplit.class);
+
+@Override
+public List buildRules() {
+return ImmutableList.of(
+//LogicalDynamicSplit -> LogicalFilter ->
LogicalCatalogRelation
+
RuleType.BIND_DYNAMIC_SPLIT.build(logicalDynamicSplit(logicalFilter(logicalRelation()))
+.thenApply(ctx -> {
+
+Plan result = ctx.root.child();
+
LogicalDynamicSplit> logicalDynamicSplit =
ctx.root;
+LogicalRelation logicalRelation =
(LogicalRelation) ((LogicalFilter)
+logicalDynamicSplit.child())
+.child();
+return rewritePlan(logicalRelation, result,
logicalDynamicSplit);
+})),
+//LogicalDynamicSplit -> LogicalProject -> LogicalFilter ->
LogicalCatalogRelation
+
RuleType.BIND_DYNAMIC_SPLIT.build(logicalDynamicSplit(logicalProject(logicalFilter(logicalRelation(
+.thenApply(ctx -> {
+
+Plan result = ctx.root.child();
+LogicalDynamicSplit logicalDynamicSplit = ctx.root;
+LogicalRelation logicalRelation =
(LogicalRelation) ((LogicalProject)
+((LogicalFilter)
logicalDynamicSplit.child()).child()).child();
+return rewritePlan(logicalRelation, result,
logicalDynamicSplit);
+})),
+//LogicalDynamicSplit -> LogicalSubQueryAlias -> LogicalView
+
RuleType.BIND_DYNAMIC_SPLIT.build(logicalDynamicSplit(logicalSubQueryAlias(logicalView()))
+.thenApply(ctx -> {
+
+Plan result = ctx.root.child();
+
LogicalDynamicSplit>>
logicalDynamicSplit = ctx.root;
+LogicalView logicalView = (LogicalView)
((LogicalSubQueryAlias) logicalDynamicSplit
+.child()).child();
+
+return rewritePlan(logicalView, result,
logicalDynamicSplit);
+})),
+//
Re: [PR] [fix](regression) fix multi replica case not executed [doris]
liaoxin01 merged PR #37425: URL: https://github.com/apache/doris/pull/37425 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (cloud-merge) Fix index data cannot be writed into ttl dir [doris]
doris-robot commented on PR #37485: URL: https://github.com/apache/doris/pull/37485#issuecomment-2216869543 TPC-H: Total hot run time: 40139 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e32ca88238c0105f65f896f5edfbeb259539fc4a, data reload: false -- Round 1 -- q1 17598 435043274327 q2 2017192 185 185 q3 10458 116411681164 q4 10187 801 797 797 q5 7515269626162616 q6 220 141 141 141 q7 953 609 595 595 q8 9232207320642064 q9 8934653065666530 q10 9056373737403737 q11 468 237 235 235 q12 458 228 230 228 q13 17769 299129812981 q14 269 213 221 213 q15 525 472 487 472 q16 508 380 371 371 q17 968 765 734 734 q18 7986746874477447 q19 6539155214521452 q20 653 318 329 318 q21 4996319739373197 q22 397 335 335 335 Total cold run time: 117706 ms Total hot run time: 40139 ms - Round 2, with runtime_filter_mode=off - q1 4474427043004270 q2 375 279 262 262 q3 2947290029042900 q4 1979164017651640 q5 5593549354695469 q6 222 141 139 139 q7 2209189518771877 q8 3251343234563432 q9 8655870287518702 q10 4105379837813781 q11 587 518 495 495 q12 813 636 621 621 q13 17180 315231733152 q14 308 279 269 269 q15 540 478 480 478 q16 493 421 438 421 q17 1827153815131513 q18 8208807978637863 q19 1791174516421642 q20 2608187118771871 q21 6498488050664880 q22 629 550 548 548 Total cold run time: 75292 ms Total hot run time: 56225 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](regression) fix multi replica case not executed (#37425)
This is an automated email from the ASF dual-hosted git repository.
liaoxin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new c3a1861ebd6 [fix](regression) fix multi replica case not executed
(#37425)
c3a1861ebd6 is described below
commit c3a1861ebd6edc937913acdc8495fcd3b6645be5
Author: Kaijie Chen
AuthorDate: Tue Jul 9 15:57:43 2024 +0800
[fix](regression) fix multi replica case not executed (#37425)
test_multi_replica_fault_injection.groovy should be executed when BE num
>= 3
---
.../suites/fault_injection_p0/test_multi_replica_fault_injection.groovy | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/regression-test/suites/fault_injection_p0/test_multi_replica_fault_injection.groovy
b/regression-test/suites/fault_injection_p0/test_multi_replica_fault_injection.groovy
index 8080b52ff48..d0582099eb8 100644
---
a/regression-test/suites/fault_injection_p0/test_multi_replica_fault_injection.groovy
+++
b/regression-test/suites/fault_injection_p0/test_multi_replica_fault_injection.groovy
@@ -26,7 +26,7 @@ suite("test_multi_replica_fault_injection", "nonConcurrent") {
beNums++;
logger.info(item.toString())
}
-if (beNums == 3){
+if (beNums >= 3){
sql """ set enable_memtable_on_sink_node=true """
sql """
CREATE TABLE IF NOT EXISTS `baseall` (
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](agg) fix for_each agg function core dump with nullable result column [doris]
github-actions[bot] commented on PR #37534: URL: https://github.com/apache/doris/pull/37534#issuecomment-2216871129 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](load) do not copy input_block in memtable (#36939) [doris]
liaoxin01 merged PR #37407: URL: https://github.com/apache/doris/pull/37407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated (81360cf897d -> 005304953e7)
This is an automated email from the ASF dual-hosted git repository. liaoxin pushed a change to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from 81360cf897d [opt](test) shorten the external p0 running time (#37320) (#37473) add 005304953e7 [performance](load) do not copy input_block in memtable (#36939) (#37407) No new revisions were added by this update. Summary of changes: be/src/olap/memtable.cpp | 14 ++ be/src/vec/core/block.cpp | 25 ++--- be/src/vec/core/block.h | 5 +++-- 3 files changed, 27 insertions(+), 17 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc [doris]
doris-robot commented on PR #37528: URL: https://github.com/apache/doris/pull/37528#issuecomment-2216876595 TPC-H: Total hot run time: 39834 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit fc2fc027aaf942a5f4f2b681375296ab67275fdd, data reload: false -- Round 1 -- q1 18059 446243884388 q2 3043201 194 194 q3 12408 116111321132 q4 10644 749 805 749 q5 7849270426222622 q6 227 141 141 141 q7 959 602 603 602 q8 9249208420642064 q9 8998650264596459 q10 8951370437773704 q11 468 242 249 242 q12 414 232 236 232 q13 17774 297429852974 q14 285 224 223 223 q15 529 475 494 475 q16 506 383 374 374 q17 969 701 667 667 q18 8057750773977397 q19 7454157613651365 q20 703 342 341 341 q21 4928314240493142 q22 412 352 347 347 Total cold run time: 122886 ms Total hot run time: 39834 ms - Round 2, with runtime_filter_mode=off - q1 4389426542694265 q2 376 263 270 263 q3 3005278328112783 q4 1845158716391587 q5 5236526252855262 q6 226 132 134 132 q7 2127178217241724 q8 3212336433223322 q9 8381835483968354 q10 3848366436533653 q11 596 491 469 469 q12 783 620 604 604 q13 16453 299230282992 q14 293 265 252 252 q15 521 475 495 475 q16 473 415 416 415 q17 1798150714731473 q18 7752758474387438 q19 1715151214511451 q20 1969181117691769 q21 5001476848214768 q22 660 556 573 556 Total cold run time: 70659 ms Total hot run time: 54007 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](job)Support batch Insert job [doris]
github-actions[bot] commented on PR #36606: URL: https://github.com/apache/doris/pull/36606#issuecomment-2216877386 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](job)Support batch Insert job [doris]
github-actions[bot] commented on PR #36606: URL: https://github.com/apache/doris/pull/36606#issuecomment-2216877338 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [performance](move-memtable) only call _select_streams when necessary (#35576) [doris]
liaoxin01 commented on PR #37406: URL: https://github.com/apache/doris/pull/37406#issuecomment-2216880334 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (cloud-merge) Supports online capacity expansion and contraction [doris]
doris-robot commented on PR #37484: URL: https://github.com/apache/doris/pull/37484#issuecomment-2216885324 TPC-H: Total hot run time: 39940 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7e4f193ae758099da01ba174b3f4fc09a02d2715, data reload: false -- Round 1 -- q1 17619 433642274227 q2 2032195 199 195 q3 10432 122311761176 q4 10181 779 839 779 q5 7494261226072607 q6 216 141 135 135 q7 962 595 599 595 q8 9246204420722044 q9 8854648565726485 q10 8941395737373737 q11 468 238 240 238 q12 467 234 240 234 q13 17989 299330332993 q14 264 219 230 219 q15 534 490 497 490 q16 491 370 373 370 q17 969 620 722 620 q18 8177748575497485 q19 8092154514541454 q20 658 328 344 328 q21 4887318338743183 q22 396 346 354 346 Total cold run time: 119369 ms Total hot run time: 39940 ms - Round 2, with runtime_filter_mode=off - q1 4424428842844284 q2 383 287 276 276 q3 3224301330403013 q4 1997184518041804 q5 5628568456245624 q6 250 144 143 143 q7 2429198220281982 q8 3388348334673467 q9 8789894886628662 q10 4014369738323697 q11 573 508 502 502 q12 816 617 654 617 q13 16396 318932443189 q14 309 288 299 288 q15 529 485 500 485 q16 506 425 413 413 q17 1824152515601525 q18 8241792378527852 q19 1811160116331601 q20 2625186918681868 q21 11602 486348854863 q22 643 564 555 555 Total cold run time: 80401 ms Total hot run time: 56710 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
doris-robot commented on PR #37532: URL: https://github.com/apache/doris/pull/37532#issuecomment-221674 TPC-DS: Total hot run time: 172863 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 76d36ebbeead3d31c8ce05f3024f5ea8b04b0a63, data reload: false query1 904 380 364 364 query2 6477230522842284 query3 6676211 221 211 query4 28443 17410 17302 17302 query5 4209481 470 470 query6 263 165 160 160 query7 4577300 277 277 query8 303 285 281 281 query9 8635244924322432 query10 439 301 282 282 query11 10899 10101 10188 10101 query12 145 85 82 82 query13 1644378 374 374 query14 9410818374737473 query15 249 201 187 187 query16 7400326 322 322 query17 1811580 543 543 query18 1303288 291 288 query19 198 154 197 154 query20 87 83 82 82 query21 204 126 128 126 query22 4314403140454031 query23 33852 32993 33122 32993 query24 11139 283428302830 query25 613 357 369 357 query26 1159145 143 143 query27 2595262 271 262 query28 7393209320612061 query29 881 630 596 596 query30 283 148 151 148 query31 965 766 738 738 query32 99 51 55 51 query33 764 290 302 290 query34 925 479 488 479 query35 661 601 609 601 query36 1117938 966 938 query37 149 79 82 79 query38 2944276727462746 query39 858 783 826 783 query40 201 119 120 119 query41 54 52 55 52 query42 115 98 99 98 query43 582 556 524 524 query44 1182726 706 706 query45 193 166 159 159 query46 1063726 724 724 query47 1850177217611761 query48 365 301 296 296 query49 1084411 407 407 query50 777 398 393 393 query51 6993679567346734 query52 115 92 95 92 query53 359 294 298 294 query54 957 450 472 450 query55 74 73 70 70 query56 289 272 276 272 query57 1114103610291029 query58 260 260 245 245 query59 3241319831703170 query60 310 275 265 265 query61 98 95 98 95 query62 834 665 657 657 query63 326 290 298 290 query64 9720217616261626 query65 3204314530913091 query66 870 332 326 326 query67 15515 15241 14858 14858 query68 4581540 543 540 query69 477 327 316 316 query70 1156109611341096 query71 416 277 278 277 query72 7425492453654924 query73 728 332 328 328 query74 6013548055575480 query75 3504270626732673 query76 2851937 944 937 query77 479 313 310 310 query78 9525892789518927 query79 2227522 521 521 query80 2003478 486 478 query81 593 214 218 214 query82 1004147 138 138 query83 295 170 182 170 query84 267 91 91 91 query85 1273314 307 307 query86 463 335 296 296 query87 3284313731213121 query88 3865246924612461 query89 488 395 385 385 query90 1780195 256 195 query91 134 101 107 101 query92 73 48 49 48 query93 1971507 496 496 query94 1202216 214 214 query95 419 324 322 322 query96 602 274 269 269 query97 3196303231033032 query98 238 201 199 199 query99 1619128912731273 Total cold run time: 280883 ms Total hot run time: 172863 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [pick](Variant) refactor flush logic to support partial update [doris]
doris-robot commented on PR #37526: URL: https://github.com/apache/doris/pull/37526#issuecomment-2216890535 TeamCity be ut coverage result: Function Coverage: 36.34% (9159/25201) Line Coverage: 27.87% (74790/268306) Region Coverage: 26.77% (38576/144124) Branch Coverage: 23.47% (19551/83314) Coverage Report: http://coverage.selectdb-in.cc/coverage/36ccf7bafdd42bcb105c03dd50b6ddbbe73e0385_36ccf7bafdd42bcb105c03dd50b6ddbbe73e0385/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
platoneko opened a new pull request, #37535: URL: https://github.com/apache/doris/pull/37535 ## Proposed changes Fix incorrect mtime convertion in azure obj client -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (cloud-merge) Fix index data cannot be writed into ttl dir [doris]
doris-robot commented on PR #37485: URL: https://github.com/apache/doris/pull/37485#issuecomment-2216893169 TPC-DS: Total hot run time: 173634 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e32ca88238c0105f65f896f5edfbeb259539fc4a, data reload: false query1 909 370 371 370 query2 6386232822682268 query3 6674210 219 210 query4 27849 17310 17114 17114 query5 3789488 473 473 query6 258 163 159 159 query7 4582290 283 283 query8 301 288 273 273 query9 8535246624292429 query10 447 288 268 268 query11 11322 10118 query12 126 85 86 85 query13 1655379 373 373 query14 9726714078207140 query15 237 184 186 184 query16 7423323 315 315 query17 1698575 545 545 query18 1878287 285 285 query19 207 158 163 158 query20 94 84 90 84 query21 204 127 131 127 query22 4436421739953995 query23 33961 33686 8 8 query24 11016 292328742874 query25 607 426 453 426 query26 714 166 157 157 query27 2303280 294 280 query28 6190220021922192 query29 957 645 635 635 query30 254 156 159 156 query31 950 760 773 760 query32 105 65 63 63 query33 711 312 288 288 query34 909 497 496 496 query35 714 561 575 561 query36 11381017951 951 query37 140 86 84 84 query38 3014281428032803 query39 904 828 790 790 query40 205 123 123 123 query41 53 50 51 50 query42 118 104 98 98 query43 558 513 544 513 query44 1175754 742 742 query45 193 156 160 156 query46 1093724 743 724 query47 1836178417451745 query48 366 298 304 298 query49 832 405 428 405 query50 788 390 391 390 query51 6922686867796779 query52 104 90 93 90 query53 365 293 294 293 query54 915 453 448 448 query55 75 72 74 72 query56 277 259 263 259 query57 1157104310521043 query58 276 250 265 250 query59 3316305831403058 query60 298 274 273 273 query61 118 94 98 94 query62 805 646 651 646 query63 334 285 288 285 query64 9534215616201620 query65 3189310331273103 query66 791 326 327 326 query67 15694 15160 14829 14829 query68 4603548 546 546 query69 694 421 347 347 query70 1207112210651065 query71 461 281 284 281 query72 8406557356055573 query73 755 330 324 324 query74 5911577858505778 query75 4339268927032689 query76 3066968 887 887 query77 676 312 319 312 query78 9671893289258925 query79 3737524 541 524 query80 1735481 522 481 query81 588 219 223 219 query82 1040139 142 139 query83 353 180 174 174 query84 278 86 98 86 query85 1761314 309 309 query86 455 310 327 310 query87 3305311030723072 query88 4693238323762376 query89 491 378 380 378 query90 1935190 194 190 query91 138 105 112 105 query92 63 49 51 49 query93 5237531 516 516 query94 1320210 224 210 query95 414 314 322 314 query96 600 275 270 270 query97 3252306530173017 query98 220 204 198 198 query99 1537129912671267 Total cold run time: 287651 ms Total hot run time: 173634 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
doris-robot commented on PR #37535: URL: https://github.com/apache/doris/pull/37535#issuecomment-2216893181 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](multi-catalog) Add memory tracker for orc reader and writer. [doris]
kaka11chen commented on PR #37257: URL: https://github.com/apache/doris/pull/37257#issuecomment-2216897290 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Disable Arrow Jemalloc [doris]
doris-robot commented on PR #37528: URL: https://github.com/apache/doris/pull/37528#issuecomment-2216899631 TPC-DS: Total hot run time: 169964 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit fc2fc027aaf942a5f4f2b681375296ab67275fdd, data reload: false query1 908 368 369 368 query2 6904231023782310 query3 6656216 229 216 query4 24843 17556 17358 17358 query5 4244497 494 494 query6 269 195 177 177 query7 4596298 307 298 query8 325 308 303 303 query9 8675246524802465 query10 449 295 299 295 query11 10866 10009 10011 10009 query12 137 89 81 81 query13 1637366 372 366 query14 10352 699884166998 query15 235 192 181 181 query16 7201316 314 314 query17 1809550 532 532 query18 1186298 271 271 query19 195 150 146 146 query20 90 81 81 81 query21 208 133 134 133 query22 4306398139543954 query23 33534 32903 33040 32903 query24 11243 286328072807 query25 605 364 369 364 query26 1369150 150 150 query27 2612274 279 274 query28 7198209520842084 query29 922 653 632 632 query30 287 152 150 150 query31 966 740 744 740 query32 98 55 55 55 query33 795 318 319 318 query34 887 483 493 483 query35 726 567 572 567 query36 1110958 971 958 query37 138 79 80 79 query38 2881272627162716 query39 847 782 811 782 query40 283 120 117 117 query41 52 52 51 51 query42 117 96 103 96 query43 563 563 570 563 query44 1190735 726 726 query45 193 161 160 160 query46 1102726 705 705 query47 1824174717521747 query48 370 300 294 294 query49 1100415 411 411 query50 774 404 406 404 query51 6873675168786751 query52 100 100 99 99 query53 357 299 291 291 query54 963 491 448 448 query55 75 73 75 73 query56 290 262 268 262 query57 1138102610601026 query58 247 239 259 239 query59 3204337932003200 query60 309 275 272 272 query61 93 94 91 91 query62 839 658 679 658 query63 334 289 288 288 query64 10449 217616301630 query65 3175309831183098 query66 1302338 330 330 query67 15430 14938 14942 14938 query68 4614556 552 552 query69 480 349 329 329 query70 1209112011061106 query71 387 285 282 282 query72 7287276726232623 query73 749 322 332 322 query74 5956559554755475 query75 3472268726862686 query76 2837903 922 903 query77 467 309 311 309 query78 9446892887838783 query79 2115514 512 512 query80 1487471 463 463 query81 566 221 228 221 query82 778 144 137 137 query83 202 167 166 166 query84 280 87 91 87 query85 1443310 299 299 query86 454 334 329 329 query87 3273308131173081 query88 3830244924632449 query89 484 398 385 385 query90 1858195 196 195 query91 132 103 102 102 query92 69 48 52 48 query93 2318495 502 495 query94 1227218 215 215 query95 500 326 318 318 query96 585 271 269 269 query97 3186304429972997 query98 221 210 198 198 query99 1588130012481248 Total cold run time: 278555 ms Total hot run time: 169964 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](ctas) keep varchar length not work when enable be constant folding [doris]
doris-robot commented on PR #37532: URL: https://github.com/apache/doris/pull/37532#issuecomment-2216900059 ClickBench: Total hot run time: 31.34 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 76d36ebbeead3d31c8ce05f3024f5ea8b04b0a63, data reload: false query1 0.040.030.04 query2 0.080.040.04 query3 0.230.060.06 query4 1.660.100.09 query5 0.500.490.48 query6 1.140.730.73 query7 0.020.010.02 query8 0.050.040.04 query9 0.550.500.48 query10 0.570.540.54 query11 0.150.120.12 query12 0.150.130.13 query13 0.600.590.58 query14 0.780.790.77 query15 0.870.830.83 query16 0.370.370.38 query17 1.051.021.06 query18 0.230.220.23 query19 1.931.771.84 query20 0.020.010.01 query21 15.40 0.780.66 query22 4.046.872.25 query23 18.37 1.401.37 query24 2.130.230.23 query25 0.160.090.08 query26 0.290.220.21 query27 0.450.240.24 query28 13.25 1.031.01 query29 12.58 3.423.35 query30 0.250.060.07 query31 2.850.400.39 query32 3.270.470.47 query33 2.982.952.96 query34 16.98 4.324.38 query35 4.444.524.38 query36 0.650.460.46 query37 0.190.160.15 query38 0.160.150.15 query39 0.040.040.04 query40 0.140.120.13 query41 0.100.050.05 query42 0.050.040.04 query43 0.040.040.04 Total cold run time: 109.8 s Total hot run time: 31.34 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](move-memtable) check segment num when closing each tablet (#36753) [doris]
kaijchen opened a new pull request, #37536: URL: https://github.com/apache/doris/pull/37536 cherry-pick #36753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
gavinchou commented on code in PR #37535:
URL: https://github.com/apache/doris/pull/37535#discussion_r1669967030
##
cloud/src/recycler/azure_obj_client.cpp:
##
@@ -91,12 +92,15 @@ class AzureListIterator final : public ObjectListIterator {
DCHECK(!(has_more_ && resp.Blobs.empty())) << has_more_ << ' ' <<
resp.Blobs.empty();
req_.ContinuationToken = std::move(resp.NextPageToken);
results_.reserve(resp.Blobs.size());
+const auto unix_epoch = Azure::DateTime(1970, 1, 1);
Review Comment:
const static ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) check segment num when closing each tablet (#36753) [doris]
kaijchen commented on PR #37536: URL: https://github.com/apache/doris/pull/37536#issuecomment-2216900666 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) check segment num when closing each tablet (#36753) [doris]
doris-robot commented on PR #37536: URL: https://github.com/apache/doris/pull/37536#issuecomment-2216900471 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
github-actions[bot] commented on PR #37535: URL: https://github.com/apache/doris/pull/37535#issuecomment-2216901461 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](jdbc catalog) Added support for Oracle Raw type [doris]
zy-kkk merged PR #37078: URL: https://github.com/apache/doris/pull/37078 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
github-actions[bot] commented on PR #37535: URL: https://github.com/apache/doris/pull/37535#issuecomment-2216901510 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](group commit)Optimize be select for group commit [doris]
Yukang-Lian commented on PR #35558: URL: https://github.com/apache/doris/pull/35558#issuecomment-2216902122 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [improvement](jdbc catalog) Added support for Oracle Raw type (#37078)
This is an automated email from the ASF dual-hosted git repository.
zykkk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 270f592608e [improvement](jdbc catalog) Added support for Oracle Raw
type (#37078)
270f592608e is described below
commit 270f592608ed9d69a0c4df94a24ec1d59b5dde09
Author: zy-kkk
AuthorDate: Tue Jul 9 16:13:43 2024 +0800
[improvement](jdbc catalog) Added support for Oracle Raw type (#37078)
In previous versions, we adopted the strategy of reading the object
address for Oracle's raw type, which would lead to unstable and
meaningless results. Here I changed it to read hexadecimal or UTF8
---
.../org/apache/doris/jdbc/OracleJdbcExecutor.java | 34 ++
.../jdbc/test_oracle_jdbc_catalog.out | 27 ++---
.../jdbc/test_oracle_jdbc_catalog.groovy | 4 +--
3 files changed, 38 insertions(+), 27 deletions(-)
diff --git
a/fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/OracleJdbcExecutor.java
b/fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/OracleJdbcExecutor.java
index 0c29ac440e5..9a38c2b9e68 100644
---
a/fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/OracleJdbcExecutor.java
+++
b/fe/be-java-extensions/jdbc-scanner/src/main/java/org/apache/doris/jdbc/OracleJdbcExecutor.java
@@ -27,6 +27,10 @@ import org.apache.log4j.Logger;
import java.math.BigDecimal;
import java.math.BigInteger;
+import java.nio.ByteBuffer;
+import java.nio.charset.CharacterCodingException;
+import java.nio.charset.CharsetDecoder;
+import java.nio.charset.StandardCharsets;
import java.sql.Clob;
import java.sql.SQLException;
import java.time.LocalDate;
@@ -34,6 +38,7 @@ import java.time.LocalDateTime;
public class OracleJdbcExecutor extends BaseJdbcExecutor {
private static final Logger LOG =
Logger.getLogger(OracleJdbcExecutor.class);
+private final CharsetDecoder utf8Decoder =
StandardCharsets.UTF_8.newDecoder();
public OracleJdbcExecutor(byte[] thriftParams) throws Exception {
super(thriftParams);
@@ -112,6 +117,8 @@ public class OracleJdbcExecutor extends BaseJdbcExecutor {
LOG.error("Failed to get string from clob", e);
return null;
}
+} else if (input instanceof byte[]) {
+return convertByteArrayToString((byte[]) input);
} else {
return input.toString();
}
@@ -120,4 +127,31 @@ public class OracleJdbcExecutor extends BaseJdbcExecutor {
return null;
}
}
+
+private String convertByteArrayToString(byte[] bytes) {
+if (isValidUtf8(bytes)) {
+return new String(bytes, StandardCharsets.UTF_8);
+} else {
+// Convert byte[] to hexadecimal string with "0x" prefix
+return "0x" + bytesToHex(bytes);
+}
+}
+
+private boolean isValidUtf8(byte[] bytes) {
+utf8Decoder.reset();
+try {
+utf8Decoder.decode(ByteBuffer.wrap(bytes));
+return true;
+} catch (CharacterCodingException e) {
+return false;
+}
+}
+
+private String bytesToHex(byte[] bytes) {
+StringBuilder sb = new StringBuilder();
+for (byte b : bytes) {
+sb.append(String.format("%02X", b));
+}
+return sb.toString();
+}
}
diff --git
a/regression-test/data/external_table_p0/jdbc/test_oracle_jdbc_catalog.out
b/regression-test/data/external_table_p0/jdbc/test_oracle_jdbc_catalog.out
index c5473a451e8..74e3ee619cd 100644
--- a/regression-test/data/external_table_p0/jdbc/test_oracle_jdbc_catalog.out
+++ b/regression-test/data/external_table_p0/jdbc/test_oracle_jdbc_catalog.out
@@ -136,30 +136,9 @@ mysql
-- !date7 --
3 \N 2019-11-12T20:33:57.999 \N \N \N \N \N
--- !filter4_old_plan --
-1 alice 20 99.5
-3 jerry 23 88.0
-4 andy21 93.0
-
--- !filter5_old_plan --
-1 alice 20 99.5
-2 bob 21 90.5
-3 jerry 23 88.0
-4 andy21 93.0
-
--- !filter6_old_plan --
-1 alice 20 99.5
-4 andy21 93.0
-
--- !filter7_old_plan --
-3 jerry 23 88.0
-
--- !filter8_old_plan --
-4 andy21 93.0
-
--- !filter9_old_plan --
-3 jerry 23 88.0
-4 andy21 93.0
+-- !raw --
+1 0x 0x
+2 beijing shanghai
-- !test_insert1 --
doris1 18
diff --git
a/regression-test/suites/external_table_p0/jdbc/test_oracle_jdbc_catalog.groovy
b/regression-test/suites/external_table_p0/jdbc/test_oracle_jdbc_catalog.groovy
index dc23e601b2b..057723a808e 100644
---
a/regression-test/suites/external_tabl
Re: [PR] [feature](Vault) Support alter s3 storage vault stmt [doris]
doris-robot commented on PR #37537: URL: https://github.com/apache/doris/pull/37537#issuecomment-2216903468 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](Vault) Support alter s3 storage vault stmt [doris]
ByteYue opened a new pull request, #37537: URL: https://github.com/apache/doris/pull/37537 ## Proposed changes Now user can alter theirs s3 storage vault's properties. Currently only ak and sk are supported. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](recycler) Fix incorrect mtime convertion in azure obj client [doris]
github-actions[bot] commented on PR #37535: URL: https://github.com/apache/doris/pull/37535#issuecomment-2216903708 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (cloud-merge) Fix index data cannot be writed into ttl dir [doris]
doris-robot commented on PR #37485: URL: https://github.com/apache/doris/pull/37485#issuecomment-2216903838 ClickBench: Total hot run time: 30.96 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e32ca88238c0105f65f896f5edfbeb259539fc4a, data reload: false query1 0.040.040.03 query2 0.090.040.04 query3 0.230.050.05 query4 1.680.070.07 query5 0.500.480.49 query6 1.150.730.72 query7 0.020.020.02 query8 0.050.040.04 query9 0.550.480.49 query10 0.540.550.56 query11 0.150.120.12 query12 0.160.120.13 query13 0.600.590.59 query14 0.760.770.77 query15 0.860.820.82 query16 0.370.370.35 query17 0.950.960.94 query18 0.230.220.22 query19 1.891.831.86 query20 0.010.010.02 query21 15.39 0.820.66 query22 4.087.622.13 query23 18.25 1.351.26 query24 2.100.260.23 query25 0.150.090.09 query26 0.300.220.21 query27 0.450.230.24 query28 13.22 1.041.00 query29 12.66 3.383.35 query30 0.260.060.06 query31 2.880.390.39 query32 3.260.490.47 query33 2.892.892.90 query34 17.06 4.394.31 query35 4.464.464.38 query36 0.650.470.48 query37 0.200.160.16 query38 0.170.150.15 query39 0.040.040.03 query40 0.160.120.13 query41 0.090.050.04 query42 0.060.050.04 query43 0.040.040.04 Total cold run time: 109.65 s Total hot run time: 30.96 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](group commit)Optimize be select for group commit [doris]
Yukang-Lian commented on PR #35558: URL: https://github.com/apache/doris/pull/35558#issuecomment-2216904161 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
