Re: [PR] [branch-2.1](memory) Pick some memory GC patch [doris]
xinyiZzz merged PR #37725: URL: https://github.com/apache/doris/pull/37725 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [branch-2.1](memory) Pick some memory GC patch (#37725)
This is an automated email from the ASF dual-hosted git repository.
zouxinyi pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 747172237ac [branch-2.1](memory) Pick some memory GC patch (#37725)
747172237ac is described below
commit 747172237ac36ff0bdb60acf59c5b0b92b02d9a2
Author: Xinyi Zou
AuthorDate: Sun Jul 14 15:19:40 2024 +0800
[branch-2.1](memory) Pick some memory GC patch (#37725)
pick
#36768
#37164
#37174
#37525
---
be/src/common/config.cpp | 8 ++--
be/src/common/config.h | 10 ++
be/src/common/daemon.cpp | 27 +++
be/src/olap/page_cache.cpp | 25 +
be/src/olap/page_cache.h | 3 +--
be/src/util/mem_info.cpp | 8 +++-
be/src/util/mem_info.h | 8
7 files changed, 48 insertions(+), 41 deletions(-)
diff --git a/be/src/common/config.cpp b/be/src/common/config.cpp
index c747391abe0..7c687923803 100644
--- a/be/src/common/config.cpp
+++ b/be/src/common/config.cpp
@@ -113,12 +113,7 @@ DEFINE_mInt32(max_fill_rate, "2");
DEFINE_mInt32(double_resize_threshold, "23");
-// The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit
byte, default 1.6G,
-// actual low water mark=min(1.6G, MemTotal * 10%), avoid wasting too much
memory on machines
-// with large memory larger than 16G.
-// Turn up max. On machines with more than 16G memory, more memory buffers
will be reserved for Full GC.
-// Turn down max. will use as much memory as possible.
-DEFINE_Int64(max_sys_mem_available_low_water_mark_bytes, "1717986918");
+DEFINE_Int64(max_sys_mem_available_low_water_mark_bytes, "6871947673");
// The size of the memory that gc wants to release each time, as a percentage
of the mem limit.
DEFINE_mString(process_minor_gc_size, "10%");
@@ -556,6 +551,7 @@ DEFINE_String(pprof_profile_dir, "${DORIS_HOME}/log");
// for jeprofile in jemalloc
DEFINE_mString(jeprofile_dir, "${DORIS_HOME}/log");
DEFINE_mBool(enable_je_purge_dirty_pages, "true");
+DEFINE_mString(je_dirty_pages_mem_limit_percent, "5%");
// to forward compatibility, will be removed later
DEFINE_mBool(enable_token_check, "true");
diff --git a/be/src/common/config.h b/be/src/common/config.h
index 75cb0e2e272..945454079bf 100644
--- a/be/src/common/config.h
+++ b/be/src/common/config.h
@@ -155,10 +155,10 @@ DECLARE_mInt32(max_fill_rate);
DECLARE_mInt32(double_resize_threshold);
-// The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit
byte, default 1.6G,
-// actual low water mark=min(1.6G, MemTotal * 10%), avoid wasting too much
memory on machines
-// with large memory larger than 16G.
-// Turn up max. On machines with more than 16G memory, more memory buffers
will be reserved for Full GC.
+// The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit
byte, default 6.4G,
+// actual low water mark=min(6.4G, MemTotal * 5%), avoid wasting too much
memory on machines
+// with large memory larger than 128G.
+// Turn up max. On machines with more than 128G memory, more memory buffers
will be reserved for Full GC.
// Turn down max. will use as much memory as possible.
DECLARE_Int64(max_sys_mem_available_low_water_mark_bytes);
@@ -609,6 +609,8 @@ DECLARE_String(pprof_profile_dir);
DECLARE_mString(jeprofile_dir);
// Purge all unused dirty pages for all arenas.
DECLARE_mBool(enable_je_purge_dirty_pages);
+// Purge all unused Jemalloc dirty pages for all arenas when exceed
je_dirty_pages_mem_limit and process exceed soft limit.
+DECLARE_mString(je_dirty_pages_mem_limit_percent);
// to forward compatibility, will be removed later
DECLARE_mBool(enable_token_check);
diff --git a/be/src/common/daemon.cpp b/be/src/common/daemon.cpp
index d54189bce23..00d9caa4155 100644
--- a/be/src/common/daemon.cpp
+++ b/be/src/common/daemon.cpp
@@ -194,26 +194,29 @@ void Daemon::memory_maintenance_thread() {
doris::PerfCounters::refresh_proc_status();
doris::MemInfo::refresh_proc_meminfo();
doris::GlobalMemoryArbitrator::reset_refresh_interval_memory_growth();
+
ExecEnv::GetInstance()->brpc_iobuf_block_memory_tracker()->set_consumption(
+butil::IOBuf::block_memory());
+// Refresh allocator memory metrics.
+#if !defined(ADDRESS_SANITIZER) && !defined(LEAK_SANITIZER) &&
!defined(THREAD_SANITIZER)
+doris::MemInfo::refresh_allocator_mem();
+#ifdef USE_JEMALLOC
+if (doris::MemInfo::je_dirty_pages_mem() >
doris::MemInfo::je_dirty_pages_mem_limit() &&
+GlobalMemoryArbitrator::is_exceed_soft_mem_limit()) {
+doris::MemInfo::notify_je_purge_dirty_pages();
+}
+#endif
+if (config::enable_system_metrics) {
+
DorisMetrics::instance()->system_metrics()->update_allocator_metrics();
+}
+#endif
// Update and print memor
Re: [PR] [bugfix](external)Modify the default value of `pushdowncount` [doris]
doris-robot commented on PR #37754: URL: https://github.com/apache/doris/pull/37754#issuecomment-2227224364 TPC-H: Total hot run time: 39949 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ec4377a0e782edac724bf6ca79ebaf73fce74985, data reload: false -- Round 1 -- q1 17621 433242734273 q2 2026193 194 193 q3 10425 122311131113 q4 10186 737 801 737 q5 7541270427552704 q6 220 140 142 140 q7 949 603 603 603 q8 9219204620702046 q9 8621654265456542 q10 8680376237923762 q11 465 231 237 231 q12 406 230 235 230 q13 18382 297729912977 q14 272 241 236 236 q15 532 508 492 492 q16 512 384 381 381 q17 967 651 690 651 q18 7962743873857385 q19 7818141814481418 q20 645 321 322 321 q21 4978322840663228 q22 341 286 291 286 Total cold run time: 118768 ms Total hot run time: 39949 ms - Round 2, with runtime_filter_mode=off - q1 4391433842464246 q2 374 253 263 253 q3 3053291229432912 q4 1989179517221722 q5 5567552454305430 q6 228 135 143 135 q7 2228185218411841 q8 3288342833873387 q9 8693885588208820 q10 4112382538053805 q11 590 499 510 499 q12 799 645 618 618 q13 16434 320031673167 q14 316 297 284 284 q15 552 494 490 490 q16 498 459 428 428 q17 1839152914671467 q18 8080787177177717 q19 1784157816811578 q20 2133185818461846 q21 7416494446944694 q22 603 527 505 505 Total cold run time: 74967 ms Total hot run time: 55844 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](fe) fix several blocking bugs [doris]
morningman opened a new pull request, #37756: URL: https://github.com/apache/doris/pull/37756 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
doris-robot commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227226041 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](external)Modify the default value of `pushdowncount` [doris]
doris-robot commented on PR #37754: URL: https://github.com/apache/doris/pull/37754#issuecomment-2227227054 TPC-DS: Total hot run time: 172355 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ec4377a0e782edac724bf6ca79ebaf73fce74985, data reload: false query1 915 369 352 352 query2 6434182318611823 query3 6630208 216 208 query4 28047 17352 17416 17352 query5 3594463 466 463 query6 262 179 166 166 query7 4581287 282 282 query8 238 205 207 205 query9 8611235123362336 query10 430 285 273 273 query11 11771 992410131 9924 query12 113 82 88 82 query13 1645370 363 363 query14 10199 706576617065 query15 244 167 166 166 query16 7664304 315 304 query17 1807535 514 514 query18 1786273 271 271 query19 192 143 147 143 query20 90 81 79 79 query21 216 128 121 121 query22 4264417039943994 query23 34026 33640 33541 33541 query24 11159 280428772804 query25 616 387 371 371 query26 969 147 145 145 query27 2323271 277 271 query28 6696204720102010 query29 879 664 622 622 query30 248 156 154 154 query31 1004774 770 770 query32 99 57 55 55 query33 767 299 296 296 query34 1054485 493 485 query35 683 639 584 584 query36 1108985 974 974 query37 153 85 87 85 query38 2975280029392800 query39 895 837 834 834 query40 212 121 125 121 query41 48 44 49 44 query42 111 101 102 101 query43 523 497 470 470 query44 1245731 722 722 query45 190 161 164 161 query46 1083771 722 722 query47 1857176117551755 query48 371 288 292 288 query49 844 396 401 396 query50 782 383 390 383 query51 6936679168076791 query52 114 89 89 89 query53 354 284 279 279 query54 864 452 440 440 query55 76 73 72 72 query56 289 302 275 275 query57 1150105910791059 query58 238 249 245 245 query59 2846281325532553 query60 292 281 275 275 query61 96 96 93 93 query62 777 633 648 633 query63 318 285 285 285 query64 9340221417211721 query65 3160309831013098 query66 740 342 328 328 query67 15615 14880 14957 14880 query68 4600526 529 526 query69 646 415 358 358 query70 1164110011491100 query71 432 296 277 277 query72 7562588255645564 query73 760 320 319 319 query74 5924564555475547 query75 3559269727022697 query76 3357969 943 943 query77 655 299 287 287 query78 9590955989958995 query79 3376513 511 511 query80 2051467 470 467 query81 594 221 220 220 query82 1255136 126 126 query83 326 168 169 168 query84 275 90 89 89 query85 1533317 358 317 query86 354 322 311 311 query87 3303310231143102 query88 4309246324342434 query89 484 378 397 378 query90 1757196 187 187 query91 127 102 96 96 query92 62 50 47 47 query93 4794485 480 480 query94 858 215 205 205 query95 397 314 315 314 query96 616 274 271 271 query97 3203301830073007 query98 222 199 197 197 query99 1583124912631249 Total cold run time: 285586 ms Total hot run time: 172355 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [bugfix](external)Modify the default value of `pushdowncount` [doris]
doris-robot commented on PR #37754: URL: https://github.com/apache/doris/pull/37754#issuecomment-2227228326 ClickBench: Total hot run time: 30.78 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ec4377a0e782edac724bf6ca79ebaf73fce74985, data reload: false query1 0.030.030.03 query2 0.090.040.04 query3 0.220.050.05 query4 1.680.060.07 query5 0.530.500.48 query6 1.140.720.72 query7 0.020.020.01 query8 0.050.040.05 query9 0.570.500.49 query10 0.550.550.54 query11 0.150.110.12 query12 0.140.110.12 query13 0.590.580.58 query14 0.770.770.79 query15 0.860.810.81 query16 0.360.370.37 query17 0.981.000.98 query18 0.220.220.22 query19 1.781.801.67 query20 0.020.010.01 query21 15.40 0.770.65 query22 4.117.352.09 query23 18.25 1.411.25 query24 2.110.220.22 query25 0.160.090.08 query26 0.290.210.21 query27 0.450.230.22 query28 13.27 1.001.01 query29 12.64 3.403.35 query30 0.250.060.05 query31 2.870.390.38 query32 3.290.490.48 query33 2.922.872.97 query34 17.00 4.404.36 query35 4.414.404.40 query36 0.660.490.49 query37 0.190.160.16 query38 0.150.150.15 query39 0.050.040.03 query40 0.160.130.13 query41 0.100.050.05 query42 0.060.040.04 query43 0.040.030.04 Total cold run time: 109.58 s Total hot run time: 30.78 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](fe) fix several blocking bugs #37756 [doris]
morningman opened a new pull request, #37757: URL: https://github.com/apache/doris/pull/37757 bp #37756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37757: URL: https://github.com/apache/doris/pull/37757#issuecomment-2227229270 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
morningman commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227229276 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
morningman commented on PR #37757: URL: https://github.com/apache/doris/pull/37757#issuecomment-2227229310 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](fe) fix several blocking bugs #37756 [doris]
morningman opened a new pull request, #37758: URL: https://github.com/apache/doris/pull/37758 bp #37756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227229935 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
morningman commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227229943 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](jni_connector) fix that be core when jni_connector open fails (#37697)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 2f2ccc6aa75 [fix](jni_connector) fix that be core when jni_connector
open fails (#37697)
2f2ccc6aa75 is described below
commit 2f2ccc6aa75c2a416f116d2d726d347a3e36d20e
Author: Tiewei Fang <43782773+bepppo...@users.noreply.github.com>
AuthorDate: Sun Jul 14 15:52:20 2024 +0800
[fix](jni_connector) fix that be core when jni_connector open fails (#37697)
Here are two problems:
1. `appendDataTimeNs` will be `NULL` if TrinoConnector open fails before
call to `parseRequiredTypes`
2. It does not catch exception in method `get_statistics()` and this
exception is not caught until `close()` method. Therefore, it will cause
BE core dump in `JniConnector::close()` at `LOG(FATAL)`
---
be/src/vec/exec/jni_connector.cpp| 9 -
.../apache/doris/trinoconnector/TrinoConnectorJniScanner.java| 1 +
2 files changed, 9 insertions(+), 1 deletion(-)
diff --git a/be/src/vec/exec/jni_connector.cpp
b/be/src/vec/exec/jni_connector.cpp
index 66b01bbe847..0c2485ada3b 100644
--- a/be/src/vec/exec/jni_connector.cpp
+++ b/be/src/vec/exec/jni_connector.cpp
@@ -154,6 +154,13 @@ Status JniConnector::get_table_schema(std::string&
table_schema_str) {
std::map JniConnector::get_statistics(JNIEnv* env) {
jobject metrics = env->CallObjectMethod(_jni_scanner_obj,
_jni_scanner_get_statistics);
+jthrowable exc = (env)->ExceptionOccurred();
+if (exc != nullptr) {
+LOG(WARNING) << "get_statistics has error: "
+ << JniUtil::GetJniExceptionMsg(env).to_string();
+env->DeleteLocalRef(metrics);
+return std::map {};
+}
std::map result =
JniUtil::convert_to_cpp_map(env, metrics);
env->DeleteLocalRef(metrics);
return result;
@@ -163,7 +170,7 @@ Status JniConnector::close() {
if (!_closed) {
JNIEnv* env = nullptr;
RETURN_IF_ERROR(JniUtil::GetJNIEnv(&env));
-if (_scanner_opened) {
+if (_scanner_opened && _jni_scanner_obj != nullptr) {
// _fill_block may be failed and returned, we should release table
in close.
// org.apache.doris.common.jni.JniScanner#releaseTable is
idempotent
env->CallVoidMethod(_jni_scanner_obj, _jni_scanner_release_table);
diff --git
a/fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorJniScanner.java
b/fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorJniScanner.java
index 3e050fc923f..af20668081d 100644
---
a/fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorJniScanner.java
+++
b/fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorJniScanner.java
@@ -132,6 +132,7 @@ public class TrinoConnectorJniScanner extends JniScanner {
catalogNameString = params.get("catalog_name");
super.batchSize = batchSize;
super.fields = params.get("required_fields").split(",");
+appendDataTimeNs = new long[fields.length];
connectorSplitString = params.get("trino_connector_split");
connectorTableHandleString =
params.get("trino_connector_table_handle");
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](jni_connector) fix that be core when jni_connector open fails [doris]
morningman merged PR #37697: URL: https://github.com/apache/doris/pull/37697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
doris-robot commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227233512 TPC-H: Total hot run time: 39765 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 55200fa645dff84214b6cf38684dcb90394216ac, data reload: false -- Round 1 -- q1 17970 452543464346 q2 2504233 186 186 q3 10953 116711091109 q4 10242 734 702 702 q5 7576272127162716 q6 220 144 142 142 q7 959 609 609 609 q8 9252210320942094 q9 9097656465406540 q10 8710376837433743 q11 455 239 233 233 q12 398 232 220 220 q13 18747 296429542954 q14 284 237 234 234 q15 522 487 492 487 q16 497 377 369 369 q17 957 597 629 597 q18 8092759873897389 q19 9122131513971315 q20 689 333 315 315 q21 5205318238313182 q22 345 296 283 283 Total cold run time: 122796 ms Total hot run time: 39765 ms - Round 2, with runtime_filter_mode=off - q1 4431421942284219 q2 363 284 262 262 q3 3002272427422724 q4 1907154216171542 q5 5304526053035260 q6 225 129 130 129 q7 2085173717261726 q8 3169332333073307 q9 8400833184698331 q10 3937365137233651 q11 569 493 499 493 q12 799 629 602 602 q13 16367 295029812950 q14 299 277 267 267 q15 505 469 479 469 q16 473 403 407 403 q17 1746148214881482 q18 7609753372517251 q19 1630159315981593 q20 1978178418221784 q21 4839469147624691 q22 599 506 486 486 Total cold run time: 70236 ms Total hot run time: 53622 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Vault) Support alter s3 storage vault using http interface [doris]
ByteYue commented on PR #37537: URL: https://github.com/apache/doris/pull/37537#issuecomment-2227236675 Included in #37606 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Vault) Support alter s3 storage vault using http interface [doris]
ByteYue closed pull request #37537: [feature](Vault) Support alter s3 storage vault using http interface URL: https://github.com/apache/doris/pull/37537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
doris-robot commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227237054 TPC-DS: Total hot run time: 171724 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 55200fa645dff84214b6cf38684dcb90394216ac, data reload: false query1 913 381 362 362 query2 6458195818491849 query3 6652203 225 203 query4 28450 17495 17388 17388 query5 4173492 477 477 query6 290 176 169 169 query7 4612286 278 278 query8 244 190 194 190 query9 8413239523872387 query10 431 275 275 275 query11 10550 991810072 9918 query12 128 88 80 80 query13 1651380 356 356 query14 10025 713777767137 query15 206 163 163 163 query16 7648324 312 312 query17 1566564 521 521 query18 1919277 267 267 query19 188 147 149 147 query20 88 81 81 81 query21 203 129 128 128 query22 4347403639453945 query23 33635 3 32910 32910 query24 12069 292728682868 query25 676 389 403 389 query26 1774142 143 142 query27 2909266 264 264 query28 7520196719591959 query29 1058620 603 603 query30 282 148 145 145 query31 958 739 757 739 query32 95 53 57 53 query33 765 299 292 292 query34 956 491 492 491 query35 684 570 593 570 query36 1091927 974 927 query37 177 77 83 77 query38 2865275527222722 query39 874 787 819 787 query40 282 119 118 118 query41 45 46 45 45 query42 109 97 99 97 query43 525 450 480 450 query44 1240742 733 733 query45 197 161 160 160 query46 1084715 703 703 query47 1827177817851778 query48 371 287 298 287 query49 1180417 408 408 query50 762 407 392 392 query51 6825680267516751 query52 101 88 96 88 query53 359 286 299 286 query54 1032453 449 449 query55 74 75 75 75 query56 289 297 270 270 query57 1156105910291029 query58 263 239 247 239 query59 2857265626682656 query60 310 270 275 270 query61 100 98 93 93 query62 857 630 627 627 query63 324 299 285 285 query64 10514 230316541654 query65 3279311231003100 query66 1384333 336 333 query67 15395 15005 15007 15005 query68 4576542 536 536 query69 470 323 313 313 query70 1192108911551089 query71 399 272 269 269 query72 7397564857895648 query73 749 319 324 319 query74 5939548954765476 query75 3433271226772677 query76 2653998 923 923 query77 459 312 298 298 query78 9534896888448844 query79 2554519 525 519 query80 1895502 487 487 query81 577 218 221 218 query82 719 137 130 130 query83 280 175 173 173 query84 284 93 98 93 query85 2068375 354 354 query86 502 316 312 312 query87 3286311931343119 query88 4225249724622462 query89 471 375 393 375 query90 1853197 200 197 query91 139 112 113 112 query92 72 50 49 49 query93 2449493 491 491 query94 1273234 223 223 query95 422 328 329 328 query96 592 279 275 275 query97 3178300030743000 query98 225 205 200 200 query99 1614130312631263 Total cold run time: 285763 ms Total hot run time: 171724 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227238500 TPC-H: Total hot run time: 49637 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false -- Round 1 -- q1 18028 441443374337 q2 2069153 150 150 q3 10444 187118851871 q4 10337 124212821242 q5 9066390938663866 q6 226 124 166 124 q7 2020160115571557 q8 9390280527062706 q9 10695 10388 10169 10169 q10 8639352134913491 q11 431 239 248 239 q12 474 303 297 297 q13 18359 397839793978 q14 357 320 337 320 q15 502 462 461 461 q16 681 576 573 573 q17 1132953 994 953 q18 7259684069686840 q19 1812163116111611 q20 516 297 298 297 q21 4441410541374105 q22 551 450 457 450 Total cold run time: 117429 ms Total hot run time: 49637 ms - Round 2, with runtime_filter_mode=off - q1 4361436442854285 q2 320 235 232 232 q3 4177412940904090 q4 2748272427442724 q5 7091709270657065 q6 240 122 120 120 q7 3211284928132813 q8 4358447244834472 q9 16929 16689 16736 16689 q10 4218431843104310 q11 775 743 694 694 q12 1037871 871 871 q13 6855371537083708 q14 455 429 429 429 q15 502 460 460 460 q16 748 690 674 674 q17 3831384738053805 q18 8740870388408703 q19 1714172816771677 q20 2368211120962096 q21 8490851585228515 q22 1087100510211005 Total cold run time: 84255 ms Total hot run time: 79437 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
doris-robot commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227238620 ClickBench: Total hot run time: 30.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 55200fa645dff84214b6cf38684dcb90394216ac, data reload: false query1 0.040.030.03 query2 0.070.040.03 query3 0.220.050.04 query4 1.710.060.06 query5 0.480.460.50 query6 1.130.730.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.550.480.48 query10 0.560.550.54 query11 0.140.120.11 query12 0.140.120.12 query13 0.590.580.58 query14 0.760.770.78 query15 0.850.820.82 query16 0.340.340.37 query17 1.030.960.98 query18 0.230.220.22 query19 1.761.641.67 query20 0.010.000.01 query21 15.39 0.730.67 query22 4.316.682.03 query23 18.25 1.361.30 query24 2.100.230.22 query25 0.140.090.08 query26 0.300.210.22 query27 0.450.220.22 query28 13.25 1.011.00 query29 12.62 3.263.26 query30 0.260.060.06 query31 2.880.390.38 query32 3.300.480.47 query33 2.852.932.95 query34 16.98 4.404.30 query35 4.434.424.44 query36 0.650.450.48 query37 0.180.150.15 query38 0.150.150.14 query39 0.050.040.04 query40 0.160.120.12 query41 0.100.040.05 query42 0.060.050.05 query43 0.040.040.04 Total cold run time: 109.58 s Total hot run time: 30.55 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [only test] Fix arrow flight regression test `test_select` [doris]
xinyiZzz opened a new pull request, #37759: URL: https://github.com/apache/doris/pull/37759 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
doris-robot commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227243749 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
xinyiZzz commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227243804 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](vault) Support alter storage vault stmt in FE [doris]
github-actions[bot] commented on PR #37606: URL: https://github.com/apache/doris/pull/37606#issuecomment-2227246767 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
github-actions[bot] commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227252879 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227253613 TPC-DS: Total hot run time: 203450 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false query1 934 426 377 377 query2 6554267228322672 query3 6924220 204 204 query4 21170 17868 17962 17868 query5 19732 651365676513 query6 289 219 226 219 query7 4160295 302 295 query8 422 446 446 446 query9 3127267826212621 query10 412 318 300 300 query11 11371 10597 10659 10597 query12 126 73 74 73 query13 5610690 692 690 query14 17840 13147 13387 13147 query15 365 246 249 246 query16 6460288 264 264 query17 17481445911 911 query18 2277417 411 411 query19 221 156 148 148 query20 81 78 80 78 query21 193 98 91 91 query22 5119499249424942 query23 32501 31826 32103 31826 query24 6981649265036492 query25 528 426 434 426 query26 528 165 160 160 query27 1854302 297 297 query28 6175233523002300 query29 2860263927452639 query30 242 168 168 168 query31 906 734 748 734 query32 69 64 61 61 query33 409 256 263 256 query34 843 461 493 461 query35 1113940 923 923 query36 1288109312261093 query37 96 60 59 59 query38 3043293729322932 query39 1376134713211321 query40 207 98 96 96 query41 49 45 45 45 query42 87 86 84 84 query43 787 688 672 672 query44 1236716 714 714 query45 248 234 240 234 query46 1223966 967 966 query47 1895175717101710 query48 1025718 716 716 query49 634 401 376 376 query50 867 599 602 599 query51 4783468446024602 query52 95 79 95 79 query53 441 333 326 326 query54 2684242924492429 query55 94 83 83 83 query56 244 216 209 209 query57 1129109910861086 query58 226 202 203 202 query59 4013389338013801 query60 230 211 210 210 query61 95 93 115 93 query62 806 475 451 451 query63 484 344 340 340 query64 2597152513781378 query65 3639353235623532 query66 770 380 379 379 query67 17418 16268 15813 15813 query68 5718646 635 635 query69 575 350 357 350 query70 1463156915491549 query71 393 302 317 302 query72 6376352435203520 query73 732 323 320 320 query74 6257575458105754 query75 4401371538803715 query76 2955118412111184 query77 470 252 254 252 query78 12507 11748 11672 11672 query79 8218655 627 627 query80 2800406 402 402 query81 527 236 236 236 query82 160899 100 99 query83 256 139 135 135 query84 256 71 73 71 query85 1411329 339 329 query86 376 295 285 285 query87 3239305130243024 query88 5297235123522351 query89 366 292 289 289 query90 1779210 219 210 query91 182 153 147 147 query92 59 55 54 54 query93 3927578 553 553 query94 868 215 208 208 query95 1107105210641052 query96 645 335 335 335 query97 6592634164136341 query98 182 169 171 169 query99 2958794 842 794 Total cold run time: 308453 ms Total hot run time: 203450 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227262930 ClickBench: Total hot run time: 30.35 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false query1 0.030.020.03 query2 0.060.030.02 query3 0.250.050.05 query4 1.800.070.06 query5 0.540.520.52 query6 1.230.600.60 query7 0.020.010.01 query8 0.030.020.03 query9 0.520.480.48 query10 0.540.530.52 query11 0.120.090.09 query12 0.120.090.09 query13 0.630.610.62 query14 0.790.760.79 query15 0.790.760.76 query16 0.400.380.36 query17 1.010.981.00 query18 0.220.250.22 query19 1.931.851.84 query20 0.010.020.01 query21 15.49 0.540.56 query22 2.281.871.63 query23 17.30 0.980.92 query24 7.381.040.70 query25 0.360.040.04 query26 0.830.160.16 query27 0.040.030.03 query28 6.310.780.74 query29 12.65 2.362.25 query30 0.600.530.53 query31 2.810.380.38 query32 3.370.490.50 query33 3.063.073.05 query34 15.24 4.754.77 query35 4.874.854.85 query36 1.061.011.02 query37 0.060.050.05 query38 0.030.030.02 query39 0.020.010.02 query40 0.160.140.14 query41 0.060.010.02 query42 0.020.010.01 query43 0.030.020.02 Total cold run time: 105.07 s Total hot run time: 30.35 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
doris-robot commented on PR #37758: URL: https://github.com/apache/doris/pull/37758#issuecomment-2227266926 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit d616efb63e3c3e727400aa3311bbb504ac423858 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.5 seconds inserted 1000 Rows, about 465K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
doris-robot commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227267728 TPC-H: Total hot run time: 39858 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 25d97bae554cb975a8bf6af733ce09f40e7138a8, data reload: false -- Round 1 -- q1 17692 444043414341 q2 2369189 183 183 q3 10453 122511271127 q4 10195 785 814 785 q5 7525274126232623 q6 221 137 136 136 q7 959 600 584 584 q8 9204208320652065 q9 8507650965406509 q10 8604379137433743 q11 457 238 237 237 q12 387 223 218 218 q13 17949 293529782935 q14 276 233 242 233 q15 523 484 480 480 q16 475 381 380 380 q17 955 648 646 646 q18 8164744274357435 q19 5409145513541354 q20 670 317 337 317 q21 4884323738403237 q22 344 295 290 290 Total cold run time: 116222 ms Total hot run time: 39858 ms - Round 2, with runtime_filter_mode=off - q1 4344423742004200 q2 360 257 267 257 q3 3016276527272727 q4 1899159416341594 q5 5276527852925278 q6 208 127 128 127 q7 2160175017361736 q8 3186332733073307 q9 8369833883118311 q10 3897370236873687 q11 560 486 497 486 q12 761 588 590 588 q13 16660 297629932976 q14 304 271 269 269 q15 513 468 484 468 q16 472 413 419 413 q17 1763146814621462 q18 7585752072847284 q19 1691155516491555 q20 1986176117811761 q21 4873466047284660 q22 609 509 491 491 Total cold run time: 70492 ms Total hot run time: 53637 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](external)Modify the default value of `pushdowncount` [doris]
github-actions[bot] commented on PR #37754: URL: https://github.com/apache/doris/pull/37754#issuecomment-2227270339 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](external)Modify the default value of `pushdowncount` [doris]
github-actions[bot] commented on PR #37754: URL: https://github.com/apache/doris/pull/37754#issuecomment-2227270331 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
doris-robot commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227270634 TPC-DS: Total hot run time: 172133 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 25d97bae554cb975a8bf6af733ce09f40e7138a8, data reload: false query1 924 381 376 376 query2 6931187319031873 query3 6645206 212 206 query4 28674 17562 17241 17241 query5 4248480 470 470 query6 274 167 176 167 query7 4601285 281 281 query8 242 194 193 193 query9 8623233823412338 query10 446 301 270 270 query11 10490 998999249924 query12 132 81 85 81 query13 1637370 373 370 query14 10497 822572207220 query15 216 177 173 173 query16 7519319 317 317 query17 1801537 521 521 query18 1593295 269 269 query19 187 146 147 146 query20 92 79 77 77 query21 206 125 126 125 query22 4424418640744074 query23 34042 32995 32999 32995 query24 11193 290828952895 query25 642 366 359 359 query26 1529149 146 146 query27 2602266 271 266 query28 6828196019551955 query29 976 626 623 623 query30 287 149 147 147 query31 958 757 762 757 query32 97 53 56 53 query33 766 300 336 300 query34 892 490 487 487 query35 669 571 568 568 query36 1118946 936 936 query37 150 80 78 78 query38 2844273327142714 query39 893 800 781 781 query40 279 120 118 118 query41 46 44 44 44 query42 121 94 96 94 query43 515 473 486 473 query44 1202732 732 732 query45 191 160 158 158 query46 1091715 716 715 query47 1841178717891787 query48 375 293 293 293 query49 1179411 408 408 query50 784 387 394 387 query51 6823679666976697 query52 102 94 95 94 query53 360 288 293 288 query54 1071439 483 439 query55 77 76 74 74 query56 281 263 273 263 query57 1157107510801075 query58 265 239 251 239 query59 2984280727122712 query60 290 278 273 273 query61 97 92 96 92 query62 852 649 643 643 query63 321 298 289 289 query64 10542 231616491649 query65 3191311231473112 query66 1296330 325 325 query67 15362 15088 14961 14961 query68 4565523 539 523 query69 484 325 332 325 query70 1178109411121094 query71 384 271 269 269 query72 7070587861485878 query73 757 319 320 319 query74 6139544555535445 query75 3406271426722672 query76 2815956 889 889 query77 497 309 293 293 query78 9575935889898989 query79 2916519 509 509 query80 2092471 462 462 query81 569 222 221 221 query82 821 131 133 131 query83 277 174 165 165 query84 277 90 85 85 query85 2151304 288 288 query86 459 302 319 302 query87 3256309431403094 query88 4466247724602460 query89 486 379 380 379 query90 1844193 193 193 query91 134 103 101 101 query92 64 50 51 50 query93 4230513 499 499 query94 1165207 213 207 query95 462 317 320 317 query96 612 274 272 272 query97 3177305630503050 query98 221 199 189 189 query99 1814127412571257 Total cold run time: 287946 ms Total hot run time: 172133 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [only test] Fix arrow flight regression test `test_select` [doris]
doris-robot commented on PR #37759: URL: https://github.com/apache/doris/pull/37759#issuecomment-2227271938 ClickBench: Total hot run time: 31.19 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 25d97bae554cb975a8bf6af733ce09f40e7138a8, data reload: false query1 0.040.030.03 query2 0.070.040.04 query3 0.220.050.05 query4 1.670.070.08 query5 0.500.490.51 query6 1.140.740.73 query7 0.020.010.01 query8 0.060.050.05 query9 0.550.480.48 query10 0.530.540.53 query11 0.150.120.12 query12 0.150.120.13 query13 0.590.590.59 query14 0.750.770.78 query15 0.850.820.80 query16 0.370.380.37 query17 1.010.990.97 query18 0.230.210.21 query19 1.791.781.79 query20 0.010.010.01 query21 15.40 0.750.67 query22 4.425.652.39 query23 18.34 1.341.29 query24 2.120.240.23 query25 0.160.080.09 query26 0.290.210.21 query27 0.450.240.22 query28 13.31 1.021.00 query29 12.64 3.323.27 query30 0.250.060.06 query31 2.880.390.37 query32 3.340.470.47 query33 2.972.892.94 query34 17.10 4.384.40 query35 4.414.444.42 query36 0.650.480.46 query37 0.190.150.15 query38 0.160.150.14 query39 0.050.030.04 query40 0.160.110.12 query41 0.090.060.05 query42 0.060.040.05 query43 0.040.040.04 Total cold run time: 110.18 s Total hot run time: 31.19 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](MoW) fix MoW & segcompaction conflict on cache of temp segment [doris]
freemandealer opened a new pull request, #37760: URL: https://github.com/apache/doris/pull/37760 MoW will update delete bitmap during load, and the page cache could be modified by segcompaction. Disable page cache touchs when doing segcompaction could solve this problem. ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](MoW) fix MoW & segcompaction conflict on cache of temp segment [doris]
doris-robot commented on PR #37760: URL: https://github.com/apache/doris/pull/37760#issuecomment-2227272629 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](MoW) fix MoW & segcompaction conflict on cache of temp segment [doris]
github-actions[bot] commented on PR #37760: URL: https://github.com/apache/doris/pull/37760#issuecomment-2227274422 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](UT) Add UT for cloud string util [doris]
github-actions[bot] commented on PR #37552: URL: https://github.com/apache/doris/pull/37552#issuecomment-2227281608 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](test) fix test typo [doris]
morningman merged PR #37740: URL: https://github.com/apache/doris/pull/37740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](test) fix test typo (#37740)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 80c97962369 [fix](test) fix test typo (#37740)
80c97962369 is described below
commit 80c97962369a561878d80a78503b99513d219e84
Author: Mingyu Chen
AuthorDate: Sun Jul 14 17:36:43 2024 +0800
[fix](test) fix test typo (#37740)
---
regression-test/suites/external_table_p0/hive/test_hive_other.groovy | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/regression-test/suites/external_table_p0/hive/test_hive_other.groovy
b/regression-test/suites/external_table_p0/hive/test_hive_other.groovy
index d013e352eac..936790c6dc2 100644
--- a/regression-test/suites/external_table_p0/hive/test_hive_other.groovy
+++ b/regression-test/suites/external_table_p0/hive/test_hive_other.groovy
@@ -77,7 +77,7 @@ suite("test_hive_other",
"p0,external,hive,external_docker,external_docker_hive"
connect(user = 'ext_catalog_user', password = '12345', url =
context.config.jdbcUrl) {
def database_lists = sql """show databases from ${catalog_name}"""
boolean ok = false;
-for (int i = 0; i < database_lists.size(); ++j) {
+for (int i = 0; i < database_lists.size(); ++i) {
assertEquals(1, database_lists[i].size())
if (database_lists[i][0].equals("default")) {
ok = true;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](vault) Support alter storage vault stmt in FE [doris]
github-actions[bot] commented on PR #37606: URL: https://github.com/apache/doris/pull/37606#issuecomment-2227283736 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud tvf) Fix tvf query run in cloud multi cluster [doris]
dataroaring commented on code in PR #37157:
URL: https://github.com/apache/doris/pull/37157#discussion_r1677097333
##
fe/fe-core/src/main/java/org/apache/doris/catalog/StorageVaultMgr.java:
##
@@ -176,7 +179,14 @@ public void createHdfsVault(StorageVault vault) throws
DdlException {
}
private void alterSyncVaultTask() {
-systemInfoService.getAllBackends().forEach(backend -> {
+List bes;
+try {
+bes = systemInfoService.getBackendsByCurrentCluster();
Review Comment:
Need check if backends in current cluster is enough.
##
fe/fe-core/src/main/java/org/apache/doris/clone/TabletScheduler.java:
##
@@ -180,7 +180,13 @@ public Rebalancer getRebalancer() {
* update working slots at the beginning of each round
*/
private boolean updateWorkingSlots() {
-ImmutableMap backends = infoService.getAllBackendsMap();
+ImmutableMap backends;
+try {
+backends = infoService.getBackendsWithIdByCurrentCluster();
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/common/proc/TabletsProcDir.java:
##
@@ -65,10 +65,11 @@ public TabletsProcDir(Table table, MaterializedIndex index)
{
this.index = index;
}
-public List> fetchComparableResult(long version, long
backendId, Replica.ReplicaState state) {
+public List> fetchComparableResult(long version, long
backendId, Replica.ReplicaState state)
+throws AnalysisException {
Preconditions.checkNotNull(table);
Preconditions.checkNotNull(index);
-ImmutableMap backendMap =
Env.getCurrentSystemInfo().getIdToBackend();
+ImmutableMap backendMap =
Env.getCurrentSystemInfo().getBackendsWithIdByCurrentCluster();
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/httpv2/rest/manager/NodeAction.java:
##
@@ -627,7 +627,7 @@ public Object operateBackend(HttpServletRequest request,
HttpServletResponse res
} else if ("DROP".equals(action)) {
currentSystemInfo.dropBackends(hostInfos);
} else if ("DECOMMISSION".equals(action)) {
-ImmutableMap backendsInCluster =
currentSystemInfo.getAllBackendsMap();
+ImmutableMap backendsInCluster =
currentSystemInfo.getBackendsWithIdByCurrentCluster();
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/httpv2/restv2/StatisticAction.java:
##
@@ -80,7 +81,13 @@ private int getTblCount(Env env) {
private long getDiskOccupancy(SystemInfoService infoService) {
long diskOccupancy = 0;
-List backends = infoService.getAllBackends();
+List backends;
+try {
+backends = infoService.getBackendsByCurrentCluster();
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/policy/PolicyMgr.java:
##
@@ -731,7 +731,7 @@ public void alterPolicy(AlterPolicyStmt stmt) throws
DdlException, AnalysisExcep
// log alter
Env.getCurrentEnv().getEditLog().logAlterStoragePolicy(storagePolicy);
AgentBatchTask batchTask = new AgentBatchTask();
-for (long backendId :
Env.getCurrentSystemInfo().getIdToBackend().keySet()) {
+for (long backendId :
Env.getCurrentSystemInfo().getBackendsWithIdByCurrentCluster().keySet()) {
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/qe/cache/CacheCoordinator.java:
##
@@ -110,7 +111,7 @@ public void resetBackend() {
}
try {
belock.lock();
-ImmutableMap idToBackend =
Env.getCurrentSystemInfo().getIdToBackend();
+ImmutableMap idToBackend =
Env.getCurrentSystemInfo().getBackendsWithIdByCurrentCluster();
Review Comment:
Need checking.
##
fe/fe-core/src/main/java/org/apache/doris/common/util/AutoBucketUtils.java:
##
@@ -50,7 +57,13 @@ private static int getBENum() {
private static int getBucketsNumByBEDisks() {
SystemInfoService infoService = Env.getCurrentSystemInfo();
-ImmutableMap backends = infoService.getAllBackendsMap();
+ImmutableMap backends;
+try {
+backends = infoService.getBackendsWithIdByCurrentCluster();
Review Comment:
Need checking too.
##
fe/fe-core/src/main/java/org/apache/doris/common/publish/ClusterStatePublisher.java:
##
@@ -62,8 +63,8 @@ public static ClusterStatePublisher getInstance() {
return INSTANCE;
}
-public void publish(ClusterStateUpdate state, Listener listener, int
timeoutMs) {
-Collection nodesToPublish =
clusterInfoService.getIdToBackend().values();
+public void publish(ClusterStateUpdate state, Listener listener, int
timeoutMs) throws UserException {
+Collection nodesToPublish =
clusterInfoService.getBackendsWithIdByCurrentCluste
Re: [PR] [chore](UT) Add UT for cloud string util [doris]
gavinchou merged PR #37552: URL: https://github.com/apache/doris/pull/37552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [chore](UT) Add UT for cloud string util (#37552)
This is an automated email from the ASF dual-hosted git repository.
gavinchou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new fe50c256bcf [chore](UT) Add UT for cloud string util (#37552)
fe50c256bcf is described below
commit fe50c256bcf27eb232a556fa465c3034ce375b4b
Author: Gavin Chou
AuthorDate: Sun Jul 14 17:59:39 2024 +0800
[chore](UT) Add UT for cloud string util (#37552)
---
cloud/src/recycler/recycler_service.cpp | 6 +++
cloud/test/CMakeLists.txt | 4 ++
cloud/test/util_test.cpp| 91 +
run-cloud-ut.sh | 27 +-
4 files changed, 115 insertions(+), 13 deletions(-)
diff --git a/cloud/src/recycler/recycler_service.cpp
b/cloud/src/recycler/recycler_service.cpp
index 198c61db0a2..eca3bc6563b 100644
--- a/cloud/src/recycler/recycler_service.cpp
+++ b/cloud/src/recycler/recycler_service.cpp
@@ -186,6 +186,12 @@ void recycle_copy_jobs(const std::shared_ptr&
txn_kv, const std::string&
}
}
auto recycler = std::make_unique(txn_kv, instance);
+if (recycler->init() != 0) {
+LOG(WARNING) << "failed to init InstanceRecycler recycle_copy_jobs on
instance "
+ << instance_id;
+return;
+}
+
std::thread worker([recycler = std::move(recycler), instance_id] {
LOG(INFO) << "manually trigger recycle_copy_jobs on instance " <<
instance_id;
recycler->recycle_copy_jobs();
diff --git a/cloud/test/CMakeLists.txt b/cloud/test/CMakeLists.txt
index c64c351f246..a27f7a1c538 100644
--- a/cloud/test/CMakeLists.txt
+++ b/cloud/test/CMakeLists.txt
@@ -50,6 +50,8 @@ add_executable(s3_accessor_test s3_accessor_test.cpp)
add_executable(hdfs_accessor_test hdfs_accessor_test.cpp)
+add_executable(util_test util_test.cpp)
+
add_executable(stopwatch_test stopwatch_test.cpp)
add_executable(network_util_test network_util_test.cpp)
@@ -83,6 +85,8 @@ target_link_libraries(s3_accessor_test ${TEST_LINK_LIBS})
target_link_libraries(hdfs_accessor_test ${TEST_LINK_LIBS})
+target_link_libraries(util_test ${TEST_LINK_LIBS})
+
target_link_libraries(stopwatch_test ${TEST_LINK_LIBS})
target_link_libraries(network_util_test ${TEST_LINK_LIBS})
diff --git a/cloud/test/util_test.cpp b/cloud/test/util_test.cpp
new file mode 100644
index 000..02921170761
--- /dev/null
+++ b/cloud/test/util_test.cpp
@@ -0,0 +1,91 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+#include
+#include
+#include
+
+#include "common/config.h"
+#include "common/string_util.h"
+#include "glog/logging.h"
+#include "gtest/gtest.h"
+
+int main(int argc, char** argv) {
+doris::cloud::config::init(nullptr, true);
+::testing::InitGoogleTest(&argc, argv);
+return RUN_ALL_TESTS();
+}
+
+TEST(StringUtilTest, test_string_strip) {
+// clang-format off
+// str expect to_drop
+std::vector>
leading_inputs {
+{"" , "" , ""},
+{"" , "" , "/" },
+{"/" , "" , "/" },
+{"\t" , "" , "/ \t"},
+{"/a///" , "a///" , "/" },
+{"/a/b/c/", "a/b/c/", "/" },
+{"a/b/c/" , "a/b/c/", "/" },
+{"a/b/c/" , "/b/c/" , "a" },
+};
+int idx = 0;
+for (auto&& i : leading_inputs) {
+doris::cloud::strip_leading(std::get<0>(i), std::get<2>(i));
+EXPECT_EQ(std::get<0>(i), std::get<1>(i)) << " index=" << idx;
+++idx;
+}
+
+idx = 0;
+std::vector>
trailing_inputs {
+{"" , "" , ""},
+{"/" , "" , "/" },
+{"\t" , "" , "/ \t"},
+{"/a///" , "/a", "/" },
+{"/a/b/c/", "/a/b/c", "/" },
+{"a/b/c/" , "a/b/c" , "/" },
+{"a/b/c" , "a/b/c" , "/" },
+{"a/b/c" , "a/b/" , "c" },
+};
+for (auto&& i : trailing_inputs) {
+doris::cloud::strip_trailing(std::get<0>(i), std::get<2>(i));
+EXPECT_EQ(std::get<0>(i), std::get<1>(i)) << " index=" << idx;
+++idx;
+}
+
+idx = 0;
+
Re: [PR] [feature](vault) Support alter storage vault stmt in FE [doris]
github-actions[bot] commented on code in PR #37606:
URL: https://github.com/apache/doris/pull/37606#discussion_r1677101321
##
cloud/test/meta_service_test.cpp:
##
@@ -6562,6 +6562,107 @@ TEST(MetaServiceTest, GetObjStoreInfoTest) {
SyncPoint::get_instance()->clear_all_call_backs();
}
+TEST(MetaServiceTest, AlterS3StorageVaultTest) {
Review Comment:
warning: function 'TEST' exceeds recommended size/complexity thresholds
[readability-function-size]
```cpp
TEST(MetaServiceTest, AlterS3StorageVaultTest) {
^
```
Additional context
**cloud/test/meta_service_test.cpp:6564:** 99 lines including whitespace and
comments (threshold 80)
```cpp
TEST(MetaServiceTest, AlterS3StorageVaultTest) {
^
```
##
cloud/test/meta_service_test.cpp:
##
@@ -6562,6 +6562,107 @@
SyncPoint::get_instance()->clear_all_call_backs();
}
+TEST(MetaServiceTest, AlterS3StorageVaultTest) {
+auto meta_service = get_meta_service();
+
+auto sp = SyncPoint::get_instance();
Review Comment:
warning: 'auto sp' can be declared as 'auto *sp' [readability-qualified-auto]
```suggestion
auto *sp = SyncPoint::get_instance();
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](fix) replace hardcode s3BucketName [doris]
hello-stephen commented on PR #37739: URL: https://github.com/apache/doris/pull/37739#issuecomment-2227297681 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](fix) replace hardcode s3BucketName [doris]
hello-stephen merged PR #37750: URL: https://github.com/apache/doris/pull/37750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [test](fix) replace hardcode s3BucketName (#37750)
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 8f39143c144 [test](fix) replace hardcode s3BucketName (#37750)
8f39143c144 is described below
commit 8f39143c14465e9b64bfc9ee4ef07d5f830c29c4
Author: Dongyang Li
AuthorDate: Sun Jul 14 18:38:52 2024 +0800
[test](fix) replace hardcode s3BucketName (#37750)
## Proposed changes
pick from master #37739
-
Co-authored-by: stephen
---
.../paimon/paimon_base_filesystem.groovy | 5 +-
.../hive/test_hive_write_insert_s3.groovy | 5 +-
.../suites/github_events_p2/load.groovy| 2 +-
.../load_p0/broker_load/test_compress_type.groovy | 41 +++---
.../test_csv_with_enclose_and_escapeS3_load.groovy | 15 ++-
.../load_p0/broker_load/test_etl_failed.groovy | 8 +-
.../broker_load/test_multi_table_load.groovy | 13 +-
.../suites/load_p0/broker_load/test_s3_load.groovy | 44 +++---
.../test_s3_load_with_load_parallelism.groovy | 7 +-
.../load_p0/broker_load/test_seq_load.groovy | 7 +-
.../load_p2/broker_load/test_broker_load.groovy| 140 +--
.../test_parquet_large_metadata_load.groovy| 15 ++-
.../broker_load/test_s3_load_properties.groovy | 150 +++--
.../tvf/test_tvf_based_broker_load.groovy | 74 +-
.../diff_data/stress_test_diff_date_list.groovy| 2 +-
.../same_data/stress_test_same_date_range.groovy | 2 +-
.../stress_test_two_stream_load.groovy | 2 +-
...est_update_rows_and_partition_first_load.groovy | 16 ++-
regression-test/suites/tpcds_sf1000_p2/load.groovy | 5 +-
19 files changed, 287 insertions(+), 266 deletions(-)
diff --git
a/regression-test/suites/external_table_p0/paimon/paimon_base_filesystem.groovy
b/regression-test/suites/external_table_p0/paimon/paimon_base_filesystem.groovy
index 7be15f94243..0e00cd8fb7a 100644
---
a/regression-test/suites/external_table_p0/paimon/paimon_base_filesystem.groovy
+++
b/regression-test/suites/external_table_p0/paimon/paimon_base_filesystem.groovy
@@ -29,6 +29,7 @@ suite("paimon_base_filesystem",
"p0,external,doris,external_docker,external_dock
String s3ak = getS3AK()
String s3sk = getS3SK()
+def s3Endpoint = getS3Endpoint()
def cos = """select
c1,c2,c3,c4,c5,c6,c7,c8,c9,c10,c11,c12,c13,c14,c15,c16,c18 from
${catalog_cos}.zd.all_table order by c18"""
def oss = """select * from ${catalog_oss}.paimonossdb1.test_tableoss
order by a"""
@@ -48,9 +49,9 @@ suite("paimon_base_filesystem",
"p0,external,doris,external_docker,external_dock
create catalog if not exists ${catalog_oss} properties (
"type" = "paimon",
"warehouse" = "oss://paimon-zd/paimonoss",
-"oss.endpoint"="oss-cn-beijing.aliyuncs.com",
"oss.access_key"="${ak}",
-"oss.secret_key"="${sk}"
+"oss.secret_key"="${sk}",
+"oss.endpoint"="oss-cn-beijing.aliyuncs.com"
);
"""
logger.info("catalog " + catalog_cos + " created")
diff --git
a/regression-test/suites/external_table_p2/hive/test_hive_write_insert_s3.groovy
b/regression-test/suites/external_table_p2/hive/test_hive_write_insert_s3.groovy
index 87633ba1b09..cf9fea67cbd 100644
---
a/regression-test/suites/external_table_p2/hive/test_hive_write_insert_s3.groovy
+++
b/regression-test/suites/external_table_p2/hive/test_hive_write_insert_s3.groovy
@@ -17,6 +17,7 @@
suite("test_hive_write_insert_s3",
"p2,external,hive,external_remote,external_remote_hive") {
def format_compressions = ["parquet_snappy"]
+def s3BucketName = getS3BucketName()
def q01 = { String format_compression, String catalog_name ->
logger.info("hive sql: " + """ truncate table
all_types_${format_compression}_s3; """)
@@ -76,8 +77,8 @@ suite("test_hive_write_insert_s3",
"p2,external,hive,external_remote,external_re
hive_remote """ DROP TABLE IF EXISTS
all_types_par_${format_compression}_s3_${catalog_name}_q02; """
logger.info("hive sql: " + """ CREATE TABLE IF NOT EXISTS
all_types_par_${format_compression}_s3_${catalog_name}_q02 like
all_types_par_${format_compression}_s3; """)
hive_remote """ CREATE TABLE IF NOT EXISTS
all_types_par_${format_compression}_s3_${catalog_name}_q02 like
all_types_par_${format_compression}_s3; """
-logger.info("hive sql: " + """ ALTER TABLE
all_types_par_${format_compression}_s3_${catalog_name}_q02 SET LOCATION
'cosn://doris-build-1308700295/regression/write/data/all_types_par_${format_compression}_s3_${catalog_name}_q02';
""")
-hive_remote """ ALTER TABLE
all_types_par_${format_compression}_s3_${cata
Re: [PR] [fix](ci) compile cloud when cloud/cmake/* changed [doris]
hello-stephen closed pull request #37611: [fix](ci) compile cloud when cloud/cmake/* changed URL: https://github.com/apache/doris/pull/37611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [release](version) change branch-2.0 version to 2.0.13 [doris]
xiaokang merged PR #37749: URL: https://github.com/apache/doris/pull/37749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [release](version) change branch-2.0 version to 2.0.13 (#37749)
This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new a5f45d329f1 [release](version) change branch-2.0 version to 2.0.13
(#37749)
a5f45d329f1 is described below
commit a5f45d329f1e9a7d26d7abd2ba1613416899c548
Author: Kang
AuthorDate: Sun Jul 14 18:48:36 2024 +0800
[release](version) change branch-2.0 version to 2.0.13 (#37749)
---
gensrc/script/gen_build_version.sh | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/gensrc/script/gen_build_version.sh
b/gensrc/script/gen_build_version.sh
index 3b50121bceb..5161addbc68 100755
--- a/gensrc/script/gen_build_version.sh
+++ b/gensrc/script/gen_build_version.sh
@@ -30,13 +30,13 @@ set -eo pipefail
build_version_prefix="doris"
build_version_major=2
build_version_minor=0
-build_version_patch=12
+build_version_patch=13
build_version_rc_version=""
if [[ -z "${build_version_rc_version}" ]]; then
build_version="${build_version_prefix}-${build_version_major}.${build_version_minor}.${build_version_patch}"
else
-
build_version="${build_version_prefix}-${build_version_major}.${build_version_minor}.${build_version_patch}-${build_version_rc_version}"
+
build_version="${build_version_prefix}-${build_version_major}.${build_version_minor}.${build_version_patch}.${build_version_rc_version}"
fi
unset LANG
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs #37756 [doris]
morningman merged PR #37758: URL: https://github.com/apache/doris/pull/37758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [fix](fe) fix several blocking bugs #37756 (#37758)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new 0bcc1771f6d [fix](fe) fix several blocking bugs #37756 (#37758)
0bcc1771f6d is described below
commit 0bcc1771f6d2c0915a09a2229b9af30b07126fc3
Author: Mingyu Chen
AuthorDate: Sun Jul 14 18:50:23 2024 +0800
[fix](fe) fix several blocking bugs #37756 (#37758)
bp #37756
---
.../java/org/apache/doris/analysis/FunctionCallExpr.java| 1 -
.../java/org/apache/doris/qe/MasterCatalogExecutor.java | 13 +++--
2 files changed, 11 insertions(+), 3 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/FunctionCallExpr.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/FunctionCallExpr.java
index 3f92c959670..e588e8ca717 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/FunctionCallExpr.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/FunctionCallExpr.java
@@ -2364,7 +2364,6 @@ public class FunctionCallExpr extends Expr {
int result = super.hashCode();
result = 31 * result + Objects.hashCode(opcode);
result = 31 * result + Objects.hashCode(fnName);
-result = 31 * result + Objects.hashCode(fnParams);
return result;
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/qe/MasterCatalogExecutor.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/MasterCatalogExecutor.java
index a1e557b526b..293413e9708 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/MasterCatalogExecutor.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/MasterCatalogExecutor.java
@@ -66,11 +66,20 @@ public class MasterCatalogExecutor {
boolean isReturnToPool = false;
try {
TInitExternalCtlMetaResult result =
client.initExternalCtlMeta(request);
-
Env.getCurrentEnv().getJournalObservable().waitOn(result.maxJournalId,
waitTimeoutMs);
if (!result.getStatus().equalsIgnoreCase(STATUS_OK)) {
throw new UserException(result.getStatus());
+} else {
+// DO NOT wait on journal replayed, this may cause deadlock.
+// 1. hold table read lock
+// 2. wait on journal replayed
+// 3. previous journal (eg, txn journal) replayed need to hold
table write lock
+// 4. deadlock
+// But no waiting on journal replayed may cause some request
on non-master FE failed for some time.
+// There is no good solution for this.
+// In feature version, this whole process is refactored, so we
temporarily remove this waiting.
+//
Env.getCurrentEnv().getJournalObservable().waitOn(result.maxJournalId,
timeoutMs);
+isReturnToPool = true;
}
-isReturnToPool = true;
} catch (Exception e) {
LOG.warn("Failed to finish forward init operation, please try
again. ", e);
throw e;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [case](restart_fe) add demo case for restart_fe test (#37091) [doris]
hello-stephen commented on PR #37313: URL: https://github.com/apache/doris/pull/37313#issuecomment-2227301015 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](cloud_p0) prepare java udf for some cases [doris]
hello-stephen commented on PR #35991: URL: https://github.com/apache/doris/pull/35991#issuecomment-2227301127 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) tag 2.0.13 created (now 0bcc1771f6d)
This is an automated email from the ASF dual-hosted git repository. kxiao pushed a change to tag 2.0.13 in repository https://gitbox.apache.org/repos/asf/doris.git at 0bcc1771f6d (commit) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](csv)Supports reading CSV data using LF and CRLF as line separators. [doris]
hubgeter commented on PR #37687: URL: https://github.com/apache/doris/pull/37687#issuecomment-2227301856 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) remove folding constant implementation of convert_tz [doris]
zclllyybb commented on PR #37746: URL: https://github.com/apache/doris/pull/37746#issuecomment-2227316382 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](csv)Supports reading CSV data using LF and CRLF as line separators. [doris]
doris-robot commented on PR #37687: URL: https://github.com/apache/doris/pull/37687#issuecomment-2227316908 TPC-H: Total hot run time: 39956 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e13733074bf4b1af26392d64aef141f2533dc3c7, data reload: false -- Round 1 -- q1 18547 440542924292 q2 2025193 188 188 q3 10527 125611381138 q4 10224 798 783 783 q5 7537268126772677 q6 221 140 147 140 q7 980 596 612 596 q8 9217208421032084 q9 8750658866056588 q10 8838374638303746 q11 456 237 239 237 q12 400 223 221 221 q13 17766 298029862980 q14 277 231 233 231 q15 521 481 467 467 q16 490 386 380 380 q17 989 616 711 616 q18 8097757673807380 q19 5853149914061406 q20 647 308 316 308 q21 4920321732413217 q22 346 281 290 281 Total cold run time: 117628 ms Total hot run time: 39956 ms - Round 2, with runtime_filter_mode=off - q1 4456427642434243 q2 381 282 278 278 q3 3023294329182918 q4 1998169116821682 q5 5707554854925492 q6 227 137 156 137 q7 2198188918551855 q8 3279343934553439 q9 8733881389088813 q10 4148377638013776 q11 591 484 516 484 q12 826 662 619 619 q13 17243 321832033203 q14 314 284 274 274 q15 534 485 497 485 q16 504 440 456 440 q17 1837154114971497 q18 8211789279267892 q19 1722163415801580 q20 2137187618611861 q21 5169477647234723 q22 623 547 520 520 Total cold run time: 73861 ms Total hot run time: 56211 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](csv)Supports reading CSV data using LF and CRLF as line separators. [doris]
doris-robot commented on PR #37687: URL: https://github.com/apache/doris/pull/37687#issuecomment-2227320030 TPC-DS: Total hot run time: 174024 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit e13733074bf4b1af26392d64aef141f2533dc3c7, data reload: false query1 932 376 365 365 query2 6462188519011885 query3 6630204 216 204 query4 27922 17661 17235 17235 query5 3639499 465 465 query6 257 200 169 169 query7 4554290 291 290 query8 251 189 192 189 query9 8269235023422342 query10 424 308 284 284 query11 11638 10084 10119 10084 query12 119 86 84 84 query13 1616372 379 372 query14 10403 782878377828 query15 232 172 176 172 query16 7912325 355 325 query17 1755543 522 522 query18 2039276 277 276 query19 196 151 145 145 query20 88 83 82 82 query21 202 149 126 126 query22 4415408140724072 query23 34131 33698 33665 33665 query24 10951 289429702894 query25 590 406 387 387 query26 694 152 153 152 query27 2211274 270 270 query28 5910201720382017 query29 894 650 673 650 query30 249 149 150 149 query31 938 776 760 760 query32 93 52 54 52 query33 674 317 300 300 query34 886 487 515 487 query35 686 584 603 584 query36 1109977 966 966 query37 152 88 94 88 query38 2935290028472847 query39 872 858 858 858 query40 202 134 120 120 query41 79 47 52 47 query42 107 98 103 98 query43 503 458 449 449 query44 1136729 740 729 query45 204 164 164 164 query46 1094695 739 695 query47 1854178317781778 query48 366 286 286 286 query49 837 406 415 406 query50 789 393 390 390 query51 6937683368226822 query52 106 96 93 93 query53 362 291 294 291 query54 847 447 447 447 query55 73 74 72 72 query56 290 270 280 270 query57 1137108010741074 query58 237 252 274 252 query59 2877268726372637 query60 303 292 283 283 query61 132 95 96 95 query62 770 642 661 642 query63 317 298 289 289 query64 9160221416641664 query65 3155310931263109 query66 753 331 339 331 query67 15430 15066 15030 15030 query68 4489528 530 528 query69 540 392 403 392 query70 1192110910881088 query71 376 280 281 280 query72 7380556259525562 query73 760 320 323 320 query74 5889559455185518 query75 3401269126902690 query76 2403954 928 928 query77 469 306 315 306 query78 9827915589278927 query79 3176521 516 516 query80 1508474 462 462 query81 557 224 226 224 query82 761 140 142 140 query83 193 171 173 171 query84 268 89 87 87 query85 1256329 315 315 query86 460 328 286 286 query87 3323311330903090 query88 4360243924632439 query89 483 388 379 379 query90 1754201 201 201 query91 142 117 111 111 query92 65 125 48 48 query93 4160505 502 502 query94 1027213 223 213 query95 414 323 327 323 query96 614 271 273 271 query97 3213303330863033 query98 227 198 193 193 query99 1728127612791276 Total cold run time: 280402 ms Total hot run time: 174024 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [feature](csv)Supports reading CSV data using LF and CRLF as line separators. [doris]
doris-robot commented on PR #37687: URL: https://github.com/apache/doris/pull/37687#issuecomment-2227321837 ClickBench: Total hot run time: 31.51 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit e13733074bf4b1af26392d64aef141f2533dc3c7, data reload: false query1 0.040.030.03 query2 0.080.040.03 query3 0.230.060.05 query4 1.690.070.06 query5 0.510.480.48 query6 1.160.730.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.540.490.49 query10 0.540.550.55 query11 0.150.120.11 query12 0.140.110.13 query13 0.590.590.58 query14 0.750.790.76 query15 0.850.820.81 query16 0.350.360.38 query17 1.051.011.01 query18 0.240.220.21 query19 1.911.751.73 query20 0.010.000.01 query21 15.40 0.730.65 query22 3.667.192.85 query23 18.25 1.411.24 query24 2.150.240.22 query25 0.160.090.09 query26 0.290.210.21 query27 0.450.220.23 query28 13.22 1.011.00 query29 12.59 3.343.29 query30 0.250.060.05 query31 2.890.390.40 query32 3.260.500.47 query33 2.882.992.91 query34 17.07 4.344.34 query35 4.404.404.38 query36 0.650.490.47 query37 0.200.150.15 query38 0.160.150.15 query39 0.040.040.04 query40 0.150.120.13 query41 0.090.050.04 query42 0.060.050.05 query43 0.050.040.04 Total cold run time: 109.22 s Total hot run time: 31.51 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
Mryange commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2227325057 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
github-actions[bot] commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2227327122 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) remove folding constant implementation of convert_tz [doris]
zclllyybb commented on PR #37746: URL: https://github.com/apache/doris/pull/37746#issuecomment-2227327420 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[Enhancement](partial update) Add some partial update case (#36385)" [doris]
Yukang-Lian commented on PR #37519: URL: https://github.com/apache/doris/pull/37519#issuecomment-2227334410 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
doris-robot commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2227334302 TPC-H: Total hot run time: 39969 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a0ccbc5300942c70dbbb94d83994528dd53d4bad, data reload: false -- Round 1 -- q1 17612 495643784378 q2 2015189 189 189 q3 10522 121511191119 q4 10192 812 902 812 q5 7580272126942694 q6 221 139 142 139 q7 967 602 591 591 q8 9218211521142114 q9 8995659065516551 q10 8831380838093808 q11 466 231 239 231 q12 421 234 229 229 q13 18001 298929572957 q14 285 243 237 237 q15 535 492 479 479 q16 513 384 379 379 q17 985 718 734 718 q18 8159742573387338 q19 7050142012111211 q20 660 309 326 309 q21 4917320233543202 q22 357 284 288 284 Total cold run time: 118502 ms Total hot run time: 39969 ms - Round 2, with runtime_filter_mode=off - q1 4452430843004300 q2 377 276 271 271 q3 3063288529412885 q4 1970179517521752 q5 5594556454615461 q6 233 133 144 133 q7 2280182118111811 q8 3286347134433443 q9 8773886288338833 q10 4144373838763738 q11 596 490 505 490 q12 823 665 630 630 q13 16126 313632123136 q14 317 286 294 286 q15 530 501 491 491 q16 503 432 447 432 q17 1853153915001500 q18 8039790777587758 q19 1819171115701570 q20 2121185218551852 q21 7656489747994799 q22 589 491 519 491 Total cold run time: 75144 ms Total hot run time: 56062 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
doris-robot commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2227337735 TPC-DS: Total hot run time: 173385 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a0ccbc5300942c70dbbb94d83994528dd53d4bad, data reload: false query1 912 369 364 364 query2 6449192118341834 query3 6629205 212 205 query4 28330 17556 17443 17443 query5 3583478 484 478 query6 264 164 170 164 query7 4583283 292 283 query8 232 194 194 194 query9 8368237123672367 query10 432 294 261 261 query11 10731 10058 10099 10058 query12 117 82 82 82 query13 1649374 371 371 query14 10212 769679507696 query15 219 167 169 167 query16 7156313 307 307 query17 1643570 543 543 query18 1738308 278 278 query19 206 161 158 158 query20 91 84 84 84 query21 206 130 126 126 query22 4247408040504050 query23 33846 33707 33454 33454 query24 11236 286528612861 query25 593 418 386 386 query26 700 152 169 152 query27 2158273 277 273 query28 6054210121202101 query29 904 668 625 625 query30 258 164 160 160 query31 992 766 785 766 query32 104 56 59 56 query33 754 300 303 300 query34 931 510 505 505 query35 703 586 586 586 query36 1135985 972 972 query37 145 83 94 83 query38 2985292928782878 query39 888 858 839 839 query40 232 129 129 129 query41 48 45 44 44 query42 117 98 101 98 query43 509 475 443 443 query44 1230723 753 723 query45 194 157 160 157 query46 1081697 733 697 query47 1836178717711771 query48 362 294 313 294 query49 844 414 422 414 query50 769 391 394 391 query51 6911674868086748 query52 101 97 93 93 query53 361 299 299 299 query54 919 464 437 437 query55 77 75 74 74 query56 298 266 267 266 query57 1140103710281028 query58 257 242 256 242 query59 2856268927432689 query60 298 278 269 269 query61 92 92 91 91 query62 802 658 644 644 query63 325 284 287 284 query64 9476219716611661 query65 3144310931313109 query66 744 329 330 329 query67 15530 15065 14831 14831 query68 7385538 535 535 query69 620 494 367 367 query70 1179115411371137 query71 485 280 289 280 query72 7123591555415541 query73 832 319 325 319 query74 5985552054655465 query75 3999269827222698 query76 4024880 936 880 query77 677 298 312 298 query78 10274 905489838983 query79 3865501 519 501 query80 1176491 480 480 query81 581 220 217 217 query82 766 136 129 129 query83 203 175 171 171 query84 280 94 87 87 query85 1244301 305 301 query86 433 328 312 312 query87 3283310230633063 query88 4505244824392439 query89 500 397 387 387 query90 1824198 195 195 query91 132 101 151 101 query92 62 49 51 49 query93 4492502 491 491 query94 1059220 209 209 query95 403 308 323 308 query96 600 277 274 274 query97 3193297530292975 query98 213 196 200 196 query99 1577123212961232 Total cold run time: 285910 ms Total hot run time: 173385 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [cherry-pick](branch-2.0) Pick "[Enhancement](partial update)Add timezone case for partial update timestamp #33177" [doris]
Yukang-Lian closed pull request #37603: [cherry-pick](branch-2.0) Pick "[Enhancement](partial update)Add timezone case for partial update timestamp #33177" URL: https://github.com/apache/doris/pull/37603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [quick-start] refactor quick start [doris-website]
morningman opened a new pull request, #857: URL: https://github.com/apache/doris-website/pull/857 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](pipeline) remove no pipeline code in SenderQueue [doris]
doris-robot commented on PR #37208: URL: https://github.com/apache/doris/pull/37208#issuecomment-2227339316 ClickBench: Total hot run time: 30.28 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a0ccbc5300942c70dbbb94d83994528dd53d4bad, data reload: false query1 0.040.040.04 query2 0.090.030.03 query3 0.220.050.05 query4 1.680.060.08 query5 0.490.470.50 query6 1.150.720.72 query7 0.020.010.02 query8 0.050.040.05 query9 0.560.500.50 query10 0.550.540.53 query11 0.150.120.11 query12 0.150.120.12 query13 0.590.590.58 query14 0.770.770.80 query15 0.860.810.83 query16 0.370.370.37 query17 0.951.011.00 query18 0.220.210.21 query19 1.901.731.72 query20 0.010.010.01 query21 15.40 0.770.66 query22 4.118.271.56 query23 18.31 1.491.28 query24 2.130.230.23 query25 0.160.090.09 query26 0.280.210.21 query27 0.450.230.22 query28 13.22 1.041.01 query29 12.65 3.353.31 query30 0.250.060.05 query31 2.890.380.39 query32 3.260.470.47 query33 2.892.922.92 query34 17.16 4.374.33 query35 4.394.464.38 query36 0.660.460.47 query37 0.190.160.15 query38 0.160.150.16 query39 0.050.030.03 query40 0.160.120.12 query41 0.100.040.05 query42 0.060.040.04 query43 0.050.040.04 Total cold run time: 109.8 s Total hot run time: 30.28 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) remove folding constant implementation of convert_tz [doris]
doris-robot commented on PR #37746: URL: https://github.com/apache/doris/pull/37746#issuecomment-2227340609 TPC-H: Total hot run time: 39811 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 60e32e4db10f22768b41a4e57fc44a6af38795ed, data reload: false -- Round 1 -- q1 17620 431442734273 q2 2005192 188 188 q3 10446 113610221022 q4 10199 833 855 833 q5 7582267526802675 q6 238 138 140 138 q7 951 606 611 606 q8 9217206520722065 q9 8679655865806558 q10 8904378837813781 q11 469 230 238 230 q12 427 227 228 227 q13 18892 297529672967 q14 281 236 242 236 q15 533 477 485 477 q16 498 386 389 386 q17 963 713 710 710 q18 8041738773737373 q19 7118148012781278 q20 700 321 327 321 q21 4899317239213172 q22 356 295 297 295 Total cold run time: 119018 ms Total hot run time: 39811 ms - Round 2, with runtime_filter_mode=off - q1 4376426942544254 q2 377 271 265 265 q3 3060291129262911 q4 1974173816951695 q5 5543551154465446 q6 228 133 144 133 q7 2270187218711871 q8 3256343233843384 q9 8715880088208800 q10 4215377838543778 q11 624 500 497 497 q12 817 665 652 652 q13 17276 314331543143 q14 330 286 285 285 q15 530 488 490 488 q16 504 462 442 442 q17 1803152214721472 q18 8092797678447844 q19 4011164116031603 q20 2157184418661844 q21 5164488747534753 q22 597 502 544 502 Total cold run time: 75919 ms Total hot run time: 56062 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) remove folding constant implementation of convert_tz [doris]
doris-robot commented on PR #37746: URL: https://github.com/apache/doris/pull/37746#issuecomment-2227344637 TPC-DS: Total hot run time: 173924 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 60e32e4db10f22768b41a4e57fc44a6af38795ed, data reload: false query1 917 368 357 357 query2 6429190917671767 query3 6663207 216 207 query4 28460 17593 17389 17389 query5 3744510 511 510 query6 273 167 176 167 query7 4582284 282 282 query8 239 192 199 192 query9 8554236523472347 query10 428 287 282 282 query11 10533 10123 10172 10123 query12 123 85 83 83 query13 1632361 357 357 query14 10272 745274837452 query15 212 166 169 166 query16 7691310 311 310 query17 1811575 523 523 query18 1887269 275 269 query19 189 148 147 147 query20 90 81 92 81 query21 202 131 121 121 query22 4268409740754075 query23 33939 33725 33675 33675 query24 11244 288629112886 query25 636 427 418 418 query26 1213162 149 149 query27 2515272 265 265 query28 7245205020312031 query29 912 635 635 635 query30 259 155 160 155 query31 948 762 742 742 query32 97 54 55 54 query33 756 302 289 289 query34 1002513 485 485 query35 676 590 592 590 query36 1120992 971 971 query37 162 92 91 91 query38 2979296428332833 query39 899 850 869 850 query40 209 128 129 128 query41 49 47 53 47 query42 115 100 101 100 query43 500 479 470 470 query44 1241738 730 730 query45 200 169 169 169 query46 1088718 707 707 query47 1871176417711764 query48 383 291 293 291 query49 861 424 433 424 query50 789 397 395 395 query51 6849692167456745 query52 108 95 96 95 query53 363 288 293 288 query54 888 466 456 456 query55 74 77 77 77 query56 308 295 280 280 query57 1137108610321032 query58 252 252 266 252 query59 2811283726912691 query60 318 307 305 305 query61 116 118 118 118 query62 794 655 622 622 query63 314 289 288 288 query64 9667228917471747 query65 3185311231303112 query66 778 344 342 342 query67 15549 15053 14868 14868 query68 6194542 525 525 query69 735 460 379 379 query70 1206112411511124 query71 497 290 291 290 query72 8716599256365636 query73 842 325 320 320 query74 5970548756025487 query75 4569271027092709 query76 4104100310071003 query77 767 320 299 299 query78 9705902290119011 query79 8512525 521 521 query80 2640486 479 479 query81 589 232 216 216 query82 761 141 144 141 query83 304 170 166 166 query84 272 89 92 89 query85 1495325 299 299 query86 428 290 316 290 query87 3363310131573101 query88 5239245924622459 query89 487 388 379 379 query90 2027198 199 198 query91 130 103 102 102 query92 62 51 52 51 query93 6382494 500 494 query94 1295220 218 218 query95 412 323 327 323 query96 630 277 279 277 query97 3196304030323032 query98 220 206 241 206 query99 1581123112611231 Total cold run time: 299948 ms Total hot run time: 173924 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
[PR] Revert "[refactor](nereids) New distribute planner (#36531)" [doris]
dataroaring opened a new pull request, #37761: URL: https://github.com/apache/doris/pull/37761 This reverts commit 5b68de56cd1a48517c823320579786e3454b1a3d. ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Revert "[refactor](nereids) New distribute planner (#36531)" [doris]
doris-robot commented on PR #37761: URL: https://github.com/apache/doris/pull/37761#issuecomment-2227345920 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](function) remove folding constant implementation of convert_tz [doris]
doris-robot commented on PR #37746: URL: https://github.com/apache/doris/pull/37746#issuecomment-2227346240 ClickBench: Total hot run time: 31.25 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 60e32e4db10f22768b41a4e57fc44a6af38795ed, data reload: false query1 0.040.040.04 query2 0.090.030.04 query3 0.220.050.05 query4 1.680.070.08 query5 0.490.500.50 query6 1.140.730.72 query7 0.020.020.02 query8 0.060.050.05 query9 0.550.490.49 query10 0.540.560.55 query11 0.150.120.12 query12 0.150.120.12 query13 0.600.590.58 query14 0.760.800.82 query15 0.840.800.83 query16 0.380.370.37 query17 0.960.970.95 query18 0.230.210.22 query19 1.891.811.73 query20 0.010.000.01 query21 15.39 0.780.67 query22 4.586.832.45 query23 18.27 1.411.28 query24 2.080.240.22 query25 0.160.090.09 query26 0.290.200.20 query27 0.460.240.22 query28 13.30 1.011.02 query29 12.60 3.353.32 query30 0.250.070.06 query31 2.860.390.38 query32 3.280.490.49 query33 2.942.952.88 query34 17.18 4.344.34 query35 4.394.414.40 query36 0.640.460.47 query37 0.180.160.16 query38 0.150.140.14 query39 0.050.030.04 query40 0.150.120.12 query41 0.090.050.05 query42 0.050.040.04 query43 0.040.040.04 Total cold run time: 110.18 s Total hot run time: 31.25 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) add pull up literal when infer predicates [doris]
feiniaofeiafei commented on PR #37314: URL: https://github.com/apache/doris/pull/37314#issuecomment-2227346140 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)" [doris]
Yukang-Lian commented on PR #37605: URL: https://github.com/apache/doris/pull/37605#issuecomment-2227347415 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bug](backup) Add table/partition id into convert_rowset_ids() [doris]
lide-reed merged PR #37077: URL: https://github.com/apache/doris/pull/37077 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-1.2-lts updated: [bug](backup) Add table/partition id into convert_rowset_ids() (#37077)
This is an automated email from the ASF dual-hosted git repository.
lide pushed a commit to branch branch-1.2-lts
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-1.2-lts by this push:
new 2ce6124f155 [bug](backup) Add table/partition id into
convert_rowset_ids() (#37077)
2ce6124f155 is described below
commit 2ce6124f1555a779881612ae6524fc48d246dce5
Author: xy720 <22125576+xy...@users.noreply.github.com>
AuthorDate: Sun Jul 14 21:21:07 2024 +0800
[bug](backup) Add table/partition id into convert_rowset_ids() (#37077)
---
be/src/olap/snapshot_manager.cpp | 12 +++-
be/src/olap/snapshot_manager.h | 2 +-
be/src/olap/task/engine_clone_task.cpp | 2 +-
be/src/olap/task/engine_storage_migration_task.cpp | 5 +++--
be/src/runtime/snapshot_loader.cpp | 3 ++-
.../src/main/java/org/apache/doris/task/CloneTask.java | 2 ++
gensrc/thrift/AgentService.thrift| 2 ++
7 files changed, 22 insertions(+), 6 deletions(-)
diff --git a/be/src/olap/snapshot_manager.cpp b/be/src/olap/snapshot_manager.cpp
index ea1dc1c995f..7136f4f2586 100644
--- a/be/src/olap/snapshot_manager.cpp
+++ b/be/src/olap/snapshot_manager.cpp
@@ -117,7 +117,8 @@ Status SnapshotManager::release_snapshot(const string&
snapshot_path) {
}
Status SnapshotManager::convert_rowset_ids(const std::string& clone_dir,
int64_t tablet_id,
- int64_t replica_id, const int32_t&
schema_hash) {
+ int64_t replica_id, int64_t
table_id,
+ int64_t partition_id, const
int32_t& schema_hash) {
SCOPED_CONSUME_MEM_TRACKER(_mem_tracker);
Status res = Status::OK();
// check clone dir existed
@@ -149,6 +150,12 @@ Status SnapshotManager::convert_rowset_ids(const
std::string& clone_dir, int64_t
// equal to tablet id in meta
new_tablet_meta_pb.set_tablet_id(tablet_id);
new_tablet_meta_pb.set_replica_id(replica_id);
+if (table_id > 0) {
+new_tablet_meta_pb.set_table_id(table_id);
+}
+if (partition_id > 0) {
+new_tablet_meta_pb.set_partition_id(partition_id);
+}
new_tablet_meta_pb.set_schema_hash(schema_hash);
TabletSchemaSPtr tablet_schema;
tablet_schema =
@@ -177,6 +184,9 @@ Status SnapshotManager::convert_rowset_ids(const
std::string& clone_dir, int64_t
}
// FIXME(cyx): Redundant?
rowset_meta->set_tablet_id(tablet_id);
+if (partition_id > 0) {
+rowset_meta->set_partition_id(partition_id);
+}
rowset_meta->set_tablet_schema_hash(schema_hash);
Version rowset_version = {visible_rowset.start_version(),
visible_rowset.end_version()};
rs_version_map[rowset_version] = rowset_meta;
diff --git a/be/src/olap/snapshot_manager.h b/be/src/olap/snapshot_manager.h
index a7857c3ffb0..df99cfda839 100644
--- a/be/src/olap/snapshot_manager.h
+++ b/be/src/olap/snapshot_manager.h
@@ -60,7 +60,7 @@ public:
static SnapshotManager* instance();
Status convert_rowset_ids(const std::string& clone_dir, int64_t tablet_id,
int64_t replica_id,
- const int32_t& schema_hash);
+ int64_t table_id, int64_t partition_id, const
int32_t& schema_hash);
private:
SnapshotManager() : _snapshot_base_id(0) {
diff --git a/be/src/olap/task/engine_clone_task.cpp
b/be/src/olap/task/engine_clone_task.cpp
index 67e3c36e796..75e8caa59a3 100644
--- a/be/src/olap/task/engine_clone_task.cpp
+++ b/be/src/olap/task/engine_clone_task.cpp
@@ -263,7 +263,7 @@ Status
EngineCloneTask::_make_and_download_snapshots(DataDir& data_dir,
// change all rowset ids because they maybe its id same with local
rowset
status = SnapshotManager::instance()->convert_rowset_ids(
local_data_path, _clone_req.tablet_id,
_clone_req.replica_id,
-_clone_req.schema_hash);
+_clone_req.table_id, _clone_req.partition_id,
_clone_req.schema_hash);
} else {
LOG_WARNING("failed to download snapshot from remote BE")
.tag("url", remote_url_prefix)
diff --git a/be/src/olap/task/engine_storage_migration_task.cpp
b/be/src/olap/task/engine_storage_migration_task.cpp
index 6ecefe47222..913ba6a7a4d 100644
--- a/be/src/olap/task/engine_storage_migration_task.cpp
+++ b/be/src/olap/task/engine_storage_migration_task.cpp
@@ -125,8 +125,9 @@ Status
EngineStorageMigrationTask::_gen_and_write_header_to_hdr_file(
// it will change rowset id and its create time
// rowset create time is useful when load tablet from meta to check which
tablet is the tablet to load
-return SnapshotManager::instance()->convert_rowset_ids(full_path,
t
[PR] [fix](nereids) fix outerjoin assoc rule bug [doris]
xzj7019 opened a new pull request, #37762: URL: https://github.com/apache/doris/pull/37762 ## Proposed changes Fix outer join assoc rule bug, which unexpectly doing the join reorder for the (t1 left outer t2) inner t3 => t1 left outer (t2 inner join t3) transformation, and leading the wrong result. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) fix outerjoin assoc rule bug [doris]
doris-robot commented on PR #37762: URL: https://github.com/apache/doris/pull/37762#issuecomment-2227348215 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) fix outerjoin assoc rule bug [doris]
xzj7019 commented on PR #37762: URL: https://github.com/apache/doris/pull/37762#issuecomment-2227348240 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)" [doris]
github-actions[bot] commented on PR #37605: URL: https://github.com/apache/doris/pull/37605#issuecomment-2227348951 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) fix several blocking bugs [doris]
github-actions[bot] commented on PR #37756: URL: https://github.com/apache/doris/pull/37756#issuecomment-2227351394 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) add pull up literal when infer predicates [doris]
doris-robot commented on PR #37314: URL: https://github.com/apache/doris/pull/37314#issuecomment-2227352574 TPC-H: Total hot run time: 3 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2a22f945ce740d86e6600cb93c5c2efb649b1251, data reload: false -- Round 1 -- q1 17880 445944014401 q2 2784198 195 195 q3 11181 119111021102 q4 10497 767 902 767 q5 7589273227112711 q6 222 138 139 138 q7 968 614 599 599 q8 9551204220752042 q9 8854655265696552 q10 8768376137813761 q11 443 238 238 238 q12 397 219 215 215 q13 18977 295429562954 q14 282 240 238 238 q15 531 478 487 478 q16 473 394 377 377 q17 953 708 744 708 q18 8153768273767376 q19 3936129212681268 q20 655 323 324 323 q21 5011327332783273 q22 350 283 288 283 Total cold run time: 118455 ms Total hot run time: 3 ms - Round 2, with runtime_filter_mode=off - q1 4374426842254225 q2 378 275 259 259 q3 3024279627472747 q4 1924159215701570 q5 5277530453115304 q6 217 130 130 130 q7 2129176517211721 q8 3195334033123312 q9 8400839284488392 q10 3895364537743645 q11 587 516 501 501 q12 783 616 601 601 q13 17411 296930162969 q14 295 285 281 281 q15 515 482 481 481 q16 495 441 446 441 q17 1767149214971492 q18 7709753773927392 q19 1694158415101510 q20 1976178017761776 q21 4771472046984698 q22 572 486 486 486 Total cold run time: 71388 ms Total hot run time: 53933 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipeline) [doris]
Mryange commented on PR #37672: URL: https://github.com/apache/doris/pull/37672#issuecomment-2227354202 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) Add object ID in expression and use it as hash code [doris]
XieJiann commented on PR #37538: URL: https://github.com/apache/doris/pull/37538#issuecomment-2227356011 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](pipeline) [doris]
github-actions[bot] commented on PR #37672: URL: https://github.com/apache/doris/pull/37672#issuecomment-2227356262 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) add pull up literal when infer predicates [doris]
doris-robot commented on PR #37314: URL: https://github.com/apache/doris/pull/37314#issuecomment-2227356331 TPC-DS: Total hot run time: 172823 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2a22f945ce740d86e6600cb93c5c2efb649b1251, data reload: false query1 918 372 362 362 query2 6461188918161816 query3 6659210 222 210 query4 28478 17677 17275 17275 query5 4236490 504 490 query6 292 171 167 167 query7 4597297 287 287 query8 252 193 188 188 query9 8414236323542354 query10 442 274 277 274 query11 10546 10191 10183 10183 query12 142 80 85 80 query13 1632358 358 358 query14 9989760881767608 query15 237 160 167 160 query16 7368311 314 311 query17 1820560 518 518 query18 1425277 278 277 query19 194 152 150 150 query20 89 82 82 82 query21 205 123 127 123 query22 4227423440594059 query23 33444 32947 32971 32947 query24 11912 285128792851 query25 647 365 370 365 query26 1719152 153 152 query27 2766267 271 267 query28 7448198019881980 query29 1035630 602 602 query30 282 150 150 150 query31 925 731 729 729 query32 93 54 55 54 query33 765 300 295 295 query34 1000481 482 481 query35 676 568 562 562 query36 1105966 956 956 query37 247 79 76 76 query38 2874275928102759 query39 858 801 790 790 query40 291 122 124 122 query41 48 47 52 47 query42 122 102 100 100 query43 494 492 459 459 query44 1172746 729 729 query45 191 161 160 160 query46 1079741 710 710 query47 1838179517521752 query48 363 290 294 290 query49 1183416 407 407 query50 782 398 401 398 query51 6851680068016800 query52 101 93 95 93 query53 357 293 296 293 query54 1010440 441 440 query55 74 75 74 74 query56 319 269 267 267 query57 1160102710341027 query58 263 243 254 243 query59 2841268226892682 query60 307 285 286 285 query61 99 94 95 94 query62 841 654 658 654 query63 328 293 284 284 query64 10565 224116391639 query65 3205310931243109 query66 1298333 331 331 query67 15484 14887 15072 14887 query68 4541545 549 545 query69 483 328 336 328 query70 1124111710661066 query71 411 281 279 279 query72 7036588962475889 query73 751 328 326 326 query74 5965558455855584 query75 3524269927202699 query76 2805963 944 944 query77 446 293 290 290 query78 9640904889178917 query79 2529509 521 509 query80 2504475 473 473 query81 589 218 228 218 query82 929 134 135 134 query83 294 168 171 168 query84 273 91 90 90 query85 2258318 313 313 query86 496 324 285 285 query87 3285313130983098 query88 4200245424722454 query89 480 396 381 381 query90 1878193 197 193 query91 129 102 101 101 query92 68 53 49 49 query93 2630509 484 484 query94 1341215 207 207 query95 404 320 311 311 query96 618 282 282 282 query97 3240303630563036 query98 220 225 194 194 query99 1582127312521252 Total cold run time: 285758 ms Total hot run time: 172823 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [cherry-pick](branch-2.0) Pick "[fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)" [doris]
doris-robot commented on PR #37605: URL: https://github.com/apache/doris/pull/37605#issuecomment-2227356808 TeamCity be ut coverage result: Function Coverage: 37.86% (8119/21444) Line Coverage: 29.54% (66545/225299) Region Coverage: 29.01% (34298/118238) Branch Coverage: 24.88% (17616/70812) Coverage Report: http://coverage.selectdb-in.cc/coverage/8745d103b668306bd3633b3fdfd7fc00b02109eb_8745d103b668306bd3633b3fdfd7fc00b02109eb/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids) add pull up literal when infer predicates [doris]
doris-robot commented on PR #37314: URL: https://github.com/apache/doris/pull/37314#issuecomment-2227357998 ClickBench: Total hot run time: 31.47 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 2a22f945ce740d86e6600cb93c5c2efb649b1251, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.220.050.05 query4 1.670.080.08 query5 0.500.480.50 query6 1.140.720.73 query7 0.020.010.01 query8 0.060.040.04 query9 0.550.490.50 query10 0.550.520.54 query11 0.150.120.11 query12 0.150.120.12 query13 0.590.580.59 query14 0.750.780.82 query15 0.860.820.82 query16 0.360.380.36 query17 0.961.000.99 query18 0.230.210.22 query19 1.911.811.83 query20 0.010.010.01 query21 15.41 0.780.67 query22 3.946.882.54 query23 18.22 1.351.34 query24 2.070.230.25 query25 0.160.080.08 query26 0.310.200.21 query27 0.450.240.22 query28 13.23 1.021.00 query29 12.63 3.363.34 query30 0.260.060.05 query31 2.870.380.39 query32 3.270.480.48 query33 2.912.902.92 query34 17.03 4.344.35 query35 4.414.404.44 query36 0.640.480.47 query37 0.190.160.15 query38 0.160.150.14 query39 0.040.030.04 query40 0.160.120.13 query41 0.090.050.05 query42 0.050.050.05 query43 0.050.040.04 Total cold run time: 109.35 s Total hot run time: 31.47 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)" [doris]
doris-robot commented on PR #37605: URL: https://github.com/apache/doris/pull/37605#issuecomment-2227358165 TPC-H: Total hot run time: 49792 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8745d103b668306bd3633b3fdfd7fc00b02109eb, data reload: false -- Round 1 -- q1 17877 440043414341 q2 2079153 151 151 q3 10506 196219391939 q4 10314 128113291281 q5 8393387939493879 q6 230 150 125 125 q7 2075161515871587 q8 9306272626972697 q9 10951 10475 10279 10279 q10 8635350235193502 q11 420 252 243 243 q12 469 305 307 305 q13 18336 400440354004 q14 357 326 337 326 q15 500 462 458 458 q16 680 572 584 572 q17 1141941 967 941 q18 7303672368926723 q19 1768167216011601 q20 557 317 292 292 q21 4401413141174117 q22 539 447 429 429 Total cold run time: 116837 ms Total hot run time: 49792 ms - Round 2, with runtime_filter_mode=off - q1 4336430042894289 q2 322 232 219 219 q3 4180418641384138 q4 2749274827632748 q5 7214708671277086 q6 240 120 119 119 q7 3248283928712839 q8 4395446444734464 q9 17343 17149 16975 16975 q10 4233426042734260 q11 746 669 686 669 q12 1036859 867 859 q13 6717375937053705 q14 445 424 438 424 q15 511 448 453 448 q16 740 680 679 679 q17 3806379738263797 q18 875287658752 q19 1714173016501650 q20 2367211321212113 q21 8429849783788378 q22 10391000963 963 Total cold run time: 84698 ms Total hot run time: 79574 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[Enhancement](full compaction) Add run status support for full compaction (#34043)" [doris]
Yukang-Lian commented on PR #37607: URL: https://github.com/apache/doris/pull/37607#issuecomment-2227360033 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
svn commit: r70297 - in /dev/doris/2.0.13: ./ apache-doris-2.0.13-src.tar.gz apache-doris-2.0.13-src.tar.gz.asc apache-doris-2.0.13-src.tar.gz.sha512
Author: kxiao Date: Sun Jul 14 14:05:26 2024 New Revision: 70297 Log: doris-2.0.13 release vote Added: dev/doris/2.0.13/ dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz (with props) dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.asc (with props) dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.sha512 Added: dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz == Binary file - no diff available. Propchange: dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz -- svn:mime-type = application/x-gzip Added: dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.asc == Binary file - no diff available. Propchange: dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.asc -- svn:mime-type = application/pgp-signature Added: dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.sha512 == --- dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.sha512 (added) +++ dev/doris/2.0.13/apache-doris-2.0.13-src.tar.gz.sha512 Sun Jul 14 14:05:26 2024 @@ -0,0 +1 @@ +a61ed3154d3f58e8173d5fa018cc190ca65478b333ad26d369089b3974d5816b8a8384fffd8db8a1fe516ea328d6a4a2840d5ccbed34b12b61c2e7ea6710ea07 apache-doris-2.0.13-src.tar.gz - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.0) Pick "[fix](partial update) Support partial update when the date default value is 'current_date'. This PR is a extension of PR #32926. (#33394)" [doris]
doris-robot commented on PR #37605: URL: https://github.com/apache/doris/pull/37605#issuecomment-2227361879 TPC-DS: Total hot run time: 204589 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8745d103b668306bd3633b3fdfd7fc00b02109eb, data reload: false query1 933 417 381 381 query2 6538277625592559 query3 6916207 207 207 query4 20804 18090 18157 18090 query5 19722 662165456545 query6 306 227 240 227 query7 4165297 313 297 query8 404 398 430 398 query9 3092267926452645 query10 417 306 312 306 query11 11344 10635 10653 10635 query12 123 74 74 74 query13 5608702 688 688 query14 18168 13711 13622 13622 query15 364 247 234 234 query16 6446300 265 265 query17 14841496900 900 query18 2245419 422 419 query19 212 152 151 151 query20 83 79 75 75 query21 182 95 92 92 query22 5211502550525025 query23 32632 32006 32127 32006 query24 6905653264746474 query25 525 436 447 436 query26 532 168 164 164 query27 1791298 304 298 query28 6050234923272327 query29 2862264827782648 query30 239 168 167 167 query31 896 748 743 743 query32 71 65 61 61 query33 408 253 250 250 query34 843 486 478 478 query35 1160985 944 944 query36 1426112511131113 query37 91 61 65 61 query38 3102300930033003 query39 1375133913211321 query40 203 97 99 97 query41 48 44 43 43 query42 83 86 85 85 query43 676 641 667 641 query44 1144717 716 716 query45 252 238 232 232 query46 1223957 976 957 query47 1799186618901866 query48 1024721 732 721 query49 624 360 371 360 query50 855 629 645 629 query51 4761468447694684 query52 100 82 79 79 query53 447 326 328 326 query54 2656246924942469 query55 94 78 82 78 query56 241 235 209 209 query57 1380109011371090 query58 226 212 207 207 query59 4082390240513902 query60 210 205 201 201 query61 101 96 99 96 query62 827 456 454 454 query63 492 351 348 348 query64 2522157015361536 query65 3662357535793575 query66 791 378 387 378 query67 17500 15624 15311 15311 query68 10621 641 643 641 query69 591 378 346 346 query70 2072133114031331 query71 428 310 305 305 query72 6508356434843484 query73 754 327 329 327 query74 6303585858585858 query75 5563377437653765 query76 6902115112281151 query77 1194249 260 249 query78 12806 11630 11910 11630 query79 8546644 642 642 query80 1137408 404 404 query81 485 234 234 234 query82 985 99 102 99 query83 169 138 130 130 query84 258 71 73 71 query85 893 344 342 342 query86 335 295 337 295 query87 3254298430642984 query88 4501236323622362 query89 483 286 289 286 query90 1977214 215 214 query91 173 138 151 138 query92 62 54 55 54 query93 6989568 583 568 query94 710 219 214 214 query95 1090106210661062 query96 646 337 330 330 query97 6508635664486356 query98 194 185 179 179 query99 2994919 981 919 Total cold run time: 319829 ms Total hot run time: 204589 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [cherry-pick](branch-2.0) Pick "[Enhancement](full compaction) Add run status support for full compaction (#34043)" [doris]
github-actions[bot] commented on code in PR #37607:
URL: https://github.com/apache/doris/pull/37607#discussion_r1677142884
##
be/src/olap/full_compaction.cpp:
##
@@ -44,7 +44,9 @@ using namespace ErrorCode;
FullCompaction::FullCompaction(const TabletSharedPtr& tablet)
: Compaction(tablet, "FullCompaction:" +
std::to_string(tablet->tablet_id())) {}
-FullCompaction::~FullCompaction() {}
+FullCompaction::~FullCompaction() {
Review Comment:
warning: use '= default' to define a trivial destructor
[modernize-use-equals-default]
```cpp
FullCompaction::~FullCompaction() {
^
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) fix outerjoin assoc rule bug [doris]
doris-robot commented on PR #37762: URL: https://github.com/apache/doris/pull/37762#issuecomment-2227362615 TPC-H: Total hot run time: 39735 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 87116e55452ea875e72a386bb24f1a70ae0ee117, data reload: false -- Round 1 -- q1 17627 437443214321 q2 2015195 192 192 q3 10442 119710991099 q4 10187 751 834 751 q5 7529267326562656 q6 219 135 136 135 q7 941 601 596 596 q8 9212205720712057 q9 8630655265446544 q10 8824381337723772 q11 440 238 229 229 q12 395 225 221 221 q13 17772 299429982994 q14 268 246 242 242 q15 527 473 494 473 q16 494 388 379 379 q17 952 613 683 613 q18 8145737273717371 q19 8283139713261326 q20 668 317 318 317 q21 4909318131643164 q22 344 283 283 283 Total cold run time: 118823 ms Total hot run time: 39735 ms - Round 2, with runtime_filter_mode=off - q1 4402427543064275 q2 366 262 256 256 q3 2999292029382920 q4 1994168217591682 q5 5643548654855485 q6 226 142 131 131 q7 2217184118381838 q8 3244338633923386 q9 8810879487998794 q10 4070392437553755 q11 584 508 506 506 q12 819 632 628 628 q13 15913 313832063138 q14 308 284 285 284 q15 548 465 503 465 q16 501 440 436 436 q17 1829152815131513 q18 8024791277367736 q19 1775152416921524 q20 2975188918901889 q21 5071504047324732 q22 583 498 524 498 Total cold run time: 72901 ms Total hot run time: 55871 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](dockerfile) Switch repos to point to to vault.centos.org because CentOS 7 is EOL (#37568) [doris]
morningman opened a new pull request, #37763: URL: https://github.com/apache/doris/pull/37763 bp #37568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](dockerfile) Switch repos to point to to vault.centos.org because CentOS 7 is EOL (#37568) [doris]
doris-robot commented on PR #37763: URL: https://github.com/apache/doris/pull/37763#issuecomment-2227362843 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
