Re: [PR] [enhance](Cloud) Add GCP enum for ObjectStoreInfoPB [doris]
dataroaring merged PR #34100: URL: https://github.com/apache/doris/pull/34100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix rule SimplifyWindowExpression [doris]
yiguolei merged PR #34099: URL: https://github.com/apache/doris/pull/34099 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (b95b37bf027 -> 48a306149c1)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from b95b37bf027 [enhance](Cloud) Add GCP enum for ObjectStoreInfoPB (#34100) add 48a306149c1 [Fix](nereids) fix rule SimplifyWindowExpression (#34099) No new revisions were added by this update. Summary of changes: .../rules/rewrite/SimplifyWindowExpression.java| 12 +++- .../simplify_window_expression.out | 67 +- .../simplify_window_expression.groovy | 3 + 3 files changed, 53 insertions(+), 29 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [enhance](Cloud) Add GCP enum for ObjectStoreInfoPB (#34100)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new b95b37bf027 [enhance](Cloud) Add GCP enum for ObjectStoreInfoPB
(#34100)
b95b37bf027 is described below
commit b95b37bf0279f2a116c8ec84c6830bcf6423ccf4
Author: AlexYue
AuthorDate: Thu Apr 25 15:00:36 2024 +0800
[enhance](Cloud) Add GCP enum for ObjectStoreInfoPB (#34100)
---
fe/fe-core/src/main/java/org/apache/doris/cloud/storage/RemoteBase.java | 1 +
gensrc/proto/cloud.proto| 1 +
2 files changed, 2 insertions(+)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/cloud/storage/RemoteBase.java
b/fe/fe-core/src/main/java/org/apache/doris/cloud/storage/RemoteBase.java
index 7b12be88d74..e146e52f534 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/cloud/storage/RemoteBase.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/cloud/storage/RemoteBase.java
@@ -140,6 +140,7 @@ public abstract class RemoteBase {
switch (obj.provider) {
case OSS:
return new OssRemote(obj);
+case GCP:
case S3:
return new S3Remote(obj);
case COS:
diff --git a/gensrc/proto/cloud.proto b/gensrc/proto/cloud.proto
index 0ed9b693988..f132e2eab4d 100644
--- a/gensrc/proto/cloud.proto
+++ b/gensrc/proto/cloud.proto
@@ -176,6 +176,7 @@ message ObjectStoreInfoPB {
COS = 2;
OBS = 3;
BOS = 4;
+GCP = 5;
}
optional int64 ctime = 1;
optional int64 mtime = 2;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Bug] catch an exception when setup bdb environment. will exit. java.lang.NullPointerException: null [doris]
f3f34 opened a new issue, #34106: URL: https://github.com/apache/doris/issues/34106 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version V1.1.3 -FE ### What's Wrong? 2024-04-25 14:52:18,078 INFO (main|1) [Catalog.getClusterIdAndRole():1079] finished to get cluster id: 1939777199, role: FOLLOWER and node name: 127.0.0.1_9010_1714027826027 2024-04-25 14:52:18,087 INFO (main|1) [Catalog.loadImage():1617] image does not exist: /mnt/log/doris/doris-meta/image/image.0 2024-04-25 14:52:18,294 ERROR (main|1) [BDBJEJournal.open():306] catch an exception when setup bdb environment. will exit. java.lang.NullPointerException: null at com.sleepycat.je.dbi.EnvironmentImpl.requestShutdownDaemons(EnvironmentImpl.java:2407) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.dbi.EnvironmentImpl.invalidate(EnvironmentImpl.java:1738) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.rep.impl.RepImpl.invalidate(RepImpl.java:2202) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.EnvironmentFailureException.(EnvironmentFailureException.java:170) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.EnvironmentFailureException.unexpectedException(EnvironmentFailureException.java:369) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.cleaner.Cleaner.(Cleaner.java:358) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.dbi.EnvironmentImpl.(EnvironmentImpl.java:690) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.rep.impl.RepImpl.(RepImpl.java:328) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_332] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_332] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_332] at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_332] at com.sleepycat.je.dbi.DbEnvPool.loadRepImpl(DbEnvPool.java:261) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:195) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:278) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.Environment.(Environment.java:258) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:605) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:464) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:538) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT] at org.apache.doris.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:153) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:303) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.persist.EditLog.open(EditLog.java:847) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.catalog.Catalog.initialize(Catalog.java:852) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.PaloFe.start(PaloFe.java:128) ~[doris-fe.jar:1.0-SNAPSHOT] at org.apache.doris.PaloFe.main(PaloFe.java:63) ~[doris-fe.jar:1.0-SNAPSHOT] 。 This exception occurs during FE startup in the chroot environment。 bash-4.1# cat /proc/mounts proc /proc proc rw,relatime 0 0 sysfs /sys sysfs rw,relatime 0 0 devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /dev/shm tmpfs rw,relatime 0 0 ### What You Expected? 41/1 实时翻译 划译 The solution is that FE can be started in Choort, and now only BE can be started in chroot. ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: co
[PR] change document for superset [doris-website]
wyx123654 opened a new pull request, #589: URL: https://github.com/apache/doris-website/pull/589 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 01/05: Fix remote scan pool (#33976)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 47b54d4bd57982e35b9ead4119b7c1b044f48c86
Author: wangbo
AuthorDate: Thu Apr 25 10:11:56 2024 +0800
Fix remote scan pool (#33976)
---
be/src/runtime/workload_group/workload_group.cpp | 31 +--
be/src/vec/exec/scan/scanner_scheduler.cpp | 24 +---
be/src/vec/exec/scan/scanner_scheduler.h | 26 +
.../resource/workloadgroup/WorkloadGroup.java | 11
.../data/workload_manager_p0/test_curd_wlg.out | 24
.../workload_manager_p0/test_curd_wlg.groovy | 64 ++
6 files changed, 145 insertions(+), 35 deletions(-)
diff --git a/be/src/runtime/workload_group/workload_group.cpp
b/be/src/runtime/workload_group/workload_group.cpp
index 673263f1a17..c82346f040e 100644
--- a/be/src/runtime/workload_group/workload_group.cpp
+++ b/be/src/runtime/workload_group/workload_group.cpp
@@ -295,7 +295,8 @@ Status WorkloadGroupInfo::parse_topic_info(const
TWorkloadGroupInfo& tworkload_g
}
// 10 max remote scan thread num
-workload_group_info->max_remote_scan_thread_num =
config::doris_scanner_thread_pool_thread_num;
+workload_group_info->max_remote_scan_thread_num =
+vectorized::ScannerScheduler::get_remote_scan_thread_num();
if (tworkload_group_info.__isset.max_remote_scan_thread_num &&
tworkload_group_info.max_remote_scan_thread_num > 0) {
workload_group_info->max_remote_scan_thread_num =
@@ -303,7 +304,8 @@ Status WorkloadGroupInfo::parse_topic_info(const
TWorkloadGroupInfo& tworkload_g
}
// 11 min remote scan thread num
-workload_group_info->min_remote_scan_thread_num =
config::doris_scanner_thread_pool_thread_num;
+workload_group_info->min_remote_scan_thread_num =
+vectorized::ScannerScheduler::get_remote_scan_thread_num();
if (tworkload_group_info.__isset.min_remote_scan_thread_num &&
tworkload_group_info.min_remote_scan_thread_num > 0) {
workload_group_info->min_remote_scan_thread_num =
@@ -384,23 +386,18 @@ void
WorkloadGroup::upsert_task_scheduler(WorkloadGroupInfo* tg_info, ExecEnv* e
}
}
if (scan_thread_num > 0 && _scan_task_sched) {
-_scan_task_sched->reset_thread_num(scan_thread_num);
+_scan_task_sched->reset_thread_num(scan_thread_num, scan_thread_num);
}
if (_remote_scan_task_sched == nullptr) {
-int remote_max_thread_num =
-config::doris_max_remote_scanner_thread_pool_thread_num != -1
-?
config::doris_max_remote_scanner_thread_pool_thread_num
-: std::max(512, CpuInfo::num_cores() * 10);
-remote_max_thread_num =
-std::max(remote_max_thread_num,
config::doris_scanner_thread_pool_thread_num);
-
+int remote_max_thread_num =
vectorized::ScannerScheduler::get_remote_scan_thread_num();
+int remote_scan_thread_queue_size =
+
vectorized::ScannerScheduler::get_remote_scan_thread_queue_size();
std::unique_ptr
remote_scan_scheduler =
std::make_unique("RScan_"
+ tg_name,
cg_cpu_ctl_ptr);
-Status ret =
-remote_scan_scheduler->start(remote_max_thread_num,
remote_max_thread_num,
-
config::doris_remote_scanner_thread_pool_queue_size);
+Status ret = remote_scan_scheduler->start(remote_max_thread_num,
remote_max_thread_num,
+
remote_scan_thread_queue_size);
if (ret.ok()) {
_remote_scan_task_sched = std::move(remote_scan_scheduler);
} else {
@@ -408,11 +405,9 @@ void
WorkloadGroup::upsert_task_scheduler(WorkloadGroupInfo* tg_info, ExecEnv* e
<< tg_id;
}
}
-if (max_remote_scan_thread_num > 0 && _remote_scan_task_sched) {
-
_remote_scan_task_sched->reset_max_thread_num(max_remote_scan_thread_num);
-}
-if (min_remote_scan_thread_num > 0 && _remote_scan_task_sched) {
-
_remote_scan_task_sched->reset_min_thread_num(min_remote_scan_thread_num);
+if (max_remote_scan_thread_num >= min_remote_scan_thread_num &&
_remote_scan_task_sched) {
+_remote_scan_task_sched->reset_thread_num(max_remote_scan_thread_num,
+ min_remote_scan_thread_num);
}
if (_non_pipe_thread_pool == nullptr) {
diff --git a/be/src/vec/exec/scan/scanner_scheduler.cpp
b/be/src/vec/exec/scan/scanner_scheduler.cpp
index 571df35e55e..eba62dcf19a 100644
--- a/be/src/vec/exec/scan/scanner_scheduler.cpp
+++ b/be/src/vec/exec/scan/scanner_scheduler.cpp
@@ -97,14 +97,10 @@ Status ScannerScheduler::init(ExecEnv* env) {
confi
(doris) 05/05: [Fix](nereids) fix rule SimplifyWindowExpression (#34099)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 987f7552065635a202f0cb49c5a4d83bd235bc4e
Author: feiniaofeiafei <53502832+feiniaofeia...@users.noreply.github.com>
AuthorDate: Thu Apr 25 15:01:55 2024 +0800
[Fix](nereids) fix rule SimplifyWindowExpression (#34099)
Co-authored-by: feiniaofeiafei
---
.../rules/rewrite/SimplifyWindowExpression.java| 12 +++-
.../simplify_window_expression.out | 67 +-
.../simplify_window_expression.groovy | 3 +
3 files changed, 53 insertions(+), 29 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SimplifyWindowExpression.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SimplifyWindowExpression.java
index 872ca789818..c0548a42579 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SimplifyWindowExpression.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SimplifyWindowExpression.java
@@ -27,10 +27,12 @@ import
org.apache.doris.nereids.trees.expressions.NamedExpression;
import org.apache.doris.nereids.trees.expressions.Slot;
import org.apache.doris.nereids.trees.expressions.WindowExpression;
import org.apache.doris.nereids.trees.expressions.functions.BoundFunction;
+import org.apache.doris.nereids.trees.expressions.functions.agg.Count;
import org.apache.doris.nereids.trees.expressions.literal.TinyIntLiteral;
import org.apache.doris.nereids.trees.plans.Plan;
import org.apache.doris.nereids.trees.plans.logical.LogicalProject;
import org.apache.doris.nereids.trees.plans.logical.LogicalWindow;
+import org.apache.doris.nereids.util.TypeCoercionUtils;
import com.google.common.collect.ImmutableList;
import com.google.common.collect.ImmutableSet;
@@ -87,11 +89,13 @@ public class SimplifyWindowExpression extends
OneRewriteRuleFactory {
if (function instanceof BoundFunction) {
BoundFunction boundFunction = (BoundFunction) function;
String name = ((BoundFunction) function).getName();
-if ((name.equals(COUNT) &&
boundFunction.child(0).notNullable())
+if ((name.equals(COUNT) && checkCount((Count) boundFunction))
|| REWRRITE_TO_CONST_WINDOW_FUNCTIONS.contains(name)) {
projectionsBuilder.add(new Alias(alias.getExprId(), new
TinyIntLiteral((byte) 1), alias.getName()));
} else if (REWRRITE_TO_SLOT_WINDOW_FUNCTIONS.contains(name)) {
-projectionsBuilder.add(new Alias(alias.getExprId(),
boundFunction.child(0), alias.getName()));
+projectionsBuilder.add(new Alias(alias.getExprId(),
+
TypeCoercionUtils.castIfNotSameType(boundFunction.child(0),
boundFunction.getDataType()),
+alias.getName()));
} else {
remainWindowExpression.add(expr);
}
@@ -120,4 +124,8 @@ public class SimplifyWindowExpression extends
OneRewriteRuleFactory {
window.child(0)));
}
}
+
+private boolean checkCount(Count count) {
+return count.isCountStar() || count.child(0).notNullable();
+}
}
diff --git
a/regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_expression.out
b/regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_expression.out
index 3befc3dcbb2..e660cd7702c 100644
---
a/regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_expression.out
+++
b/regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_expression.out
@@ -119,28 +119,28 @@
-- !select_avg --
\N \N \N
\N \N \N
-1 1 1
-1 1 1
-2 2 2
-3 3 3
-3 3 3
-4 4 4
-5 5 5
-5 5 5
-7 7 7
+1 1.0 1.0
+1 1.0 1.0
+2 2.0 2.0
+3 3.0 3.0
+3 3.0 3.0
+4 4.0 4.0
+5 5.0 5.0
+5 5.0 5.0
+7 7.0 7.0
-- !more_than_pk --
\N \N \N
\N \N \N
-1 1 1
-1 1 1
-2 2 2
-3 3 3
-3 3 3
-4 4 4
-5 5 5
-5 5 5
-7 7 7
+1 1.0 1.0
+1 1.0 1.0
+2 2.0 2.0
+3 3.0 3.0
+3 3.0 3.0
+4 4.0 4.0
+5 5.0 5.0
+5 5.0 5.0
+7 7.0 7.0
-- !select_last_value_shape --
PhysicalResultSink
@@ -163,18 +163,31 @@ PhysicalResultSink
--filter((mal_test_simplify_window.__DORIS_DELETE_SIGN__ = 0))
PhysicalOlapScan[mal_test_simplify_window]
+-- !select_count_star_col1 --
+\N 1 1
+1 1 1
+1 1 1
+2 1 1
+2
(doris) 04/05: [fix](scan) fix ignore expr exec when _non_predicate_columns is empty (#33934)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit f34fe46bfa0fe43be4093933a02a40492fed34ad
Author: Mryange <59914473+mrya...@users.noreply.github.com>
AuthorDate: Thu Apr 25 14:06:15 2024 +0800
[fix](scan) fix ignore expr exec when _non_predicate_columns is empty
(#33934)
fix ignore expr exec when _non_predicate_columns is empty
---
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 17 +++--
1 file changed, 11 insertions(+), 6 deletions(-)
diff --git a/be/src/olap/rowset/segment_v2/segment_iterator.cpp
b/be/src/olap/rowset/segment_v2/segment_iterator.cpp
index ccdc0577a6b..d4ae8cf3324 100644
--- a/be/src/olap/rowset/segment_v2/segment_iterator.cpp
+++ b/be/src/olap/rowset/segment_v2/segment_iterator.cpp
@@ -1956,14 +1956,16 @@ void SegmentIterator::_replace_version_col(size_t
num_rows) {
uint16_t SegmentIterator::_evaluate_vectorization_predicate(uint16_t*
sel_rowid_idx,
uint16_t
selected_size) {
SCOPED_RAW_TIMER(&_opts.stats->vec_cond_ns);
-if (_is_need_vec_eval) {
-_is_need_vec_eval = false;
-for (const auto& pred : _pre_eval_block_predicate) {
-_is_need_vec_eval |= (!pred->always_true());
+bool all_pred_always_true = true;
+for (const auto& pred : _pre_eval_block_predicate) {
+if (!pred->always_true()) {
+all_pred_always_true = false;
+break;
}
}
-if (!_is_need_vec_eval) {
-for (uint32_t i = 0; i < selected_size; ++i) {
+//If all predicates are always_true, then return directly.
+if (all_pred_always_true || !_is_need_vec_eval) {
+for (uint16_t i = 0; i < selected_size; ++i) {
sel_rowid_idx[i] = i;
}
return selected_size;
@@ -2247,6 +2249,9 @@ Status
SegmentIterator::_next_batch_internal(vectorized::Block* block) {
}
if (!_is_need_vec_eval && !_is_need_short_eval && !_is_need_expr_eval) {
+if (_non_predicate_columns.empty()) {
+return Status::InternalError("_non_predicate_columns is empty");
+}
RETURN_IF_ERROR(_convert_to_expected_type(_first_read_column_ids));
RETURN_IF_ERROR(_convert_to_expected_type(_non_predicate_columns));
_output_non_pred_columns(block);
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated (5f2d0e3d534 -> 987f7552065)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 5f2d0e3d534 [Fix](executor)Fix when Fe send empty wg list to be may
cause query failed. (#34074)
new 47b54d4bd57 Fix remote scan pool (#33976)
new 789a16ec6b6 [fix](fe) Fix SHOW CREATE TABLE with AUTO PARTITION
(#34071)
new c2e3defe56f [fix](tablet invert index) fix tablet invert index leaky
caused by auto partition (#33973)
new f34fe46bfa0 [fix](scan) fix ignore expr exec when
_non_predicate_columns is empty (#33934)
new 987f7552065 [Fix](nereids) fix rule SimplifyWindowExpression (#34099)
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 17 --
be/src/runtime/workload_group/workload_group.cpp | 31 +-
be/src/vec/exec/scan/scanner_scheduler.cpp | 24 +---
be/src/vec/exec/scan/scanner_scheduler.h | 26 +
.../apache/doris/catalog/RangePartitionInfo.java | 10 +---
.../apache/doris/datasource/InternalCatalog.java | 24
.../rules/rewrite/SimplifyWindowExpression.java| 12 +++-
.../resource/workloadgroup/WorkloadGroup.java | 11
.../apache/doris/alter/AddExistsPartitionTest.java | 56 ++
.../apache/doris/utframe/TestWithFeService.java| 3 +-
.../simplify_window_expression.out | 67 +-
.../data/workload_manager_p0/test_curd_wlg.out | 24
.../test_create_table_auto_partition.groovy} | 37 ++--
.../simplify_window_expression.groovy | 3 +
.../workload_manager_p0/test_curd_wlg.groovy | 64 +
15 files changed, 301 insertions(+), 108 deletions(-)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/alter/AddExistsPartitionTest.java
copy regression-test/suites/{datatype_p0/ip/test_ip_implicit_cast.groovy =>
ddl_p0/test_create_table_auto_partition.groovy} (52%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 02/05: [fix](fe) Fix SHOW CREATE TABLE with AUTO PARTITION (#34071)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 789a16ec6b696aa55af02463ab3531255453495d
Author: walter
AuthorDate: Thu Apr 25 11:09:12 2024 +0800
[fix](fe) Fix SHOW CREATE TABLE with AUTO PARTITION (#34071)
AUTO PARTITION grammar has changed since #31585, but the output
of SHOW CREATE TABLE was left out to change, so the result is not
able to be recognized by the FE parser.
---
.../apache/doris/catalog/RangePartitionInfo.java | 10 +
.../ddl_p0/test_create_table_auto_partition.groovy | 45 ++
2 files changed, 47 insertions(+), 8 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/catalog/RangePartitionInfo.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/RangePartitionInfo.java
index 952fa88d259..9a6c5d353fd 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/RangePartitionInfo.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/RangePartitionInfo.java
@@ -23,7 +23,6 @@ import org.apache.doris.analysis.PartitionDesc;
import org.apache.doris.analysis.PartitionKeyDesc;
import org.apache.doris.analysis.RangePartitionDesc;
import org.apache.doris.analysis.SinglePartitionDesc;
-import org.apache.doris.analysis.SlotRef;
import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.DdlException;
import org.apache.doris.common.util.RangeUtils;
@@ -266,14 +265,9 @@ public class RangePartitionInfo extends PartitionInfo {
if (enableAutomaticPartition()) {
sb.append("AUTO PARTITION BY RANGE ");
for (Expr e : partitionExprs) {
-boolean isSlotRef = (e instanceof SlotRef);
-if (isSlotRef) {
-sb.append("(");
-}
+sb.append("(");
sb.append(e.toSql());
-if (isSlotRef) {
-sb.append(")");
-}
+sb.append(")");
}
sb.append("\n(");
} else {
diff --git
a/regression-test/suites/ddl_p0/test_create_table_auto_partition.groovy
b/regression-test/suites/ddl_p0/test_create_table_auto_partition.groovy
new file mode 100644
index 000..a9ca68a8777
--- /dev/null
+++ b/regression-test/suites/ddl_p0/test_create_table_auto_partition.groovy
@@ -0,0 +1,45 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+// this suite is for creating table with timestamp datatype in defferent
+// case. For example: 'year' and 'Year' datatype should also be valid in
definition
+
+
+suite("test_create_table_auto_partition") {
+def testTable = "test_create_table_auto_partition_table"
+
+sql "DROP TABLE IF EXISTS ${testTable}"
+sql """
+CREATE TABLE `${testTable}` (
+`TIME_STAMP` datev2 NOT NULL COMMENT 'Date of collection'
+) ENGINE=OLAP
+DUPLICATE KEY(`TIME_STAMP`)
+AUTO PARTITION BY RANGE (date_trunc(`TIME_STAMP`, 'month'))
+(
+)
+DISTRIBUTED BY HASH(`TIME_STAMP`) BUCKETS 10
+PROPERTIES (
+"replication_allocation" = "tag.location.default: 1"
+);
+"""
+
+// The AUTO PARTITION func call must wrapped with ().
+def text = sql_return_maparray "show create table ${testTable}"
+def createTable = text[0]['Create Table']
+assertTrue(createTable.contains("AUTO PARTITION BY RANGE
(date_trunc(`TIME_STAMP`, 'month')"))
+}
+
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 03/05: [fix](tablet invert index) fix tablet invert index leaky caused by auto partition (#33973)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit c2e3defe56f210161a625bcbdbe0583a4f75588f
Author: yujun
AuthorDate: Thu Apr 25 11:13:01 2024 +0800
[fix](tablet invert index) fix tablet invert index leaky caused by auto
partition (#33973)
---
.../apache/doris/datasource/InternalCatalog.java | 24 ++
.../apache/doris/alter/AddExistsPartitionTest.java | 56 ++
.../apache/doris/utframe/TestWithFeService.java| 3 +-
3 files changed, 72 insertions(+), 11 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
b/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
index ea33e30f861..5934b18211a 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/datasource/InternalCatalog.java
@@ -1415,8 +1415,10 @@ public class InternalCatalog implements
CatalogIf {
// check partition name
if (olapTable.checkPartitionNameExist(partitionName)) {
if (singlePartitionDesc.isSetIfNotExists()) {
-LOG.info("add partition[{}] which already exists",
partitionName);
-return;
+LOG.info("table[{}] add partition[{}] which already
exists", olapTable.getName(), partitionName);
+if
(!DebugPointUtil.isEnable("InternalCatalog.addPartition.noCheckExists")) {
+return;
+}
} else {
ErrorReport.reportDdlException(ErrorCode.ERR_SAME_NAME_PARTITION,
partitionName);
}
@@ -1573,6 +1575,11 @@ public class InternalCatalog implements
CatalogIf {
if (!Strings.isNullOrEmpty(dataProperty.getStoragePolicy())) {
storagePolicy = dataProperty.getStoragePolicy();
}
+Runnable failedCleanCallback = () -> {
+for (Long tabletId : tabletIdSet) {
+Env.getCurrentInvertedIndex().deleteTablet(tabletId);
+}
+};
try {
long partitionId = idGeneratorBuffer.getNextId();
Partition partition = createPartitionWithIndices(db.getId(),
olapTable,
@@ -1592,8 +1599,9 @@ public class InternalCatalog implements
CatalogIf {
olapTable.checkNormalStateForAlter();
// check partition name
if (olapTable.checkPartitionNameExist(partitionName)) {
+LOG.info("table[{}] add partition[{}] which already
exists", olapTable.getName(), partitionName);
if (singlePartitionDesc.isSetIfNotExists()) {
-LOG.info("add partition[{}] which already exists",
partitionName);
+failedCleanCallback.run();
return;
} else {
ErrorReport.reportDdlException(ErrorCode.ERR_SAME_NAME_PARTITION,
partitionName);
@@ -1642,8 +1650,6 @@ public class InternalCatalog implements
CatalogIf {
}
}
-
-
if (metaChanged) {
throw new DdlException("Table[" + tableName + "]'s meta
has been changed. try again.");
}
@@ -1685,9 +1691,7 @@ public class InternalCatalog implements
CatalogIf {
olapTable.writeUnlock();
}
} catch (DdlException e) {
-for (Long tabletId : tabletIdSet) {
-Env.getCurrentInvertedIndex().deleteTablet(tabletId);
-}
+failedCleanCallback.run();
throw e;
}
}
@@ -2735,10 +2739,10 @@ public class InternalCatalog implements
CatalogIf {
Env.getCurrentEnv().getEditLog().logColocateAddTable(info);
}
LOG.info("successfully create table[{};{}]", tableName,
tableId);
-// register or remove table from DynamicPartition after table
created
-
DynamicPartitionUtil.registerOrRemoveDynamicPartitionTable(db.getId(),
olapTable, false);
Env.getCurrentEnv().getDynamicPartitionScheduler()
.executeDynamicPartitionFirstTime(db.getId(),
olapTable.getId());
+// register or remove table from DynamicPartition after table
created
+
DynamicPartitionUtil.registerOrRemoveDynamicPartitionTable(db.getId(),
olapTable, false);
Env.getCurrentEnv().getDynamicPartitionScheduler()
.createOrUpdateRuntimeInfo(tableId,
DynamicPartitionScheduler.LAST_UPDATE_TIME,
TimeUtils.getCurrentFormatTime());
diff --git
a/fe/fe-core/src/test/java/org/apache/doris/alter/AddExistsPartitionTest.java
b/fe/fe-core/src/test/java/org/apache/doris/alter/AddExi
(doris) branch branch-2.1 updated: [Improvementation](join) empty_block shall be set true when build blo… (#33977)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new e3ed861e4b6 [Improvementation](join) empty_block shall be set true
when build blo… (#33977)
e3ed861e4b6 is described below
commit e3ed861e4b6a602ea874b6501998578952291f38
Author: Pxl
AuthorDate: Thu Apr 25 11:40:05 2024 +0800
[Improvementation](join) empty_block shall be set true when build blo…
(#33977)
empty_block shall be set true when build block only one row
---
be/src/pipeline/exec/hashjoin_build_sink.cpp | 17 ++---
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 80 ++
be/src/pipeline/exec/hashjoin_probe_operator.h | 9 +--
be/src/vec/core/column_with_type_and_name.cpp | 12 ++--
.../join/test_half_join_nullable_build_side.out| 6 ++
.../join/test_half_join_nullable_build_side.groovy | 4 ++
6 files changed, 67 insertions(+), 61 deletions(-)
diff --git a/be/src/pipeline/exec/hashjoin_build_sink.cpp
b/be/src/pipeline/exec/hashjoin_build_sink.cpp
index a0d111c63a7..2b2bdad86f7 100644
--- a/be/src/pipeline/exec/hashjoin_build_sink.cpp
+++ b/be/src/pipeline/exec/hashjoin_build_sink.cpp
@@ -156,21 +156,22 @@ bool HashJoinBuildSinkLocalState::build_unique() const {
void HashJoinBuildSinkLocalState::init_short_circuit_for_probe() {
auto& p = _parent->cast();
+bool empty_block =
+!_shared_state->build_block ||
+!(_shared_state->build_block->rows() > 1); // build size always
mock a row into block
_shared_state->short_circuit_for_probe =
(_shared_state->_has_null_in_build_side &&
p._join_op == TJoinOp::NULL_AWARE_LEFT_ANTI_JOIN &&
!p._is_mark_join) ||
-(!_shared_state->build_block && p._join_op == TJoinOp::INNER_JOIN
&&
- !p._is_mark_join) ||
-(!_shared_state->build_block && p._join_op ==
TJoinOp::LEFT_SEMI_JOIN &&
- !p._is_mark_join) ||
-(!_shared_state->build_block && p._join_op ==
TJoinOp::RIGHT_OUTER_JOIN) ||
-(!_shared_state->build_block && p._join_op ==
TJoinOp::RIGHT_SEMI_JOIN) ||
-(!_shared_state->build_block && p._join_op ==
TJoinOp::RIGHT_ANTI_JOIN);
+(empty_block && p._join_op == TJoinOp::INNER_JOIN &&
!p._is_mark_join) ||
+(empty_block && p._join_op == TJoinOp::LEFT_SEMI_JOIN &&
!p._is_mark_join) ||
+(empty_block && p._join_op == TJoinOp::RIGHT_OUTER_JOIN) ||
+(empty_block && p._join_op == TJoinOp::RIGHT_SEMI_JOIN) ||
+(empty_block && p._join_op == TJoinOp::RIGHT_ANTI_JOIN);
//when build table rows is 0 and not have other_join_conjunct and not
_is_mark_join and join type is one of
LEFT_OUTER_JOIN/FULL_OUTER_JOIN/LEFT_ANTI_JOIN
//we could get the result is probe table + null-column(if need output)
_shared_state->empty_right_table_need_probe_dispose =
-(!_shared_state->build_block && !p._have_other_join_conjunct &&
!p._is_mark_join) &&
+(empty_block && !p._have_other_join_conjunct && !p._is_mark_join)
&&
(p._join_op == TJoinOp::LEFT_OUTER_JOIN || p._join_op ==
TJoinOp::FULL_OUTER_JOIN ||
p._join_op == TJoinOp::LEFT_ANTI_JOIN);
}
diff --git a/be/src/pipeline/exec/hashjoin_probe_operator.cpp
b/be/src/pipeline/exec/hashjoin_probe_operator.cpp
index a58ad62211c..fc6f81f4190 100644
--- a/be/src/pipeline/exec/hashjoin_probe_operator.cpp
+++ b/be/src/pipeline/exec/hashjoin_probe_operator.cpp
@@ -247,7 +247,7 @@ Status HashJoinProbeOperatorX::pull(doris::RuntimeState*
state, vectorized::Bloc
}
//TODO: this short circuit maybe could refactor, no need to check at here.
-if (local_state._shared_state->empty_right_table_need_probe_dispose) {
+if (local_state.empty_right_table_shortcut()) {
// when build table rows is 0 and not have other_join_conjunct and
join type is one of LEFT_OUTER_JOIN/FULL_OUTER_JOIN/LEFT_ANTI_JOIN
// we could get the result is probe table + null-column(if need output)
// If we use a short-circuit strategy, should return block directly by
add additional null data.
@@ -257,12 +257,6 @@ Status HashJoinProbeOperatorX::pull(doris::RuntimeState*
state, vectorized::Bloc
return Status::OK();
}
-vectorized::Block temp_block;
-//get probe side output column
-for (int i = 0; i < _left_output_slot_flags.size(); ++i) {
-temp_block.insert(local_state._probe_block.get_by_position(i));
-}
-
//create build side null column, if need output
for (int i = 0;
(_join_op != TJoinOp::LEFT_ANTI_JOIN) && i <
_right_output_slot_flags.size(); ++i) {
@@ -273,8 +267,8 @@ Status HashJoinProbeOperatorX::pull(doris::RuntimeState*
state, vectorized::Bloc
Re: [PR] [feature](Cloud) Load index data into index cache when writing data [doris]
ByteYue commented on PR #34046: URL: https://github.com/apache/doris/pull/34046#issuecomment-2076528008 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Materialization context and mtmv decoupling [doris]
github-actions[bot] commented on PR #34093: URL: https://github.com/apache/doris/pull/34093#issuecomment-2076536355 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Cloud) Load index data into index cache when writing data [doris]
github-actions[bot] commented on PR #34046: URL: https://github.com/apache/doris/pull/34046#issuecomment-2076534710 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Planner) convert varchar column to string when ctas from external table [doris]
morrySnow commented on PR #34103: URL: https://github.com/apache/doris/pull/34103#issuecomment-2076536171 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Materialization context and mtmv decoupling [doris]
github-actions[bot] commented on PR #34093: URL: https://github.com/apache/doris/pull/34093#issuecomment-2076536409 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [RuntimeFilter] (JDBC) jdbc scan node support IN/MIN_MAX runtime filter [doris]
DarvenDuan commented on PR #31741: URL: https://github.com/apache/doris/pull/31741#issuecomment-2076538226 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](cloud): fix parent directory doesn't exist in HdfsFileWriter (#33985)
This is an automated email from the ASF dual-hosted git repository.
weixiang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 693a4852218 [fix](cloud): fix parent directory doesn't exist in
HdfsFileWriter (#33985)
693a4852218 is described below
commit 693a48522187546ec1e1a8519336524c6cb9baa6
Author: spaces-x
AuthorDate: Thu Apr 25 15:25:23 2024 +0800
[fix](cloud): fix parent directory doesn't exist in HdfsFileWriter (#33985)
Co-authored-by: weixiang06
---
be/src/io/fs/hdfs_file_writer.cpp | 15 +++
1 file changed, 15 insertions(+)
diff --git a/be/src/io/fs/hdfs_file_writer.cpp
b/be/src/io/fs/hdfs_file_writer.cpp
index d15745ebf37..c596c0e290f 100644
--- a/be/src/io/fs/hdfs_file_writer.cpp
+++ b/be/src/io/fs/hdfs_file_writer.cpp
@@ -281,6 +281,21 @@ Result HdfsFileWriter::create(Path
full_path, std::shared_ptrhdfs_fs, hdfs_dir.c_str());
+if (exists != 0) {
+VLOG_NOTICE << "hdfs dir doesn't exist, create it: " << hdfs_dir;
+int ret = hdfsCreateDirectory(handler->hdfs_fs, hdfs_dir.c_str());
+if (ret != 0) {
+std::stringstream ss;
+ss << "create dir failed. "
+ << " fs_name: " << fs_name << " path: " << hdfs_dir << ", err:
" << hdfs_error();
+LOG(WARNING) << ss.str();
+return ResultError(Status::InternalError(ss.str()));
+}
+}
+#endif
// open file
hdfsFile hdfs_file = nullptr;
{
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud): fix parent directory doesn't exist in HdfsFileWriter [doris]
spaces-X merged PR #33985: URL: https://github.com/apache/doris/pull/33985 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] parent directory doesn't exist in HdfsFileWriter [doris]
spaces-X closed issue #33983: [Bug] parent directory doesn't exist in HdfsFileWriter URL: https://github.com/apache/doris/issues/33983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](pipeline) Use hash shuffle for 1-phase Agg/Analytic operator [doris]
Gabriel39 commented on PR #34075: URL: https://github.com/apache/doris/pull/34075#issuecomment-2076544721 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](txn insert) txn insert support write to one table many times [doris]
mymeiyi commented on PR #32980: URL: https://github.com/apache/doris/pull/32980#issuecomment-2076544832 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](shuffle) enable strict consistency dml by default [doris]
kaijchen commented on PR #32958: URL: https://github.com/apache/doris/pull/32958#issuecomment-2076548409 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhencement](Nereids) add string to length rule [doris]
LiBinfeng-01 commented on PR #34102: URL: https://github.com/apache/doris/pull/34102#issuecomment-2076549947 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](pipeline) Use hash shuffle for 1-phase Agg/Analytic operator [doris]
github-actions[bot] commented on PR #34075: URL: https://github.com/apache/doris/pull/34075#issuecomment-2076554797 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Planner) convert varchar column to string when ctas from external table [doris]
doris-robot commented on PR #34103: URL: https://github.com/apache/doris/pull/34103#issuecomment-2076567610 TPC-H: Total hot run time: 49484 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 6518fc4020328ffbd5e1755667dc0db4b0498380, data reload: false -- Round 1 -- q1 17653 440543014301 q2 2028150 143 143 q3 10471 188619111886 q4 10383 123813361238 q5 8397388638813881 q6 230 124 123 123 q7 2048160815891589 q8 9505271027142710 q9 13673 10142 10371 10142 q10 8646351135243511 q11 416 239 240 239 q12 469 298 306 298 q13 18338 396340313963 q14 353 323 328 323 q15 500 455 452 452 q16 661 560 559 559 q17 1127933 928 928 q18 7263694368906890 q19 1681157515651565 q20 527 313 310 310 q21 4455413040404040 q22 480 400 393 393 Total cold run time: 119304 ms Total hot run time: 49484 ms - Round 2, with runtime_filter_mode=off - q1 4362429742924292 q2 317 223 213 213 q3 4160416041394139 q4 2744275527482748 q5 7157710371207103 q6 235 114 115 114 q7 3293280227792779 q8 4361439344404393 q9 16839 16609 16763 16609 q10 4211425542224222 q11 744 667 687 667 q12 1044875 838 838 q13 7594372537583725 q14 432 431 425 425 q15 495 457 461 457 q16 727 691 677 677 q17 3822381638653816 q18 8805882887158715 q19 1729167416671667 q20 2346216520862086 q21 8480851084448444 q22 1046946 907 907 Total cold run time: 84943 ms Total hot run time: 79036 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
xinyiZzz opened a new pull request, #34107: URL: https://github.com/apache/doris/pull/34107 This reverts commit 5fee7157ccfc8ed88bc3405eb404a2916b5aac3e. ## Proposed changes #33946 exist two error: 1. unable to use jemalloc heap profile 2. maybe cause jemalloc memory not to be freed. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
doris-robot commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076581195 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
xinyiZzz commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076581293 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [RuntimeFilter] (JDBC) jdbc scan node support IN/MIN_MAX runtime filter [doris]
doris-robot commented on PR #31741: URL: https://github.com/apache/doris/pull/31741#issuecomment-2076581723 TeamCity be ut coverage result: Function Coverage: 35.19% (8917/25342) Line Coverage: 26.95% (73315/272044) Region Coverage: 26.13% (37883/144955) Branch Coverage: 22.94% (19287/84058) Coverage Report: http://coverage.selectdb-in.cc/coverage/982f4cfc4da9cdd8641ff426138adcb3f59865d7_982f4cfc4da9cdd8641ff426138adcb3f59865d7/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](jdbc catalog) Change Jdbc connection pool to hikari [doris]
zy-kkk commented on PR #34045: URL: https://github.com/apache/doris/pull/34045#issuecomment-2076584237 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [blog](update) Cross-Cluster Replication for read-write separation: story of a grocery store brand [doris-website]
KassieZ opened a new pull request, #590: URL: https://github.com/apache/doris-website/pull/590 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Planner) convert varchar column to string when ctas from external table [doris]
doris-robot commented on PR #34103: URL: https://github.com/apache/doris/pull/34103#issuecomment-2076588694 TPC-DS: Total hot run time: 202799 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6518fc4020328ffbd5e1755667dc0db4b0498380, data reload: false query1 918 402 380 380 query2 6524297027432743 query3 6909194 198 194 query4 20179 18018 17984 17984 query5 19729 647564536453 query6 287 218 229 218 query7 4157300 300 300 query8 255 268 269 268 query9 3173274126512651 query10 396 281 285 281 query11 11332 10679 10739 10679 query12 119 75 70 70 query13 5563694 693 693 query14 17873 13501 13398 13398 query15 364 222 223 222 query16 6469268 253 253 query17 17611430864 864 query18 2338399 397 397 query19 202 148 144 144 query20 81 77 75 75 query21 185 92 99 92 query22 5047483748924837 query23 32607 31857 32036 31857 query24 6978647165146471 query25 513 428 415 415 query26 526 160 159 159 query27 1908294 298 294 query28 6252243723942394 query29 2962277528912775 query30 242 161 160 160 query31 921 719 720 719 query32 69 60 57 57 query33 396 249 254 249 query34 859 475 482 475 query35 910 937 910 query36 1338123413281234 query37 89 59 60 59 query38 3112291728762876 query39 1375132013321320 query40 206 96 91 91 query41 37 38 33 33 query42 85 87 84 84 query43 717 797 659 659 query44 1134737 729 729 query45 241 233 218 218 query46 1214961 940 940 query47 1888167017311670 query48 1021716 696 696 query49 629 374 374 374 query50 882 598 645 598 query51 4796468246804680 query52 93 86 77 77 query53 449 317 313 313 query54 2661246124642461 query55 93 72 84 72 query56 226 209 193 193 query57 1253111411441114 query58 221 183 197 183 query59 3923397741223977 query60 219 186 198 186 query61 89 80 80 80 query62 802 530 475 475 query63 467 333 330 330 query64 2385155814141414 query65 3630359135333533 query66 816 366 381 366 query67 15788 16927 15093 15093 query68 8283657 677 657 query69 559 344 344 344 query70 1664150014671467 query71 390 313 300 300 query72 6427343034313430 query73 731 305 310 305 query74 6365583858065806 query75 4613372336803680 query76 4648118311761176 query77 580 244 247 244 query78 12531 11549 12039 11549 query79 10268 644 677 644 query80 1276400 422 400 query81 497 225 236 225 query82 154395 95 95 query83 166 131 131 131 query84 258 68 66 66 query85 986 307 299 299 query86 333 291 297 291 query87 3238299830442998 query88 5076232123342321 query89 422 286 266 266 query90 1864207 196 196 query91 180 134 134 134 query92 61 53 50 50 query93 5825575 590 575 query94 756 205 206 205 query95 1082105810471047 query96 634 339 322 322 query97 6376634763456345 query98 197 188 172 172 query99 2807800 1009800 Total cold run time: 311720 ms Total hot run time: 202799 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
github-actions[bot] commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076590224 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Planner) convert varchar column to string when ctas from external table [doris]
doris-robot commented on PR #34103: URL: https://github.com/apache/doris/pull/34103#issuecomment-2076603674 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 6518fc4020328ffbd5e1755667dc0db4b0498380 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.3 seconds inserted 1000 Rows, about 469K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Planner) convert varchar column to string when ctas from external table [doris]
doris-robot commented on PR #34103: URL: https://github.com/apache/doris/pull/34103#issuecomment-2076598032 ClickBench: Total hot run time: 31.03 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6518fc4020328ffbd5e1755667dc0db4b0498380, data reload: false query1 0.030.030.02 query2 0.070.020.02 query3 0.240.050.05 query4 1.790.080.08 query5 0.530.520.52 query6 1.230.620.60 query7 0.020.020.02 query8 0.040.020.02 query9 0.520.480.47 query10 0.540.530.54 query11 0.120.090.08 query12 0.120.090.09 query13 0.620.630.61 query14 0.770.790.80 query15 0.760.760.77 query16 0.370.400.37 query17 1.011.020.96 query18 0.240.230.25 query19 1.941.881.88 query20 0.020.020.01 query21 15.48 0.590.55 query22 2.262.151.99 query23 16.99 1.120.99 query24 4.451.001.59 query25 0.380.130.05 query26 0.520.180.17 query27 0.040.040.03 query28 8.070.740.72 query29 12.68 2.282.14 query30 0.600.550.56 query31 2.910.400.37 query32 3.390.490.49 query33 3.043.083.05 query34 15.26 4.784.80 query35 4.864.804.84 query36 1.071.011.02 query37 0.060.040.05 query38 0.040.020.02 query39 0.020.010.02 query40 0.160.130.14 query41 0.070.010.01 query42 0.030.010.01 query43 0.020.020.01 Total cold run time: 103.38 s Total hot run time: 31.03 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](Nereids): boost mv rewritting [doris]
XieJiann opened a new pull request, #34108: URL: https://github.com/apache/doris/pull/34108 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](resource)fix check available fail when s3 aws_token is set and reset as, sk faild on be. [doris]
github-actions[bot] commented on PR #34057: URL: https://github.com/apache/doris/pull/34057#issuecomment-2076610692 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](resource)fix check available fail when s3 aws_token is set and reset as, sk faild on be. [doris]
github-actions[bot] commented on PR #34057: URL: https://github.com/apache/doris/pull/34057#issuecomment-2076610769 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): boost mv rewritting [doris]
doris-robot commented on PR #34108: URL: https://github.com/apache/doris/pull/34108#issuecomment-2076610301 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve](expr)first support array_contains for expr push down inverted index [doris]
amorynan commented on PR #32620: URL: https://github.com/apache/doris/pull/32620#issuecomment-2076612888 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Feat](Job) Job supports task execution statistics [doris]
CalvinKirs opened a new pull request, #34109:
URL: https://github.com/apache/doris/pull/34109
## Changes
### Task metadata add jobName
```sql
mysql> desc function tasks("type"="insert");;
+---+--+--+---+-+---+
| Field | Type | Null | Key | Default | Extra |
+---+--+--+---+-+---+
| TaskId| TEXT | No | false | NULL| NONE |
| JobId | TEXT | No | false | NULL| NONE |
| JobName | TEXT | No | false | NULL| NONE |
| Label | TEXT | No | false | NULL| NONE |
| Status| TEXT | No | false | NULL| NONE |
| ErrorMsg | TEXT | No | false | NULL| NONE |
| CreateTime| TEXT | No | false | NULL| NONE |
| FinishTime| TEXT | No | false | NULL| NONE |
| TrackingUrl | TEXT | No | false | NULL| NONE |
| LoadStatistic | TEXT | No | false | NULL| NONE |
| User | TEXT | No | false | NULL| NONE |
+---+--+--+---+-+---+
11 row
```
### Failed tasks cannot be displayed.
We use a LoadManager to store task execution information, but failed tasks
are not stored. Since the entire lifecycle of a task includes the Load Manager,
it must be managed throughout the entire Job Manager.
### Job metadata add succeedCount, failedCount, canceledCount
```sql
mysql> desc function jobs("type"="insert");
+---+--+--+---+-+---+
| Field | Type | Null | Key | Default | Extra |
+---+--+--+---+-+---+
| Id| TEXT | No | false | NULL| NONE |
| Name | TEXT | No | false | NULL| NONE |
| Definer | TEXT | No | false | NULL| NONE |
| ExecuteType | TEXT | No | false | NULL| NONE |
| RecurringStrategy | TEXT | No | false | NULL| NONE |
| Status| TEXT | No | false | NULL| NONE |
| ExecuteSql| TEXT | No | false | NULL| NONE |
| CreateTime| TEXT | No | false | NULL| NONE |
| SucceedTaskCount | TEXT | No | false | NULL| NONE |
| FailedTaskCount | TEXT | No | false | NULL| NONE |
| CanceledTaskCount | TEXT | No | false | NULL| NONE |
| Comment | TEXT | No | false | NULL| NONE |
+---+--+--+---+-+---+
12 rows in set (0.01 sec)
```
We have added the fields SucceedTaskCount, FailedTaskCount,
RunningTaskCount, and CancelTaskCount. Users want to be able to view the
execution status of tasks, so we included these fields.
## Compatibility:
### Upgrade
Upgrading smoothly without any compatibility issues.
### Rollback
However, if you upgrade to this new version and then roll back to the old
version, the new version's tasks will not be displayed. The new version
deprecates the old task storage method, and the old tasks will be migrated to
the new task storage. Therefore, when rolling back to the old version, the
tasks generated by the new version will not be visible. However, tasks are
primarily responsible for task execution and have a short lifespan, so it will
not have a significant impact on users.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](Job) Job supports task execution statistics [doris]
doris-robot commented on PR #34109: URL: https://github.com/apache/doris/pull/34109#issuecomment-2076621454 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Cloud) Load index data into index cache when writing data [doris]
doris-robot commented on PR #34046: URL: https://github.com/apache/doris/pull/34046#issuecomment-2076623155 TeamCity be ut coverage result: Function Coverage: 35.19% (8916/25340) Line Coverage: 26.97% (73308/271837) Region Coverage: 26.14% (37879/144882) Branch Coverage: 22.96% (19283/83976) Coverage Report: http://coverage.selectdb-in.cc/coverage/f1cadc619e1a7537395a1e9e3ee290eaa0ae8967_f1cadc619e1a7537395a1e9e3ee290eaa0ae8967/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
doris-robot commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076620624 TPC-H: Total hot run time: 39828 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 691421c630cfd5f4a85852695389cd3204a75af9, data reload: false -- Round 1 -- q1 17620 427142254225 q2 2009187 191 187 q3 10475 118511651165 q4 10205 816 744 744 q5 7481271726622662 q6 216 130 136 130 q7 1034595 585 585 q8 9231205920302030 q9 8746661565696569 q10 8721372837333728 q11 448 231 235 231 q12 442 218 227 218 q13 18542 292129802921 q14 261 233 236 233 q15 535 475 470 470 q16 488 384 379 379 q17 954 735 738 735 q18 8073740473297329 q19 6477153214781478 q20 627 311 309 309 q21 4972333632323232 q22 344 268 270 268 Total cold run time: 117901 ms Total hot run time: 39828 ms - Round 2, with runtime_filter_mode=off - q1 4367423642074207 q2 387 252 275 252 q3 3002279426942694 q4 1900156716011567 q5 5371536852915291 q6 210 124 125 124 q7 2221184518911845 q8 3226335533773355 q9 8593858086068580 q10 3888375536813681 q11 573 482 477 477 q12 776 590 563 563 q13 17575 295329762953 q14 294 266 276 266 q15 527 464 460 460 q16 488 410 423 410 q17 1776149014521452 q18 7722744672727272 q19 1635154515441544 q20 1954176117941761 q21 6990475448084754 q22 568 455 486 455 Total cold run time: 74043 ms Total hot run time: 53963 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](build) remove all vla usage and enable vla check [doris]
BiteThet commented on PR #34001: URL: https://github.com/apache/doris/pull/34001#issuecomment-2076626063 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix cases unstable of hint [doris]
github-actions[bot] commented on PR #34101: URL: https://github.com/apache/doris/pull/34101#issuecomment-2076627219 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](nereids)nereids support create table like [doris]
feiniaofeiafei commented on PR #34025: URL: https://github.com/apache/doris/pull/34025#issuecomment-2076627635 run cloud_p1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix cases unstable of hint [doris]
github-actions[bot] commented on PR #34101: URL: https://github.com/apache/doris/pull/34101#issuecomment-2076627133 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](compaction) be do not compact invisible version to avoid query error -230 [doris]
yujun777 commented on PR #28082: URL: https://github.com/apache/doris/pull/28082#issuecomment-2076629706 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feat](Job) Job supports task execution statistics [doris]
CalvinKirs commented on PR #34109: URL: https://github.com/apache/doris/pull/34109#issuecomment-2076639323 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](build) remove all vla usage and enable vla check [doris]
github-actions[bot] commented on PR #34001: URL: https://github.com/apache/doris/pull/34001#issuecomment-2076640705 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
doris-robot commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076641198 TPC-DS: Total hot run time: 188158 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 691421c630cfd5f4a85852695389cd3204a75af9, data reload: false query1 909 349 344 344 query2 7849234323772343 query3 6649206 202 202 query4 23478 21680 21427 21427 query5 4182415 408 408 query6 270 169 174 169 query7 4589292 294 292 query8 241 186 188 186 query9 8615237223512351 query10 593 257 261 257 query11 14736 14160 14197 14160 query12 138 96 95 95 query13 1649373 364 364 query14 10552 839284778392 query15 251 184 194 184 query16 8167268 259 259 query17 1954555 542 542 query18 2104269 268 268 query19 352 146 150 146 query20 93 83 84 83 query21 193 127 123 123 query22 5104487148064806 query23 33874 33163 32783 32783 query24 11763 295428872887 query25 627 366 392 366 query26 1725164 146 146 query27 2970314 310 310 query28 7575198119891981 query29 993 583 586 583 query30 283 153 148 148 query31 957 746 742 742 query32 96 55 52 52 query33 751 250 236 236 query34 1098491 473 473 query35 833 686 678 678 query36 1067933 890 890 query37 274 68 66 66 query38 3328317232163172 query39 1576153915341534 query40 286 127 120 120 query41 42 39 39 39 query42 104 94 96 94 query43 570 524 528 524 query44 1236711 721 711 query45 282 258 263 258 query46 1084747 702 702 query47 1937185618901856 query48 406 292 293 292 query49 1170391 385 385 query50 757 378 383 378 query51 6901671767596717 query52 101 91 89 89 query53 352 276 274 274 query54 333 231 227 227 query55 81 69 71 69 query56 237 228 215 215 query57 1241113011381130 query58 227 192 198 192 query59 3481303630093009 query60 249 231 223 223 query61 91 130 89 89 query62 651 440 423 423 query63 305 280 277 277 query64 9484715071127112 query65 3095307830533053 query66 1373365 345 345 query67 15356 15023 14956 14956 query68 5149529 535 529 query69 469 299 299 299 query70 1189113811351135 query71 1371126512651265 query72 7223266124362436 query73 715 323 324 323 query74 6852640663756375 query75 3384267826522652 query76 3367913 960 913 query77 402 255 258 255 query78 10880 10228 10161 10161 query79 3347517 507 507 query80 2097434 424 424 query81 509 220 223 220 query82 1405100 95 95 query83 344 169 170 169 query84 259 88 86 86 query85 1597339 257 257 query86 468 280 299 280 query87 3460324032773240 query88 4801241024062406 query89 467 363 373 363 query90 2016187 187 187 query91 126 96 100 96 query92 65 48 48 48 query93 4317502 499 499 query94 1239181 182 181 query95 395 303 301 301 query96 607 270 263 263 query97 3194295929052905 query98 243 222 231 222 query99 1264874 859 859 Total cold run time: 297111 ms Total hot run time: 188158 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [feature](shuffle) enable strict consistency dml by default [doris]
kaijchen commented on PR #32958: URL: https://github.com/apache/doris/pull/32958#issuecomment-2076640564 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) fix cases unstable of hint [doris]
englefly merged PR #34101: URL: https://github.com/apache/doris/pull/34101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Fix](nereids) fix cases unstable of hint (#34101)
This is an automated email from the ASF dual-hosted git repository. englefly pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 785ffb2aeb1 [Fix](nereids) fix cases unstable of hint (#34101) 785ffb2aeb1 is described below commit 785ffb2aeb1bf02b88a22b8a961f1bede47d2f81 Author: LiBinfeng <46676950+libinfeng...@users.noreply.github.com> AuthorDate: Thu Apr 25 16:27:37 2024 +0800 [Fix](nereids) fix cases unstable of hint (#34101) fix cases unstable of hint, remove unused cases and project nodes and use string contains in order to avoid unstable problem. --- .../data/nereids_p0/hint/test_leading.out | 507 - .../suites/nereids_p0/hint/fix_leading.groovy | 6 +- .../suites/nereids_p0/hint/multi_leading.groovy| 17 +- .../suites/nereids_p0/hint/test_leading.groovy | 110 - 4 files changed, 105 insertions(+), 535 deletions(-) diff --git a/regression-test/data/nereids_p0/hint/test_leading.out b/regression-test/data/nereids_p0/hint/test_leading.out index 53195035880..31df4aafe73 100644 --- a/regression-test/data/nereids_p0/hint/test_leading.out +++ b/regression-test/data/nereids_p0/hint/test_leading.out @@ -2165,25 +2165,6 @@ Used: [broadcast]_2 UnUsed: SyntaxError: --- !select90_2 -- -PhysicalResultSink ---hashAgg[GLOBAL] -PhysicalDistribute[DistributionSpecGather] ---hashAgg[LOCAL] -PhysicalProject ---hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t1.c1 = t2.c2)) otherCondition=() -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t1] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t2] - -Hint log: -Used: -UnUsed: [broadcast]_2 -SyntaxError: - -- !select90_3 -- PhysicalResultSink --hashAgg[GLOBAL] @@ -2208,30 +2189,6 @@ Used: [broadcast]_2 [shuffle]_3 UnUsed: SyntaxError: --- !select90_4 -- -PhysicalResultSink ---hashAgg[GLOBAL] -PhysicalDistribute[DistributionSpecGather] ---hashAgg[LOCAL] -PhysicalProject ---hashJoin[INNER_JOIN] hashCondition=((t2.c2 = t3.c3)) otherCondition=() -PhysicalProject ---hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t1.c1 = t2.c2)) otherCondition=() -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t1] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t2] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t3] - -Hint log: -Used: [shuffle]_3 -UnUsed: [broadcast]_2 -SyntaxError: - -- !select90_5 -- PhysicalResultSink --hashAgg[GLOBAL] @@ -2256,125 +2213,6 @@ Used: [broadcast]_2 [shuffle]_3 UnUsed: SyntaxError: --- !select90_6 -- -PhysicalResultSink ---hashAgg[GLOBAL] -PhysicalDistribute[DistributionSpecGather] ---hashAgg[LOCAL] -PhysicalProject ---hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t2.c2 = t3.c3)) otherCondition=() -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -hashJoin[INNER_JOIN] hashCondition=((t1.c1 = t2.c2)) otherCondition=() ---PhysicalProject -PhysicalOlapScan[t1] ---PhysicalDistribute[DistributionSpecHash] -PhysicalProject ---PhysicalOlapScan[t2] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t3] - -Hint log: -Used: [shuffle]_2 -UnUsed: [broadcast]_3 -SyntaxError: - --- !select91_1 -- -PhysicalResultSink ---hashAgg[GLOBAL] -PhysicalDistribute[DistributionSpecGather] ---hashAgg[LOCAL] -PhysicalProject ---hashJoin[INNER_JOIN] hashCondition=((t2.c2 = t3.c3)) otherCondition=() -PhysicalProject ---hashJoin[INNER_JOIN] hashCondition=((t1.c1 = t2.c2)) otherCondition=() -PhysicalProject ---PhysicalOlapScan[t1] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t2] -PhysicalDistribute[DistributionSpecHash] ---PhysicalProject -PhysicalOlapScan[t3] - -Hint log: -Used: leading(t1 t2 t3 ) -UnUsed: [broadcast]_2 [shuffle]_3 -SyntaxError: - --- !select91_2 -- -PhysicalResultSink ---hashAgg[GLOBAL] -PhysicalDistribute[DistributionSpecGather] ---hashAgg[LOCAL] -PhysicalProject ---hashJoin[INNER_JOIN] hashCondition=((t2.c2 = t3.c3)) otherCondition=() -PhysicalProject ---hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t1.c1 = t2.c2)) otherCondition=() -Physi
Re: [PR] [branch-2.0](create table) show create table print storage medium #29080 [doris]
yujun777 commented on PR #34028: URL: https://github.com/apache/doris/pull/34028#issuecomment-2076648079 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Revert Fix Jemalloc hook failed to start BE with JDK 17 [doris]
github-actions[bot] commented on PR #34107: URL: https://github.com/apache/doris/pull/34107#issuecomment-2076651351 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) support aggregate function only in having statement [doris]
github-actions[bot] commented on PR #34086: URL: https://github.com/apache/doris/pull/34086#issuecomment-2076653799 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) support aggregate function only in having statement [doris]
github-actions[bot] commented on PR #34086: URL: https://github.com/apache/doris/pull/34086#issuecomment-2076653855 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): add equal set in functional dependencies [doris]
jackwener merged PR #33642: URL: https://github.com/apache/doris/pull/33642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (785ffb2aeb1 -> 073fec33b96)
This is an automated email from the ASF dual-hosted git repository.
jakevin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 785ffb2aeb1 [Fix](nereids) fix cases unstable of hint (#34101)
add 073fec33b96 [feature](Nereids): add equal set in functional
dependencies (#33642)
No new revisions were added by this update.
Summary of changes:
.../nereids/properties/FunctionalDependencies.java | 42 +-
.../trees/plans/BlockFuncDepsPropagation.java | 5 +
.../nereids/trees/plans/PropagateFuncDeps.java | 5 +
.../trees/plans/logical/LogicalAggregate.java | 5 +
.../trees/plans/logical/LogicalAssertNumRows.java | 6 +
.../plans/logical/LogicalCatalogRelation.java | 5 +
.../plans/logical/LogicalDeferMaterializeTopN.java | 5 +
.../nereids/trees/plans/logical/LogicalExcept.java | 15 ++
.../nereids/trees/plans/logical/LogicalFilter.java | 10 ++
.../trees/plans/logical/LogicalGenerate.java | 6 +
.../nereids/trees/plans/logical/LogicalHaving.java | 10 ++
.../trees/plans/logical/LogicalIntersect.java | 9 ++
.../nereids/trees/plans/logical/LogicalJoin.java | 16 ++
.../nereids/trees/plans/logical/LogicalLimit.java | 5 +
.../trees/plans/logical/LogicalOneRowRelation.java | 16 ++
.../nereids/trees/plans/logical/LogicalPlan.java | 3 +
.../trees/plans/logical/LogicalProject.java| 21 +++
.../nereids/trees/plans/logical/LogicalRepeat.java | 5 +
.../trees/plans/logical/LogicalSqlCache.java | 21 +--
.../trees/plans/logical/LogicalSubQueryAlias.java | 11 ++
.../nereids/trees/plans/logical/LogicalTopN.java | 5 +
.../nereids/trees/plans/logical/LogicalUnion.java | 61
.../nereids/trees/plans/logical/LogicalView.java | 6 +
.../nereids/trees/plans/logical/LogicalWindow.java | 6 +
.../apache/doris/nereids/util/ExpressionUtils.java | 8 +
.../doris/nereids/util/ImmutableEqualSet.java | 69 +++--
.../{UniformTest.java => EqualSetTest.java}| 161 -
.../suites/nereids_syntax_p0/join_order.groovy | 8 +-
28 files changed, 437 insertions(+), 108 deletions(-)
copy
fe/fe-core/src/test/java/org/apache/doris/nereids/properties/{UniformTest.java
=> EqualSetTest.java} (50%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [RegressionTest](test) Add fuzzy test config for column string overflow and p2 case [doris]
HappenLee commented on PR #34091: URL: https://github.com/apache/doris/pull/34091#issuecomment-2076663208 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… [doris]
github-actions[bot] commented on PR #34105: URL: https://github.com/apache/doris/pull/34105#issuecomment-2076667326 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… [doris]
github-actions[bot] commented on PR #34105: URL: https://github.com/apache/doris/pull/34105#issuecomment-2076667256 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [RegressionTest](test) Add fuzzy test config for column string overflow and p2 case [doris]
github-actions[bot] commented on PR #34091: URL: https://github.com/apache/doris/pull/34091#issuecomment-2076671707 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) column pruning should prune map in cte consumer [doris]
morrySnow commented on PR #34079: URL: https://github.com/apache/doris/pull/34079#issuecomment-2076672549 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) support aggregate function only in having statement [doris]
morrySnow merged PR #34086: URL: https://github.com/apache/doris/pull/34086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (073fec33b96 -> dfe30f542d8)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 073fec33b96 [feature](Nereids): add equal set in functional
dependencies (#33642)
add dfe30f542d8 [fix](Nereids) support aggregate function only in having
statement (#34086)
No new revisions were added by this update.
Summary of changes:
.../nereids/rules/analysis/FillUpMissingSlots.java | 71 +-
.../test_having_with_aggregate_function.out} | 2 +-
.../test_having_with_aggregate_function.groovy}| 17 +++---
3 files changed, 66 insertions(+), 24 deletions(-)
copy regression-test/data/{correctness/test_crossjoin_inlineview_slot.out =>
nereids_rules_p0/fill_up_missing_slots/test_having_with_aggregate_function.out}
(60%)
copy
regression-test/suites/nereids_rules_p0/{grouping_sets/grouping_with_same_grouping_set.groovy
=> fill_up_missing_slots/test_having_with_aggregate_function.groovy} (74%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size… [doris]
eldenmoon merged PR #34105: URL: https://github.com/apache/doris/pull/34105 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size from default to 2048 (#34105)
This is an automated email from the ASF dual-hosted git repository. eldenmoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new c3402ad2cbf [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size from default to 2048 (#34105) c3402ad2cbf is described below commit c3402ad2cbf0b9f082954418eaa86fd1603f9144 Author: lihangyu <15605149...@163.com> AuthorDate: Thu Apr 25 16:43:31 2024 +0800 [Chore](regression-test) adjust variant tpch/q09_trans.sql batch_size from default to 2048 (#34105) since 50 may cause performance issue introduced by #33853 --- regression-test/suites/variant_p0/tpch/sql/q09_trans.sql | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/regression-test/suites/variant_p0/tpch/sql/q09_trans.sql b/regression-test/suites/variant_p0/tpch/sql/q09_trans.sql index ddbc82812bc..f501d73dd72 100644 --- a/regression-test/suites/variant_p0/tpch/sql/q09_trans.sql +++ b/regression-test/suites/variant_p0/tpch/sql/q09_trans.sql @@ -1,6 +1,6 @@ -- TABLES: part,SUPPLIER,lineitem,partsupp,orders,NATION -- ERROR: not stable -SELECT /*+SET_VAR(enable_fallback_to_original_planner=false) */ +SELECT /*+SET_VAR(enable_fallback_to_original_planner=false,batch_size=2048) */ NATION, O_YEAR, SUM(AMOUNT) AS SUM_PROFIT - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [test](stream-load) add load empty file regression test [doris]
HHoflittlefish777 opened a new pull request, #34110: URL: https://github.com/apache/doris/pull/34110 ## Proposed changes Add load empty file regression test. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](stream-load) add load empty file regression test [doris]
doris-robot commented on PR #34110: URL: https://github.com/apache/doris/pull/34110#issuecomment-2076687916 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](stream-load) add load empty file regression test [doris]
HHoflittlefish777 commented on PR #34110: URL: https://github.com/apache/doris/pull/34110#issuecomment-2076688031 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](external catalog) Added status reset when jdbc name mapping is abnormal [doris]
zy-kkk commented on PR #33971: URL: https://github.com/apache/doris/pull/33971#issuecomment-2076691801 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](create table) show create table print storage medium #29080 [doris]
doris-robot commented on PR #34028: URL: https://github.com/apache/doris/pull/34028#issuecomment-2076697494 TPC-H: Total hot run time: 49433 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 665258db627b7847302159aa93c95678ef08e4f3, data reload: false -- Round 1 -- q1 17681 439043424342 q2 2030150 140 140 q3 10524 190323371903 q4 10281 127413001274 q5 8512385139173851 q6 230 126 124 124 q7 2016158716181587 q8 9259269726982697 q9 10471 10270 10257 10257 q10 8597349934803480 q11 416 240 250 240 q12 463 309 311 309 q13 18332 395340103953 q14 355 327 319 319 q15 513 458 445 445 q16 659 581 562 562 q17 1118951 953 951 q18 7342686468326832 q19 1716158514701470 q20 515 308 300 300 q21 4357410240204020 q22 487 377 382 377 Total cold run time: 115874 ms Total hot run time: 49433 ms - Round 2, with runtime_filter_mode=off - q1 4329430343504303 q2 319 215 220 215 q3 4153411341164113 q4 2732273427522734 q5 7180702370787023 q6 232 120 120 120 q7 3222284328632843 q8 4332443144964431 q9 16923 16808 16898 16808 q10 4259423542664235 q11 751 681 689 681 q12 1036856 835 835 q13 7123374537433743 q14 453 423 416 416 q15 496 461 461 461 q16 743 704 675 675 q17 3860379038463790 q18 8793868687558686 q19 1694167916181618 q20 2359211520992099 q21 8481840984838409 q22 1043935 980 935 Total cold run time: 84513 ms Total hot run time: 79173 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](external catalog) Added status reset when jdbc name mapping is abnormal [doris]
github-actions[bot] commented on PR #33971: URL: https://github.com/apache/doris/pull/33971#issuecomment-2076700684 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](external catalog) Added status reset when jdbc name mapping is abnormal [doris]
github-actions[bot] commented on PR #33971: URL: https://github.com/apache/doris/pull/33971#issuecomment-2076700737 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](stream-load) add load empty file regression test [doris]
github-actions[bot] commented on PR #34110: URL: https://github.com/apache/doris/pull/34110#issuecomment-2076701879 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improve](disk) Not add disk path to broken list if check status is not IO_ERROR [doris]
zxealous opened a new pull request, #34111: URL: https://github.com/apache/doris/pull/34111 ## Proposed changes Issue Number: close #xxx Not add disk path to broken list if check status is not IO_ERROR ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](disk) Not add disk path to broken list if check status is not IO_ERROR [doris]
doris-robot commented on PR #34111: URL: https://github.com/apache/doris/pull/34111#issuecomment-2076702910 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](disk) Not add disk path to broken list if check status is not IO_ERROR [doris]
zxealous commented on PR #34111: URL: https://github.com/apache/doris/pull/34111#issuecomment-2076703158 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](stream-load) add load empty file regression test [doris]
github-actions[bot] commented on PR #34110: URL: https://github.com/apache/doris/pull/34110#issuecomment-2076701937 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](stream-load) fix no error url when data quality error and total rows is negative [doris]
HHoflittlefish777 commented on PR #34072: URL: https://github.com/apache/doris/pull/34072#issuecomment-2076704961 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline-load) fix no error url when data quality error and total rows is negative [doris]
github-actions[bot] commented on PR #34072: URL: https://github.com/apache/doris/pull/34072#issuecomment-2076714430 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](disk) Not add disk path to broken list if check status is not IO_ERROR [doris]
github-actions[bot] commented on PR #34111: URL: https://github.com/apache/doris/pull/34111#issuecomment-2076713042 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](create table) show create table print storage medium #29080 [doris]
doris-robot commented on PR #34028: URL: https://github.com/apache/doris/pull/34028#issuecomment-2076721037 TPC-DS: Total hot run time: 202151 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 665258db627b7847302159aa93c95678ef08e4f3, data reload: false query1 929 408 395 395 query2 6545296527172717 query3 6920199 193 193 query4 19835 17900 17935 17900 query5 19735 651764156415 query6 274 213 234 213 query7 4156293 302 293 query8 262 250 235 235 query9 3171275026822682 query10 412 288 299 288 query11 11300 10783 10639 10639 query12 124 78 67 67 query13 5583680 690 680 query14 17480 13613 13138 13138 query15 388 232 230 230 query16 6470267 258 258 query17 16191461863 863 query18 2330413 401 401 query19 207 148 148 148 query20 79 78 76 76 query21 190 91 90 90 query22 5194508749904990 query23 32435 31883 32023 31883 query24 7762650864936493 query25 521 430 412 412 query26 725 157 158 157 query27 2203294 290 290 query28 6231242523892389 query29 2911266225832583 query30 241 162 164 162 query31 898 720 745 720 query32 67 60 58 58 query33 396 236 252 236 query34 842 452 479 452 query35 1133911 906 906 query36 1311129313381293 query37 87 66 62 62 query38 3077288829602888 query39 1348131813211318 query40 304 98 98 98 query41 38 38 35 35 query42 87 81 82 81 query43 809 715 649 649 query44 1123724 730 724 query45 246 223 229 223 query46 1224942 944 942 query47 1915173117361731 query48 1006711 700 700 query49 642 364 359 359 query50 859 630 611 611 query51 4699466446604660 query52 91 82 77 77 query53 434 319 308 308 query54 2666246624432443 query55 100 76 82 76 query56 209 211 185 185 query57 1254118510991099 query58 223 195 195 195 query59 4277403640574036 query60 204 209 207 207 query61 96 85 85 85 query62 805 476 462 462 query63 467 333 327 327 query64 2815165814161416 query65 3648357835373537 query66 807 372 384 372 query67 15796 15353 14842 14842 query68 10465 660 686 660 query69 568 339 355 339 query70 1976146713251325 query71 410 287 313 287 query72 6393348234793479 query73 733 313 318 313 query74 6298584958055805 query75 5548370036753675 query76 6851117612111176 query77 1188255 238 238 query78 12687 11486 11658 11486 query79 7855633 635 633 query80 1048403 409 403 query81 490 231 239 231 query82 985 98 93 93 query83 168 137 136 136 query84 268 70 72 70 query85 852 310 317 310 query86 339 286 312 286 query87 3269304629882988 query88 4565232123272321 query89 410 300 287 287 query90 1969212 188 188 query91 186 146 140 140 query92 58 48 50 48 query93 6583599 620 599 query94 700 206 208 206 query95 1106105710431043 query96 644 332 324 324 query97 6493632763526327 query98 190 176 172 172 query99 2976870 921 870 Total cold run time: 316506 ms Total hot run time: 202151 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Bug](runtime-filter) fix bloom filter size error on rf merge [doris]
github-actions[bot] commented on PR #34082: URL: https://github.com/apache/doris/pull/34082#issuecomment-2076724929 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](runtime-filter) fix bloom filter size error on rf merge [doris]
github-actions[bot] commented on PR #34082: URL: https://github.com/apache/doris/pull/34082#issuecomment-2076724995 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](partial update) Fix rowset not found error when doing partial update [doris]
doris-robot commented on PR #34112: URL: https://github.com/apache/doris/pull/34112#issuecomment-2076728650 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Fix](partial update) Fix rowset not found error when doing partial update [doris]
Yukang-Lian opened a new pull request, #34112: URL: https://github.com/apache/doris/pull/34112 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](create table) show create table print storage medium #29080 [doris]
doris-robot commented on PR #34028: URL: https://github.com/apache/doris/pull/34028#issuecomment-2076731290 ClickBench: Total hot run time: 30.52 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 665258db627b7847302159aa93c95678ef08e4f3, data reload: false query1 0.030.020.02 query2 0.060.020.01 query3 0.250.040.05 query4 1.810.070.06 query5 0.530.530.52 query6 1.230.610.61 query7 0.010.000.01 query8 0.030.030.03 query9 0.530.470.48 query10 0.540.530.53 query11 0.120.080.08 query12 0.120.090.09 query13 0.620.610.61 query14 0.800.760.80 query15 0.790.760.76 query16 0.380.370.36 query17 1.031.001.03 query18 0.240.250.25 query19 1.961.881.85 query20 0.020.020.01 query21 15.52 0.540.53 query22 2.002.991.64 query23 17.47 1.040.91 query24 7.091.230.75 query25 0.380.120.05 query26 0.790.160.16 query27 0.050.040.03 query28 6.080.750.76 query29 12.59 2.322.34 query30 0.630.600.53 query31 2.810.380.37 query32 3.370.500.49 query33 3.083.073.08 query34 15.28 4.814.78 query35 4.864.864.83 query36 1.061.021.02 query37 0.060.040.05 query38 0.020.020.03 query39 0.020.020.01 query40 0.160.140.13 query41 0.070.020.01 query42 0.020.010.01 query43 0.020.020.01 Total cold run time: 104.53 s Total hot run time: 30.52 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](partial update) Fix rowset not found error when doing partial update [doris]
Yukang-Lian commented on PR #34112: URL: https://github.com/apache/doris/pull/34112#issuecomment-2076729371 test will be add soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](create table) show create table print storage medium #29080 [doris]
doris-robot commented on PR #34028: URL: https://github.com/apache/doris/pull/34028#issuecomment-2076737098 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 665258db627b7847302159aa93c95678ef08e4f3 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s Insert into select: 21.2 seconds inserted 1000 Rows, about 471K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Opt] multi table func exec performance [doris]
github-actions[bot] commented on PR #34090: URL: https://github.com/apache/doris/pull/34090#issuecomment-2076737647 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhencement](Nereids) add string to length rule [doris]
morrySnow closed pull request #34102: [Enhencement](Nereids) add string to length rule URL: https://github.com/apache/doris/pull/34102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhencement](Nereids) add string to length rule [doris]
morrySnow commented on PR #34102: URL: https://github.com/apache/doris/pull/34102#issuecomment-2076739449 as @Gabriel39 say, this is not always improvement. we reopen it if we need it again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](partial update) Fix rowset not found error when doing partial update [doris]
github-actions[bot] commented on PR #34112: URL: https://github.com/apache/doris/pull/34112#issuecomment-2076738792 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
