Re: [PR] [Fix](nereids) add backquote and qualifier to udf, column, column alias and table alias when create view [doris]
feiniaofeiafei commented on PR #37237: URL: https://github.com/apache/doris/pull/37237#issuecomment-2213191182 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
sollhui opened a new pull request, #37455:
URL: https://github.com/apache/doris/pull/37455
pick (#36269)
## Proposed changes
```
*** Current BE git commitID: 5a8ea3079d ***
*** SIGSEGV address not mapped to object (@0x18) received by PID 3726857
(TID 3727585 OR 0x7f0129e83700) from PID 24; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int,
siginfo_t*, void*) at
/mnt/disk2/xujianxu/doris/be/src/common/signal_handler.h:421
1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in
/usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
2# JVM_handle_linux_signal in
/usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
3# 0x7F01D9E87090 in /lib/x86_64-linux-gnu/libc.so.6
4# std::_Function_handler (),
std::__future_base::_State_baseV2::_Setter
>::_M_invoke(std::_Any_data const&) at
/mnt/disk2/xujianxu/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/13/../../../../include/c++/13/bits/std_function.h:290
5#
std::__future_base::_State_baseV2::_M_do_set(std::function ()>*, bool*) at
/mnt/disk2/xujianxu/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/13/../../../../include/c++/13/future:593
6# __pthread_once_slow at
/build/glibc-SzIz7B/glibc-2.31/nptl/pthread_once.c:118
7#
std::__future_base::_State_baseV2::_M_set_result(std::function ()>, bool) at
/mnt/disk2/xujianxu/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/13/../../../../include/c++/13/future:428
8# doris::io::MultiTablePipe::_handle_consumer_finished() at
/mnt/disk2/xujianxu/doris/be/src/io/fs/multi_table_pipe.cpp:334
9#
doris::io::MultiTablePipe::exec_plans(doris::ExecEnv*,
std::vector
>)::{lambda(doris::RuntimeState*,
doris::Status*)#1}::operator()(doris::RuntimeState*, doris::Status*) const at
/mnt/disk2/xujianxu/doris/be/src/io/fs/multi_table_pipe.cpp:253
10# doris::pipeline::PipelineFragmentContext::~PipelineFragmentContext() at
/mnt/disk2/xujianxu/doris/be/src/pipeline/pipeline_fragment_context.cpp:131
11#
std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release_last_use_cold()
at
/mnt/disk2/xujianxu/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/13/../../../../include/c++/13/bits/shared_ptr_base.h:199
12# doris::pipeline::_close_task(doris::pipeline::PipelineTask*,
doris::Status) at
/mnt/disk2/xujianxu/doris/be/src/pipeline/task_scheduler.cpp:95
13# doris::pipeline::TaskScheduler::_do_work(unsigned long) at
/mnt/disk2/xujianxu/doris/be/src/pipeline/task_scheduler.cpp:168
14# doris::ThreadPool::dispatch_thread() in
/mnt/hdd01/STRESS_ENV/be/lib/doris_be
15# doris::Thread::supervise_thread(void*) at
/mnt/disk2/xujianxu/doris/be/src/util/thread.cpp:499
16# start_thread at /build/glibc-SzIz7B/glibc-2.31/nptl/pthread_create.c:478
17# __clone at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
```
BE will core when multi table load pipe finish fail. For exec_task will
return if finish fail, causing ctx was deconstructed. Wait all table finish to
solve this problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
doris-robot commented on PR #37455: URL: https://github.com/apache/doris/pull/37455#issuecomment-2213192281 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
sollhui commented on PR #37455: URL: https://github.com/apache/doris/pull/37455#issuecomment-2213192352 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](cloud) Extract SyncPoint to common cpp [doris]
github-actions[bot] commented on PR #37165: URL: https://github.com/apache/doris/pull/37165#issuecomment-2213194845 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) end Kafka consume when meets partition EOF #32046 [doris]
doris-robot commented on PR #37442: URL: https://github.com/apache/doris/pull/37442#issuecomment-2213194850 TPC-DS: Total hot run time: 203692 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 70947da6383d83df9c0facbfad5703c6b4e6fa5e, data reload: false query1 919 425 379 379 query2 6550277226002600 query3 6942205 201 201 query4 20490 18106 17973 17973 query5 19725 653265716532 query6 281 222 230 222 query7 4160303 292 292 query8 450 456 394 394 query9 3110266225942594 query10 396 295 297 295 query11 11271 10719 10770 10719 query12 127 75 76 75 query13 5606691 692 691 query14 17812 13524 13567 13524 query15 353 243 249 243 query16 6463281 262 262 query17 17451425905 905 query18 2287420 418 418 query19 198 153 153 153 query20 79 78 78 78 query21 194 101 99 99 query22 5203498750294987 query23 32407 31848 32053 31848 query24 6929658664906490 query25 536 432 415 415 query26 533 165 165 165 query27 1900293 296 293 query28 6117233523062306 query29 2886280126832683 query30 242 164 169 164 query31 901 740 755 740 query32 69 65 60 60 query33 403 249 252 249 query34 829 477 503 477 query35 1166932 947 932 query36 1255135711621162 query37 91 63 59 59 query38 3104289929362899 query39 1370132413221322 query40 199 97 98 97 query41 46 44 43 43 query42 83 83 78 78 query43 791 691 775 691 query44 1136710 711 710 query45 249 239 235 235 query46 1222959 991 959 query47 1795174218051742 query48 1016729 698 698 query49 622 384 359 359 query50 857 615 613 613 query51 4778466246484648 query52 104 87 93 87 query53 458 333 328 328 query54 2670247624662466 query55 89 78 86 78 query56 238 218 211 211 query57 1233125911741174 query58 194 189 203 189 query59 4222407341874073 query60 216 205 219 205 query61 94 91 95 91 query62 869 506 482 482 query63 488 359 345 345 query64 2560155114161416 query65 3655354035583540 query66 769 382 380 380 query67 15419 15087 15143 15087 query68 11353 666 625 625 query69 595 344 331 331 query70 2048137115801371 query71 422 310 314 310 query72 6472348434703470 query73 741 318 318 318 query74 6373582458605824 query75 5488371137223711 query76 7003116912341169 query77 1203258 293 258 query78 12585 11712 11919 11712 query79 5670620 628 620 query80 790 400 428 400 query81 452 237 238 237 query82 825 103 98 98 query83 177 126 134 126 query84 258 72 69 69 query85 874 330 327 327 query86 338 296 296 296 query87 3267302430133013 query88 4390228423082284 query89 399 282 278 278 query90 1902198 217 198 query91 173 151 151 151 query92 60 54 52 52 query93 4910581 580 580 query94 677 212 215 212 query95 1106106610411041 query96 641 331 321 321 query97 6468629564046295 query98 188 173 174 173 query99 2958897 921 897 Total cold run time: 311977 ms Total hot run time: 203692 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [refactor](cloud) Extract SyncPoint to common cpp [doris]
github-actions[bot] commented on PR #37165: URL: https://github.com/apache/doris/pull/37165#issuecomment-2213194889 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
sollhui opened a new pull request, #37456:
URL: https://github.com/apache/doris/pull/37456
pick #36450
before
```
ErrorReason{code=errCode = 105, msg='be 10002 abort task, task id:
d846f3d3-7c9e-44a7-bee0-3eff8cd11c6f job id: 11310 with reason:
[INTERNAL_ERROR]Offset out of range,
0# doris::Status doris::Status::Error<6,
true>(std::basic_string_view >) at
/mnt/disk1/laihui/doris/be/src/common/status.h:422
1# doris::Status
doris::Status::InternalError(std::basic_string_view >) at /mnt/disk1/laihui/doris/be/src/common/status.h:468
2#
doris::KafkaDataConsumer::group_consume(doris::BlockingQueue*,
long) at
/mnt/disk1/laihui/doris/be/src/runtime/routine_load/data_consumer.cpp:226
3#
doris::KafkaDataConsumerGroup::actual_consume(std::shared_ptr,
doris::BlockingQueue*, long, std::function) at
/mnt/disk1/laihui/doris/be/src/runtime/routine_load/data_consumer_group.cpp:200
4# void std::__invoke_impl,
doris::BlockingQueue*, long, std::function), doris::KafkaDataConsumerGroup*&,
std::shared_ptr&,
doris::BlockingQueue*&, long&,
doris::KafkaDataConsumerGroup::start_all(std::shared_ptr,
std::shared_ptr)::$_0&>(std::__invoke_memfun_deref,
void (doris::KafkaDataConsumerGroup::*&)(std::shared_ptr,
doris::BlockingQueue*, long, std::function), doris::KafkaDataConsumerGroup*&,
std::shared_ptr&,
doris::BlockingQueue*&, long&,
doris::KafkaDataConsumerGroup::start_all(std::shared_ptr,
std::shared_ptr)::$_0&) at
/mnt/disk1/laihui/build/ldb_toolchain/bin/../lib/gcc/x86_6
4-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:74
...
```
now
```
ErrorReason{code=errCode = 105, msg='be 10002 abort task, task id:
3ba0c0f4-d13c-4dfa-90ce-3df922fd9340 job id: 11310 with reason:
[INTERNAL_ERROR]Offset out of range, consume partition 0, consume offset 100,
the offset used by job does not exist in kafka, please check the offset, using
the Alter ROUTINE LOAD command to modify it, and resume the job'}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
doris-robot commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213197223 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
sollhui commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213197270 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](mtmv) Support grouping_sets rewrite when query rewrite by materialized view (#36056) [doris]
morrySnow merged PR #37436: URL: https://github.com/apache/doris/pull/37436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [feat](mtmv) Support grouping_sets rewrite when query rewrite by materialized view (#36056) (#37436)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new fbc954e8be6 [feat](mtmv) Support grouping_sets rewrite when query
rewrite by materialized view (#36056) (#37436)
fbc954e8be6 is described below
commit fbc954e8be687a1496a6e21f0bae833fea21640b
Author: seawinde <149132972+seawi...@users.noreply.github.com>
AuthorDate: Mon Jul 8 15:06:16 2024 +0800
[feat](mtmv) Support grouping_sets rewrite when query rewrite by
materialized view (#36056) (#37436)
cherry pick from master
pr: #36056
commitId: 569c9772
---
.../nereids/rules/analysis/NormalizeRepeat.java| 45 +-
.../mv/AbstractMaterializedViewAggregateRule.java | 275 +
.../mv/AbstractMaterializedViewRule.java | 20 +
.../exploration/mv/MaterializedViewUtils.java | 5 +-
.../nereids/rules/exploration/mv/StructInfo.java | 10 +-
.../mv/grouping_sets/grouping_sets.out | 225
.../mv/grouping_sets/grouping_sets.groovy | 616 +
7 files changed, 1057 insertions(+), 139 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/NormalizeRepeat.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/NormalizeRepeat.java
index fd6cce8b4fb..6465b81da30 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/NormalizeRepeat.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/NormalizeRepeat.java
@@ -89,16 +89,23 @@ public class NormalizeRepeat extends OneAnalysisRuleFactory
{
return new
LogicalAggregate<>(repeat.getGroupByExpressions(),
repeat.getOutputExpressions(), repeat.child());
}
-checkRepeatLegality(repeat);
-repeat = removeDuplicateColumns(repeat);
-// add virtual slot, LogicalAggregate and LogicalProject for
normalize
-LogicalAggregate agg = normalizeRepeat(repeat);
-return dealSlotAppearBothInAggFuncAndGroupingSets(agg);
+return doNormalize(repeat);
})
);
}
-private LogicalRepeat removeDuplicateColumns(LogicalRepeat
repeat) {
+/**
+ * Normalize repeat, this can be used directly, if optimize the repeat
+ */
+public static LogicalAggregate doNormalize(LogicalRepeat
repeat) {
+checkRepeatLegality(repeat);
+repeat = removeDuplicateColumns(repeat);
+// add virtual slot, LogicalAggregate and LogicalProject for normalize
+LogicalAggregate agg = normalizeRepeat(repeat);
+return dealSlotAppearBothInAggFuncAndGroupingSets(agg);
+}
+
+private static LogicalRepeat
removeDuplicateColumns(LogicalRepeat repeat) {
List> groupingSets = repeat.getGroupingSets();
ImmutableList.Builder> builder =
ImmutableList.builder();
for (List sets : groupingSets) {
@@ -108,11 +115,11 @@ public class NormalizeRepeat extends
OneAnalysisRuleFactory {
return repeat.withGroupSets(builder.build());
}
-private void checkRepeatLegality(LogicalRepeat repeat) {
+private static void checkRepeatLegality(LogicalRepeat repeat) {
checkGroupingSetsSize(repeat);
}
-private void checkGroupingSetsSize(LogicalRepeat repeat) {
+private static void checkGroupingSetsSize(LogicalRepeat repeat) {
Set flattenGroupingSetExpr = ImmutableSet.copyOf(
ExpressionUtils.flatExpressions(repeat.getGroupingSets()));
if (flattenGroupingSetExpr.size() >
LogicalRepeat.MAX_GROUPING_SETS_NUM) {
@@ -122,7 +129,7 @@ public class NormalizeRepeat extends OneAnalysisRuleFactory
{
}
}
-private LogicalAggregate normalizeRepeat(LogicalRepeat repeat)
{
+private static LogicalAggregate normalizeRepeat(LogicalRepeat
repeat) {
Set needToSlotsGroupingExpr =
collectNeedToSlotGroupingExpr(repeat);
NormalizeToSlotContext groupingExprContext = buildContext(repeat,
needToSlotsGroupingExpr);
Map groupingExprMap =
groupingExprContext.getNormalizeToSlotMap();
@@ -198,14 +205,14 @@ public class NormalizeRepeat extends
OneAnalysisRuleFactory {
Optional.of(normalizedRepeat), normalizedRepeat);
}
-private Set collectNeedToSlotGroupingExpr(LogicalRepeat
repeat) {
+private static Set
collectNeedToSlotGroupingExpr(LogicalRepeat repeat) {
// grouping sets should be pushed down, e.g. grouping sets((k + 1)),
// we should push down the `k + 1` to the bottom plan
return ImmutableSet.copyOf(
ExpressionUtils.flatExpressions(repeat.getGroupingSets()));
}
-private Set
collectNeedToSlotArgsOfGroupingScalarFuncAndAggFunc(LogicalRepeat repeat)
Re: [PR] [opt](routine-load) end Kafka consume when meets partition EOF #32046 [doris]
doris-robot commented on PR #37442: URL: https://github.com/apache/doris/pull/37442#issuecomment-2213203404 ClickBench: Total hot run time: 30.45 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 70947da6383d83df9c0facbfad5703c6b4e6fa5e, data reload: false query1 0.020.020.02 query2 0.070.020.02 query3 0.240.060.04 query4 1.780.100.07 query5 0.540.530.52 query6 1.240.620.62 query7 0.020.010.01 query8 0.040.030.02 query9 0.540.490.48 query10 0.540.530.54 query11 0.120.090.09 query12 0.110.090.09 query13 0.620.610.61 query14 0.790.760.79 query15 0.780.760.76 query16 0.360.400.38 query17 1.011.001.03 query18 0.260.220.25 query19 1.811.921.85 query20 0.010.010.02 query21 15.45 0.540.57 query22 1.982.971.40 query23 17.36 1.031.06 query24 6.480.890.91 query25 0.370.120.05 query26 0.680.160.15 query27 0.030.050.03 query28 6.880.770.71 query29 12.71 2.342.32 query30 0.550.520.46 query31 2.820.380.37 query32 3.390.490.48 query33 3.093.073.09 query34 15.26 4.784.76 query35 4.814.854.84 query36 1.041.011.03 query37 0.060.050.04 query38 0.040.020.02 query39 0.020.020.01 query40 0.160.140.14 query41 0.070.010.02 query42 0.020.010.01 query43 0.020.010.02 Total cold run time: 104.19 s Total hot run time: 30.45 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [doc](doc) Fix TIP card format and spaces between EN and ZH characters [doris-website]
httpshirley opened a new pull request, #838: URL: https://github.com/apache/doris-website/pull/838 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
github-actions[bot] commented on PR #37455: URL: https://github.com/apache/doris/pull/37455#issuecomment-2213202594 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auth)fix fe can not restart when replay create row policy log [doris]
zddr commented on PR #37342: URL: https://github.com/apache/doris/pull/37342#issuecomment-2213202981 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) end Kafka consume when meets partition EOF #32046 [doris]
doris-robot commented on PR #37442: URL: https://github.com/apache/doris/pull/37442#issuecomment-2213208955 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 70947da6383d83df9c0facbfad5703c6b4e6fa5e with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.1 seconds inserted 1000 Rows, about 473K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
github-actions[bot] commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213208283 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression test) Change the case to nonConcurrent [doris]
hello-stephen commented on PR #37356: URL: https://github.com/apache/doris/pull/37356#issuecomment-2213208849 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [config](routineload) adjusting the default configuration of routing load (#34898) [doris]
doris-robot commented on PR #37452: URL: https://github.com/apache/doris/pull/37452#issuecomment-2213209960 TPC-H: Total hot run time: 49927 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 58a953b655c4737efce59e76a9d79884004132b5, data reload: false -- Round 1 -- q1 18204 442443704370 q2 2074155 151 151 q3 10467 186919061869 q4 10253 124113331241 q5 8528387639133876 q6 240 151 127 127 q7 2051160116161601 q8 9349273526992699 q9 10763 10266 10307 10266 q10 8675354034903490 q11 421 246 246 246 q12 466 298 301 298 q13 18369 396940153969 q14 342 315 328 315 q15 505 455 462 455 q16 688 567 580 567 q17 1145976 951 951 q18 7233703969856985 q19 1808164516381638 q20 527 313 304 304 q21 4421409640824082 q22 532 427 459 427 Total cold run time: 117061 ms Total hot run time: 49927 ms - Round 2, with runtime_filter_mode=off - q1 4337432543264325 q2 321 220 222 220 q3 4144414541554145 q4 2755273727402737 q5 7181712671507126 q6 234 118 122 118 q7 3231278528942785 q8 4355444044624440 q9 16838 16758 16796 16758 q10 4249423042504230 q11 735 672 668 668 q12 1035872 860 860 q13 6987373037393730 q14 443 422 420 420 q15 507 450 454 450 q16 727 675 691 675 q17 3736375938243759 q18 8777877288218772 q19 1770172416961696 q20 2380212420902090 q21 8485845784688457 q22 1059946 975 946 Total cold run time: 84286 ms Total hot run time: 79407 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) timely pause job if Kafka cluster exception when consume (#33372) [doris]
doris-robot commented on PR #37446: URL: https://github.com/apache/doris/pull/37446#issuecomment-2213210274 TPC-H: Total hot run time: 49542 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 6f7a126ccd161fc108abcb647f09305d63f96e7d, data reload: false -- Round 1 -- q1 17705 438943174317 q2 2100157 148 148 q3 10444 187619241876 q4 10376 122912871229 q5 8532387338973873 q6 235 126 125 125 q7 2029160215871587 q8 9312273527142714 q9 10534 10531 10170 10170 q10 8629353835053505 q11 428 255 241 241 q12 463 313 303 303 q13 18347 395640133956 q14 359 323 324 323 q15 497 456 456 456 q16 693 573 568 568 q17 1150943 970 943 q18 7193682170146821 q19 1791162415831583 q20 539 318 301 301 q21 4430409540684068 q22 532 442 435 435 Total cold run time: 116318 ms Total hot run time: 49542 ms - Round 2, with runtime_filter_mode=off - q1 4354429343044293 q2 323 235 221 221 q3 4163417741614161 q4 2751274227332733 q5 7144712671007100 q6 241 122 121 121 q7 3261283528892835 q8 4341443744814437 q9 16808 16609 16850 16609 q10 4206425942754259 q11 757 685 676 676 q12 1035881 871 871 q13 7309374137413741 q14 461 416 435 416 q15 497 458 467 458 q16 743 677 672 672 q17 3757387338483848 q18 8744877687828776 q19 1765171016541654 q20 2388210421062104 q21 8502850984418441 q22 1078981 948 948 Total cold run time: 84628 ms Total hot run time: 79374 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [cherry-pick](branch-2.1) Change the case to nonConcurrent [doris]
hello-stephen merged PR #37357: URL: https://github.com/apache/doris/pull/37357 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [cherry-pick](branch-2.1) Change the case to nonConcurrent (#37357)
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new b058867e39e [cherry-pick](branch-2.1) Change the case to nonConcurrent
(#37357)
b058867e39e is described below
commit b058867e39e61af761eb3b7f0f6f1e4aa0207ca0
Author: Sun Chenyang
AuthorDate: Mon Jul 8 15:12:48 2024 +0800
[cherry-pick](branch-2.1) Change the case to nonConcurrent (#37357)
## Proposed changes
pick from master [#37356 ](https://github.com/apache/doris/pull/37356)
Issue Number: close #xxx
---
.../suites/fault_injection_p0/test_calc_crc_fault_injection.groovy | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/regression-test/suites/fault_injection_p0/test_calc_crc_fault_injection.groovy
b/regression-test/suites/fault_injection_p0/test_calc_crc_fault_injection.groovy
index e5cb5526d9f..d3a1e07f52c 100644
---
a/regression-test/suites/fault_injection_p0/test_calc_crc_fault_injection.groovy
+++
b/regression-test/suites/fault_injection_p0/test_calc_crc_fault_injection.groovy
@@ -17,7 +17,7 @@
import org.codehaus.groovy.runtime.IOGroovyMethods
-suite("test_calc_crc") {
+suite("test_calc_crc", "nonConcurrent") {
def calc_file_crc_on_tablet = { ip, port, tablet ->
return curl("GET",
String.format("http://%s:%s/api/calc_crc?tablet_id=%s";, ip, port, tablet))
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](routine-load) add retry when get Kafka meta info and make get Kafka meta timeout configurable [doris]
doris-robot commented on PR #37458: URL: https://github.com/apache/doris/pull/37458#issuecomment-2213212027 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) avoid routine load pause for check transaction status fail (#32638) [doris]
doris-robot commented on PR #37444: URL: https://github.com/apache/doris/pull/37444#issuecomment-2213212069 TPC-H: Total hot run time: 49865 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 59da711646699639ce6708255f4b51e59705f77b, data reload: false -- Round 1 -- q1 17674 434943584349 q2 2089154 148 148 q3 10451 194819451945 q4 10302 123513291235 q5 8473387739423877 q6 236 144 122 122 q7 2024157416101574 q8 9321272727002700 q9 10956 10364 10384 10364 q10 8640354135573541 q11 416 248 258 248 q12 470 305 299 299 q13 18360 396140423961 q14 351 329 331 329 q15 503 457 451 451 q16 674 565 569 565 q17 1126968 973 968 q18 7274677469256774 q19 1812169716071607 q20 514 304 297 297 q21 4410411740884088 q22 506 434 423 423 Total cold run time: 116582 ms Total hot run time: 49865 ms - Round 2, with runtime_filter_mode=off - q1 4284427142994271 q2 322 227 220 220 q3 4156415641564156 q4 2761274727442744 q5 7284723272967232 q6 247 121 126 121 q7 3319296528762876 q8 4461457945344534 q9 17454 16882 17054 16882 q10 4230426142764261 q11 739 694 693 693 q12 1041852 859 852 q13 6901374737383738 q14 445 422 426 422 q15 511 448 448 448 q16 732 672 685 672 q17 3854387138403840 q18 8893879587468746 q19 1722169616421642 q20 2350219321432143 q21 8516842184698421 q22 1017957 961 957 Total cold run time: 85239 ms Total hot run time: 79871 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](routine-load) add retry when get Kafka meta info and make get Kafka meta timeout configurable [doris]
sollhui commented on PR #37458: URL: https://github.com/apache/doris/pull/37458#issuecomment-2213212082 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) null type result with alias name should keep alias name [doris]
doris-robot commented on PR #37457: URL: https://github.com/apache/doris/pull/37457#issuecomment-2213211257 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) null type result with alias name should keep alias name [doris]
morrySnow commented on PR #37457: URL: https://github.com/apache/doris/pull/37457#issuecomment-2213211438 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [branch-2.0](routine-load) add retry when get Kafka meta info and make get Kafka meta timeout configurable [doris]
sollhui opened a new pull request, #37458: URL: https://github.com/apache/doris/pull/37458 pick https://github.com/apache/doris/pull/36619 and https://github.com/apache/doris/pull/35376 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](routine-load) increase routine load job default max batch size and rows (#36632) [doris]
sollhui opened a new pull request, #37459: URL: https://github.com/apache/doris/pull/37459 pick #36632 Most users only care about the size of **max_batch_interval**, but in order to achieve an interval effect, they have to configure **max_batch_rows** and **max_batch_size** according to the characteristics of the data. By adjusting these two default values, users do not need to worry about configuration in most scenarios. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) increase routine load job default max batch size and rows (#36632) [doris]
doris-robot commented on PR #37459: URL: https://github.com/apache/doris/pull/37459#issuecomment-2213214294 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) increase routine load job default max batch size and rows (#36632) [doris]
sollhui commented on PR #37459: URL: https://github.com/apache/doris/pull/37459#issuecomment-2213214374 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] fix date hardcode to date function [doris]
liaoxin01 commented on code in PR #37389:
URL: https://github.com/apache/doris/pull/37389#discussion_r1668101659
##
regression-test/suites/load_p0/stream_load/test_stream_load_2pc.groovy:
##
@@ -452,16 +452,16 @@ suite("test_stream_load_2pc", "p0") {
def dynamic_partition = ["", "", "", "", "",
"""
"dynamic_partition.enable" = "true",
-"dynamic_partition.time_unit" = "MONTH",
-"dynamic_partition.start" = "-1",
Review Comment:
ditto
##
regression-test/suites/load_p0/stream_load/test_stream_load_2pc.groovy:
##
@@ -317,9 +317,9 @@ suite("test_stream_load_2pc", "p0") {
'',
"""
"dynamic_partition.enable" = "true",
-"dynamic_partition.time_unit" = "MONTH",
-"dynamic_partition.start" = "-3",
Review Comment:
There is no need to change this, as it will result in longer case execution
time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](planner)fix bug of char(255) toSql [doris]
feiniaofeiafei commented on PR #37340: URL: https://github.com/apache/doris/pull/37340#issuecomment-2213215965 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [perf](routine-load) reduce waiting in task scheduler to accelerate consume (#33756) [doris]
doris-robot commented on PR #37448: URL: https://github.com/apache/doris/pull/37448#issuecomment-2213218025 TPC-H: Total hot run time: 49767 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 34a8f7425b809ff036596fee5f349f0ae8173cf6, data reload: false -- Round 1 -- q1 18193 432243104310 q2 2074156 148 148 q3 10264 191218891889 q4 10343 126413141264 q5 8529389838663866 q6 229 125 124 124 q7 2034156315841563 q8 9261272826912691 q9 10667 10373 10213 10213 q10 8692351435503514 q11 420 241 247 241 q12 471 310 303 303 q13 18421 406341044063 q14 367 340 347 340 q15 509 457 469 457 q16 697 603 605 603 q17 1151952 934 934 q18 7199681468966814 q19 1754163216791632 q20 544 314 309 309 q21 4425410140434043 q22 530 456 446 446 Total cold run time: 116774 ms Total hot run time: 49767 ms - Round 2, with runtime_filter_mode=off - q1 4277432542854285 q2 323 234 219 219 q3 4155415441444144 q4 2758275727432743 q5 7208708371587083 q6 236 121 116 116 q7 3227284228082808 q8 4404444744674447 q9 16883 16808 16853 16808 q10 4237426342344234 q11 798 685 724 685 q12 1031868 870 868 q13 7123372937383729 q14 456 427 422 422 q15 515 456 464 456 q16 746 671 663 663 q17 3792385338673853 q18 8826881288658812 q19 1729172117201720 q20 2423209021112090 q21 8522848884738473 q22 10711019980 980 Total cold run time: 84740 ms Total hot run time: 79638 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](alter) support add partitions in batch [doris]
doris-robot commented on PR #37114: URL: https://github.com/apache/doris/pull/37114#issuecomment-2213220955 TPC-H: Total hot run time: 39678 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9c9434e4ff5f9c296f522ad95c7f755e80538e37, data reload: false -- Round 1 -- q1 17614 429943154299 q2 2014195 190 190 q3 10450 120111171117 q4 10192 748 751 748 q5 7476268526072607 q6 222 137 134 134 q7 949 591 594 591 q8 9223205020702050 q9 8902648964836483 q10 9037371937243719 q11 453 238 236 236 q12 506 227 223 223 q13 17819 296729862967 q14 277 230 230 230 q15 523 491 470 470 q16 515 379 373 373 q17 964 661 664 661 q18 7957756573097309 q19 5853145314511451 q20 658 326 340 326 q21 5024316338243163 q22 384 331 331 331 Total cold run time: 117012 ms Total hot run time: 39678 ms - Round 2, with runtime_filter_mode=off - q1 4414425442314231 q2 407 260 262 260 q3 2993284529092845 q4 2041171017231710 q5 5610551454685468 q6 240 130 131 130 q7 2223188618591859 q8 3222338233873382 q9 8758865188488651 q10 4066391337363736 q11 582 498 487 487 q12 814 655 641 641 q13 16216 316531433143 q14 302 263 281 263 q15 528 496 487 487 q16 499 432 421 421 q17 1833154214601460 q18 7978777078727770 q19 2125162316191619 q20 2244191318611861 q21 10962 506249124912 q22 620 545 556 545 Total cold run time: 78677 ms Total hot run time: 55881 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [config](routineload) adjusting the default configuration of routing load (#34898) [doris]
doris-robot commented on PR #37452: URL: https://github.com/apache/doris/pull/37452#issuecomment-2213222644 TeamCity be ut coverage result: Function Coverage: 37.88% (8112/21417) Line Coverage: 29.55% (66470/224921) Region Coverage: 29.01% (34251/118051) Branch Coverage: 24.89% (17592/70690) Coverage Report: http://coverage.selectdb-in.cc/coverage/58a953b655c4737efce59e76a9d79884004132b5_58a953b655c4737efce59e76a9d79884004132b5/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](planner)fix bug of char(255) toSql [doris]
github-actions[bot] commented on PR #37340: URL: https://github.com/apache/doris/pull/37340#issuecomment-2213223151 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](routine-load) add retry when get Kafka meta info and make get Kafka meta timeout configurable [doris]
github-actions[bot] commented on PR #37458: URL: https://github.com/apache/doris/pull/37458#issuecomment-2213223268 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](delete) fix the error message for valid decimal data [doris]
doris-robot commented on PR #36802: URL: https://github.com/apache/doris/pull/36802#issuecomment-2213225569 TPC-H: Total hot run time: 39840 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3c82f3cb0850bf0dae9ad809108d9a17a0398174, data reload: false -- Round 1 -- q1 17616 430742574257 q2 2016193 187 187 q3 10459 114410691069 q4 10183 758 780 758 q5 7548263226602632 q6 223 139 139 139 q7 954 594 596 594 q8 9243207320842073 q9 8826649364906490 q10 8881371236853685 q11 455 235 236 235 q12 522 229 231 229 q13 18189 300029742974 q14 275 228 234 228 q15 525 481 494 481 q16 516 373 386 373 q17 970 743 688 688 q18 7919747775397477 q19 1856149315111493 q20 653 321 316 316 q21 4996313731483137 q22 388 325 337 325 Total cold run time: 113213 ms Total hot run time: 39840 ms - Round 2, with runtime_filter_mode=off - q1 4306420542254205 q2 379 276 271 271 q3 3000276927862769 q4 1977166116841661 q5 5550564755125512 q6 223 133 135 133 q7 2214186018061806 q8 3308346634423442 q9 8714867286938672 q10 4111386939163869 q11 587 488 499 488 q12 794 638 591 591 q13 16884 320731633163 q14 297 287 279 279 q15 552 497 482 482 q16 488 443 454 443 q17 1786150014861486 q18 8012782577187718 q19 1791145715511457 q20 2120189818651865 q21 5247486848724868 q22 650 596 571 571 Total cold run time: 72990 ms Total hot run time: 55751 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) constant folding for str_to_date on datev1 is wrong (#37360) [doris]
morrySnow merged PR #37367: URL: https://github.com/apache/doris/pull/37367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [fix](Nereids) constant folding for str_to_date on datev1 is wrong (#37360) (#37367)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 68352c7c77b [fix](Nereids) constant folding for str_to_date on datev1
is wrong (#37360) (#37367)
68352c7c77b is described below
commit 68352c7c77bef3fa051ce4a4e68c2419eb260dae
Author: morrySnow <101034200+morrys...@users.noreply.github.com>
AuthorDate: Mon Jul 8 15:21:12 2024 +0800
[fix](Nereids) constant folding for str_to_date on datev1 is wrong (#37360)
(#37367)
pick from master #37360
when enable datev1, we should return datev1/datetimev1
---
.../executable/DateTimeExtractAndTransform.java| 24 ++
1 file changed, 20 insertions(+), 4 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/executable/DateTimeExtractAndTransform.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/executable/DateTimeExtractAndTransform.java
index b6960d4384b..0639e96a9c9 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/executable/DateTimeExtractAndTransform.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/executable/DateTimeExtractAndTransform.java
@@ -17,6 +17,8 @@
package org.apache.doris.nereids.trees.expressions.functions.executable;
+import org.apache.doris.catalog.ScalarType;
+import org.apache.doris.catalog.Type;
import org.apache.doris.nereids.exceptions.AnalysisException;
import org.apache.doris.nereids.trees.expressions.ExecFunction;
import org.apache.doris.nereids.trees.expressions.Expression;
@@ -32,8 +34,10 @@ import
org.apache.doris.nereids.trees.expressions.literal.SmallIntLiteral;
import org.apache.doris.nereids.trees.expressions.literal.StringLikeLiteral;
import org.apache.doris.nereids.trees.expressions.literal.TinyIntLiteral;
import org.apache.doris.nereids.trees.expressions.literal.VarcharLiteral;
+import org.apache.doris.nereids.types.DataType;
import org.apache.doris.nereids.types.DateTimeV2Type;
import org.apache.doris.nereids.types.DateType;
+import org.apache.doris.nereids.types.DateV2Type;
import org.apache.doris.nereids.types.DecimalV3Type;
import org.apache.doris.nereids.types.VarcharType;
import org.apache.doris.nereids.util.DateUtils;
@@ -611,11 +615,23 @@ public class DateTimeExtractAndTransform {
@ExecFunction(name = "str_to_date", argTypes = {"VARCHAR", "VARCHAR"},
returnType = "DATETIMEV2")
public static Expression strToDate(StringLikeLiteral str,
StringLikeLiteral format) {
if
(org.apache.doris.analysis.DateLiteral.hasTimePart(format.getStringValue())) {
-return
DateTimeV2Literal.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
-.toFormatter(), str.getValue()));
+DataType returnType =
DataType.fromCatalogType(ScalarType.getDefaultDateType(Type.DATETIME));
+if (returnType instanceof DateTimeV2Type) {
+return
DateTimeV2Literal.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
+.toFormatter(), str.getValue()));
+} else {
+return
DateTimeLiteral.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
+.toFormatter(), str.getValue()));
+}
} else {
-return
DateV2Literal.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
-.toFormatter(), str.getValue()));
+DataType returnType =
DataType.fromCatalogType(ScalarType.getDefaultDateType(Type.DATE));
+if (returnType instanceof DateV2Type) {
+return
DateV2Literal.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
+.toFormatter(), str.getValue()));
+} else {
+return
DateLiteral.fromJavaDateType(DateUtils.getTime(DateUtils.formatBuilder(format.getValue())
+.toFormatter(), str.getValue()));
+}
}
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](query) print query id when killed by timeout checker (#36868) [doris]
sollhui commented on PR #37460: URL: https://github.com/apache/doris/pull/37460#issuecomment-2213227420 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](query) print query id when killed by timeout checker (#36868) [doris]
sollhui opened a new pull request, #37460: URL: https://github.com/apache/doris/pull/37460 pick #36868 ``` 2024-06-26 14:58:30,917 WARN (connect-scheduler-check-timer-0|92) [ConnectContext.checkTimeout():776] kill query timeout, remote: :XX, query timeout: 90 ``` It is hard to know which query is killed when timeout, so it is necessary to print query id. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](query) print query id when killed by timeout checker (#36868) [doris]
doris-robot commented on PR #37460: URL: https://github.com/apache/doris/pull/37460#issuecomment-2213227319 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) dealing with the high watermark of Kafka may fallback (#35901) [doris]
doris-robot commented on PR #37454: URL: https://github.com/apache/doris/pull/37454#issuecomment-2213228432 TPC-H: Total hot run time: 49676 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 88fb51b5436a53dbe73a581c924e3ce7a8d4a8ca, data reload: false -- Round 1 -- q1 18027 438843224322 q2 2062152 150 150 q3 10464 185619141856 q4 10290 122913191229 q5 8762406339293929 q6 233 148 126 126 q7 2021157815961578 q8 9310271826962696 q9 11024 10691 10284 10284 q10 8691350434763476 q11 430 254 244 244 q12 482 297 301 297 q13 18349 394240083942 q14 349 321 331 321 q15 506 450 467 450 q16 674 569 570 569 q17 1137973 967 967 q18 7263702068426842 q19 1761168116141614 q20 542 303 324 303 q21 4445404740754047 q22 519 434 445 434 Total cold run time: 117341 ms Total hot run time: 49676 ms - Round 2, with runtime_filter_mode=off - q1 4317427243184272 q2 316 237 230 230 q3 4157414941534149 q4 2761273627632736 q5 7216714171637141 q6 234 121 120 120 q7 3239288628542854 q8 4352447544924475 q9 17367 17089 17110 17089 q10 4209425942934259 q11 774 673 683 673 q12 1038841 864 841 q13 6923373437533734 q14 452 422 421 421 q15 497 460 456 456 q16 733 687 673 673 q17 3841386438443844 q18 8724875388398753 q19 1707172716851685 q20 2395213321102110 q21 8537839284898392 q22 10251011985 985 Total cold run time: 84814 ms Total hot run time: 79892 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auth)fix fe can not restart when replay create row policy log [doris]
github-actions[bot] commented on PR #37342: URL: https://github.com/apache/doris/pull/37342#issuecomment-2213228473 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auth)fix fe can not restart when replay create row policy log [doris]
github-actions[bot] commented on PR #37342: URL: https://github.com/apache/doris/pull/37342#issuecomment-2213228415 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [config](routineload) adjusting the default configuration of routing load (#34898) [doris]
doris-robot commented on PR #37452: URL: https://github.com/apache/doris/pull/37452#issuecomment-2213231321 TPC-DS: Total hot run time: 203126 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 58a953b655c4737efce59e76a9d79884004132b5, data reload: false query1 924 394 410 394 query2 6550282627152715 query3 6921204 205 204 query4 20069 17978 18037 17978 query5 19724 654365196519 query6 278 218 228 218 query7 4152292 302 292 query8 393 430 371 371 query9 3128270326372637 query10 417 300 284 284 query11 11417 10750 10679 10679 query12 119 85 75 75 query13 5604719 689 689 query14 17943 13220 13666 13220 query15 365 240 251 240 query16 6478290 261 261 query17 17011478864 864 query18 2319415 403 403 query19 220 147 154 147 query20 76 78 79 78 query21 190 98 91 91 query22 5195512951315129 query23 32354 31804 31962 31804 query24 7027655165046504 query25 512 432 438 432 query26 526 165 164 164 query27 1875306 308 306 query28 6092235423152315 query29 2904276328342763 query30 242 167 163 163 query31 902 719 721 719 query32 65 59 60 59 query33 401 261 255 255 query34 847 468 470 468 query35 1138956 906 906 query36 1109126111451145 query37 90 62 59 59 query38 3125295329482948 query39 1373132813241324 query40 204 94 93 93 query41 46 44 45 44 query42 92 89 80 80 query43 794 724 649 649 query44 1100705 717 705 query45 246 232 240 232 query46 1216939 987 939 query47 2042170816691669 query48 984 711 694 694 query49 624 387 380 380 query50 845 606 594 594 query51 4709463846354635 query52 95 82 84 82 query53 442 326 323 323 query54 2665247124622462 query55 88 86 75 75 query56 248 192 189 189 query57 1166110110841084 query58 224 204 201 201 query59 4075402542214025 query60 219 196 204 196 query61 97 93 93 93 query62 818 432 434 432 query63 494 336 343 336 query64 2478148615001486 query65 3594356035923560 query66 766 366 365 365 query67 15454 17314 14742 14742 query68 8672654 649 649 query69 579 333 356 333 query70 1762138713731373 query71 417 314 308 308 query72 6538342134643421 query73 738 321 314 314 query74 6456581558805815 query75 5176376037293729 query76 5133114311701143 query77 862 257 255 255 query78 12514 11850 12236 11850 query79 9210639 650 639 query80 1155400 397 397 query81 488 235 238 235 query82 966 101 93 93 query83 165 139 136 136 query84 252 71 73 71 query85 889 330 331 330 query86 316 288 306 288 query87 3203302830343028 query88 4579230522892289 query89 448 277 271 271 query90 1928209 209 209 query91 168 137 138 137 query92 58 51 50 50 query93 5665584 546 546 query94 723 212 209 209 query95 105510601055 query96 641 325 315 315 query97 6430642864036403 query98 192 180 178 178 query99 2924870 898 870 Total cold run time: 310948 ms Total hot run time: 203126 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [improve](routine-load) timely pause job if Kafka cluster exception when consume (#33372) [doris]
doris-robot commented on PR #37446: URL: https://github.com/apache/doris/pull/37446#issuecomment-2213231709 TPC-DS: Total hot run time: 202616 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6f7a126ccd161fc108abcb647f09305d63f96e7d, data reload: false query1 925 419 380 380 query2 6524284226372637 query3 6917206 198 198 query4 20279 17994 17889 17889 query5 19738 649964756475 query6 302 217 227 217 query7 4155307 311 307 query8 428 435 407 407 query9 3133268926092609 query10 417 321 299 299 query11 11286 10704 10741 10704 query12 117 77 75 75 query13 5593700 702 700 query14 18173 13520 13902 13520 query15 344 237 253 237 query16 6469287 265 265 query17 17091464874 874 query18 2299411 414 411 query19 212 153 150 150 query20 84 77 86 77 query21 192 98 91 91 query22 5280513050025002 query23 32565 31874 31733 31733 query24 6934653764506450 query25 521 420 422 420 query26 534 164 160 160 query27 1803297 301 297 query28 6191235323222322 query29 2911261226662612 query30 247 166 164 164 query31 932 717 759 717 query32 69 61 61 61 query33 412 253 256 253 query34 837 466 475 466 query35 11171352927 927 query36 1232146511231123 query37 90 61 64 61 query38 3077291429362914 query39 1398133913311331 query40 200 92 94 92 query41 45 45 45 45 query42 83 83 81 81 query43 692 720 732 720 query44 1191717 718 717 query45 240 239 235 235 query46 1236949 985 949 query47 1872190117911791 query48 1021726 701 701 query49 620 382 380 380 query50 865 601 627 601 query51 4820474446524652 query52 93 88 82 82 query53 454 331 322 322 query54 2710248024532453 query55 84 86 77 77 query56 241 223 214 214 query57 1236105311451053 query58 212 188 198 188 query59 4457395139293929 query60 211 220 206 206 query61 99 95 99 95 query62 906 486 458 458 query63 484 339 351 339 query64 2526152513511351 query65 3616356435623562 query66 762 377 380 377 query67 16395 17636 14835 14835 query68 9019659 645 645 query69 569 343 348 343 query70 1737132916481329 query71 400 301 320 301 query72 6493348935143489 query73 732 325 318 318 query74 6362585158355835 query75 5355373237053705 query76 5573117011861170 query77 956 263 256 256 query78 12431 11455 11644 11455 query79 7743643 666 643 query80 1211402 407 402 query81 485 239 232 232 query82 159899 95 95 query83 169 130 129 129 query84 266 73 73 73 query85 890 344 337 337 query86 331 289 314 289 query87 3256306630423042 query88 4966231622882288 query89 381 283 283 283 query90 1961207 205 205 query91 170 140 138 138 query92 58 54 52 52 query93 5225590 581 581 query94 708 208 199 199 query95 1106105111241051 query96 640 321 314 314 query97 6451642263216321 query98 189 178 171 171 query99 2984885 946 885 Total cold run time: 313232 ms Total hot run time: 202616 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Optimize](Row store) allow to set row_column_page_size for tables, change default value to 16KB [doris]
github-actions[bot] commented on PR #37145: URL: https://github.com/apache/doris/pull/37145#issuecomment-2213232391 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) optimize routine load job auto resume policy (#35266) [doris]
doris-robot commented on PR #37453: URL: https://github.com/apache/doris/pull/37453#issuecomment-2213233315 TPC-H: Total hot run time: 50008 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a0892fd13ea5b5826f1b0dc58e8d4086f81e, data reload: false -- Round 1 -- q1 17926 439243324332 q2 2058154 153 153 q3 10265 192019391920 q4 10381 121713161217 q5 8420387639663876 q6 234 147 123 123 q7 2021161915951595 q8 9487271427032703 q9 11004 10488 10627 10488 q10 8661350634823482 q11 421 250 253 250 q12 473 299 302 299 q13 18370 393740173937 q14 357 323 324 323 q15 508 451 467 451 q16 666 570 582 570 q17 1128980 985 980 q18 7245682269896822 q19 1771167216511651 q20 540 302 305 302 q21 4460409141004091 q22 538 445 443 443 Total cold run time: 116934 ms Total hot run time: 50008 ms - Round 2, with runtime_filter_mode=off - q1 4347432343574323 q2 325 227 225 225 q3 4180415242224152 q4 2791273927402739 q5 7228713871807138 q6 239 119 121 119 q7 3207288628602860 q8 4379444645034446 q9 17444 17217 17152 17152 q10 4207423042774230 q11 781 758 686 686 q12 1028855 852 852 q13 6961375637753756 q14 447 436 418 418 q15 509 469 458 458 q16 740 677 697 677 q17 3908378738843787 q18 8716883589098835 q19 1742173316781678 q20 2408211121372111 q21 8486857084778477 q22 1027972 995 972 Total cold run time: 85100 ms Total hot run time: 80091 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Optimize](Row store) allow to set row_column_page_size for tables, change default value to 16KB [doris]
github-actions[bot] commented on PR #37145: URL: https://github.com/apache/doris/pull/37145#issuecomment-2213233998 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) avoid routine load pause for check transaction status fail (#32638) [doris]
doris-robot commented on PR #37444: URL: https://github.com/apache/doris/pull/37444#issuecomment-2213233362 TPC-DS: Total hot run time: 205108 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 59da711646699639ce6708255f4b51e59705f77b, data reload: false query1 946 429 375 375 query2 6567272326402640 query3 6925208 203 203 query4 20892 18167 18718 18167 query5 19724 650165556501 query6 291 225 240 225 query7 4162299 308 299 query8 393 399 396 396 query9 3100267625972597 query10 420 300 287 287 query11 11397 10876 10793 10793 query12 125 79 76 76 query13 5609701 708 701 query14 17969 13524 13789 13524 query15 394 242 254 242 query16 6445285 268 268 query17 17331456871 871 query18 2312412 412 412 query19 210 152 163 152 query20 81 76 81 76 query21 191 97 95 95 query22 5273516751245124 query23 32509 31803 31818 31803 query24 6933651065896510 query25 522 426 429 426 query26 529 163 158 158 query27 1846299 301 299 query28 6118238023262326 query29 2883276127982761 query30 241 163 169 163 query31 897 733 766 733 query32 70 68 61 61 query33 400 255 269 255 query34 847 469 482 469 query35 1141965 961 961 query36 1433141411371137 query37 91 59 61 59 query38 3150295629412941 query39 1364135413191319 query40 206 98 97 97 query41 46 44 43 43 query42 81 91 82 82 query43 738 731 643 643 query44 1137722 717 717 query45 248 240 237 237 query46 1226975 982 975 query47 1832186318351835 query48 1022719 717 717 query49 638 376 367 367 query50 856 616 632 616 query51 4712470046734673 query52 98 78 86 78 query53 447 332 322 322 query54 2650244424512444 query55 98 87 81 81 query56 223 230 217 217 query57 1252128510841084 query58 228 205 203 203 query59 4157396938523852 query60 217 223 214 214 query61 102 96 99 96 query62 817 477 468 468 query63 495 349 350 349 query64 2560156615341534 query65 3621354135193519 query66 795 385 379 379 query67 16825 17191 15750 15750 query68 9912634 643 634 query69 585 359 357 357 query70 1772136414261364 query71 415 314 324 314 query72 6586350935073507 query73 744 322 325 322 query74 6281583258815832 query75 5370375736793679 query76 6328113612031136 query77 1037262 253 253 query78 12662 11910 19028 11910 query79 4119603 632 603 query80 804 405 398 398 query81 499 240 240 240 query82 263 93 97 93 query83 172 139 131 131 query84 266 71 71 71 query85 889 343 340 340 query86 331 342 307 307 query87 3176300730283007 query88 3400232723122312 query89 361 275 298 275 query90 2000209 211 209 query91 186 147 134 134 query92 64 52 50 50 query93 940 578 531 531 query94 697 216 210 210 query95 1127106910621062 query96 622 326 331 326 query97 6540645664866456 query98 181 179 179 179 query99 2975869 1011869 Total cold run time: 304764 ms Total hot run time: 205108 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement](mtmv) Support read sync materialized view in async materialized view [doris]
morrySnow commented on PR #37396: URL: https://github.com/apache/doris/pull/37396#issuecomment-2213235611 Could you give a more specific example and put it into the regression test? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
doris-robot commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213238981 TPC-H: Total hot run time: 50107 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit f7d7f30bae82c02b48f01f2bf86d4e8957c61187, data reload: false -- Round 1 -- q1 17536 435543304330 q2 2070155 149 149 q3 10267 189619241896 q4 10112 123413231234 q5 8404395838843884 q6 230 122 125 122 q7 2056159716071597 q8 9283276927192719 q9 10568 10966 10600 10600 q10 8653354235563542 q11 419 255 246 246 q12 469 308 307 307 q13 18383 394740583947 q14 345 325 331 325 q15 523 454 466 454 q16 678 574 580 574 q17 1136953 970 953 q18 7189674368826743 q19 1772163916191619 q20 539 321 322 321 q21 4451410741034103 q22 535 444 442 442 Total cold run time: 115618 ms Total hot run time: 50107 ms - Round 2, with runtime_filter_mode=off - q1 4300428643074286 q2 321 227 230 227 q3 4154415741374137 q4 2742275327522752 q5 7181719972147199 q6 234 120 117 117 q7 3233288728532853 q8 4374448344894483 q9 16895 16870 16759 16759 q10 4265429643024296 q11 754 683 655 655 q12 1038842 857 842 q13 6985374437373737 q14 456 422 423 422 q15 509 464 449 449 q16 729 684 666 666 q17 3868380838933808 q18 8868877488158774 q19 1743172616581658 q20 2366215721202120 q21 8550844085308440 q22 1076975 1001975 Total cold run time: 84641 ms Total hot run time: 79655 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [perf](routine-load) reduce waiting in task scheduler to accelerate consume (#33756) [doris]
doris-robot commented on PR #37448: URL: https://github.com/apache/doris/pull/37448#issuecomment-2213239283 TPC-DS: Total hot run time: 206108 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 34a8f7425b809ff036596fee5f349f0ae8173cf6, data reload: false query1 940 421 386 386 query2 6552282226162616 query3 6916204 198 198 query4 20050 18215 18142 18142 query5 19738 656665146514 query6 289 216 231 216 query7 4151301 291 291 query8 402 444 395 395 query9 3080267325922592 query10 420 298 306 298 query11 11457 11034 10989 10989 query12 123 75 78 75 query13 5594700 685 685 query14 18165 13621 13402 13402 query15 360 237 239 237 query16 6464299 261 261 query17 16871454874 874 query18 2311405 403 403 query19 209 147 158 147 query20 85 78 82 78 query21 189 94 92 92 query22 5265512551575125 query23 32391 31797 31892 31797 query24 6927651564966496 query25 517 433 406 406 query26 532 160 161 160 query27 1928295 292 292 query28 6230238623272327 query29 2871283726742674 query30 249 163 169 163 query31 910 749 749 749 query32 70 64 61 61 query33 398 257 250 250 query34 857 480 477 477 query35 1140927 1001927 query36 1344132411211121 query37 89 61 62 61 query38 3092290629202906 query39 1374132813301328 query40 204 90 93 90 query41 47 44 43 43 query42 87 79 82 79 query43 664 784 751 751 query44 1106712 718 712 query45 244 235 240 235 query46 1222986 972 972 query47 2049173117691731 query48 1002714 701 701 query49 625 398 364 364 query50 864 617 585 585 query51 4742464346824643 query52 89 87 78 78 query53 453 318 320 318 query54 2636242924082408 query55 93 75 84 75 query56 214 223 199 199 query57 1118106411091064 query58 213 213 204 204 query59 4055424340854085 query60 209 198 222 198 query61 95 92 101 92 query62 837 463 492 463 query63 483 338 346 338 query64 2622156014761476 query65 3657353935593539 query66 773 366 382 366 query67 17604 15213 15120 15120 query68 10486 640 661 640 query69 578 341 376 341 query70 1986152113751375 query71 418 298 334 298 query72 6583346534583458 query73 733 319 319 319 query74 6304597959885979 query75 5378368836673667 query76 6809115912271159 query77 1191267 248 248 query78 12779 15084 13823 13823 query79 8786631 650 631 query80 649 398 394 394 query81 486 240 232 232 query82 259 95 95 95 query83 182 144 133 133 query84 265 71 73 71 query85 835 339 339 339 query86 321 290 289 289 query87 3259308130113011 query88 4452230623162306 query89 372 277 284 277 query90 2620206 213 206 query91 170 138 148 138 query92 56 53 53 53 query93 1041540 600 540 query94 1194210 209 209 query95 1110105310491049 query96 634 332 325 325 query97 6429632963566329 query98 184 175 167 167 query99 2954897 867 867 Total cold run time: 312876 ms Total hot run time: 206108 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [Enhancement](alter) support add partitions in batch [doris]
doris-robot commented on PR #37114: URL: https://github.com/apache/doris/pull/37114#issuecomment-2213239352 TPC-DS: Total hot run time: 172591 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9c9434e4ff5f9c296f522ad95c7f755e80538e37, data reload: false query1 933 364 357 357 query2 6453238123442344 query3 6634204 227 204 query4 28622 17289 17308 17289 query5 3711495 480 480 query6 258 180 175 175 query7 4611302 299 299 query8 316 286 291 286 query9 8525239323552355 query10 564 305 299 299 query11 10566 998698119811 query12 117 93 88 88 query13 1675374 376 374 query14 10246 70697069 query15 243 181 187 181 query16 7666315 294 294 query17 1801533 524 524 query18 1892273 275 273 query19 202 149 147 147 query20 88 80 79 79 query21 206 135 130 130 query22 4271415240074007 query23 34070 33576 33553 33553 query24 11009 291229292912 query25 619 406 388 388 query26 1240163 154 154 query27 2385328 329 328 query28 6956215421452145 query29 900 623 651 623 query30 246 149 154 149 query31 1006758 763 758 query32 94 56 55 55 query33 766 318 291 291 query34 1015500 497 497 query35 759 634 645 634 query36 1123101410001000 query37 151 77 85 77 query38 2974285328622853 query39 910 836 834 834 query40 209 128 135 128 query41 53 50 51 50 query42 111 98 106 98 query43 608 561 533 533 query44 1229738 742 738 query45 191 162 161 161 query46 1081735 714 714 query47 1858177817771777 query48 380 308 311 308 query49 846 418 416 416 query50 770 384 392 384 query51 6837677468316774 query52 112 92 98 92 query53 364 291 282 282 query54 871 448 451 448 query55 74 77 81 77 query56 287 271 282 271 query57 1131104410551044 query58 270 257 250 250 query59 3513327231903190 query60 309 270 283 270 query61 92 97 92 92 query62 624 446 462 446 query63 315 286 282 282 query64 9397217816421642 query65 3154309630883088 query66 720 329 325 325 query67 15228 14829 14748 14748 query68 4457555 546 546 query69 650 357 345 345 query70 1205112011481120 query71 378 281 279 279 query72 7379516054865160 query73 749 327 329 327 query74 5881551554145414 query75 3387270226882688 query76 2459977 886 886 query77 461 295 316 295 query78 9497888687738773 query79 2770518 513 513 query80 2077469 468 468 query81 584 217 218 217 query82 920 104 108 104 query83 331 169 173 169 query84 281 86 91 86 query85 1786310 294 294 query86 464 333 335 333 query87 3320311031433110 query88 4377246524432443 query89 480 393 380 380 query90 1785192 195 192 query91 129 101 102 101 query92 62 48 48 48 query93 2993527 531 527 query94 1127228 220 220 query95 411 392 314 314 query96 601 277 270 270 query97 3194298630312986 query98 225 204 198 198 query99 1299845 841 841 Total cold run time: 282176 ms Total hot run time: 172591 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
[PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
mrhhsg opened a new pull request, #37461: URL: https://github.com/apache/doris/pull/37461 ## Proposed changes Duplicate calling the function `Dependency::set_ready()` will cause pipeline tasks to be scheduled incorrectly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
doris-robot commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2213239558 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
mrhhsg commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2213240305 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [config](routineload) adjusting the default configuration of routing load (#34898) [doris]
doris-robot commented on PR #37452: URL: https://github.com/apache/doris/pull/37452#issuecomment-2213240488 ClickBench: Total hot run time: 30.65 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 58a953b655c4737efce59e76a9d79884004132b5, data reload: false query1 0.020.020.02 query2 0.070.030.03 query3 0.250.040.04 query4 1.790.050.06 query5 0.530.520.52 query6 1.270.610.64 query7 0.010.010.01 query8 0.030.020.03 query9 0.530.490.49 query10 0.540.540.54 query11 0.120.090.09 query12 0.120.100.09 query13 0.630.620.61 query14 0.780.780.77 query15 0.760.750.74 query16 0.370.390.39 query17 1.031.011.00 query18 0.220.250.25 query19 1.931.881.86 query20 0.010.020.02 query21 15.46 0.540.54 query22 2.392.691.64 query23 17.25 0.950.95 query24 6.290.801.12 query25 0.380.110.05 query26 0.650.140.15 query27 0.030.030.04 query28 6.930.740.72 query29 12.70 2.312.33 query30 0.600.530.52 query31 2.810.390.38 query32 3.420.490.49 query33 3.053.073.10 query34 15.23 4.814.78 query35 4.824.834.85 query36 1.061.011.01 query37 0.060.040.05 query38 0.030.020.02 query39 0.020.010.02 query40 0.170.130.14 query41 0.060.010.02 query42 0.020.020.01 query43 0.020.020.02 Total cold run time: 104.46 s Total hot run time: 30.65 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) timely pause job if Kafka cluster exception when consume (#33372) [doris]
doris-robot commented on PR #37446: URL: https://github.com/apache/doris/pull/37446#issuecomment-2213240875 ClickBench: Total hot run time: 30.61 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6f7a126ccd161fc108abcb647f09305d63f96e7d, data reload: false query1 0.030.020.02 query2 0.060.020.02 query3 0.260.060.04 query4 1.780.070.08 query5 0.540.520.52 query6 1.250.610.61 query7 0.010.000.01 query8 0.040.020.02 query9 0.520.480.49 query10 0.520.530.53 query11 0.110.080.08 query12 0.120.090.09 query13 0.620.620.62 query14 0.780.780.77 query15 0.780.760.76 query16 0.370.370.36 query17 0.981.031.00 query18 0.200.280.24 query19 1.951.891.79 query20 0.010.010.01 query21 15.50 0.550.56 query22 2.082.891.75 query23 17.29 0.951.00 query24 5.070.850.92 query25 0.310.150.05 query26 0.600.150.16 query27 0.050.040.03 query28 8.250.720.77 query29 12.72 2.172.33 query30 0.610.530.53 query31 2.810.390.37 query32 3.400.500.48 query33 3.073.143.10 query34 15.26 4.794.78 query35 4.884.854.86 query36 1.071.021.01 query37 0.060.050.04 query38 0.040.030.02 query39 0.020.020.01 query40 0.160.140.13 query41 0.070.020.01 query42 0.020.020.01 query43 0.020.020.02 Total cold run time: 104.29 s Total hot run time: 30.61 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) optimize routine load task thread pool and related param(#32282) [doris]
sollhui commented on PR #37443: URL: https://github.com/apache/doris/pull/37443#issuecomment-2213243617 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) avoid routine load pause for check transaction status fail (#32638) [doris]
doris-robot commented on PR #37444: URL: https://github.com/apache/doris/pull/37444#issuecomment-2213242511 ClickBench: Total hot run time: 31.03 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 59da711646699639ce6708255f4b51e59705f77b, data reload: false query1 0.030.020.02 query2 0.060.020.02 query3 0.250.050.05 query4 1.790.060.06 query5 0.530.520.51 query6 1.230.610.62 query7 0.010.010.01 query8 0.030.020.02 query9 0.520.460.48 query10 0.550.520.53 query11 0.120.080.08 query12 0.110.100.09 query13 0.610.610.61 query14 0.770.790.80 query15 0.780.760.76 query16 0.380.370.36 query17 1.031.041.01 query18 0.220.280.23 query19 1.931.861.84 query20 0.010.010.01 query21 15.48 0.540.53 query22 2.052.051.62 query23 16.97 1.080.99 query24 4.702.741.13 query25 0.350.110.05 query26 0.670.150.15 query27 0.050.040.03 query28 6.670.740.73 query29 12.62 2.382.37 query30 0.590.580.52 query31 2.810.380.36 query32 3.410.500.49 query33 3.103.073.11 query34 15.23 4.844.80 query35 4.874.904.87 query36 1.061.021.00 query37 0.060.050.05 query38 0.040.020.03 query39 0.020.020.01 query40 0.160.150.15 query41 0.070.010.01 query42 0.020.010.01 query43 0.020.010.02 Total cold run time: 101.98 s Total hot run time: 31.03 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
doris-robot commented on PR #37455: URL: https://github.com/apache/doris/pull/37455#issuecomment-2213243947 TPC-H: Total hot run time: 49663 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 063353d44cb1f7a425e352a4be663204d53da90e, data reload: false -- Round 1 -- q1 17960 436443234323 q2 2037158 151 151 q3 10456 189418921892 q4 10291 123113431231 q5 8438389639033896 q6 232 126 126 126 q7 2035159016161590 q8 9298272026982698 q9 10409 10382 10162 10162 q10 8610344934493449 q11 429 238 253 238 q12 470 294 308 294 q13 18355 399840263998 q14 358 333 322 322 q15 514 460 466 460 q16 666 572 571 571 q17 1124975 965 965 q18 7339682870296828 q19 1780164516291629 q20 543 313 298 298 q21 4430413840944094 q22 515 448 450 448 Total cold run time: 116289 ms Total hot run time: 49663 ms - Round 2, with runtime_filter_mode=off - q1 4334436443064306 q2 318 230 225 225 q3 4177416641474147 q4 2757273927362736 q5 7150712270807080 q6 235 119 121 119 q7 3253284528562845 q8 4391444844954448 q9 16926 16672 16734 16672 q10 4302432442894289 q11 773 708 689 689 q12 1028863 873 863 q13 8749376837643764 q14 455 441 425 425 q15 508 472 457 457 q16 738 692 700 692 q17 3893392138683868 q18 9356887188688868 q19 1741171617141714 q20 2400213721292129 q21 8582852587808525 q22 1139110310401040 Total cold run time: 87205 ms Total hot run time: 79901 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner) fix bug of select stmt toSql(#37274) [doris]
feiniaofeiafei commented on PR #37344: URL: https://github.com/apache/doris/pull/37344#issuecomment-2213244508 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](delete) fix the error message for valid decimal data [doris]
doris-robot commented on PR #36802: URL: https://github.com/apache/doris/pull/36802#issuecomment-2213244747 TPC-DS: Total hot run time: 174086 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3c82f3cb0850bf0dae9ad809108d9a17a0398174, data reload: false query1 923 376 366 366 query2 6474230823052305 query3 6631204 217 204 query4 28270 17250 17577 17250 query5 3670497 481 481 query6 258 173 161 161 query7 4594297 299 297 query8 333 301 289 289 query9 8587238523632363 query10 589 316 303 303 query11 10992 10041 10180 10041 query12 115 84 83 83 query13 1665385 392 385 query14 10256 777377327732 query15 233 189 190 189 query16 7409323 322 322 query17 1776565 544 544 query18 1941293 282 282 query19 204 159 160 159 query20 92 84 85 84 query21 225 133 133 133 query22 4391413439693969 query23 34042 33855 33548 33548 query24 10659 285528402840 query25 606 425 406 406 query26 738 174 167 167 query27 2170325 347 325 query28 6006218221762176 query29 900 690 638 638 query30 270 155 160 155 query31 981 789 760 760 query32 98 60 58 58 query33 677 328 312 312 query34 891 516 498 498 query35 763 648 652 648 query36 1124963 942 942 query37 138 85 83 83 query38 2957284728102810 query39 907 864 800 800 query40 216 133 128 128 query41 55 53 51 51 query42 120 104 101 101 query43 590 537 556 537 query44 1094749 761 749 query45 197 164 165 164 query46 1102780 715 715 query47 1840177117681768 query48 374 305 303 303 query49 951 417 433 417 query50 772 391 383 383 query51 6821685167626762 query52 111 93 93 93 query53 354 289 283 283 query54 877 450 449 449 query55 72 73 76 73 query56 289 272 263 263 query57 1109103310431033 query58 269 256 244 244 query59 3356325030713071 query60 305 277 274 274 query61 118 99 96 96 query62 604 439 448 439 query63 310 292 292 292 query64 9141215916291629 query65 3189311130873087 query66 743 319 338 319 query67 15701 15019 14964 14964 query68 8242568 561 561 query69 730 446 360 360 query70 1240115711481148 query71 521 283 272 272 query72 8745547054035403 query73 1134326 331 326 query74 5941557954975497 query75 5051263626622636 query76 4662989 873 873 query77 792 312 303 303 query78 9625907310655 9073 query79 6985515 510 510 query80 1079488 478 478 query81 575 223 224 223 query82 557 107 108 107 query83 327 172 165 165 query84 276 90 95 90 query85 1302309 308 308 query86 400 314 313 313 query87 3371313231043104 query88 4259249524732473 query89 499 386 378 378 query90 1954196 192 192 query91 132 104 106 104 query92 60 49 50 49 query93 3409520 517 517 query94 1234208 208 208 query95 405 322 315 315 query96 601 271 276 271 query97 3166299630472996 query98 223 205 198 198 query99 1160840 854 840 Total cold run time: 292892 ms Total hot run time: 174086 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [enhancement](trash) support skip trash, update trash default expire time (#37170) [doris]
zhannngchen merged PR #37409: URL: https://github.com/apache/doris/pull/37409 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [enhancement](trash) support skip trash, update trash default expire time (#37170) (#37409)
This is an automated email from the ASF dual-hosted git repository.
zhangchen pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 494b54a5a56 [enhancement](trash) support skip trash, update trash
default expire time (#37170) (#37409)
494b54a5a56 is described below
commit 494b54a5a56a3db17940a486db54ede17907b756
Author: zhannngchen <48427519+zhannngc...@users.noreply.github.com>
AuthorDate: Mon Jul 8 15:33:02 2024 +0800
[enhancement](trash) support skip trash, update trash default expire time
(#37170) (#37409)
cherry-pick #37170
---
be/src/common/config.cpp | 2 +-
be/src/olap/data_dir.cpp | 8 +++-
2 files changed, 8 insertions(+), 2 deletions(-)
diff --git a/be/src/common/config.cpp b/be/src/common/config.cpp
index cbae3ee896b..11e2635047b 100644
--- a/be/src/common/config.cpp
+++ b/be/src/common/config.cpp
@@ -312,7 +312,7 @@ DEFINE_mInt32(garbage_sweep_batch_size, "100");
DEFINE_mInt32(snapshot_expire_time_sec, "172800");
// It is only a recommended value. When the disk space is insufficient,
// the file storage period under trash dose not have to comply with this
parameter.
-DEFINE_mInt32(trash_file_expire_time_sec, "259200");
+DEFINE_mInt32(trash_file_expire_time_sec, "86400");
// minimum file descriptor number
// modify them upon necessity
DEFINE_Int32(min_file_descriptor_number, "6");
diff --git a/be/src/olap/data_dir.cpp b/be/src/olap/data_dir.cpp
index 37dd76c848c..98bc721c048 100644
--- a/be/src/olap/data_dir.cpp
+++ b/be/src/olap/data_dir.cpp
@@ -927,8 +927,14 @@ void DataDir::disks_compaction_num_increment(int64_t
delta) {
}
Status DataDir::move_to_trash(const std::string& tablet_path) {
-Status res = Status::OK();
+if (config::trash_file_expire_time_sec <= 0) {
+LOG(INFO) << "delete tablet dir " << tablet_path
+ << " directly due to trash_file_expire_time_sec is 0";
+
RETURN_IF_ERROR(io::global_local_filesystem()->delete_directory(tablet_path));
+return delete_tablet_parent_path_if_empty(tablet_path);
+}
+Status res = Status::OK();
// 1. get timestamp string
string time_str;
if ((res = gen_timestamp_string(&time_str)) != Status::OK()) {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [config](routineload) adjusting the default configuration of routing load (#34898) [doris]
doris-robot commented on PR #37452: URL: https://github.com/apache/doris/pull/37452#issuecomment-2213246154 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 58a953b655c4737efce59e76a9d79884004132b5 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.5 seconds inserted 1000 Rows, about 465K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner) fix bug of select stmt toSql (#37274) [doris]
feiniaofeiafei commented on PR #37346: URL: https://github.com/apache/doris/pull/37346#issuecomment-2213246280 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](MultiCast) Avoid copying while holding a lock. [doris]
Mryange closed pull request #37309: [opt](MultiCast) Avoid copying while holding a lock. URL: https://github.com/apache/doris/pull/37309 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](MultiCast) Avoid copying while holding a lock [doris]
Mryange opened a new pull request, #37462: URL: https://github.com/apache/doris/pull/37462 ## Proposed changes Previously, copying was done while holding a lock; Now, get block while holding the lock and then copy -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](MultiCast) Avoid copying while holding a lock [doris]
doris-robot commented on PR #37462: URL: https://github.com/apache/doris/pull/37462#issuecomment-2213246353 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) timely pause job if Kafka cluster exception when consume (#33372) [doris]
doris-robot commented on PR #37446: URL: https://github.com/apache/doris/pull/37446#issuecomment-2213246473 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 6f7a126ccd161fc108abcb647f09305d63f96e7d with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.5 seconds inserted 1000 Rows, about 465K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) avoid routine load pause for check transaction status fail (#32638) [doris]
doris-robot commented on PR #37444: URL: https://github.com/apache/doris/pull/37444#issuecomment-2213248244 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 59da711646699639ce6708255f4b51e59705f77b with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.4 seconds inserted 1000 Rows, about 467K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [perf](routine-load) reduce waiting in task scheduler to accelerate consume (#33756) [doris]
doris-robot commented on PR #37448: URL: https://github.com/apache/doris/pull/37448#issuecomment-2213248976 ClickBench: Total hot run time: 30.5 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 34a8f7425b809ff036596fee5f349f0ae8173cf6, data reload: false query1 0.020.020.02 query2 0.070.030.02 query3 0.240.040.04 query4 1.780.060.07 query5 0.540.530.53 query6 1.250.620.62 query7 0.010.010.02 query8 0.030.020.02 query9 0.520.490.48 query10 0.540.530.53 query11 0.120.090.09 query12 0.120.090.09 query13 0.620.610.61 query14 0.790.770.79 query15 0.770.750.75 query16 0.380.370.35 query17 1.021.031.04 query18 0.220.260.25 query19 1.911.891.87 query20 0.010.010.01 query21 15.46 0.550.56 query22 2.122.281.54 query23 17.20 0.930.93 query24 7.740.830.97 query25 0.370.150.04 query26 0.840.160.14 query27 0.040.040.04 query28 5.610.740.74 query29 12.69 2.252.30 query30 0.610.600.52 query31 2.820.390.38 query32 3.360.490.50 query33 3.083.053.04 query34 15.27 4.804.79 query35 4.884.834.83 query36 1.061.011.01 query37 0.060.040.05 query38 0.040.020.02 query39 0.030.010.01 query40 0.160.140.13 query41 0.060.020.01 query42 0.020.020.01 query43 0.020.010.02 Total cold run time: 104.5 s Total hot run time: 30.5 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](alter) support add partitions in batch [doris]
doris-robot commented on PR #37114: URL: https://github.com/apache/doris/pull/37114#issuecomment-2213249164 ClickBench: Total hot run time: 30.52 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9c9434e4ff5f9c296f522ad95c7f755e80538e37, data reload: false query1 0.040.030.03 query2 0.080.040.04 query3 0.220.050.06 query4 1.670.100.08 query5 0.500.480.49 query6 1.130.730.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.550.480.49 query10 0.550.540.55 query11 0.150.110.11 query12 0.150.130.12 query13 0.590.590.58 query14 0.780.780.78 query15 0.850.810.82 query16 0.380.370.37 query17 0.941.031.04 query18 0.220.250.24 query19 1.891.761.78 query20 0.010.010.01 query21 15.40 0.760.65 query22 4.327.241.69 query23 18.31 1.331.22 query24 2.190.220.22 query25 0.160.080.09 query26 0.290.200.21 query27 0.440.230.23 query28 13.20 1.011.00 query29 12.61 3.313.30 query30 0.260.070.05 query31 2.880.370.38 query32 3.320.480.47 query33 2.872.902.90 query34 17.16 4.424.38 query35 4.414.434.42 query36 0.660.480.48 query37 0.180.150.16 query38 0.150.150.14 query39 0.050.040.04 query40 0.160.110.12 query41 0.090.050.05 query42 0.060.050.05 query43 0.040.040.04 Total cold run time: 109.98 s Total hot run time: 30.52 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](spill) Duplicate calls to Dependency::set_ready() in hash join [doris]
github-actions[bot] commented on PR #37461: URL: https://github.com/apache/doris/pull/37461#issuecomment-2213249587 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) dealing with the high watermark of Kafka may fallback (#35901) [doris]
doris-robot commented on PR #37454: URL: https://github.com/apache/doris/pull/37454#issuecomment-2213250162 TPC-DS: Total hot run time: 203698 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 88fb51b5436a53dbe73a581c924e3ce7a8d4a8ca, data reload: false query1 936 419 375 375 query2 6546281827112711 query3 6913206 202 202 query4 20963 17971 18025 17971 query5 19736 653365536533 query6 282 226 232 226 query7 4158289 293 289 query8 412 368 359 359 query9 3117267925972597 query10 431 296 285 285 query11 11238 10715 10687 10687 query12 117 80 73 73 query13 5605715 679 679 query14 18187 13065 13300 13065 query15 397 241 237 237 query16 6453286 265 265 query17 17101431882 882 query18 2307422 401 401 query19 213 153 155 153 query20 78 83 80 80 query21 193 92 90 90 query22 5223512250945094 query23 32525 31989 32051 31989 query24 6894649865176498 query25 521 430 423 423 query26 526 159 160 159 query27 1839287 294 287 query28 6218238523222322 query29 2994261526782615 query30 246 166 169 166 query31 908 764 749 749 query32 67 67 62 62 query33 392 258 256 256 query34 853 469 487 469 query35 1153976 929 929 query36 1441116912741169 query37 90 61 62 61 query38 3105295429622954 query39 1376131113071307 query40 209 98 96 96 query41 48 44 43 43 query42 84 83 86 83 query43 646 629 647 629 query44 1124713 715 713 query45 244 235 236 235 query46 1234981 974 974 query47 1800168716731673 query48 1016715 698 698 query49 624 369 384 369 query50 878 620 632 620 query51 4787468846484648 query52 94 78 82 78 query53 452 330 316 316 query54 2643244724432443 query55 83 73 72 72 query56 249 230 214 214 query57 1137107111411071 query58 213 208 198 198 query59 4232394738873887 query60 205 204 198 198 query61 98 95 96 95 query62 800 481 448 448 query63 492 345 339 339 query64 2511153514851485 query65 3637356335473547 query66 780 379 375 375 query67 15838 15637 15898 15637 query68 8431654 641 641 query69 562 342 351 342 query70 1670137313411341 query71 406 309 312 309 query72 6487347035083470 query73 736 319 324 319 query74 6268589958505850 query75 5208378637003700 query76 5125115211891152 query77 872 262 248 248 query78 12708 11805 12564 11805 query79 10590 637 627 627 query80 946 404 397 397 query81 492 236 232 232 query82 1560106 101 101 query83 175 130 135 130 query84 266 71 74 71 query85 887 346 339 339 query86 330 294 279 279 query87 3204308930043004 query88 4764229922902290 query89 477 296 285 285 query90 1972217 208 208 query91 171 140 135 135 query92 61 53 55 53 query93 6495532 601 532 query94 722 217 209 209 query95 1094103610501036 query96 648 321 320 320 query97 6565644364026402 query98 188 182 178 178 query99 2826840 880 840 Total cold run time: 315427 ms Total hot run time: 203698 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [opt](MultiCast) Avoid copying while holding a lock [doris]
Mryange commented on PR #37462: URL: https://github.com/apache/doris/pull/37462#issuecomment-2213250404 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](ES Catalog)Support control scroll level by config #37180 [doris]
qidaye commented on PR #37271: URL: https://github.com/apache/doris/pull/37271#issuecomment-2213251609 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) fix routine load lag is negative (#33846) [doris]
sollhui commented on PR #37449: URL: https://github.com/apache/doris/pull/37449#issuecomment-2213253474 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](delete) fix the error message for valid decimal data [doris]
doris-robot commented on PR #36802: URL: https://github.com/apache/doris/pull/36802#issuecomment-2213254512 ClickBench: Total hot run time: 31.15 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 3c82f3cb0850bf0dae9ad809108d9a17a0398174, data reload: false query1 0.040.040.03 query2 0.080.040.04 query3 0.230.050.05 query4 1.680.080.07 query5 0.490.480.50 query6 1.130.730.73 query7 0.020.010.02 query8 0.050.050.05 query9 0.550.500.50 query10 0.530.540.53 query11 0.160.120.11 query12 0.150.120.12 query13 0.590.600.59 query14 0.780.790.76 query15 0.860.800.82 query16 0.370.370.38 query17 0.981.021.04 query18 0.220.230.26 query19 1.871.711.68 query20 0.010.010.01 query21 15.39 0.740.65 query22 3.936.762.52 query23 18.29 1.401.19 query24 2.110.230.23 query25 0.160.070.08 query26 0.290.200.20 query27 0.450.230.23 query28 13.30 1.021.00 query29 12.61 3.333.31 query30 0.250.060.06 query31 2.900.390.38 query32 3.250.490.47 query33 2.882.922.88 query34 16.96 4.334.36 query35 4.424.414.44 query36 0.650.470.50 query37 0.180.160.15 query38 0.150.140.14 query39 0.040.040.03 query40 0.150.140.12 query41 0.100.060.06 query42 0.060.040.05 query43 0.050.030.04 Total cold run time: 109.36 s Total hot run time: 31.15 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) add backquote and qualifier to udf, column, column alias and table alias when create view [doris]
doris-robot commented on PR #37237: URL: https://github.com/apache/doris/pull/37237#issuecomment-2213254566 TPC-H: Total hot run time: 40449 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c5d54615b8d0929cacd633b2deb62bf89e3957b6, data reload: false -- Round 1 -- q1 17630 430843744308 q2 2018192 184 184 q3 10450 122410781078 q4 10194 900 818 818 q5 7506267626142614 q6 215 136 134 134 q7 960 597 613 597 q8 9224207520322032 q9 8804645664806456 q10 8987375337173717 q11 528 233 240 233 q12 409 229 230 229 q13 18907 299830122998 q14 273 213 232 213 q15 532 508 484 484 q16 519 376 372 372 q17 965 597 688 597 q18 8021743574747435 q19 5560148715441487 q20 670 322 325 322 q21 4909385938083808 q22 400 344 333 333 Total cold run time: 117681 ms Total hot run time: 40449 ms - Round 2, with runtime_filter_mode=off - q1 4439421542174215 q2 388 276 257 257 q3 3001292129122912 q4 1976171017401710 q5 5607548554235423 q6 226 129 127 127 q7 2194190118401840 q8 3283338333983383 q9 8664873489188734 q10 4071384437733773 q11 613 487 515 487 q12 822 629 660 629 q13 16718 314631833146 q14 329 265 291 265 q15 535 489 481 481 q16 499 441 451 441 q17 1827150514721472 q18 8188802278117811 q19 2586173316031603 q20 2129188118611861 q21 5127493048524852 q22 606 565 545 545 Total cold run time: 73828 ms Total hot run time: 55967 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [perf](routine-load) reduce waiting in task scheduler to accelerate consume (#33756) [doris]
doris-robot commented on PR #37448: URL: https://github.com/apache/doris/pull/37448#issuecomment-2213254643 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 34a8f7425b809ff036596fee5f349f0ae8173cf6 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.2 seconds inserted 1000 Rows, about 471K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine-load) optimize routine load job auto resume policy (#35266) [doris]
doris-robot commented on PR #37453: URL: https://github.com/apache/doris/pull/37453#issuecomment-2213255299 TPC-DS: Total hot run time: 205675 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a0892fd13ea5b5826f1b0dc58e8d4086f81e, data reload: false query1 927 413 379 379 query2 6527289428822882 query3 6940207 201 201 query4 20794 18031 17948 17948 query5 19746 646665056466 query6 286 216 227 216 query7 4161296 314 296 query8 408 381 412 381 query9 3097267726052605 query10 416 289 301 289 query11 11380 10781 10867 10781 query12 128 79 75 75 query13 5635704 707 704 query14 18061 13706 13742 13706 query15 366 254 242 242 query16 6473305 272 272 query17 17451419903 903 query18 2297415 419 415 query19 210 158 157 157 query20 83 79 84 79 query21 192 97 97 97 query22 5332510251105102 query23 32802 32245 32242 32242 query24 7065671165846584 query25 567 506 468 468 query26 531 190 181 181 query27 2792303 310 303 query28 6253236223272327 query29 2906273026792679 query30 255 165 172 165 query31 928 762 735 735 query32 121 63 58 58 query33 693 276 255 255 query34 850 476 490 476 query35 1162882 936 882 query36 1290120313191203 query37 92 71 62 62 query38 3142293429162916 query39 1411133113371331 query40 208 93 94 93 query41 47 44 43 43 query42 83 78 87 78 query43 743 688 767 688 query44 1123722 726 722 query45 252 232 233 232 query46 1227968 982 968 query47 2195177117511751 query48 1014712 712 712 query49 623 374 369 369 query50 871 603 610 603 query51 4794470947134709 query52 91 88 85 85 query53 447 328 322 322 query54 2654247424532453 query55 92 80 75 75 query56 257 208 197 197 query57 1238101411681014 query58 222 210 216 210 query59 3998371436813681 query60 209 200 200 200 query61 104 97 99 97 query62 853 437 470 437 query63 489 332 335 332 query64 2614155115471547 query65 3644356135733561 query66 779 379 386 379 query67 15641 16004 16203 16004 query68 8587668 661 661 query69 573 362 349 349 query70 1745156514011401 query71 429 306 312 306 query72 6508349535573495 query73 737 311 318 311 query74 6352589358255825 query75 4688384936743674 query76 4855115311071107 query77 689 246 257 246 query78 12804 11850 11783 11783 query79 7108640 640 640 query80 1058411 414 411 query81 498 235 239 235 query82 1492103 97 97 query83 173 132 130 130 query84 260 71 74 71 query85 909 345 342 342 query86 339 327 336 327 query87 3249309430803080 query88 4796230322972297 query89 337 296 305 296 query90 2099214 218 214 query91 174 149 139 139 query92 60 55 55 55 query93 3236538 581 538 query94 786 214 210 210 query95 1127109110681068 query96 633 322 327 322 query97 6587635864586358 query98 197 186 174 174 query99 2965939 888 888 Total cold run time: 310626 ms Total hot run time: 205675 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [fix](multi-table-load) fix be core when multi table load pipe finish fail (#36269) [doris]
doris-robot commented on PR #37455: URL: https://github.com/apache/doris/pull/37455#issuecomment-2213255656 TeamCity be ut coverage result: Function Coverage: 37.90% (8116/21417) Line Coverage: 29.56% (66495/224921) Region Coverage: 29.03% (34275/118053) Branch Coverage: 24.91% (17606/70692) Coverage Report: http://coverage.selectdb-in.cc/coverage/063353d44cb1f7a425e352a4be663204d53da90e_063353d44cb1f7a425e352a4be663204d53da90e/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) check segment num when closing each tablet [doris]
github-actions[bot] commented on PR #36753: URL: https://github.com/apache/doris/pull/36753#issuecomment-2213255677 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](routine-load) optimize routine load task thread pool and related param(#32282) [doris]
github-actions[bot] commented on PR #37443: URL: https://github.com/apache/doris/pull/37443#issuecomment-2213254794 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
doris-robot commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213256087 TeamCity be ut coverage result: Function Coverage: 37.89% (8114/21417) Line Coverage: 29.56% (66489/224940) Region Coverage: 29.02% (34265/118058) Branch Coverage: 24.90% (17600/70694) Coverage Report: http://coverage.selectdb-in.cc/coverage/f7d7f30bae82c02b48f01f2bf86d4e8957c61187_f7d7f30bae82c02b48f01f2bf86d4e8957c61187/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](test) fix case of test_stream_load_error_url for cloud [doris]
liaoxin01 opened a new pull request, #37463: URL: https://github.com/apache/doris/pull/37463 ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](test) fix case of test_stream_load_error_url for cloud [doris]
doris-robot commented on PR #37463: URL: https://github.com/apache/doris/pull/37463#issuecomment-2213255701 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](MultiCast) Avoid copying while holding a lock [doris]
github-actions[bot] commented on PR #37462: URL: https://github.com/apache/doris/pull/37462#issuecomment-2213256194 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](move-memtable) check segment num when closing each tablet [doris]
github-actions[bot] commented on PR #36753: URL: https://github.com/apache/doris/pull/36753#issuecomment-2213255721 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](routine-load) dealing with the high watermark of Kafka may fallback (#35901) [doris]
doris-robot commented on PR #37454: URL: https://github.com/apache/doris/pull/37454#issuecomment-2213259741 ClickBench: Total hot run time: 30.66 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 88fb51b5436a53dbe73a581c924e3ce7a8d4a8ca, data reload: false query1 0.020.020.02 query2 0.070.020.02 query3 0.260.040.05 query4 1.780.060.06 query5 0.530.530.52 query6 1.230.670.62 query7 0.010.010.00 query8 0.040.030.02 query9 0.520.470.48 query10 0.550.540.53 query11 0.120.090.08 query12 0.120.090.10 query13 0.610.610.62 query14 0.780.770.78 query15 0.800.760.75 query16 0.370.370.36 query17 1.000.961.01 query18 0.210.260.26 query19 1.921.861.83 query20 0.020.010.01 query21 15.47 0.560.56 query22 2.061.811.48 query23 17.12 1.001.09 query24 6.281.581.01 query25 0.410.120.05 query26 0.720.170.14 query27 0.040.030.04 query28 6.260.730.70 query29 12.71 2.362.31 query30 0.590.520.52 query31 2.800.380.37 query32 3.390.500.48 query33 3.063.093.12 query34 15.26 4.834.80 query35 4.904.854.85 query36 1.041.021.01 query37 0.060.040.04 query38 0.040.020.02 query39 0.020.010.02 query40 0.160.140.15 query41 0.060.010.02 query42 0.020.010.02 query43 0.020.010.02 Total cold run time: 103.45 s Total hot run time: 30.66 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](routine-load) optimize out of range error message (#36450) [doris]
doris-robot commented on PR #37456: URL: https://github.com/apache/doris/pull/37456#issuecomment-2213261414 TPC-DS: Total hot run time: 204001 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit f7d7f30bae82c02b48f01f2bf86d4e8957c61187, data reload: false query1 932 421 380 380 query2 6533299726332633 query3 6913210 200 200 query4 21386 18074 18128 18074 query5 19729 653464156415 query6 278 225 234 225 query7 4161296 310 296 query8 456 428 430 428 query9 3144268126142614 query10 411 312 310 310 query11 11428 10941 10861 10861 query12 126 78 77 77 query13 5612703 684 684 query14 17781 13562 13447 13447 query15 364 250 242 242 query16 6463300 261 261 query17 16951448861 861 query18 2336417 430 417 query19 217 153 154 153 query20 81 80 79 79 query21 200 95 94 94 query22 5324510251155102 query23 32426 32060 31814 31814 query24 6965650464656465 query25 523 434 425 425 query26 530 159 160 159 query27 1862294 289 289 query28 6139238623252325 query29 3010284527952795 query30 247 167 170 167 query31 894 758 749 749 query32 68 61 64 61 query33 385 288 257 257 query34 853 486 476 476 query35 1118942 937 937 query36 1414118711381138 query37 89 62 61 61 query38 3172289929192899 query39 1383131913221319 query40 206 95 97 95 query41 54 46 45 45 query42 82 86 86 86 query43 734 673 721 673 query44 1141703 711 703 query45 247 236 236 236 query46 1220972 1005972 query47 1784176216761676 query48 1044724 708 708 query49 609 394 364 364 query50 865 615 583 583 query51 4765465647484656 query52 94 70 85 70 query53 448 324 311 311 query54 2666244524802445 query55 83 80 82 80 query56 225 195 199 195 query57 1183112512711125 query58 222 200 206 200 query59 4065417240874087 query60 214 190 216 190 query61 99 94 94 94 query62 871 441 450 441 query63 484 345 346 345 query64 2638154915111511 query65 3677356635543554 query66 807 386 370 370 query67 16311 15211 15706 15211 query68 8521645 658 645 query69 580 379 362 362 query70 1679140514101405 query71 407 311 313 311 query72 6512348234623462 query73 740 324 318 318 query74 6377589358875887 query75 4794373337763733 query76 4851117312071173 query77 674 250 245 245 query78 12686 11531 12185 11531 query79 9734651 645 645 query80 1220398 414 398 query81 503 238 232 232 query82 1624100 97 97 query83 167 134 126 126 query84 264 74 71 71 query85 890 335 325 325 query86 329 288 292 288 query87 3224301630533016 query88 4667230222832283 query89 470 304 294 294 query90 1909213 202 202 query91 185 139 143 139 query92 61 53 53 53 query93 6196572 580 572 query94 767 205 212 205 query95 1098108310361036 query96 643 321 324 321 query97 6492636264586362 query98 176 175 167 167 query99 2962986 882 882 Total cold run time: 314888 ms Total hot run time: 204001 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [branch-2.0](routine-load) add retry when get Kafka meta info and make get Kafka meta timeout configurable [doris]
sollhui commented on PR #37458: URL: https://github.com/apache/doris/pull/37458#issuecomment-2213262492 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](auth)fix fe can not restart when replay create row policy log [doris]
doris-robot commented on PR #37342: URL: https://github.com/apache/doris/pull/37342#issuecomment-2213262847 TPC-H: Total hot run time: 39524 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a2833f473f174f319c1550f9a7b993ae66944884, data reload: false -- Round 1 -- q1 17616 469042784278 q2 2023192 201 192 q3 10432 118610961096 q4 10199 721 787 721 q5 7513259726422597 q6 219 139 139 139 q7 957 602 611 602 q8 9221204120632041 q9 8891649164516451 q10 9015373237223722 q11 444 239 239 239 q12 492 229 235 229 q13 17885 298429872984 q14 260 231 232 231 q15 540 487 489 487 q16 531 384 380 380 q17 954 645 757 645 q18 7958751273727372 q19 5385151712631263 q20 694 331 334 331 q21 4854391031793179 q22 398 345 353 345 Total cold run time: 116481 ms Total hot run time: 39524 ms - Round 2, with runtime_filter_mode=off - q1 4348430542904290 q2 367 265 275 265 q3 2982282828762828 q4 2010166716601660 q5 5638553954585458 q6 227 139 143 139 q7 2141184018461840 q8 3300341034003400 q9 8676866688128666 q10 4064388237393739 q11 575 500 474 474 q12 820 649 636 636 q13 17231 318731593159 q14 332 280 271 271 q15 539 482 511 482 q16 497 444 465 444 q17 1862152015011501 q18 8106797177067706 q19 1738149217071492 q20 2147186918631863 q21 5083493849124912 q22 619 538 546 538 Total cold run time: 73302 ms Total hot run time: 55763 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
