Re: [PR] [Fix](beut) Make function be-ut test aware of result's precision [doris]
doris-robot commented on PR #49608: URL: https://github.com/apache/doris/pull/49608#issuecomment-2791342810 TPC-H: Total hot run time: 34229 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 40d92aa80b797132a00ed7e7c580bcc55704020b, data reload: false -- Round 1 -- q1 25892 501550345015 q2 2065278 174 174 q3 10402 1248686 686 q4 10221 996 524 524 q5 7544231623402316 q6 193 163 133 133 q7 909 743 615 615 q8 9317130711441144 q9 6897527650715071 q10 6907231419361936 q11 490 298 275 275 q12 355 357 243 243 q13 17783 370130573057 q14 219 219 208 208 q15 532 491 492 491 q16 619 615 590 590 q17 613 851 389 389 q18 7480707372177073 q19 1329958 545 545 q20 322 338 225 225 q21 4494349425742574 q22 1053997 945 945 Total cold run time: 115636 ms Total hot run time: 34229 ms - Round 2, with runtime_filter_mode=off - q1 5118509251035092 q2 242 328 228 228 q3 2149263422922292 q4 1431180414321432 q5 4496450044024402 q6 221 174 135 135 q7 1946192117431743 q8 2615258525512551 q9 7242719870767076 q10 2983317327282728 q11 596 506 520 506 q12 697 754 607 607 q13 3478394633843384 q14 286 292 268 268 q15 538 499 489 489 q16 665 709 650 650 q17 1174156213781378 q18 7737741873487348 q19 813 850 853 850 q20 1924196418231823 q21 5439484549074845 q22 1055103510121012 Total cold run time: 52845 ms Total hot run time: 50839 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: Revert "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928)
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new fa511851863 Revert "[enhancement](hive)Initial support for Hive
org.openx.data.jsonserde.JsonSerDe" (#49928)
fa511851863 is described below
commit fa511851863e883487faead5e0bccc2876671523
Author: Dongyang Li
AuthorDate: Thu Apr 10 09:52:46 2025 +0800
Revert "[enhancement](hive)Initial support for Hive
org.openx.data.jsonserde.JsonSerDe" (#49928)
Reverts apache/doris#49209
---
be/src/vec/exec/format/json/new_json_reader.cpp| 33 +---
be/src/vec/exec/format/json/new_json_reader.h | 8 +-
.../hive/scripts/auxlib/json-serde-1.3.9.tar.gz| Bin 78992 -> 0 bytes
.../scripts/create_preinstalled_scripts/run76.hql | 56 --
.../docker-compose/hive/scripts/hive-metastore.sh | 11 ---
.../json/openx_json/json_data_arrays_tb/1 | 2 -
.../json/openx_json/json_one_column_table/1| 5 --
.../preinstalled_data/json/openx_json/json_table/1 | 2 -
.../preinstalled_data/json/openx_json/json_table/2 | 11 ---
.../json/openx_json/scalar_to_array_tb/1 | 1 -
.../doris/datasource/hive/HMSExternalTable.java| 8 --
.../datasource/hive/HiveMetaStoreClientHelper.java | 1 -
.../doris/datasource/hive/HiveProperties.java | 12 ---
.../doris/datasource/hive/source/HiveScanNode.java | 48 +---
.../java/org/apache/doris/qe/SessionVariable.java | 21 --
gensrc/thrift/PlanNodes.thrift | 3 -
.../hive/test_hive_openx_json.out | Bin 709 -> 0 bytes
.../hive/test_hive_openx_json.groovy | 84 -
18 files changed, 9 insertions(+), 297 deletions(-)
diff --git a/be/src/vec/exec/format/json/new_json_reader.cpp
b/be/src/vec/exec/format/json/new_json_reader.cpp
index a125654eada..5820174e7fa 100644
--- a/be/src/vec/exec/format/json/new_json_reader.cpp
+++ b/be/src/vec/exec/format/json/new_json_reader.cpp
@@ -399,20 +399,6 @@ Status NewJsonReader::_get_range_params() {
if (_range.table_format_params.table_format_type == "hive") {
_is_hive_table = true;
}
-if (_params.file_attributes.__isset.openx_json_ignore_malformed) {
-_openx_json_ignore_malformed =
_params.file_attributes.openx_json_ignore_malformed;
-}
-return Status::OK();
-}
-
-static Status ignore_malformed_json_append_null(Block& block) {
-for (auto& column : block.get_columns()) {
-if (!column->is_nullable()) [[unlikely]] {
-return Status::DataQualityError("malformed json, but the column
`{}` is not nullable.",
-column->get_name());
-}
-
static_cast(column->assume_mutable().get())->insert_default();
-}
return Status::OK();
}
@@ -500,13 +486,8 @@ Status NewJsonReader::_vhandle_simple_json(RuntimeState*
/*state*/, Block& block
bool valid = false;
if (_next_row >= _total_rows) { // parse json and generic document
Status st = _parse_json(is_empty_row, eof);
-if (st.is()) {
-if (_is_load) {
-continue; // continue to read next (for load, after this ,
already append error to file.)
-} else if (_openx_json_ignore_malformed) {
-RETURN_IF_ERROR(ignore_malformed_json_append_null(block));
-continue;
-}
+if (_is_load && st.is()) {
+continue; // continue to read next (for load, after this ,
already append error to file.)
}
RETURN_IF_ERROR(st);
if (*is_empty_row) {
@@ -1315,15 +1296,9 @@ Status
NewJsonReader::_simdjson_handle_simple_json(RuntimeState* /*state*/, Bloc
// step2: get json value by json doc
Status st = _get_json_value(&size, eof, &error, is_empty_row);
-if (st.is()) {
-if (_is_load) {
-return Status::OK();
-} else if (_openx_json_ignore_malformed) {
-RETURN_IF_ERROR(ignore_malformed_json_append_null(block));
-return Status::OK();
-}
+if (_is_load && st.is()) {
+return Status::OK();
}
-
RETURN_IF_ERROR(st);
if (*is_empty_row || *eof) {
return Status::OK();
diff --git a/be/src/vec/exec/format/json/new_json_reader.h
b/be/src/vec/exec/format/json/new_json_reader.h
index 6b42ca23b4f..430f8c7af18 100644
--- a/be/src/vec/exec/format/json/new_json_reader.h
+++ b/be/src/vec/exec/format/json/new_json_reader.h
@@ -293,22 +293,18 @@ private:
int32_t skip_bitmap_col_idx {-1};
+bool _is_load = true;
//Used to indicate whether it is a stream load. When loading, only data
will be inserted into columnString.
//If an illegal
Re: [PR] Revert "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" [doris]
hello-stephen merged PR #49928: URL: https://github.com/apache/doris/pull/49928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (fa511851863 -> 43fb7d79c0a)
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from fa511851863 Revert "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) add 43fb7d79c0a [UT](pipeline) Add UT cases to terminate tasks randomly (#49906) No new revisions were added by this update. Summary of changes: be/src/pipeline/exec/operator.h | 10 +++ be/src/pipeline/pipeline_task.cpp | 32 +- be/src/pipeline/pipeline_task.h | 7 ++- be/test/pipeline/pipeline_task_test.cpp | 108 4 files changed, 125 insertions(+), 32 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](SetOperator) refine some SetOperator code. [doris]
github-actions[bot] commented on PR #49772: URL: https://github.com/apache/doris/pull/49772#issuecomment-2791371428 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] do exchange refactor [doris]
doris-robot commented on PR #49335: URL: https://github.com/apache/doris/pull/49335#issuecomment-2791385889 TPC-H: Total hot run time: 34178 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 51883d2b4b692c1a9951a7fd80d171e38e4b3db7, data reload: false -- Round 1 -- q1 26312 515549284928 q2 2070282 181 181 q3 10386 1234703 703 q4 10238 1008517 517 q5 7473237623592359 q6 187 161 130 130 q7 926 746 608 608 q8 9342128111821182 q9 6873512351135113 q10 6880230018971897 q11 501 289 273 273 q12 356 360 212 212 q13 17808 364831053105 q14 219 244 216 216 q15 529 470 493 470 q16 650 609 587 587 q17 618 860 384 384 q18 7577714571057105 q19 1622962 581 581 q20 347 340 220 220 q21 4023340424622462 q22 1034995 945 945 Total cold run time: 115971 ms Total hot run time: 34178 ms - Round 2, with runtime_filter_mode=off - q1 5143506251195062 q2 240 328 223 223 q3 2160260022732273 q4 1453181614461446 q5 4541435845234358 q6 225 164 125 125 q7 2042194717691769 q8 2583265825192519 q9 7377731971347134 q10 2939318327522752 q11 574 516 491 491 q12 677 772 601 601 q13 3573387732923292 q14 290 312 266 266 q15 526 484 480 480 q16 647 683 669 669 q17 1158161713721372 q18 7813757775067506 q19 858 825 1003825 q20 1942195618941894 q21 5249495448014801 q22 1051105310121012 Total cold run time: 53061 ms Total hot run time: 50870 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](analytic) fix analytic operator maybe used after free about column [doris]
zhangstar333 commented on PR #49924: URL: https://github.com/apache/doris/pull/49924#issuecomment-2791384606 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](nereids)support show functions [doris]
lsy3993 commented on PR #49893: URL: https://github.com/apache/doris/pull/49893#issuecomment-2791385811 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support utf8 input in initcap [doris]
BiteThet merged PR #49846: URL: https://github.com/apache/doris/pull/49846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49846-branch-3.0 created (now 89ce038c6b1)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49846-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at 89ce038c6b1 [fix](config) Turn on default value of `enable_cloud_tablet_report` (#49757) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Add UT cases to terminate tasks randomly [doris]
github-actions[bot] commented on PR #49906: URL: https://github.com/apache/doris/pull/49906#issuecomment-2791358649 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feature](function) support utf8 input in initcap #49846 [doris]
Thearas commented on PR #49933: URL: https://github.com/apache/doris/pull/49933#issuecomment-2791388019 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (95a6885e013 -> 8f535323727)
This is an automated email from the ASF dual-hosted git repository. panxiaolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 95a6885e013 [refactor](minor) Delete unused RuntimeFilterDependency (#49902) add 8f535323727 [feature](function) support utf8 input in initcap (#49846) No new revisions were added by this update. Summary of changes: be/src/vec/functions/function_string.cpp | 53 +++- be/test/vec/function/function_string_test.cpp | 2 + .../data/function_p0/test_function_string.out | Bin 188 -> 247 bytes .../suites/function_p0/test_function_string.groovy | 11 + .../fold_constant_string_arithmatic.groovy | 288 ++--- 5 files changed, 208 insertions(+), 146 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49846-branch-3.0 updated (89ce038c6b1 -> 9f38d2049a5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49846-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from 89ce038c6b1 [fix](config) Turn on default value of `enable_cloud_tablet_report` (#49757) add 9f38d2049a5 [feature](function) support utf8 input in initcap (#49846) No new revisions were added by this update. Summary of changes: be/src/vec/functions/function_string.cpp | 53 +++- be/test/vec/function/function_string_test.cpp | 2 + .../data/function_p0/test_function_string.out | Bin 188 -> 247 bytes .../suites/function_p0/test_function_string.groovy | 11 + .../fold_constant_string_arithmatic.groovy | 288 ++--- 5 files changed, 208 insertions(+), 146 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feature](function) support utf8 input in initcap #49846 [doris]
dataroaring closed pull request #49933: branch-3.0: [feature](function) support utf8 input in initcap #49846 URL: https://github.com/apache/doris/pull/49933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feature](function) support utf8 input in initcap #49846 [doris]
Thearas commented on PR #49933: URL: https://github.com/apache/doris/pull/49933#issuecomment-2791387973 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49846-branch-2.1 deleted (was 7ce420c194a)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49846-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 7ce420c194a [chore](log) change PointQueryExecutor log to VLOG_DEBUG (#49860) (#49900) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](timer) Fix task execution timer [doris]
Gabriel39 opened a new pull request, #49939: URL: https://github.com/apache/doris/pull/49939 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fragment mgr) Release query context once query finished [doris]
doris-robot commented on PR #49934: URL: https://github.com/apache/doris/pull/49934#issuecomment-2791470159 ClickBench: Total hot run time: 31.28 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit b72741ee03dca7317d68663baa2808da94dc5467, data reload: false query1 0.040.040.03 query2 0.120.110.11 query3 0.240.200.19 query4 1.600.200.11 query5 0.560.550.56 query6 1.220.730.72 query7 0.020.020.01 query8 0.040.040.04 query9 0.580.510.50 query10 0.580.580.58 query11 0.150.110.10 query12 0.150.120.12 query13 0.620.610.61 query14 2.812.722.69 query15 0.930.870.86 query16 0.390.400.38 query17 1.071.041.04 query18 0.210.200.20 query19 2.051.911.82 query20 0.020.010.01 query21 15.35 0.900.57 query22 0.741.130.66 query23 14.99 1.400.66 query24 7.681.130.78 query25 0.520.140.05 query26 0.570.180.15 query27 0.050.040.04 query28 9.100.900.45 query29 12.52 4.093.36 query30 0.260.080.06 query31 2.830.600.38 query32 3.240.570.48 query33 3.043.203.12 query34 15.53 5.234.53 query35 4.534.514.51 query36 0.680.500.49 query37 0.090.060.06 query38 0.050.040.03 query39 0.030.020.02 query40 0.180.140.13 query41 0.080.030.03 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 105.54 s Total hot run time: 31.28 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
Gabriel39 commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791470016 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Fix](Catalog) Close system resources when dropping catalog (#49621) [doris]
CalvinKirs commented on PR #49936: URL: https://github.com/apache/doris/pull/49936#issuecomment-2791470333 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) fix multi table load repeated failures and retries when meet data quality error [doris]
hello-stephen commented on PR #49938: URL: https://github.com/apache/doris/pull/49938#issuecomment-2791460501 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature]bind workload group to compute group [doris]
wangbo commented on code in PR #49884:
URL: https://github.com/apache/doris/pull/49884#discussion_r2036410791
##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CreateWorkloadGroupCommand.java:
##
@@ -67,21 +75,38 @@ private void validate(ConnectContext ctx) throws
AnalysisException {
}
String tagStr = properties.get(WorkloadGroup.TAG);
-if (!StringUtils.isEmpty(tagStr)
-&&
WorkloadGroupMgr.DEFAULT_GROUP_NAME.equals(workloadGroupName)) {
+if (!StringUtils.isEmpty(tagStr)) {
Review Comment:
字符串为null或者empty都会被StringUtils.isEmpty判定为空
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](pipeline) refactor the pipeline exec code remove unless code [doris]
Gabriel39 commented on code in PR #34557:
URL: https://github.com/apache/doris/pull/34557#discussion_r2036444701
##
be/src/pipeline/pipeline_task.cpp:
##
@@ -251,7 +250,6 @@ Status PipelineTask::execute(bool* eos) {
COUNTER_UPDATE(_yield_counts, 1);
break;
}
-SCOPED_RAW_TIMER(&time_spent);
Review Comment:
@mengzhisy Sorry for that. I think it is a mistake and I fix it in #49939
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feature](function) support utf8 input in initcap #49846 [doris]
hello-stephen commented on PR #49933: URL: https://github.com/apache/doris/pull/49933#issuecomment-2791446473 # BE UT Coverage Report Increment line coverage `100.00% (39/39)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/9f38d2049a57f9fe27d16f7984aa202f69b7434b_9f38d2049a57f9fe27d16f7984aa202f69b7434b/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/9f38d2049a57f9fe27d16f7984aa202f69b7434b_9f38d2049a57f9fe27d16f7984aa202f69b7434b/report/index.html) | Category | Coverage | |---|| | Function Coverage | 40.05% (10492/26199) | | Line Coverage | 30.73% (88199/286990) | | Region Coverage | 29.84% (45453/152305) | | Branch Coverage | 26.22% (23047/87908) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](bi) support default_init_catalog user property for external catalog [doris]
qzsee commented on PR #49658: URL: https://github.com/apache/doris/pull/49658#issuecomment-2791475103 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) fix multi table load repeated failures and retries when meet data quality error [doris]
sollhui commented on PR #49938: URL: https://github.com/apache/doris/pull/49938#issuecomment-2791473501 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
hello-stephen commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791469953 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](restore) Support force_replace different schema of view for restore [doris]
wyxxxcat commented on PR #49870: URL: https://github.com/apache/doris/pull/49870#issuecomment-2791485101 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
doris-robot commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791491747 TPC-H: Total hot run time: 34498 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bf78f63a119157e9babd5bb121f539fc9dc42f75, data reload: false -- Round 1 -- q1 26151 508650885086 q2 2072291 182 182 q3 10375 1241692 692 q4 10223 1038534 534 q5 7532242423392339 q6 194 164 133 133 q7 925 740 619 619 q8 9330130111541154 q9 6849516151465146 q10 6832230819151915 q11 501 302 281 281 q12 346 357 226 226 q13 17796 366831193119 q14 232 234 208 208 q15 525 489 512 489 q16 624 609 590 590 q17 605 876 383 383 q18 7629710471117104 q19 1211961 573 573 q20 340 352 252 252 q21 4466341125122512 q22 10371017961 961 Total cold run time: 115795 ms Total hot run time: 34498 ms - Round 2, with runtime_filter_mode=off - q1 5131516151215121 q2 239 327 229 229 q3 2202262623162316 q4 1458182215131513 q5 4592451743704370 q6 207 175 127 127 q7 1990192017661766 q8 2620258125132513 q9 7140709871647098 q10 3021314527122712 q11 587 507 481 481 q12 680 792 629 629 q13 3516389232303230 q14 288 288 282 282 q15 535 458 476 458 q16 656 706 653 653 q17 1166155713871387 q18 7766765773827382 q19 839 980 984 980 q20 1963205018111811 q21 5247469347134693 q22 10781003962 962 Total cold run time: 52921 ms Total hot run time: 50713 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) fix multi table load repeated failures and retries when meet data quality error [doris]
github-actions[bot] commented on PR #49938: URL: https://github.com/apache/doris/pull/49938#issuecomment-2791486739 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]
doris-robot commented on PR #49904: URL: https://github.com/apache/doris/pull/49904#issuecomment-2791491810 TPC-DS: Total hot run time: 189492 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, data reload: false query1 1010514 486 486 query2 6528196019441944 query3 6729231 215 215 query4 27213 23458 23371 23371 query5 5332710 492 492 query6 315 215 203 203 query7 4627517 297 297 query8 297 252 248 248 query9 8625261325862586 query10 506 336 282 282 query11 16115 15502 14942 14942 query12 177 114 114 114 query13 1651542 419 419 query14 11290 672766036603 query15 220 193 182 182 query16 7709666 474 474 query17 1558823 608 608 query18 2039432 328 328 query19 249 197 165 165 query20 123 122 121 121 query21 217 132 111 111 query22 4320426941304130 query23 34084 32919 33009 32919 query24 8230254824952495 query25 525 492 406 406 query26 731 293 150 150 query27 2585533 332 332 query28 4241240924302409 query29 629 598 442 442 query30 299 231 206 206 query31 981 918 773 773 query32 75 69 66 66 query33 570 407 357 357 query34 796 928 519 519 query35 869 854 781 781 query36 10021035921 921 query37 121 113 78 78 query38 4216407841094078 query39 1469141414481414 query40 215 123 110 110 query41 57 56 55 55 query42 124 107 107 107 query43 504 533 489 489 query44 1362819 816 816 query45 186 182 177 177 query46 903 1123647 647 query47 1783183117201720 query48 383 423 298 298 query49 738 546 429 429 query50 674 732 427 427 query51 4316422643314226 query52 108 106 105 105 query53 234 266 186 186 query54 580 576 491 491 query55 86 81 84 81 query56 315 315 285 285 query57 1136120811041104 query58 274 262 276 262 query59 2730268725772577 query60 332 333 311 311 query61 135 133 130 130 query62 870 787 717 717 query63 235 199 193 193 query64 30561037700 700 query65 4458430243214302 query66 869 460 329 329 query67 15730 15674 15372 15372 query68 9477913 520 520 query69 509 332 289 289 query70 1228113010921092 query71 464 330 312 312 query72 5780489550174895 query73 745 729 357 357 query74 9098919590719071 query75 4272341128332833 query76 48001360839 839 query77 785 389 303 303 query78 10268 10288 93839383 query79 2231901 627 627 query80 647 566 488 488 query81 603 291 254 254 query82 481 149 123 123 query83 285 286 266 266 query84 276 111 105 105 query85 866 386 345 345 query86 559 327 306 306 query87 4743481144974497 query88 6175228124162281 query89 429 365 315 315 query90 2107232 237 232 query91 172 152 119 119 query92 88 68 61 61 query93 19731018595 595 query94 677 495 316 316 query95 376 299 293 293 query96 499 625 283 283 query97 3269332031693169 query98 275 219 217 217 query99 1817149813931393 Total cold run time: 286640 ms Total hot run time: 189492 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
[PR] Add the fdb_ctl.sh clean note [doris-website]
yuanyuan8983 opened a new pull request, #2280: URL: https://github.com/apache/doris-website/pull/2280 ## Versions - [x] dev - [x] 3.0 - [ ] 2.1 - [ ] 2.0 ## Languages - [ ] Chinese - [ ] English ## Docs Checklist - [ ] Checked by AI - [ ] Test Cases Built -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) fix orc push down and materialization for hive acid table [doris]
doris-robot commented on PR #49927: URL: https://github.com/apache/doris/pull/49927#issuecomment-2791495657 TPC-DS: Total hot run time: 193370 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 54a9652bfc86dd28c27180763229d9fce79daa99, data reload: false query1 1370105010511050 query2 6070193919701939 query3 11154 481444974497 query4 54577 25400 22989 22989 query5 5165537 446 446 query6 360 210 207 207 query7 4952503 273 273 query8 311 247 235 235 query9 5948259126042591 query10 432 317 260 260 query11 15088 14979 14838 14838 query12 174 108 107 107 query13 1077513 416 416 query14 10229 646964166416 query15 209 200 183 183 query16 7090660 516 516 query17 1084742 603 603 query18 1544438 336 336 query19 205 199 171 171 query20 126 127 119 119 query21 206 123 107 107 query22 4564461645054505 query23 33772 33346 4 4 query24 6598241124522411 query25 445 477 399 399 query26 757 278 151 151 query27 2344508 330 330 query28 3106248524592459 query29 591 569 440 440 query30 270 220 198 198 query31 855 866 778 778 query32 75 69 62 62 query33 458 379 320 320 query34 759 870 537 537 query35 784 892 722 722 query36 940 982 893 893 query37 128 98 80 80 query38 4248429040174017 query39 1495144414521444 query40 215 118 109 109 query41 56 51 54 51 query42 122 114 113 113 query43 492 530 483 483 query44 1338828 816 816 query45 181 170 165 165 query46 844 1040646 646 query47 1872187418211821 query48 378 418 310 310 query49 697 511 414 414 query50 654 708 413 413 query51 4306423742004200 query52 118 108 104 104 query53 237 281 190 190 query54 577 583 503 503 query55 79 81 79 79 query56 317 318 310 310 query57 1171118111361136 query58 276 268 271 268 query59 2784291827272727 query60 333 322 300 300 query61 139 130 138 130 query62 728 735 695 695 query63 233 187 186 186 query64 17901058709 709 query65 4436433543854335 query66 747 451 357 357 query67 15989 15585 15576 15576 query68 7334901 516 516 query69 537 302 262 262 query70 1193113110721072 query71 502 332 299 299 query72 5951479849174798 query73 1374657 342 342 query74 9306901489688968 query75 3883321126672667 query76 42661202738 738 query77 643 367 279 279 query78 10115 10297 92659265 query79 2317815 564 564 query80 677 560 423 423 query81 482 255 219 219 query82 265 126 94 94 query83 261 254 234 234 query84 294 97 87 87 query85 782 355 313 313 query86 370 294 284 284 query87 4435453944244424 query88 3459224822622248 query89 395 312 286 286 query90 1773212 212 212 query91 145 143 113 113 query92 80 60 58 58 query93 2087948 586 586 query94 627 416 308 308 query95 368 292 285 285 query96 489 564 281 281 query97 3216322531343134 query98 244 211 206 206 query99 1360140612801280 Total cold run time: 299899 ms Total hot run time: 193370 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [test](beut) add pipeline QueryCache Operator beut [doris]
doris-robot commented on PR #49904: URL: https://github.com/apache/doris/pull/49904#issuecomment-2791497476 ClickBench: Total hot run time: 31.31 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6617c5faeaa72baadb8e968c081ceeb1ec45a3d1, data reload: false query1 0.030.040.03 query2 0.120.100.11 query3 0.260.190.19 query4 1.590.190.19 query5 0.600.580.55 query6 1.200.720.72 query7 0.030.020.01 query8 0.040.030.03 query9 0.580.550.54 query10 0.580.580.56 query11 0.150.100.10 query12 0.150.120.11 query13 0.610.600.61 query14 2.692.682.71 query15 0.920.850.84 query16 0.380.370.38 query17 1.061.031.03 query18 0.210.200.20 query19 1.861.981.86 query20 0.020.010.01 query21 15.36 0.900.54 query22 0.771.250.70 query23 14.79 1.440.65 query24 7.010.981.59 query25 0.520.100.14 query26 0.610.160.15 query27 0.060.050.05 query28 9.870.830.44 query29 12.61 3.983.30 query30 0.250.090.06 query31 2.820.590.39 query32 3.230.550.48 query33 3.093.013.09 query34 15.71 5.094.49 query35 4.534.494.45 query36 0.680.500.49 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.020.03 query40 0.170.130.13 query41 0.080.030.02 query42 0.030.020.02 query43 0.030.020.02 Total cold run time: 105.47 s Total hot run time: 31.31 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] num-null estimate [doris]
doris-robot commented on PR #49891: URL: https://github.com/apache/doris/pull/49891#issuecomment-2791490637 TPC-H: Total hot run time: 34223 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 61c39214e92156965fc3de3f68b3267e9eb7f0ef, data reload: false -- Round 1 -- q1 25928 504750145014 q2 2056269 184 184 q3 10421 1250687 687 q4 10231 1008517 517 q5 7466229123462291 q6 185 167 134 134 q7 891 746 595 595 q8 9324126210851085 q9 6835518152295181 q10 6869231418941894 q11 505 286 266 266 q12 347 360 217 217 q13 17767 367630873087 q14 243 228 208 208 q15 545 485 495 485 q16 619 615 580 580 q17 618 842 391 391 q18 7877730971267126 q19 1614953 557 557 q20 336 343 229 229 q21 4341343924962496 q22 1082999 1002999 Total cold run time: 116100 ms Total hot run time: 34223 ms - Round 2, with runtime_filter_mode=off - q1 5247510250765076 q2 239 330 231 231 q3 2134263722942294 q4 1425182614871487 q5 4534441644184416 q6 223 179 134 134 q7 1965190117551755 q8 2566252024822482 q9 7308708271757082 q10 2966319427672767 q11 585 514 505 505 q12 669 757 619 619 q13 3496388533183318 q14 288 306 269 269 q15 550 492 482 482 q16 654 712 637 637 q17 1156149113991399 q18 7817767374927492 q19 793 774 850 774 q20 1921199019131913 q21 5435492448404840 q22 1068107010231023 Total cold run time: 53039 ms Total hot run time: 50995 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49166-branch-3.0 deleted (was 89ce038c6b1)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49166-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git was 89ce038c6b1 [fix](config) Turn on default value of `enable_cloud_tablet_report` (#49757) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](analytic) fix analytic operator maybe used after free about column [doris]
doris-robot commented on PR #49924: URL: https://github.com/apache/doris/pull/49924#issuecomment-2791497981 TPC-H: Total hot run time: 34216 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4163ab55673920b2b796a4a7728df2953051aa09, data reload: false -- Round 1 -- q1 26065 510749764976 q2 2052282 184 184 q3 10386 1238691 691 q4 10243 1071536 536 q5 7532247623812381 q6 185 163 129 129 q7 939 822 610 610 q8 9329131510911091 q9 6763517551715171 q10 6861230219141914 q11 488 289 264 264 q12 355 353 213 213 q13 17781 367430843084 q14 219 224 207 207 q15 534 490 486 486 q16 623 623 567 567 q17 600 860 360 360 q18 7683724171107110 q19 1702977 592 592 q20 323 323 219 219 q21 4275338424672467 q22 10431009964 964 Total cold run time: 115981 ms Total hot run time: 34216 ms - Round 2, with runtime_filter_mode=off - q1 5171509450645064 q2 246 323 227 227 q3 2159266322562256 q4 1462186115081508 q5 4539443744114411 q6 222 171 124 124 q7 2001191217501750 q8 2624269025312531 q9 7258710971427109 q10 2992315127152715 q11 598 520 496 496 q12 666 768 638 638 q13 3510397133313331 q14 313 315 272 272 q15 527 472 476 472 q16 617 687 663 663 q17 1179161713721372 q18 7755755774937493 q19 834 892 974 892 q20 2009196618341834 q21 5299478048234780 q22 1081103710441037 Total cold run time: 53062 ms Total hot run time: 50975 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Test pipeline tasks [doris]
Gabriel39 commented on PR #49940: URL: https://github.com/apache/doris/pull/49940#issuecomment-2791499065 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) fix orc push down and materialization for hive acid table [doris]
doris-robot commented on PR #49927: URL: https://github.com/apache/doris/pull/49927#issuecomment-2791500872 ClickBench: Total hot run time: 31.77 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 54a9652bfc86dd28c27180763229d9fce79daa99, data reload: false query1 0.040.030.03 query2 0.140.110.11 query3 0.350.200.20 query4 1.590.200.20 query5 0.630.600.60 query6 1.180.730.72 query7 0.020.020.01 query8 0.050.040.05 query9 0.610.510.52 query10 0.580.590.58 query11 0.250.130.12 query12 0.240.130.13 query13 0.630.620.61 query14 2.662.682.71 query15 0.980.870.88 query16 0.370.360.37 query17 1.051.041.03 query18 0.180.180.17 query19 1.922.021.79 query20 0.020.010.01 query21 15.35 0.950.66 query22 0.921.000.85 query23 14.68 1.510.75 query24 5.300.600.30 query25 0.170.090.09 query26 0.540.220.17 query27 0.090.080.09 query28 11.00 1.120.57 query29 12.55 4.113.47 query30 0.280.080.06 query31 2.820.650.42 query32 3.250.590.50 query33 3.043.043.04 query34 16.59 5.114.41 query35 4.564.484.50 query36 0.630.510.50 query37 0.200.170.17 query38 0.160.160.15 query39 0.050.040.04 query40 0.210.170.16 query41 0.100.050.05 query42 0.060.040.05 query43 0.050.040.05 Total cold run time: 106.09 s Total hot run time: 31.77 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature]bind workload group to compute group [doris]
wangbo commented on code in PR #49884:
URL: https://github.com/apache/doris/pull/49884#discussion_r2036412198
##
fe/fe-core/src/main/java/org/apache/doris/load/routineload/KafkaTaskInfo.java:
##
@@ -147,8 +148,9 @@ private TPipelineFragmentParams rePlan(RoutineLoadJob
routineLoadJob) throws Use
throw new UserException("can not find workload group, id="
+ wgId);
}
} else {
-tWgList = Env.getCurrentEnv().getWorkloadGroupMgr()
-
.getWorkloadGroupByUser(routineLoadJob.getUserIdentity(), false);
+ConnectContext tmpCtx = new ConnectContext();
+
tmpCtx.setCurrentUserIdentity(routineLoadJob.getUserIdentity());
+tWgList =
Env.getCurrentEnv().getWorkloadGroupMgr().getWorkloadGroup(tmpCtx);
}
if (tWgList.size() != 0) {
tExecPlanFragmentParams.setWorkloadGroups(tWgList);
Review Comment:
fe给be传的一直都是list，只不过之前list集合大小为1，现在可能会出现同名的wg在不同的分组上，比如resource tag就可以指定多个
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
doris-robot commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791503546 TPC-DS: Total hot run time: 186918 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit bf78f63a119157e9babd5bb121f539fc9dc42f75, data reload: false query1 1019484 461 461 query2 6541196219371937 query3 6748224 218 218 query4 26283 23935 23417 23417 query5 4790637 465 465 query6 315 212 194 194 query7 4632496 286 286 query8 306 249 262 249 query9 8646257025642564 query10 505 316 262 262 query11 15352 15064 14882 14882 query12 151 109 102 102 query13 1663511 406 406 query14 9336625261936193 query15 210 188 171 171 query16 7169627 476 476 query17 1143719 595 595 query18 1995409 312 312 query19 196 189 180 180 query20 123 121 116 116 query21 217 128 107 107 query22 4026414642234146 query23 33978 33138 32972 32972 query24 8436237824002378 query25 553 481 454 454 query26 1229276 147 147 query27 2741511 330 330 query28 4316241924172417 query29 767 561 429 429 query30 296 219 192 192 query31 942 891 755 755 query32 77 62 67 62 query33 559 364 318 318 query34 785 864 503 503 query35 816 840 747 747 query36 999 998 877 877 query37 119 99 100 99 query38 4179428740204020 query39 1442138213871382 query40 216 115 107 107 query41 56 54 53 53 query42 120 105 107 105 query43 507 495 471 471 query44 1301820 809 809 query45 180 177 173 173 query46 846 1026624 624 query47 1751178717081708 query48 374 410 314 314 query49 775 488 416 416 query50 643 704 403 403 query51 4188422740864086 query52 109 104 102 102 query53 227 263 194 194 query54 575 575 520 520 query55 88 81 86 81 query56 296 328 302 302 query57 1128112410681068 query58 268 265 256 256 query59 2594279126342634 query60 324 345 310 310 query61 134 132 137 132 query62 809 738 660 660 query63 219 186 193 186 query64 43491042760 760 query65 4389425842444244 query66 1146411 312 312 query67 15664 15653 15352 15352 query68 7733892 528 528 query69 455 301 267 267 query70 1189119611201120 query71 458 320 285 285 query72 5562472147454721 query73 645 585 348 348 query74 9333888986248624 query75 3778320827092709 query76 34751195785 785 query77 786 388 282 282 query78 998310050 92629262 query79 2047810 565 565 query80 592 513 444 444 query81 482 252 224 224 query82 507 125 99 99 query83 262 250 233 233 query84 249 112 87 87 query85 795 352 363 352 query86 376 313 285 285 query87 4530450845134508 query88 3722218922122189 query89 390 302 277 277 query90 1929210 208 208 query91 144 141 112 112 query92 79 61 58 58 query93 1726936 589 589 query94 623 426 306 306 query95 377 290 291 290 query96 486 564 273 273 query97 3156321231993199 query98 236 205 198 198 query99 1338138912881288 Total cold run time: 274319 ms Total hot run time: 186918 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] branch-3.0-pick: [Opt](profile) Add profile for `sync_rowsets` (#49864) [doris]
bobhan1 commented on PR #49926: URL: https://github.com/apache/doris/pull/49926#issuecomment-2791504238 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Test pipeline tasks [doris]
hello-stephen commented on PR #49940: URL: https://github.com/apache/doris/pull/49940#issuecomment-2791497373 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](beut) Make function be-ut test aware of result's precision [doris]
doris-robot commented on PR #49608: URL: https://github.com/apache/doris/pull/49608#issuecomment-2791470921 # BE UT Coverage Report Increment line coverage `76.67% (23/30)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/40d92aa80b797132a00ed7e7c580bcc55704020b_40d92aa80b797132a00ed7e7c580bcc55704020b/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/40d92aa80b797132a00ed7e7c580bcc55704020b_40d92aa80b797132a00ed7e7c580bcc55704020b/report/index.html) | Category | Coverage | |---|| | Function Coverage | 52.34% (14072/26885) | | Line Coverage | 41.12% (121506/295521) | | Region Coverage | 39.83% (61799/155167) | | Branch Coverage | 34.48% (30925/89702) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) fix multi table load repeated failures and retries when meet data quality error [doris]
doris-robot commented on PR #49938: URL: https://github.com/apache/doris/pull/49938#issuecomment-2791509418 TPC-H: Total hot run time: 33990 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 5936ad789b0c35f2a1495ec4d48f2d0bd92384d0, data reload: false -- Round 1 -- q1 25829 499149774977 q2 2073289 181 181 q3 10393 1235676 676 q4 10218 1046522 522 q5 7518224823622248 q6 178 161 130 130 q7 891 747 602 602 q8 9306122311821182 q9 6807505950705059 q10 6847228518721872 q11 471 282 266 266 q12 349 347 218 218 q13 17794 365331043104 q14 241 224 217 217 q15 534 474 499 474 q16 618 629 581 581 q17 592 857 364 364 q18 7610728771337133 q19 1229950 554 554 q20 331 334 236 236 q21 4123336224292429 q22 1015994 965 965 Total cold run time: 114967 ms Total hot run time: 33990 ms - Round 2, with runtime_filter_mode=off - q1 5087508250955082 q2 240 332 240 240 q3 2170263022392239 q4 1439185413811381 q5 4410438944244389 q6 224 171 126 126 q7 1969190917781778 q8 2608249225392492 q9 7318726471657165 q10 2978322427692769 q11 573 507 505 505 q12 708 779 663 663 q13 3618399734443444 q14 314 307 284 284 q15 525 480 465 465 q16 676 690 653 653 q17 1164153514011401 q18 7792748273437343 q19 816 870 906 870 q20 1921194018101810 q21 5276484848024802 q22 104310301030 Total cold run time: 52937 ms Total hot run time: 50931 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
doris-robot commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791509647 ClickBench: Total hot run time: 31.17 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit bf78f63a119157e9babd5bb121f539fc9dc42f75, data reload: false query1 0.030.040.03 query2 0.120.100.11 query3 0.250.190.20 query4 1.590.190.11 query5 0.550.540.53 query6 1.200.720.72 query7 0.020.020.01 query8 0.050.040.04 query9 0.570.520.50 query10 0.620.580.59 query11 0.150.100.11 query12 0.140.110.11 query13 0.620.590.61 query14 2.822.812.70 query15 0.920.860.86 query16 0.390.380.38 query17 1.051.021.03 query18 0.210.190.20 query19 2.061.891.82 query20 0.010.010.01 query21 15.35 0.880.54 query22 0.751.190.69 query23 14.88 1.400.60 query24 7.331.780.77 query25 0.470.240.14 query26 0.590.160.12 query27 0.050.040.05 query28 9.380.840.45 query29 12.54 3.983.34 query30 0.250.090.06 query31 2.810.590.38 query32 3.240.540.48 query33 3.073.213.11 query34 15.68 5.084.54 query35 4.544.524.50 query36 0.680.500.49 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.030.02 query40 0.170.140.14 query41 0.090.020.02 query42 0.040.030.02 query43 0.040.030.03 Total cold run time: 105.49 s Total hot run time: 31.17 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature]bind workload group to compute group [doris]
wangbo commented on code in PR #49884:
URL: https://github.com/apache/doris/pull/49884#discussion_r2036401406
##
fe/fe-core/src/test/java/org/apache/doris/utframe/TestWithFeService.java:
##
@@ -158,7 +158,7 @@ public final void beforeAll() throws Exception {
// this.enableAdvanceNextId may be reset by children classes
Config.enable_advance_next_id = this.enableAdvanceNextId;
FeConstants.enableInternalSchemaDb = false;
-FeConstants.shouldCreateInternalWorkloadGroup = false;
+FeConstants.dropOldWorkloadGroup = false;
Review Comment:
这个东西不是控制线程是否运行，这个参数的作用是跑FE ut的时候，跳过这个线程
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](paimon/iceberg)upgrade paimon to 1.0.1, iceberg to 1.6.1 [doris]
doris-robot commented on PR #49280: URL: https://github.com/apache/doris/pull/49280#issuecomment-2791612241 TPC-H: Total hot run time: 39971 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 10bd08087a30448d5f55a8e4c3be1c8f8c271fad, data reload: false -- Round 1 -- q1 17599 682565746574 q2 2068171 167 167 q3 10557 11051105 q4 10588 789 675 675 q5 7733282428372824 q6 219 135 129 129 q7 999 626 611 611 q8 9357196620441966 q9 6597638763726372 q10 6973229922772277 q11 458 255 256 255 q12 413 208 208 208 q13 17764 300129722972 q14 228 212 216 212 q15 505 457 456 456 q16 664 573 582 573 q17 979 539 574 539 q18 7187668766586658 q19 1402113610751075 q20 467 201 199 199 q21 4038330731703170 q22 1097954 976 954 Total cold run time: 107892 ms Total hot run time: 39971 ms - Round 2, with runtime_filter_mode=off - q1 6601660965426542 q2 332 234 242 234 q3 2953278528982785 q4 2029181417971797 q5 5749574057195719 q6 211 132 127 127 q7 2196181918091809 q8 3386353534923492 q9 8884890490768904 q10 3589355135403540 q11 605 501 502 501 q12 864 637 626 626 q13 10479 320931713171 q14 314 271 272 271 q15 520 464 460 460 q16 704 660 636 636 q17 1841157916241579 q18 8340773776517651 q19 1680144114611441 q20 2098181118961811 q21 5374539052825282 q22 1131102710331027 Total cold run time: 69880 ms Total hot run time: 59405 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](SetOperator) refine some SetOperator code. [doris]
doris-robot commented on PR #49772: URL: https://github.com/apache/doris/pull/49772#issuecomment-2791597546 TPC-H: Total hot run time: 34445 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9f8e71c4e093f080b3f8f618fb8f342f84e82f4c, data reload: false -- Round 1 -- q1 26101 512550745074 q2 2076277 181 181 q3 10414 1254686 686 q4 10234 1021524 524 q5 7557223423792234 q6 188 165 135 135 q7 906 776 631 631 q8 9348132712931293 q9 6828509850835083 q10 6813231218951895 q11 492 284 271 271 q12 353 366 223 223 q13 17766 367030913091 q14 229 226 213 213 q15 528 498 478 478 q16 628 599 573 573 q17 629 871 374 374 q18 7479720072347200 q19 1208946 572 572 q20 359 344 225 225 q21 4330273925192519 q22 10251009970 970 Total cold run time: 115491 ms Total hot run time: 34445 ms - Round 2, with runtime_filter_mode=off - q1 5162514651475146 q2 234 330 228 228 q3 2206268123102310 q4 1428181013971397 q5 4470442644074407 q6 271 177 130 130 q7 2015192917821782 q8 2619278425752575 q9 7279714472127144 q10 2989318527222722 q11 590 504 505 504 q12 672 756 617 617 q13 3606395533383338 q14 276 323 273 273 q15 524 470 476 470 q16 643 683 657 657 q17 1174161913631363 q18 7925757675897576 q19 797 774 922 774 q20 1942198918711871 q21 5254491347564756 q22 10771054980 980 Total cold run time: 53153 ms Total hot run time: 51020 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](Nereids) cse extract wrong expression from lambda expressions #49166 [doris]
github-actions[bot] commented on PR #49941: URL: https://github.com/apache/doris/pull/49941#issuecomment-2791598698 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](SetOperator) refine some SetOperator code. [doris]
doris-robot commented on PR #49772: URL: https://github.com/apache/doris/pull/49772#issuecomment-2791613172 TPC-DS: Total hot run time: 193266 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9f8e71c4e093f080b3f8f618fb8f342f84e82f4c, data reload: false query1 1385107110661066 query2 6352198019771977 query3 11024 450845874508 query4 25050 23254 22766 22766 query5 3481598 452 452 query6 293 208 200 200 query7 3994491 279 279 query8 310 254 243 243 query9 8493258025622562 query10 472 313 266 266 query11 15153 15144 14751 14751 query12 178 110 114 110 query13 1572540 413 413 query14 9006629664286296 query15 207 190 168 168 query16 7606636 467 467 query17 1190741 578 578 query18 2001434 338 338 query19 201 237 157 157 query20 123 123 122 122 query21 209 127 107 107 query22 4456449645554496 query23 34359 33559 33563 33559 query24 8504247824062406 query25 511 472 406 406 query26 1191276 154 154 query27 2810504 338 338 query28 4902245924312431 query29 717 593 447 447 query30 281 227 198 198 query31 925 863 835 835 query32 72 73 70 70 query33 539 362 325 325 query34 788 859 553 553 query35 811 845 797 797 query36 986 1034928 928 query37 123 101 79 79 query38 4274421041974197 query39 1509144414221422 query40 207 126 112 112 query41 58 53 52 52 query42 126 113 111 111 query43 529 522 504 504 query44 1345832 827 827 query45 178 180 177 177 query46 856 1027652 652 query47 1854183918001800 query48 382 430 314 314 query49 779 516 449 449 query50 660 702 425 425 query51 4302427942124212 query52 108 115 105 105 query53 241 269 207 207 query54 598 588 527 527 query55 106 92 85 85 query56 305 306 307 306 query57 1172118911351135 query58 269 272 277 272 query59 2775294128462846 query60 334 326 323 323 query61 132 128 129 128 query62 772 729 668 668 query63 235 196 192 192 query64 40241063734 734 query65 4638435643314331 query66 1094465 310 310 query67 16378 15576 15324 15324 query68 8336888 516 516 query69 470 305 270 270 query70 1209112310841084 query71 469 314 303 303 query72 5585472248134722 query73 693 614 351 351 query74 8998905588358835 query75 3888320827162716 query76 37501168769 769 query77 785 379 276 276 query78 10038 10119 92369236 query79 2439816 565 565 query80 717 522 446 446 query81 488 267 222 222 query82 489 127 96 96 query83 258 255 232 232 query84 309 109 78 78 query85 784 361 325 325 query86 377 295 296 295 query87 4372439643614361 query88 392122072207 query89 408 313 286 286 query90 1850219 214 214 query91 143 137 110 110 query92 74 59 55 55 query93 20421003592 592 query94 642 397 308 308 query95 384 290 288 288 query96 512 562 274 274 query97 3187326431193119 query98 269 214 207 207 query99 1454145213131313 Total cold run time: 279855 ms Total hot run time: 193266 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [Chore](runtime-filter) remove RuntimeFIlterParamsContext [doris]
BiteThet commented on PR #49837: URL: https://github.com/apache/doris/pull/49837#issuecomment-2791621853 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](nereids)support stream load, routine load and broker load in nereids [doris]
doris-robot commented on PR #49116: URL: https://github.com/apache/doris/pull/49116#issuecomment-2791603426 ClickBench: Total hot run time: 31.42 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0f8c75b8fefd528d995b6d854cb22c0e3b24a9a4, data reload: false query1 0.040.030.03 query2 0.120.110.10 query3 0.240.200.20 query4 1.580.200.19 query5 0.600.560.60 query6 1.180.730.72 query7 0.030.020.01 query8 0.040.040.03 query9 0.580.510.52 query10 0.580.600.58 query11 0.150.110.11 query12 0.140.120.11 query13 0.610.590.60 query14 2.782.702.71 query15 0.910.840.84 query16 0.380.370.37 query17 1.020.991.03 query18 0.210.190.20 query19 1.921.921.88 query20 0.020.010.01 query21 15.38 0.880.56 query22 0.771.160.64 query23 14.94 1.410.60 query24 6.980.890.95 query25 0.470.130.08 query26 0.700.170.15 query27 0.050.040.04 query28 9.600.920.43 query29 12.93 4.113.45 query30 0.260.090.06 query31 2.910.580.38 query32 3.230.540.49 query33 3.093.163.10 query34 15.80 5.144.50 query35 4.524.524.53 query36 0.690.510.50 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.130.13 query41 0.080.020.02 query42 0.030.020.03 query43 0.040.030.02 Total cold run time: 105.94 s Total hot run time: 31.42 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](TrinoConnector) it will return error when query `information_schema.tables` within `trino-connector` catalog [doris]
doris-robot commented on PR #49912: URL: https://github.com/apache/doris/pull/49912#issuecomment-2791577122 TPC-DS: Total hot run time: 185856 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a36d9b28746e741f80c2c2c80a2136645f050e18, data reload: false query1 1001473 471 471 query2 6543192819121912 query3 6749218 214 214 query4 26175 23067 23568 23067 query5 4816636 477 477 query6 322 201 194 194 query7 4630490 278 278 query8 304 243 247 243 query9 8644258025842580 query10 501 326 269 269 query11 15418 15274 14763 14763 query12 162 112 116 112 query13 1672509 410 410 query14 8872604762996047 query15 204 188 169 169 query16 7343653 461 461 query17 1176717 583 583 query18 1986421 304 304 query19 191 193 170 170 query20 121 119 118 118 query21 212 123 112 112 query22 4404414642514146 query23 33898 33007 33122 33007 query24 7701234624122346 query25 535 454 391 391 query26 1233262 146 146 query27 2691479 337 337 query28 4436239824092398 query29 774 566 432 432 query30 285 215 191 191 query31 922 830 765 765 query32 70 64 62 62 query33 568 366 306 306 query34 800 838 518 518 query35 767 817 738 738 query36 955 991 905 905 query37 112 98 76 76 query38 4071406142284061 query39 1506141314001400 query40 208 121 109 109 query41 55 53 51 51 query42 120 106 104 104 query43 500 506 468 468 query44 1325804 804 804 query45 175 174 165 165 query46 819 1007627 627 query47 1742179617521752 query48 362 416 291 291 query49 789 532 409 409 query50 642 687 412 412 query51 4110415741574157 query52 112 106 100 100 query53 224 261 178 178 query54 568 564 498 498 query55 81 78 89 78 query56 317 302 291 291 query57 1100117110901090 query58 289 255 291 255 query59 2795274626912691 query60 321 308 307 307 query61 164 126 123 123 query62 809 718 655 655 query63 228 185 179 179 query64 43531005683 683 query65 4382428842524252 query66 1150436 306 306 query67 15903 15702 15567 15567 query68 8614882 510 510 query69 479 299 257 257 query70 1252111310561056 query71 493 316 290 290 query72 5758472745864586 query73 743 625 342 342 query74 8873905287098709 query75 3909318527102710 query76 37381190760 760 query77 805 369 274 274 query78 10112 10149 93089308 query79 3436819 565 565 query80 649 496 413 413 query81 467 254 218 218 query82 668 128 98 98 query83 289 266 238 238 query84 294 174 83 83 query85 787 364 313 313 query86 336 305 292 292 query87 4389439442694269 query88 3193217821942178 query89 424 310 279 279 query90 1928213 208 208 query91 141 140 113 113 query92 78 63 58 58 query93 2180945 574 574 query94 674 409 283 283 query95 374 292 281 281 query96 493 558 268 268 query97 3281321530823082 query98 239 211 204 204 query99 1466141212561256 Total cold run time: 276975 ms Total hot run time: 185856 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [fix](nereids) do eliminate constant group by key in normalizeagg [doris]
feiniaofeiafei commented on PR #49589: URL: https://github.com/apache/doris/pull/49589#issuecomment-2791632852 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](nereids)support stream load, routine load and broker load in nereids [doris]
doris-robot commented on PR #49116: URL: https://github.com/apache/doris/pull/49116#issuecomment-2791581489 TPC-H: Total hot run time: 34016 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 0f8c75b8fefd528d995b6d854cb22c0e3b24a9a4, data reload: false -- Round 1 -- q1 26139 501549794979 q2 2072291 184 184 q3 10383 1211681 681 q4 10241 1018530 530 q5 7533233023232323 q6 192 166 129 129 q7 900 741 608 608 q8 9303124710541054 q9 6885518051215121 q10 6880232118911891 q11 480 301 281 281 q12 362 352 217 217 q13 17759 362130923092 q14 225 229 204 204 q15 516 490 482 482 q16 617 620 585 585 q17 620 856 375 375 q18 7693711370287028 q19 1458962 556 556 q20 351 325 229 229 q21 4448357025252525 q22 10471017942 942 Total cold run time: 116104 ms Total hot run time: 34016 ms - Round 2, with runtime_filter_mode=off - q1 5199512650505050 q2 240 335 241 241 q3 2207269523322332 q4 1477182315211521 q5 4503440743444344 q6 212 173 129 129 q7 1995188217741774 q8 2565261025372537 q9 7302710972387109 q10 3012315227292729 q11 577 535 496 496 q12 670 758 603 603 q13 3448388733693369 q14 273 297 265 265 q15 532 478 480 478 q16 690 710 661 661 q17 1170154614081408 q18 7653759773787378 q19 824 799 801 799 q20 1911202018601860 q21 5319496747764776 q22 1061106210101010 Total cold run time: 52840 ms Total hot run time: 50869 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](SetOperator) refine some SetOperator code. [doris]
doris-robot commented on PR #49772: URL: https://github.com/apache/doris/pull/49772#issuecomment-2791620214 ClickBench: Total hot run time: 30.75 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9f8e71c4e093f080b3f8f618fb8f342f84e82f4c, data reload: false query1 0.040.040.03 query2 0.120.100.10 query3 0.250.190.19 query4 1.590.190.19 query5 0.600.580.58 query6 1.180.710.71 query7 0.030.020.02 query8 0.040.030.04 query9 0.580.520.53 query10 0.580.590.56 query11 0.150.100.10 query12 0.150.110.11 query13 0.620.610.61 query14 2.652.742.66 query15 0.920.850.84 query16 0.370.380.36 query17 1.031.031.03 query18 0.220.200.19 query19 1.881.822.00 query20 0.010.010.01 query21 15.37 0.900.54 query22 0.741.110.85 query23 14.83 1.390.64 query24 8.220.700.28 query25 0.300.080.18 query26 0.650.170.15 query27 0.050.050.05 query28 9.440.920.43 query29 12.56 3.883.29 query30 0.250.090.07 query31 2.840.610.39 query32 3.230.580.47 query33 2.983.093.09 query34 15.68 5.164.49 query35 4.504.514.50 query36 0.670.490.48 query37 0.090.060.06 query38 0.050.040.03 query39 0.030.020.02 query40 0.160.130.12 query41 0.080.040.02 query42 0.030.020.03 query43 0.030.030.02 Total cold run time: 105.79 s Total hot run time: 30.75 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](paimon/iceberg)upgrade paimon to 1.0.1, iceberg to 1.6.1 [doris]
doris-robot commented on PR #49280: URL: https://github.com/apache/doris/pull/49280#issuecomment-2791636398 ClickBench: Total hot run time: 32.4 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 10bd08087a30448d5f55a8e4c3be1c8f8c271fad, data reload: false query1 0.030.030.02 query2 0.070.020.03 query3 0.240.070.07 query4 1.610.100.10 query5 0.520.520.51 query6 1.130.730.73 query7 0.020.010.01 query8 0.040.030.04 query9 0.570.500.51 query10 0.540.540.55 query11 0.140.100.11 query12 0.140.140.11 query13 0.610.600.60 query14 2.792.712.73 query15 0.900.830.84 query16 0.400.390.38 query17 1.071.061.06 query18 0.230.220.21 query19 1.931.842.04 query20 0.020.010.01 query21 15.36 0.580.55 query22 3.112.132.19 query23 16.83 1.090.84 query24 2.851.170.91 query25 0.240.050.06 query26 0.520.140.13 query27 0.050.040.03 query28 10.67 0.540.49 query29 12.57 3.313.25 query30 0.240.060.07 query31 2.850.400.38 query32 3.230.460.46 query33 2.963.023.05 query34 17.15 4.474.45 query35 4.554.474.53 query36 0.690.480.48 query37 0.090.060.07 query38 0.050.040.04 query39 0.040.030.02 query40 0.170.130.14 query41 0.080.020.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 107.38 s Total hot run time: 32.4 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) fix create view use null literal [doris]
feiniaofeiafei commented on PR #49881: URL: https://github.com/apache/doris/pull/49881#issuecomment-2791636486 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner) fix fallback to legacy planner compute wrong result [doris]
924060929 commented on code in PR #49913:
URL: https://github.com/apache/doris/pull/49913#discussion_r2036561078
##
fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java:
##
@@ -894,12 +894,17 @@ public void executeByLegacy(TUniqueId queryId) throws
Exception {
&& !(parsedStmt instanceof TransactionStmt)) {
throw new TException("This is in a transaction, only insert,
commit, rollback is acceptable.");
}
+SessionVariable sessionVariable = context.getSessionVariable();
+if (!(parsedStmt instanceof SetStmt) && !(parsedStmt instanceof
UnsetVariableStmt)) {
Review Comment:
the unset stmt will be reverted because `disableNereidsPlannerOnce`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](planner) fix fallback to legacy planner compute wrong result [doris]
924060929 commented on code in PR #49913:
URL: https://github.com/apache/doris/pull/49913#discussion_r2036561078
##
fe/fe-core/src/main/java/org/apache/doris/qe/StmtExecutor.java:
##
@@ -894,12 +894,17 @@ public void executeByLegacy(TUniqueId queryId) throws
Exception {
&& !(parsedStmt instanceof TransactionStmt)) {
throw new TException("This is in a transaction, only insert,
commit, rollback is acceptable.");
}
+SessionVariable sessionVariable = context.getSessionVariable();
+if (!(parsedStmt instanceof SetStmt) && !(parsedStmt instanceof
UnsetVariableStmt)) {
Review Comment:
the set/unset stmt will be reverted because `disableNereidsPlannerOnce`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [doc](load) add routine load metrics [doris-website]
dataroaring merged PR #2274: URL: https://github.com/apache/doris-website/pull/2274 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](time) Support more time cast formats and refine some code. [doris]
zhangstar333 merged PR #49792: URL: https://github.com/apache/doris/pull/49792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](timer) Fix task execution timer [doris]
github-actions[bot] commented on PR #49939: URL: https://github.com/apache/doris/pull/49939#issuecomment-2791646350 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (84eaecb7435 -> e497a26fd82)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 84eaecb7435 Automated deployment with doris branch @ f50f817b5fc17051b3a7ceec61212a00da847332 new e497a26fd82 Automated deployment with doris branch @ f50f817b5fc17051b3a7ceec61212a00da847332 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (84eaecb7435) \ N -- N -- N refs/heads/asf-site (e497a26fd82) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Add UT cases to terminate tasks randomly [doris]
github-actions[bot] commented on PR #49906: URL: https://github.com/apache/doris/pull/49906#issuecomment-2791358608 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](minor) Delete unused RuntimeFilterDependency [doris]
Gabriel39 merged PR #49902: URL: https://github.com/apache/doris/pull/49902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-c108335-hive-sql updated: 1
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-c108335-hive-sql
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-c108335-hive-sql by
this push:
new 9e2f808bbd0 1
9e2f808bbd0 is described below
commit 9e2f808bbd025d48062cda917983fa23d4d58005
Author: morningman
AuthorDate: Wed Apr 9 18:48:41 2025 -0700
1
---
.../src/main/java/org/apache/doris/analysis/BoolLiteral.java | 2 +-
.../src/main/java/org/apache/doris/analysis/LiteralExpr.java | 10 --
2 files changed, 9 insertions(+), 3 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/BoolLiteral.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/BoolLiteral.java
index 521dc1bd00b..2c58c3965ba 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/BoolLiteral.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/BoolLiteral.java
@@ -114,7 +114,7 @@ public class BoolLiteral extends LiteralExpr {
@Override
public String getStringValueForArray(FormatOptions options) {
String val = options.isBoolValueNum() ? getStringValue() : (value ?
"true" : "false");
-return options.getNestedStringWrapper() + val +
options.getNestedStringWrapper();
+return val;
}
@Override
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/LiteralExpr.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/LiteralExpr.java
index 301b6277725..87841a69900 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/LiteralExpr.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/LiteralExpr.java
@@ -114,10 +114,16 @@ public abstract class LiteralExpr extends Expr implements
Comparable
Re: [PR] [refactor](minor) Delete unused RuntimeFilterDependency [doris]
github-actions[bot] commented on PR #49902: URL: https://github.com/apache/doris/pull/49902#issuecomment-2791357929 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Add UT cases to terminate tasks randomly [doris]
Gabriel39 merged PR #49906: URL: https://github.com/apache/doris/pull/49906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](operator) move eos flag to specific operators [doris]
github-actions[bot] commented on PR #49914: URL: https://github.com/apache/doris/pull/49914#issuecomment-2791394104 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](orc) fix orc push down and materialization for hive acid table [doris]
doris-robot commented on PR #49927: URL: https://github.com/apache/doris/pull/49927#issuecomment-2791396276 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.06% (18160/27489) Region Coverage: 65.50% (8946/13657) Branch Coverage: 55.33% (4818/8708) Coverage Report: http://coverage.selectdb-in.cc/coverage/54a9652bfc86dd28c27180763229d9fce79daa99_54a9652bfc86dd28c27180763229d9fce79daa99_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [feature](function) support utf8 input in initcap #49846 [doris]
github-actions[bot] opened a new pull request, #49933: URL: https://github.com/apache/doris/pull/49933 Cherry-picked from #49846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](beut) Make function be-ut test aware of result's precision [doris]
doris-robot commented on PR #49608: URL: https://github.com/apache/doris/pull/49608#issuecomment-2791355175 TPC-DS: Total hot run time: 194224 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 40d92aa80b797132a00ed7e7c580bcc55704020b, data reload: false query1 1442107610481048 query2 6317194319561943 query3 11030 447845494478 query4 57730 25557 23524 23524 query5 5171497 455 455 query6 392 220 208 208 query7 5261507 285 285 query8 346 258 265 258 query9 7113256825742568 query10 434 338 279 279 query11 15745 15135 15055 15055 query12 167 123 120 120 query13 1261549 400 400 query14 10234 653466206534 query15 216 192 183 183 query16 7122663 471 471 query17 1055715 585 585 query18 1543415 313 313 query19 189 186 170 170 query20 126 131 123 123 query21 205 121 106 106 query22 4271431844934318 query23 33826 33407 33369 33369 query24 6587249324532453 query25 485 472 402 402 query26 725 286 155 155 query27 2253526 339 339 query28 2967243724252425 query29 624 574 443 443 query30 277 234 195 195 query31 881 885 777 777 query32 75 62 63 62 query33 471 391 356 356 query34 781 862 541 541 query35 799 835 763 763 query36 956 991 914 914 query37 124 103 81 81 query38 4225428740594059 query39 1508149614591459 query40 222 127 108 108 query41 55 56 53 53 query42 121 108 109 108 query43 556 526 466 466 query44 1380819 805 805 query45 183 172 167 167 query46 847 1031678 678 query47 1879188717971797 query48 406 425 310 310 query49 704 538 457 457 query50 679 724 442 442 query51 4233429942624262 query52 111 108 102 102 query53 248 270 199 199 query54 583 574 518 518 query55 83 84 85 84 query56 316 323 314 314 query57 1176120211491149 query58 279 288 308 288 query59 2757277227182718 query60 357 353 324 324 query61 162 153 164 153 query62 742 721 687 687 query63 234 196 192 192 query64 17951133779 779 query65 4420426042644260 query66 705 404 329 329 query67 15807 15610 15192 15192 query68 7921892 521 521 query69 544 307 275 275 query70 11591114 query71 496 319 294 294 query72 5730490548734873 query73 1225690 357 357 query74 8896893988548854 query75 3835324127822782 query76 43431204789 789 query77 651 371 286 286 query78 10035 10019 93039303 query79 6842791 556 556 query80 773 532 524 524 query81 489 266 226 226 query82 723 135 97 97 query83 345 247 250 247 query84 299 111 91 91 query85 764 350 318 318 query86 374 303 311 303 query87 4570441943294329 query88 2831222822682228 query89 457 316 284 284 query90 2038225 221 221 query91 141 153 113 113 query92 78 62 57 57 query93 3509955 581 581 query94 705 425 302 302 query95 370 302 302 302 query96 488 571 277 277 query97 3167326331053105 query98 238 275 208 208 query99 1397138812521252 Total cold run time: 311407 ms Total hot run time: 194224 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [fix](doris compose) fix chose arrow_flight_sql_port [doris]
yujun777 commented on PR #49874: URL: https://github.com/apache/doris/pull/49874#issuecomment-2791398972 run cloud_p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49846-branch-2.1 created (now 7ce420c194a)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49846-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at 7ce420c194a [chore](log) change PointQueryExecutor log to VLOG_DEBUG (#49860) (#49900) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature]bind workload group to compute group [doris]
wangbo commented on code in PR #49884:
URL: https://github.com/apache/doris/pull/49884#discussion_r2036400492
##
fe/fe-core/src/main/java/org/apache/doris/analysis/AlterRoutineLoadStmt.java:
##
@@ -248,9 +249,12 @@ private void checkJobProperties() throws UserException {
}
if (jobProperties.containsKey(CreateRoutineLoadStmt.WORKLOAD_GROUP)) {
String workloadGroup =
jobProperties.get(CreateRoutineLoadStmt.WORKLOAD_GROUP);
-long wgId = Env.getCurrentEnv().getWorkloadGroupMgr()
-
.getWorkloadGroup(ConnectContext.get().getCurrentUserIdentity(), workloadGroup);
-analyzedJobProperties.put(CreateRoutineLoadStmt.WORKLOAD_GROUP,
String.valueOf(wgId));
+if (!StringUtils.isEmpty(workloadGroup)) {
+long wgId = Env.getCurrentEnv().getWorkloadGroupMgr()
+
.getWorkloadGroupByName(ConnectContext.get().getCurrentUserIdentity(),
workloadGroup).get(0)
Review Comment:
这里比较尴尬的点是，最初设计routine
load的参数的时候，只能存了一个wg的id，所以目前routineload可能没法实现多tag间的路由，得用别的办法解决。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature]bind workload group to compute group [doris]
wangbo commented on code in PR #49884:
URL: https://github.com/apache/doris/pull/49884#discussion_r2036399795
##
fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/WorkloadGroupMgr.java:
##
@@ -200,82 +203,78 @@ private void writeUnlock() {
lock.writeLock().unlock();
}
-public List getWorkloadGroup(ConnectContext
context) throws UserException {
-String groupName = getWorkloadGroupNameAndCheckPriv(context);
+private WorkloadGroup getWorkloadGroupByComputeGroupUnlock(Pair key)
+throws DdlException {
+WorkloadGroup wg = nameToWorkloadGroup.get(key);
+if (wg == null) {
+throw new DdlException("can not find workload group " + key.second
+ " in " + key.first + ".");
+}
+return wg;
+}
+
+public List getWorkloadGroupByName(UserIdentity
userIdentity, String wgFullName)
Review Comment:
之前是唯一的，但是在resource tag的功能下，用户可以指定多个tag，同名的但是不同tag的wg，返回的就是多个
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement CreateUserCommand in nereids [doris]
codeDing18 commented on PR #47554: URL: https://github.com/apache/doris/pull/47554#issuecomment-2791373645 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 02/02: patch Support hive compatible output format #49036 for nested boolean
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-c108335-hive-sql
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 4a2740990fc2f2659105f7d83b0b1af041e97aa8
Author: morningman
AuthorDate: Thu Apr 10 09:01:14 2025 +0800
patch Support hive compatible output format #49036 for nested boolean
---
be/src/vec/data_types/serde/data_type_array_serde.cpp | 2 ++
be/src/vec/data_types/serde/data_type_map_serde.cpp| 4
be/src/vec/data_types/serde/data_type_number_serde.cpp | 6 +++---
be/src/vec/data_types/serde/data_type_serde.h | 6 ++
be/src/vec/data_types/serde/data_type_struct_serde.cpp | 2 ++
5 files changed, 17 insertions(+), 3 deletions(-)
diff --git a/be/src/vec/data_types/serde/data_type_array_serde.cpp
b/be/src/vec/data_types/serde/data_type_array_serde.cpp
index ea748cdd6c4..a98d9622720 100644
--- a/be/src/vec/data_types/serde/data_type_array_serde.cpp
+++ b/be/src/vec/data_types/serde/data_type_array_serde.cpp
@@ -341,6 +341,7 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const
IColumn& column,
return Status::InternalError("pack mysql buffer failed.");
}
} else {
+++options.level;
if (is_nested_string && options.wrapper_len > 0) {
if (0 != result.push_string(options.nested_string_wrapper,
options.wrapper_len)) {
return Status::InternalError("pack mysql buffer failed.");
@@ -354,6 +355,7 @@ Status DataTypeArraySerDe::_write_column_to_mysql(const
IColumn& column,
RETURN_IF_ERROR(
nested_serde->write_column_to_mysql(data, result, j,
false, options));
}
+--options.level;
}
}
if (0 != result.push_string("]", 1)) {
diff --git a/be/src/vec/data_types/serde/data_type_map_serde.cpp
b/be/src/vec/data_types/serde/data_type_map_serde.cpp
index d2c311b70d9..118a2841f5f 100644
--- a/be/src/vec/data_types/serde/data_type_map_serde.cpp
+++ b/be/src/vec/data_types/serde/data_type_map_serde.cpp
@@ -429,6 +429,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const
IColumn& column,
return Status::InternalError("pack mysql buffer failed.");
}
} else {
+++options.level;
if (is_key_string && options.wrapper_len > 0) {
if (0 != result.push_string(options.nested_string_wrapper,
options.wrapper_len)) {
return Status::InternalError("pack mysql buffer failed.");
@@ -442,6 +443,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const
IColumn& column,
RETURN_IF_ERROR(key_serde->write_column_to_mysql(nested_keys_column, result, j,
false,
options));
}
+--options.level;
}
if (0 != result.push_string(&options.map_key_delim, 1)) {
return Status::InternalError("pack mysql buffer failed.");
@@ -451,6 +453,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const
IColumn& column,
return Status::InternalError("pack mysql buffer failed.");
}
} else {
+++options.level;
if (is_val_string && options.wrapper_len > 0) {
if (0 != result.push_string(options.nested_string_wrapper,
options.wrapper_len)) {
return Status::InternalError("pack mysql buffer failed.");
@@ -464,6 +467,7 @@ Status DataTypeMapSerDe::_write_column_to_mysql(const
IColumn& column,
RETURN_IF_ERROR(value_serde->write_column_to_mysql(nested_values_column,
result, j,
false,
options));
}
+--options.level;
}
}
if (0 != result.push_string("}", 1)) {
diff --git a/be/src/vec/data_types/serde/data_type_number_serde.cpp
b/be/src/vec/data_types/serde/data_type_number_serde.cpp
index 69e3271715f..2eb972cbf1a 100644
--- a/be/src/vec/data_types/serde/data_type_number_serde.cpp
+++ b/be/src/vec/data_types/serde/data_type_number_serde.cpp
@@ -280,11 +280,11 @@ Status
DataTypeNumberSerDe::_write_column_to_mysql(const IColumn& column,
if constexpr (std::is_same_v) {
buf_ret = result.push_tinyint(data[col_index]);
} else if constexpr (std::is_same_v) {
-if (options.is_bool_value_num) {
-buf_ret = result.push_tinyint(data[col_index]);
-} else {
+if (options.level > 0 && !options.is_bool_value_num) {
std::string bool_value = data[col_index] ? "true" : "false";
result.push_string(bool_value.c_str(), bool_value.size());
+} else {
+buf_ret = result.push_tinyint(data[col_index]);
}
} else if constexpr (std::is_same_v || std::is_same_v) {
buf_ret = result.push_smallint(data[col_index]);
diff --g
Re: [PR] branch-2.1: [enhancement](case) add cases for mow table load empty file #49843 [doris]
Thearas commented on PR #49858: URL: https://github.com/apache/doris/pull/49858#issuecomment-2785058720 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud-mow) Should clear initiators when upgrading MS [doris]
hust-hhb commented on PR #49716: URL: https://github.com/apache/doris/pull/49716#issuecomment-2791380077 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] test pipeline [doris]
eldenmoon commented on PR #49821: URL: https://github.com/apache/doris/pull/49821#issuecomment-2791415664 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fragment mgr) Release query context once query finished [doris]
github-actions[bot] commented on PR #49934: URL: https://github.com/apache/doris/pull/49934#issuecomment-2791424276 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement CreateUserCommand in nereids [doris]
doris-robot commented on PR #47554: URL: https://github.com/apache/doris/pull/47554#issuecomment-2791434223 TPC-H: Total hot run time: 34566 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit e92f841c9d37397fcd72d20c15f2d9cf627fcddd, data reload: false -- Round 1 -- q1 26033 517350975097 q2 2065277 195 195 q3 10388 1260700 700 q4 10232 1058538 538 q5 7503238923852385 q6 197 166 135 135 q7 926 768 608 608 q8 9315143311761176 q9 6803515052235150 q10 6855229419061906 q11 496 292 292 292 q12 361 368 222 222 q13 17788 373131113111 q14 224 224 207 207 q15 553 501 486 486 q16 627 634 594 594 q17 645 928 390 390 q18 7566727270387038 q19 1286976 606 606 q20 365 356 236 236 q21 4532389625122512 q22 10501019982 982 Total cold run time: 115810 ms Total hot run time: 34566 ms - Round 2, with runtime_filter_mode=off - q1 5166516552155165 q2 248 337 246 246 q3 2156267322602260 q4 1443195914901490 q5 4476445544134413 q6 222 173 127 127 q7 2026195917551755 q8 2646261325692569 q9 7179713171967131 q10 3015318827752775 q11 619 513 507 507 q12 703 741 639 639 q13 3659390034323432 q14 287 299 261 261 q15 542 493 508 493 q16 635 690 704 690 q17 1206159514231423 q18 7847758073847384 q19 912 897 1006897 q20 1963197318291829 q21 5384496749814967 q22 1071102710601027 Total cold run time: 53405 ms Total hot run time: 51480 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [doc]add examples for paimon on gcs [doris-website]
morningman commented on code in PR #2179: URL: https://github.com/apache/doris-website/pull/2179#discussion_r2036482566 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/catalogs/paimon-catalog.md: ## @@ -192,6 +192,35 @@ CREATE CATALOG paimon_dlf PROPERTIES ( ); ``` +### Paimon on Google Dataproc Metastore + +```sql +CREATE CATALOG `paimon_gms` PROPERTIES ( +"type" = "paimon", +"paimon.catalog.type" = "hms", +"hive.metastore.uris" = "thrift://ip:port", +"warehouse" = "gs://bucket/warehouse", +"s3.access_key" = "ak", +"s3.secret_key" = "sk", +"s3.region" = "region", +"s3.endpoint" = "storage.googleapis.com", +"ipc.client.fallback-to-simple-auth-allowed" = "true" Review Comment: remove this. same for other example -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](TrinoConnector) it will return error when query `information_schema.tables` within `trino-connector` catalog [doris]
doris-robot commented on PR #49912: URL: https://github.com/apache/doris/pull/49912#issuecomment-2791560967 TPC-H: Total hot run time: 34197 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a36d9b28746e741f80c2c2c80a2136645f050e18, data reload: false -- Round 1 -- q1 25883 506750065006 q2 2070302 188 188 q3 10399 1263706 706 q4 10251 1023546 546 q5 8384245223902390 q6 186 161 132 132 q7 920 737 598 598 q8 9300128810581058 q9 6881510250875087 q10 6822227618701870 q11 482 279 270 270 q12 344 363 220 220 q13 17785 366630633063 q14 225 224 219 219 q15 538 480 501 480 q16 623 627 600 600 q17 613 860 387 387 q18 7544755471087108 q19 1750962 550 550 q20 340 345 231 231 q21 4502349925172517 q22 1054999 971 971 Total cold run time: 116896 ms Total hot run time: 34197 ms - Round 2, with runtime_filter_mode=off - q1 5176509050985090 q2 249 334 239 239 q3 2181266122962296 q4 1422193114941494 q5 4567445442904290 q6 212 168 127 127 q7 1965189317491749 q8 2573261525282528 q9 7132714972397149 q10 3016314927672767 q11 568 517 495 495 q12 685 720 636 636 q13 3587384232433243 q14 292 290 288 288 q15 517 482 478 478 q16 625 682 648 648 q17 1134153613791379 q18 7682739273987392 q19 806 831 791 791 q20 1984196318311831 q21 5225464946624649 q22 10801022986 986 Total cold run time: 52678 ms Total hot run time: 50545 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage [doris]
zhiqiang- commented on PR #49925: URL: https://github.com/apache/doris/pull/49925#issuecomment-2791469945 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](restore) Add cloud restore job [doris]
doris-robot commented on PR #47300: URL: https://github.com/apache/doris/pull/47300#issuecomment-2791535393 TPC-DS: Total hot run time: 193161 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit da15c78dd2431588360c49cd328d2c4661148a37, data reload: false query1 1399106610291029 query2 6181191319031903 query3 11029 458743174317 query4 53589 25927 23473 23473 query5 5208523 471 471 query6 384 205 188 188 query7 5025497 280 280 query8 311 240 222 222 query9 6398255825562556 query10 442 317 262 262 query11 15301 15111 14950 14950 query12 163 105 105 105 query13 1102495 370 370 query14 10119 632962546254 query15 204 195 177 177 query16 7014647 505 505 query17 1069734 573 573 query18 1528407 314 314 query19 199 188 166 166 query20 127 130 127 127 query21 211 123 109 109 query22 4456447444134413 query23 34074 33507 33357 33357 query24 6748241224082408 query25 475 512 409 409 query26 657 277 152 152 query27 2280502 352 352 query28 3172246624492449 query29 602 591 454 454 query30 283 227 201 201 query31 879 872 810 810 query32 77 68 69 68 query33 457 381 310 310 query34 787 877 496 496 query35 816 843 756 756 query36 940 1012879 879 query37 124 106 84 84 query38 4102426042674260 query39 1478144614491446 query40 225 124 114 114 query41 59 60 56 56 query42 137 113 109 109 query43 483 513 474 474 query44 1319816 817 816 query45 185 179 173 173 query46 858 1040657 657 query47 1858188318471847 query48 388 454 313 313 query49 695 515 428 428 query50 669 712 401 401 query51 4202428342084208 query52 109 109 102 102 query53 226 261 182 182 query54 591 576 516 516 query55 89 85 87 85 query56 299 311 305 305 query57 1207119211371137 query58 289 263 253 253 query59 2771290227792779 query60 342 321 319 319 query61 137 132 129 129 query62 736 738 652 652 query63 223 189 191 189 query64 14991089708 708 query65 4522435443024302 query66 756 399 299 299 query67 15944 15648 15519 15519 query68 7043834 503 503 query69 538 302 283 283 query70 1234111310601060 query71 507 322 294 294 query72 5633472146094609 query73 1213573 339 339 query74 8965911886618661 query75 3852317426962696 query76 43431187748 748 query77 611 362 284 284 query78 10065 10261 92919291 query79 1943824 557 557 query80 692 505 436 436 query81 482 256 229 229 query82 462 122 99 99 query83 262 260 234 234 query84 296 111 89 89 query85 795 359 318 318 query86 387 311 280 280 query87 4477447244464446 query88 3367222722152215 query89 400 312 289 289 query90 1885234 225 225 query91 147 143 123 123 query92 75 60 59 59 query93 1690983 568 568 query94 666 433 296 296 query95 382 361 291 291 query96 499 578 270 270 query97 3223322131583158 query98 222 205 200 200 query99 1440139212841284 Total cold run time: 298024 ms Total hot run time: 193161 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [opt](nereids) remove const join condition [doris]
doris-robot commented on PR #49730: URL: https://github.com/apache/doris/pull/49730#issuecomment-2791536135 ClickBench: Total hot run time: 31.5 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0077dae60c783fdc617e0e55cf82853ece1cf0c4, data reload: false query1 0.050.040.02 query2 0.130.110.11 query3 0.240.200.19 query4 1.590.200.19 query5 0.600.570.58 query6 1.190.710.70 query7 0.020.020.02 query8 0.040.040.04 query9 0.580.510.51 query10 0.570.590.58 query11 0.150.110.11 query12 0.140.110.11 query13 0.610.590.59 query14 2.662.702.72 query15 0.920.860.85 query16 0.390.400.38 query17 1.081.051.03 query18 0.210.190.19 query19 1.891.961.81 query20 0.020.010.01 query21 15.37 0.930.53 query22 0.751.260.71 query23 14.86 1.400.64 query24 6.652.181.04 query25 0.460.100.13 query26 0.610.160.15 query27 0.050.050.05 query28 9.310.880.42 query29 12.55 3.983.37 query30 0.260.090.06 query31 2.820.590.39 query32 3.240.540.47 query33 3.063.003.07 query34 15.84 5.154.53 query35 4.534.594.54 query36 0.680.500.48 query37 0.090.070.06 query38 0.050.040.04 query39 0.040.020.02 query40 0.180.150.12 query41 0.080.030.02 query42 0.040.030.02 query43 0.040.030.03 Total cold run time: 104.64 s Total hot run time: 31.5 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] do exchange refactor [doris]
doris-robot commented on PR #49335: URL: https://github.com/apache/doris/pull/49335#issuecomment-2791399929 TPC-DS: Total hot run time: 194733 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 51883d2b4b692c1a9951a7fd80d171e38e4b3db7, data reload: false query1 1410107510351035 query2 6083197319531953 query3 11082 445745784457 query4 56019 25958 23740 23740 query5 5046483 454 454 query6 356 200 207 200 query7 4910512 285 285 query8 320 269 245 245 query9 6058257826012578 query10 438 337 270 270 query11 15112 15046 15161 15046 query12 164 113 110 110 query13 1073531 404 404 query14 10206 643463636363 query15 202 200 179 179 query16 7096656 471 471 query17 1086771 612 612 query18 1567422 320 320 query19 200 204 178 178 query20 127 123 124 123 query21 217 135 109 109 query22 4504453445984534 query23 34190 33597 33705 33597 query24 6502245324322432 query25 457 456 401 401 query26 677 277 154 154 query27 2246518 343 343 query28 3060244724512447 query29 586 561 439 439 query30 276 219 223 219 query31 882 882 815 815 query32 73 60 64 60 query33 448 369 309 309 query34 768 863 536 536 query35 844 850 770 770 query36 934 1014911 911 query37 115 103 78 78 query38 4276430542704270 query39 1471145614251425 query40 218 123 109 109 query41 59 53 52 52 query42 129 108 105 105 query43 532 526 496 496 query44 1312818 833 818 query45 185 179 167 167 query46 857 1064661 661 query47 1903189718441844 query48 384 415 306 306 query49 679 502 432 432 query50 673 703 400 400 query51 4241431342094209 query52 110 111 104 104 query53 232 256 182 182 query54 565 602 549 549 query55 86 82 82 82 query56 303 307 317 307 query57 1164125411341134 query58 267 261 264 261 query59 2790289727892789 query60 349 331 329 329 query61 130 127 131 127 query62 742 798 673 673 query63 226 191 187 187 query64 14811063736 736 query65 4449430842364236 query66 706 429 298 298 query67 15930 15872 15598 15598 query68 7932886 522 522 query69 539 331 263 263 query70 1210110211301102 query71 505 310 284 284 query72 5807479948754799 query73 1404691 346 346 query74 8995911388628862 query75 3771318626752675 query76 42481219770 770 query77 622 375 281 281 query78 10096 10132 92299229 query79 2896826 561 561 query80 668 516 436 436 query81 501 261 216 216 query82 520 126 94 94 query83 391 253 242 242 query84 293 116 86 86 query85 809 356 376 356 query86 416 312 285 285 query87 4552451743854385 query88 3703221322042204 query89 402 315 284 284 query90 1862212 211 211 query91 140 142 110 110 query92 76 61 57 57 query93 2098961 570 570 query94 679 415 298 298 query95 369 289 284 284 query96 491 564 270 270 query97 3180331231163116 query98 245 206 191 191 query99 1435140212811281 Total cold run time: 302638 ms Total hot run time: 194733 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [fix](fragment mgr) Release query context once query finished [doris]
doris-robot commented on PR #49934: URL: https://github.com/apache/doris/pull/49934#issuecomment-2791565985 TPC-H: Total hot run time: 34507 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2466453e731a6c5408881d2ebe3b46aa1933ca4e, data reload: false -- Round 1 -- q1 26078 507551275075 q2 2057286 178 178 q3 10395 1257710 710 q4 10217 1015545 545 q5 7531233324132333 q6 201 166 134 134 q7 901 761 627 627 q8 9337132111541154 q9 6959514351125112 q10 6843231619111911 q11 485 305 262 262 q12 350 360 224 224 q13 17756 368730773077 q14 224 230 206 206 q15 559 502 515 502 q16 615 648 590 590 q17 599 864 379 379 q18 7556723672207220 q19 1218939 590 590 q20 355 340 233 233 q21 4216332024922492 q22 1069996 953 953 Total cold run time: 115521 ms Total hot run time: 34507 ms - Round 2, with runtime_filter_mode=off - q1 5175520652485206 q2 235 328 227 227 q3 2157265123102310 q4 1465183214821482 q5 4589448243864386 q6 213 165 132 132 q7 2046190917381738 q8 2568259024822482 q9 7292720370977097 q10 2976342227422742 q11 574 517 525 517 q12 673 757 632 632 q13 3600395833563356 q14 273 303 272 272 q15 548 495 480 480 q16 654 678 640 640 q17 1171155613911391 q18 7692743175557431 q19 853 874 895 874 q20 1928194218581858 q21 5118459547404595 q22 1044985 962 962 Total cold run time: 52844 ms Total hot run time: 50810 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [UT](pipeline) Test pipeline tasks [doris]
doris-robot commented on PR #49940: URL: https://github.com/apache/doris/pull/49940#issuecomment-2791542067 TPC-DS: Total hot run time: 187256 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit aa3a931f5de9c025addb75119fadbfc5a49c4515, data reload: false query1 1057517 490 490 query2 6547199120261991 query3 6748228 218 218 query4 26175 23679 23058 23058 query5 4369615 480 480 query6 318 218 190 190 query7 4635490 285 285 query8 289 245 224 224 query9 8647254025882540 query10 463 316 260 260 query11 16138 15031 14825 14825 query12 164 113 100 100 query13 1648522 401 401 query14 8907635462376237 query15 221 187 173 173 query16 7136646 472 472 query17 1002735 560 560 query18 1969391 296 296 query19 187 184 154 154 query20 117 115 117 115 query21 207 122 109 109 query22 4099423442314231 query23 33766 32822 32879 32822 query24 8343243023972397 query25 552 444 391 391 query26 1233269 151 151 query27 2751519 326 326 query28 4413242624052405 query29 802 581 464 464 query30 288 223 190 190 query31 945 851 783 783 query32 74 72 73 72 query33 568 383 328 328 query34 804 864 526 526 query35 803 875 753 753 query36 956 968 894 894 query37 123 107 79 79 query38 4243423342384233 query39 1460140314421403 query40 215 121 118 118 query41 60 92 55 55 query42 124 106 105 105 query43 499 518 480 480 query44 1350809 810 809 query45 179 173 164 164 query46 855 1032629 629 query47 1745179817351735 query48 383 412 299 299 query49 773 535 401 401 query50 662 674 422 422 query51 4138418640914091 query52 111 112 99 99 query53 229 255 188 188 query54 586 574 497 497 query55 84 85 87 85 query56 320 320 286 286 query57 1169113110841084 query58 264 258 264 258 query59 2695285028232823 query60 332 313 315 313 query61 138 136 130 130 query62 798 745 653 653 query63 227 190 185 185 query64 44241067715 715 query65 4369425242924252 query66 1157427 320 320 query67 16134 15381 15481 15381 query68 6251888 520 520 query69 485 320 269 269 query70 1223109511081095 query71 398 306 294 294 query72 5543485049844850 query73 698 687 349 349 query74 9138887291258872 query75 3263319227502750 query76 31901181764 764 query77 483 386 295 295 query78 998710182 93419341 query79 1417883 574 574 query80 599 538 463 463 query81 483 257 234 234 query82 205 125 96 96 query83 262 256 239 239 query84 301 105 84 84 query85 788 356 327 327 query86 333 326 280 280 query87 4645447043584358 query88 2948225822732258 query89 386 314 290 290 query90 1824224 250 224 query91 159 157 127 127 query92 68 67 59 59 query93 1036987 589 589 query94 719 421 311 311 query95 386 298 287 287 query96 495 560 281 281 query97 3100325230833083 query98 233 214 204 204 query99 1339139812861286 Total cold run time: 269572 ms Total hot run time: 187256 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [feature](restore) Add cloud restore job [doris]
doris-robot commented on PR #47300: URL: https://github.com/apache/doris/pull/47300#issuecomment-2791541965 ClickBench: Total hot run time: 31.86 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit da15c78dd2431588360c49cd328d2c4661148a37, data reload: false query1 0.040.030.03 query2 0.160.100.11 query3 0.340.190.19 query4 1.580.200.09 query5 0.550.570.54 query6 1.180.720.72 query7 0.030.020.02 query8 0.060.050.05 query9 0.620.520.52 query10 0.580.580.57 query11 0.260.130.13 query12 0.260.140.14 query13 0.640.610.62 query14 2.682.692.79 query15 1.010.880.87 query16 0.370.380.39 query17 1.071.051.04 query18 0.190.190.19 query19 2.171.891.84 query20 0.010.010.02 query21 15.35 0.970.68 query22 0.931.010.84 query23 14.69 1.600.77 query24 5.530.600.28 query25 0.170.090.09 query26 0.550.230.19 query27 0.090.080.08 query28 11.06 1.160.57 query29 12.55 4.183.55 query30 0.280.080.06 query31 2.820.650.44 query32 3.240.600.50 query33 3.173.133.07 query34 16.54 5.134.40 query35 4.474.484.46 query36 0.630.500.49 query37 0.210.170.18 query38 0.160.150.16 query39 0.050.040.05 query40 0.190.160.15 query41 0.100.050.06 query42 0.070.050.06 query43 0.050.050.05 Total cold run time: 106.7 s Total hot run time: 31.86 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](load) fix multi table load repeated failures and retries when meet data quality error [doris]
sollhui commented on PR #49938: URL: https://github.com/apache/doris/pull/49938#issuecomment-2791461055 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](Exchange) do exchange sink buffer refactor [doris]
HappenLee commented on code in PR #49335:
URL: https://github.com/apache/doris/pull/49335#discussion_r2036487211
##
be/src/pipeline/exec/exchange_sink_operator.cpp:
##
@@ -368,11 +379,11 @@ Status ExchangeSinkOperatorX::sink(RuntimeState* state,
vectorized::Block* block
set_low_memory_mode(state);
}
-if (_part_type == TPartitionType::UNPARTITIONED ||
local_state.channels.size() == 1) {
Review Comment:
do the job in exchange sink operator contructor
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]
morningman commented on code in PR #49688:
URL: https://github.com/apache/doris/pull/49688#discussion_r2036489109
##
be/src/vec/exec/jni_connector.cpp:
##
@@ -82,12 +90,15 @@ Status JniConnector::open(RuntimeState* state,
RuntimeProfile* profile) {
batch_size = _state->batch_size();
}
RETURN_IF_ERROR(JniUtil::GetJNIEnv(&env));
-SCOPED_TIMER(_open_scanner_time);
+MonotonicStopWatch _watch;
Review Comment:
use MACRO, like this: `SCOPED_RAW_TIMER(&_statistics.decode_dict_time);`
##
be/src/vec/exec/jni_connector.cpp:
##
@@ -82,12 +90,15 @@ Status JniConnector::open(RuntimeState* state,
RuntimeProfile* profile) {
batch_size = _state->batch_size();
}
RETURN_IF_ERROR(JniUtil::GetJNIEnv(&env));
-SCOPED_TIMER(_open_scanner_time);
+MonotonicStopWatch _watch;
Review Comment:
same suggestion for others
##
fe/fe-core/src/main/java/org/apache/doris/common/profile/SummaryProfile.java:
##
@@ -399,6 +415,15 @@ public void update(Map summaryInfo) {
updateExecutionSummaryProfile();
}
+public void queryFinished() {
+executionSummaryProfile.addInfoString(
+SPLITS_ASSIGNMENT_WEIGHT,
+new
GsonBuilder().disableHtmlEscaping().create().toJson(splitWeightProfileInfoMap));
+executionSummaryProfile.addInfoString(
+SPLITS_ASSIGNMENT_SPLIT_INFO,
+new
GsonBuilder().disableHtmlEscaping().create().toJson(splitProfileInfoMap));
Review Comment:
The number of split may be huge. It is not a good idea to print them all.
I think we can only print top 10 of them.
And also need to consider and, we'd even not save all split. Just save top
10 is enough
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](paimon/iceberg)upgrade paimon to 1.0.1, iceberg to 1.6.1 [doris]
morningman commented on PR #49280: URL: https://github.com/apache/doris/pull/49280#issuecomment-2791564880 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](TrinoConnector) it will return error when query `information_schema.tables` within `trino-connector` catalog [doris]
doris-robot commented on PR #49912: URL: https://github.com/apache/doris/pull/49912#issuecomment-2791583776 ClickBench: Total hot run time: 31.3 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a36d9b28746e741f80c2c2c80a2136645f050e18, data reload: false query1 0.040.040.03 query2 0.120.100.10 query3 0.240.190.20 query4 1.590.200.20 query5 0.570.540.56 query6 1.170.720.71 query7 0.020.020.02 query8 0.040.040.03 query9 0.570.520.52 query10 0.620.580.56 query11 0.150.100.10 query12 0.140.110.12 query13 0.620.590.60 query14 2.732.742.70 query15 0.930.850.85 query16 0.370.370.38 query17 1.011.031.03 query18 0.200.190.19 query19 2.061.861.80 query20 0.010.010.02 query21 15.35 0.890.54 query22 0.751.180.93 query23 14.72 1.440.66 query24 6.641.370.74 query25 0.460.150.07 query26 0.720.160.14 query27 0.050.060.05 query28 9.040.880.42 query29 12.53 3.993.36 query30 0.250.090.06 query31 2.880.600.39 query32 3.220.540.46 query33 3.033.123.07 query34 15.80 5.104.45 query35 4.524.544.51 query36 0.670.490.48 query37 0.080.060.06 query38 0.050.040.03 query39 0.030.020.02 query40 0.170.130.13 query41 0.080.030.03 query42 0.040.030.02 query43 0.030.040.03 Total cold run time: 104.31 s Total hot run time: 31.3 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
