Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-10 Thread via GitHub
wuwenchi commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2038801635 ## fe/fe-core/src/main/java/org/apache/doris/common/profile/SummaryProfile.java: ## @@ -399,6 +415,15 @@ public void update(Map summaryInfo) { updateExecution

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-09 Thread via GitHub
morningman commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2036489109 ## be/src/vec/exec/jni_connector.cpp: ## @@ -82,12 +90,15 @@ Status JniConnector::open(RuntimeState* state, RuntimeProfile* profile) { batch_size = _state-

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2788304517 ClickBench: Total hot run time: 31.91 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2788298197 TPC-DS: Total hot run time: 193117 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2788282697 TPC-H: Total hot run time: 34086 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2788169305 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.12% (18176/27488) Region Coverage: 65.55% (8952/13657) Branch Coverage: 55.39

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
wuwenchi commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2788149869 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2785846806 TPC-H: Total hot run time: 34313 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2785893837 ClickBench: Total hot run time: 31.83 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2785879602 TPC-DS: Total hot run time: 192471 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
wuwenchi commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2785523102 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-08 Thread via GitHub
wuwenchi commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2785526428 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub
zhiqiang- commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2030400052 ## be/src/util/runtime_profile.h: ## @@ -278,6 +278,39 @@ class RuntimeProfile { DerivedCounterFunction _counter_fn; }; +using ConditionCounte

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub
zhiqiang- commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2030399418 ## be/src/util/runtime_profile.h: ## @@ -278,6 +278,39 @@ class RuntimeProfile { DerivedCounterFunction _counter_fn; }; +using ConditionCounte

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub
zhiqiang- commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2030400052 ## be/src/util/runtime_profile.h: ## @@ -278,6 +278,39 @@ class RuntimeProfile { DerivedCounterFunction _counter_fn; }; +using ConditionCounte

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub
zhiqiang- commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2030399418 ## be/src/util/runtime_profile.h: ## @@ -278,6 +278,39 @@ class RuntimeProfile { DerivedCounterFunction _counter_fn; }; +using ConditionCounte

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2781327553 # BE UT Coverage Report Increment line coverage `11.43% (8/70)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/29a330ffef20ee4b032cc8e080557af6941

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-05 Thread via GitHub
zhiqiang- commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2030053767 ## be/src/vec/exec/jni_connector.cpp: ## @@ -82,12 +87,15 @@ Status JniConnector::open(RuntimeState* state, RuntimeProfile* profile) { batch_size = _sta

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-05 Thread via GitHub
doris-robot commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2781232647 TeamCity cloud ut coverage result: Function Coverage: 83.07% (1089/1311) Line Coverage: 66.08% (18165/27488) Region Coverage: 65.52% (8948/13657) Branch Coverage: 55.36

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-05 Thread via GitHub
wuwenchi commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2781226537 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-05 Thread via GitHub
wuwenchi opened a new pull request, #49688: URL: https://github.com/apache/doris/pull/49688 ### What problem does this PR solve? Problem Summary: 1. Number the splits and output the weight of each split. 2. Further subdivide the time of the usage of JNI into 'appendDataTime' and

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-04 Thread via GitHub
Copilot commented on code in PR #49688: URL: https://github.com/apache/doris/pull/49688#discussion_r2020640946 ## fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/source/PaimonScanNode.java: ## @@ -276,6 +276,9 @@ public List getSplits(int numBackends) throws UserExc

Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-04 Thread via GitHub
Thearas commented on PR #49688: URL: https://github.com/apache/doris/pull/49688#issuecomment-2765346301 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+y