(doris-website) branch asf-site updated (ffa3245757d -> 3082d9ca497)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard ffa3245757d Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new 3082d9ca497 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (ffa3245757d)
\
 N -- N -- N   refs/heads/asf-site (3082d9ca497)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch branch-2.1 updated: branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library for be and ry #49565 (#49684)

2025-04-06 Thread yiguolei
This is an automated email from the ASF dual-hosted git repository.

yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/branch-2.1 by this push:
 new 08fc9eea0db branch-2.1: [feat](thirdparty) Add aws dentity-management 
and sts library for be and ry #49565 (#49684)
08fc9eea0db is described below

commit 08fc9eea0db36936de9bc0e0c5d5e679324cac5a
Author: github-actions[bot] 
<41898282+github-actions[bot]@users.noreply.github.com>
AuthorDate: Sun Apr 6 21:22:52 2025 +0800

branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library 
for be and ry #49565 (#49684)

Cherry-picked from #49565

Co-authored-by: Lei Zhang 
---
 thirdparty/build-thirdparty.sh | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/thirdparty/build-thirdparty.sh b/thirdparty/build-thirdparty.sh
index 93ec4fb7da8..9865ce50558 100755
--- a/thirdparty/build-thirdparty.sh
+++ b/thirdparty/build-thirdparty.sh
@@ -1345,7 +1345,7 @@ build_aws_sdk() {
 "${CMAKE_CMD}" -G "${GENERATOR}" -B"${BUILD_DIR}" 
-DCMAKE_BUILD_TYPE=RelWithDebInfo -DCMAKE_INSTALL_PREFIX="${TP_INSTALL_DIR}" \
 -DCMAKE_PREFIX_PATH="${TP_INSTALL_DIR}" -DBUILD_SHARED_LIBS=OFF 
-DENABLE_TESTING=OFF \
 -DCURL_LIBRARY_RELEASE="${TP_INSTALL_DIR}/lib/libcurl.a" 
-DZLIB_LIBRARY_RELEASE="${TP_INSTALL_DIR}/lib/libz.a" \
--DBUILD_ONLY="core;s3;s3-crt;transfer" \
+-DBUILD_ONLY="core;s3;s3-crt;transfer;identity-management;sts" \
 -DCMAKE_CXX_FLAGS="-Wno-nonnull -Wno-deprecated-declarations 
${warning_dangling_reference}" -DCPP_STANDARD=17
 
 cd "${BUILD_DIR}"
@@ -1368,6 +1368,8 @@ build_aws_sdk() {
 strip_lib libaws-cpp-sdk-transfer.a
 strip_lib libaws-checksums.a
 strip_lib libaws-c-compression.a
+strip_lib libaws-cpp-sdk-identity-management.a
+strip_lib libaws-cpp-sdk-sts.a
 }
 
 # lzma


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49565-branch-2.1 deleted (was 4216c8e3b9f)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49565-branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git


 was 4216c8e3b9f [feat](thirdparty) Add aws dentity-management and sts 
library for be and ry (#49565)

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library for be and ry #49565 [doris]

2025-04-06 Thread via GitHub


yiguolei merged PR #49684:
URL: https://github.com/apache/doris/pull/49684


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


xiedeyantu commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781425001

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


xiedeyantu commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781439021

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781448256

   
   
   TPC-H: Total hot run time: 34201 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 4bcbd533c9df1d8aee35161040fb1490678b3249, 
data reload: false
   
   -- Round 1 --
   q1   25730   511950725072
   q2   1818282 182 182
   q3   10328   1269689 689
   q4   6132996 529 529
   q5   2089233123372331
   q6   191 165 134 134
   q7   929 745 610 610
   q8   1080113910611061
   q9   5306520751995199
   q10  6834230618911891
   q11  478 279 269 269
   q12  345 358 224 224
   q13  17771   423530633063
   q14  242 225 204 204
   q15  546 507 499 499
   q16  624 621 593 593
   q17  584 850 354 354
   q18  7509719371537153
   q19  1067946 558 558
   q20  332 354 235 235
   q21  4104338623982398
   q22  10621007953 953
   Total cold run time: 95101 ms
   Total hot run time: 34201 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5176516751665166
   q2   242 341 229 229
   q3   2189266023202320
   q4   1440183413871387
   q5   4179410441154104
   q6   214 162 122 122
   q7   1878183716451645
   q8   2541258724492449
   q9   6840682968176817
   q10  2973309326452645
   q11  571 493 476 476
   q12  634 734 569 569
   q13  3325380830973097
   q14  265 286 260 260
   q15  525 486 488 486
   q16  659 681 647 647
   q17  1114153113091309
   q18  7150714371847143
   q19  785 814 823 814
   q20  1888194518481848
   q21  5126477446964696
   q22  10681021997 997
   Total cold run time: 50782 ms
   Total hot run time: 49226 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (63538a1be52 -> 14d3e920601)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 63538a1be52 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new 14d3e920601 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (63538a1be52)
\
 N -- N -- N   refs/heads/asf-site (14d3e920601)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781453373

   
   
   TPC-DS: Total hot run time: 185475 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 4bcbd533c9df1d8aee35161040fb1490678b3249, 
data reload: false
   
   query1   1030503 462 462
   query2   6542191819041904
   query3   6744224 219 219
   query4   26409   23732   22829   22829
   query5   5642631 456 456
   query6   290 200 184 184
   query7   4628500 271 271
   query8   284 234 231 231
   query9   8642260726062606
   query10  542 332 281 281
   query11  15686   15138   14834   14834
   query12  160 111 104 104
   query13  1644514 387 387
   query14  10902   612360786078
   query15  203 185 170 170
   query16  7609644 457 457
   query17  1557741 555 555
   query18  2007395 303 303
   query19  189 180 154 154
   query20  118 118 118 118
   query21  214 122 107 107
   query22  4116431438743874
   query23  33777   32824   33088   32824
   query24  7114238123572357
   query25  546 450 385 385
   query26  1246272 147 147
   query27  2643492 324 324
   query28  4367239324082393
   query29  730 574 454 454
   query30  294 221 198 198
   query31  969 863 755 755
   query32  72  63  66  63
   query33  554 374 324 324
   query34  805 844 507 507
   query35  801 820 738 738
   query36  971 1006891 891
   query37  124 105 78  78
   query38  4179409441224094
   query39  1436139814331398
   query40  214 119 107 107
   query41  56  55  52  52
   query42  137 109 105 105
   query43  477 505 484 484
   query44  1340806 803 803
   query45  182 170 166 166
   query46  843 999 616 616
   query47  1771179816911691
   query48  389 407 308 308
   query49  821 547 440 440
   query50  645 670 395 395
   query51  4116412640564056
   query52  111 112 100 100
   query53  233 259 197 197
   query54  601 604 523 523
   query55  91  84  84  84
   query56  337 299 307 299
   query57  1127115510641064
   query58  287 323 266 266
   query59  2647273527482735
   query60  328 319 355 319
   query61  136 133 131 131
   query62  788 724 670 670
   query63  218 185 190 185
   query64  43481027699 699
   query65  4334420542314205
   query66  1002432 319 319
   query67  15897   15271   15415   15271
   query68  7978880 521 521
   query69  503 297 263 263
   query70  1146110611481106
   query71  510 310 305 305
   query72  5527475547854755
   query73  645 623 347 347
   query74  8837884087798779
   query75  4015323927052705
   query76  36391193758 758
   query77  798 386 289 289
   query78  10063   10044   92639263
   query79  1971818 572 572
   query80  624 510 453 453
   query81  507 261 224 224
   query82  212 124 93  93
   query83  270 259 242 242
   query84  256 108 93  93
   query85  757 440 315 315
   query86  336 318 290 290
   query87  4333449943174317
   query88  3072224022432240
   query89  384 309 286 286
   query90  1951217 215 215
   query91  144 141 114 114
   query92  81  60  59  59
   query93  1979963 580 580
   query94  623 420 307 307
   query95  364 296 293 293
   query96  493 562 273 273
   query97  3109316231213121
   query98  243 212 211 211
   query99  1287141312821282
   Total cold run time: 275919 ms
   Total hot run time: 185475 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781455957

   
   
   ClickBench: Total hot run time: 31.66 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 4bcbd533c9df1d8aee35161040fb1490678b3249, 
data reload: false
   
   query1   0.040.040.03
   query2   0.130.100.11
   query3   0.260.190.19
   query4   1.580.190.19
   query5   0.590.570.59
   query6   1.170.720.72
   query7   0.030.010.02
   query8   0.050.030.04
   query9   0.560.520.52
   query10  0.590.590.57
   query11  0.160.110.11
   query12  0.150.110.11
   query13  0.610.600.59
   query14  2.802.702.71
   query15  0.940.860.87
   query16  0.380.390.38
   query17  1.001.030.98
   query18  0.210.200.19
   query19  1.871.961.86
   query20  0.010.010.01
   query21  15.41   0.910.54
   query22  0.741.220.92
   query23  14.72   1.310.62
   query24  6.921.401.09
   query25  0.500.260.06
   query26  0.570.150.13
   query27  0.060.050.04
   query28  10.19   0.880.43
   query29  12.56   4.043.30
   query30  0.240.080.06
   query31  2.840.610.38
   query32  3.230.550.46
   query33  3.033.053.07
   query34  15.78   5.074.53
   query35  4.484.574.54
   query36  0.650.490.48
   query37  0.080.060.06
   query38  0.060.040.04
   query39  0.040.020.02
   query40  0.160.130.13
   query41  0.090.030.02
   query42  0.040.020.02
   query43  0.030.030.02
   Total cold run time: 105.55 s
   Total hot run time: 31.66 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


xiedeyantu opened a new pull request, #49818:
URL: https://github.com/apache/doris/pull/49818

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


Thearas commented on PR #49818:
URL: https://github.com/apache/doris/pull/49818#issuecomment-2781459597

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


xiedeyantu commented on PR #49818:
URL: https://github.com/apache/doris/pull/49818#issuecomment-2781459650

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](topn) fix asc nulls last optimization ordering by key [doris]

2025-04-06 Thread via GitHub


superdiaodiao commented on code in PR #49814:
URL: https://github.com/apache/doris/pull/49814#discussion_r2030120833


##
fe/fe-core/src/main/java/org/apache/doris/planner/OlapScanNode.java:
##


Review Comment:
   Is it better to add some test cases for this fix?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (3082d9ca497 -> 8e88a04b5cb)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 3082d9ca497 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new 8e88a04b5cb Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (3082d9ca497)
\
 N -- N -- N   refs/heads/asf-site (8e88a04b5cb)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [poc](mtmv) Support copying tmp rewrite plan to memo for mv rewrite better [doris]

2025-04-06 Thread via GitHub


seawinde commented on PR #49597:
URL: https://github.com/apache/doris/pull/49597#issuecomment-2781389536

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (74bfacd9291 -> 1ba01fe22a2)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 74bfacd9291 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new 1ba01fe22a2 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (74bfacd9291)
\
 N -- N -- N   refs/heads/asf-site (1ba01fe22a2)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [poc](mtmv) Support copying tmp rewrite plan to memo for mv rewrite better [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49597:
URL: https://github.com/apache/doris/pull/49597#issuecomment-2781405545

   
   
   TPC-H: Total hot run time: 34192 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b32859344a6ff624a1137723138fd9bc0b00f235, 
data reload: false
   
   -- Round 1 --
   q1   25750   503953545039
   q2   2190374 275 275
   q3   10109   1226679 679
   q4   10232   985 522 522
   q5   7532238323232323
   q6   193 160 133 133
   q7   966 769 624 624
   q8   9359132710581058
   q9   6895511551575115
   q10  6861231018691869
   q11  483 281 274 274
   q12  361 356 224 224
   q13  17785   368431263126
   q14  229 218 205 205
   q15  540 479 475 475
   q16  613 631 576 576
   q17  578 865 356 356
   q18  7439712570267026
   q19  1222938 581 581
   q20  343 361 234 234
   q21  4448336925072507
   q22  1050987 971 971
   Total cold run time: 115178 ms
   Total hot run time: 34192 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5115513751095109
   q2   336 400 318 318
   q3   2177263522382238
   q4   1407180614341434
   q5   4403438644314386
   q6   220 166 124 124
   q7   1983192717971797
   q8   2623249725962497
   q9   7195726071437143
   q10  2958320127382738
   q11  599 517 504 504
   q12  694 758 603 603
   q13  3543390632983298
   q14  281 294 273 273
   q15  520 479 478 478
   q16  661 705 612 612
   q17  1140154014061406
   q18  7719762175897589
   q19  830 802 826 802
   q20  1995205318321832
   q21  5314478349134783
   q22  1127108610351035
   Total cold run time: 52840 ms
   Total hot run time: 50999 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feat](nereids) support show columns command [doris]

2025-04-06 Thread via GitHub


xiedeyantu commented on PR #49591:
URL: https://github.com/apache/doris/pull/49591#issuecomment-2781409378

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [poc](mtmv) Support copying tmp rewrite plan to memo for mv rewrite better [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49597:
URL: https://github.com/apache/doris/pull/49597#issuecomment-2781410595

   
   
   TPC-DS: Total hot run time: 192103 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b32859344a6ff624a1137723138fd9bc0b00f235, 
data reload: false
   
   
   query1   1387103710611037
   query2   6147190619011901
   query3   11177   477645744574
   query4   25718   23585   23415   23415
   query5   4914636 474 474
   query6   350 233 221 221
   query7   4004504 300 300
   query8   338 300 276 276
   query9   query10 502 328 272 272
   query11  15691   15181   15150   15150
   query12  164 115 113 113
   query13  3463585 433 433
   query14  9956618363666183
   query15  207 186 176 176
   query16  7546655 503 503
   query17  1239787 663 663
   query18  2098457 353 353
   query19  218 206 195 195
   query20  124 113 116 113
   query21  217 130 111 111
   query22  4428460044094409
   query23  34425   33558   33273   33273
   query24  10198   240723732373
   query25  585 519 455 455
   query26  1193274 169 169
   query27  2679533 341 341
   query28  4199244924212421
   query29  818 628 493 493
   query30  278 228 197 197
   query31  964 881 783 783
   query32  73  67  64  64
   query33  571 363 327 327
   query34  803 866 539 539
   query35  824 846 761 761
   query36  982 1014910 910
   query37  128 104 86  86
   query38  4305424042074207
   query39  1523141914071407
   query40  227 126 118 118
   query41  56  52  53  52
   query42  127 112 110 110
   query43  490 505 487 487
   query44  1337833 850 833
   query45  184 178 168 168
   query46  858 1047635 635
   query47  1828194518501850
   query48  392 434 339 339
   query49  788 541 452 452
   query50  691 693 402 402
   query51  4303423041414141
   query52  112 105 106 105
   query53  238 274 185 185
   query54  767 606 530 530
   query55  86  88  85  85
   query56  353 300 305 300
   query57  1280120411141114
   query58  267 273 269 269
   query59  2749278326762676
   query60  348 358 331 331
   query61  181 177 169 169
   query62  776 743 679 679
   query63  226 199 190 190
   query64  43651052773 773
   query65  4368434143694341
   query66  990 431 320 320
   query67  16637   16298   15413   15413
   query68  9232866 509 509
   query69  505 301 259 259
   query70  1305110811001100
   query71  471 326 313 313
   query72  6117557962125579
   query73  2525597 346 346
   query74  8913912988528852
   query75  3942325727172717
   query76  46301185747 747
   query77  785 367 299 299
   query78  9391947389518951
   query79  3790859 561 561
   query80  627 557 494 494
   query81  463 259 220 220
   query82  363 131 96  96
   query83  258 264 243 243
   query84  295 110 94  94
   query85  1004514 476 476
   query86  343 302 283 283
   query87  457543504350
   query88  2933221022082208
   query89  430 323 280 280
   query90  2096210 213 210
   query91  158 167 137 137
   query92  75  61  56  56
   query93  3084958 569 569
   query94  693 396 318 318
   query95  376 298 282 282
   query96  485 560 270 270
   query97  3123321930993099
   query98  231 203 197 197
   query99  1351139812431243
   Total cold run time: 283898 ms
   Total hot run time: 192103 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a

Re: [PR] [refactor](profile) Refactor of RuntimeFilter profile [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49777:
URL: https://github.com/apache/doris/pull/49777#issuecomment-2781305126

   
   
   TPC-H: Total hot run time: 34340 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit c1ad005cd91bf500a8bd6452d8ca343775fb5eae, 
data reload: false
   
   -- Round 1 --
   q1   25930   513850685068
   q2   2069283 182 182
   q3   10526   1263702 702
   q4   10257   1038524 524
   q5   7849240924282409
   q6   189 167 135 135
   q7   931 755 628 628
   q8   9331136811661166
   q9   6905517751175117
   q10  6811231818711871
   q11  492 285 289 285
   q12  352 359 229 229
   q13  17803   373030893089
   q14  225 231 207 207
   q15  540 480 497 480
   q16  652 618 578 578
   q17  641 879 391 391
   q18  7786731970467046
   q19  20071004552 552
   q20  334 332 243 243
   q21  4269346924762476
   q22  10591033962 962
   Total cold run time: 116958 ms
   Total hot run time: 34340 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5293513251395132
   q2   244 331 237 237
   q3   2162270323402340
   q4   1443197515071507
   q5   4475441943834383
   q6   222 176 131 131
   q7   2029192017881788
   q8   2639254425482544
   q9   7274701772207017
   q10  3027319527172717
   q11  580 523 514 514
   q12  711 780 599 599
   q13  3469392533613361
   q14  287 286 267 267
   q15  536 509 500 500
   q16  672 706 668 668
   q17  1181157214251425
   q18  7814771175887588
   q19  820 801 932 801
   q20  1923200319401940
   q21  5323496649084908
   q22  1049104510051005
   Total cold run time: 53173 ms
   Total hot run time: 51372 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](profile) Refactor of RuntimeFilter profile [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49777:
URL: https://github.com/apache/doris/pull/49777#issuecomment-2781309848

   
   
   TPC-DS: Total hot run time: 192991 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit c1ad005cd91bf500a8bd6452d8ca343775fb5eae, 
data reload: false
   
   query1   1441112310951095
   query2   6191198120011981
   query3   10961   448445514484
   query4   55084   25615   23075   23075
   query5   5169519 468 468
   query6   380 223 191 191
   query7   5024511 282 282
   query8   329 255 237 237
   query9   6087260226132602
   query10  437 330 263 263
   query11  15109   14938   14995   14938
   query12  162 112 107 107
   query13  1118528 392 392
   query14  10200   620663776206
   query15  209 193 184 184
   query16  6950675 490 490
   query17  1076756 615 615
   query18  1513424 322 322
   query19  211 203 182 182
   query20  134 128 130 128
   query21  214 128 104 104
   query22  4462453044614461
   query23  34003   33091   33211   33091
   query24  6675244024282428
   query25  462 468 411 411
   query26  800 271 154 154
   query27  2309507 338 338
   query28  3193250324552455
   query29  585 583 458 458
   query30  272 235 193 193
   query31  875 873 769 769
   query32  75  63  61  61
   query33  456 377 303 303
   query34  777 848 520 520
   query35  866 842 775 775
   query36  980 1018901 901
   query37  127 99  73  73
   query38  4128406041964060
   query39  1513146014511451
   query40  206 123 108 108
   query41  53  50  49  49
   query42  123 113 107 107
   query43  523 513 517 513
   query44  1313827 830 827
   query45  182 178 171 171
   query46  851 1048649 649
   query47  1859191418041804
   query48  409 432 330 330
   query49  729 521 426 426
   query50  669 712 402 402
   query51  4205432142574257
   query52  110 106 102 102
   query53  245 256 187 187
   query54  598 584 521 521
   query55  87  82  79  79
   query56  314 323 308 308
   query57  1176118311281128
   query58  272 269 265 265
   query59  2809290727852785
   query60  341 316 303 303
   query61  136 136 134 134
   query62  731 706 692 692
   query63  228 195 188 188
   query64  22051070733 733
   query65  4460430642564256
   query66  771 441 308 308
   query67  16022   15623   15440   15440
   query68  7281842 513 513
   query69  590 343 266 266
   query70  1214114211141114
   query71  494 310 293 293
   query72  5982491248494849
   query73  1363689 348 348
   query74  8845911686618661
   query75  3884318526812681
   query76  43361275750 750
   query77  610 362 287 287
   query78  10221   10096   92659265
   query79  2308815 581 581
   query80  627 518 446 446
   query81  476 256 228 228
   query82  459 125 99  99
   query83  383 257 240 240
   query84  286 109 82  82
   query85  808 366 396 366
   query86  384 313 282 282
   query87  4368439343684368
   query88  3579223422312231
   query89  401 314 280 280
   query90  1896223 219 219
   query91  143 146 115 115
   query92  71  66  57  57
   query93  1639966 577 577
   query94  681 423 312 312
   query95  374 294 295 294
   query96  491 570 272 272
   query97  3185319631393139
   query98  234 200 197 197
   query99  1429137712591259
   Total cold run time: 301226 ms
   Total hot run time: 192991 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

(doris-website) branch asf-site updated (1ba01fe22a2 -> c38e096ce1a)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 1ba01fe22a2 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new c38e096ce1a Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (1ba01fe22a2)
\
 N -- N -- N   refs/heads/asf-site (c38e096ce1a)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](profile) Refactor of RuntimeFilter profile [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49777:
URL: https://github.com/apache/doris/pull/49777#issuecomment-2781311867

   
   
   ClickBench: Total hot run time: 31.75 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit c1ad005cd91bf500a8bd6452d8ca343775fb5eae, 
data reload: false
   
   query1   0.030.030.03
   query2   0.140.110.10
   query3   0.340.200.20
   query4   1.600.090.07
   query5   0.550.560.54
   query6   1.190.720.72
   query7   0.020.020.02
   query8   0.060.050.04
   query9   0.640.520.54
   query10  0.580.580.57
   query11  0.250.130.12
   query12  0.260.130.14
   query13  0.650.610.62
   query14  2.652.682.80
   query15  1.000.870.87
   query16  0.370.370.37
   query17  1.051.041.04
   query18  0.200.190.19
   query19  2.181.841.77
   query20  0.010.010.01
   query21  15.36   0.980.67
   query22  0.921.000.79
   query23  14.72   1.590.77
   query24  5.440.590.29
   query25  0.170.100.09
   query26  0.550.220.19
   query27  0.090.090.08
   query28  10.98   1.220.57
   query29  12.54   4.193.50
   query30  0.260.080.06
   query31  2.820.660.44
   query32  3.240.600.50
   query33  3.123.133.10
   query34  16.52   5.224.46
   query35  4.464.504.49
   query36  0.640.510.50
   query37  0.210.180.17
   query38  0.180.160.16
   query39  0.050.040.04
   query40  0.200.150.14
   query41  0.110.050.05
   query42  0.060.050.06
   query43  0.050.040.05
   Total cold run time: 106.46 s
   Total hot run time: 31.75 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](paimon)Enhance the observability of split and JNI in profile [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49688:
URL: https://github.com/apache/doris/pull/49688#issuecomment-2781327553

   # BE UT Coverage Report
   Increment line coverage `11.43% (8/70)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/29a330ffef20ee4b032cc8e080557af6941a6bcb_29a330ffef20ee4b032cc8e080557af6941a6bcb/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/29a330ffef20ee4b032cc8e080557af6941a6bcb_29a330ffef20ee4b032cc8e080557af6941a6bcb/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.23% (14000/26805) |
   | Line Coverage | 40.96% (120601/294423) |
   | Region Coverage   | 39.68% (61339/154602) |
   | Branch Coverage   | 34.30% (30622/89276) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (c38e096ce1a -> ffa3245757d)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard c38e096ce1a Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new ffa3245757d Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (c38e096ce1a)
\
 N -- N -- N   refs/heads/asf-site (ffa3245757d)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [doc](functions) Add docs for some functions [doris-website]

2025-04-06 Thread via GitHub


suxiaogang223 commented on PR #2251:
URL: https://github.com/apache/doris-website/pull/2251#issuecomment-2781486557

   fixed👀, please review again @morrySnow 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-website) branch asf-site updated (14d3e920601 -> bbe3852470b)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard 14d3e920601 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new bbe3852470b Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (14d3e920601)
\
 N -- N -- N   refs/heads/asf-site (bbe3852470b)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49818:
URL: https://github.com/apache/doris/pull/49818#issuecomment-2781476303

   
   
   TPC-H: Total hot run time: 34576 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit bcd109ec973e9b8d111d2bb18a2b972b1bcf572b, 
data reload: false
   
   -- Round 1 --
   q1   26187   512451115111
   q2   2154286 176 176
   q3   10383   1216704 704
   q4   10226   1023534 534
   q5   7552232423352324
   q6   194 162 134 134
   q7   924 767 612 612
   q8   9322132611461146
   q9   6862518551245124
   q10  6817229018891889
   q11  487 287 282 282
   q12  363 377 223 223
   q13  17789   367531533153
   q14  229 230 216 216
   q15  538 488 502 488
   q16  627 616 600 600
   q17  589 841 355 355
   q18  8235761472997299
   q19  1876958 544 544
   q20  335 320 224 224
   q21  4087338424682468
   q22  1042970 989 970
   Total cold run time: 116818 ms
   Total hot run time: 34576 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5294515751615157
   q2   240 331 232 232
   q3   2150263222692269
   q4   1490193314451445
   q5   4459442643404340
   q6   230 172 132 132
   q7   2000196417851785
   q8   2658263426252625
   q9   7117699571376995
   q10  2973314827882788
   q11  576 517 504 504
   q12  689 770 633 633
   q13  3555394834703470
   q14  278 287 274 274
   q15  533 482 467 467
   q16  657 678 649 649
   q17  1169159214211421
   q18  7744751774397439
   q19  861 824 973 824
   q20  1916198318511851
   q21  5325485246914691
   q22  1107104910391039
   Total cold run time: 53021 ms
   Total hot run time: 51030 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](functions) Impl printf powered by fmt::sprintf [doris]

2025-04-06 Thread via GitHub


suxiaogang223 commented on PR #49048:
URL: https://github.com/apache/doris/pull/49048#issuecomment-2781479346

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49818:
URL: https://github.com/apache/doris/pull/49818#issuecomment-2781481222

   
   
   TPC-DS: Total hot run time: 193553 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit bcd109ec973e9b8d111d2bb18a2b972b1bcf572b, 
data reload: false
   
   query1   1389109810471047
   query2   6382192719061906
   query3   11008   475746034603
   query4   25686   23709   23020   23020
   query5   4136683 449 449
   query6   311 218 193 193
   query7   4010526 282 282
   query8   306 245 231 231
   query9   8487260526062605
   query10  461 338 283 283
   query11  15859   15177   14872   14872
   query12  180 118 114 114
   query13  1591547 423 423
   query14  9833644763006300
   query15  211 195 176 176
   query16  7597656 487 487
   query17  1191820 624 624
   query18  2074450 337 337
   query19  207 205 173 173
   query20  126 130 120 120
   query21  210 136 113 113
   query22  4616468042964296
   query23  34344   33569   33347   33347
   query24  8678251725502517
   query25  516 497 410 410
   query26  725 296 154 154
   query27  2835537 351 351
   query28  4557244924472447
   query29  638 594 446 446
   query30  285 238 198 198
   query31  967 898 789 789
   query32  76  70  65  65
   query33  538 404 322 322
   query34  821 946 540 540
   query35  858 877 785 785
   query36  10511071888 888
   query37  124 112 80  80
   query38  4328414442304144
   query39  1528145614741456
   query40  222 127 112 112
   query41  57  54  56  54
   query42  130 116 116 116
   query43  521 511 482 482
   query44  1423868 829 829
   query45  191 201 184 184
   query46  947 1109651 651
   query47  1838189317791779
   query48  396 442 311 311
   query49  729 540 452 452
   query50  696 744 421 421
   query51  4283432542294229
   query52  115 114 114 114
   query53  246 272 197 197
   query54  603 582 568 568
   query55  85  84  89  84
   query56  321 325 291 291
   query57  1211126211191119
   query58  284 295 268 268
   query59  2644284726942694
   query60  344 359 324 324
   query61  176 129 132 129
   query62  806 751 660 660
   query63  230 194 197 194
   query64  31111069759 759
   query65  4486437944044379
   query66  843 459 322 322
   query67  16256   15787   15333   15333
   query68  8776919 521 521
   query69  488 317 258 258
   query70  1243113210851085
   query71  478 319 296 296
   query72  5797490149964901
   query73  748 684 358 358
   query74  9160895387468746
   query75  3950332227372737
   query76  36111320799 799
   query77  779 395 288 288
   query78  10014   10488   92959295
   query79  2233869 573 573
   query80  756 532 501 501
   query81  487 267 230 230
   query82  451 136 102 102
   query83  276 267 240 240
   query84  290 111 88  88
   query85  784 360 317 317
   query86  327 328 275 275
   query87  4604463743034303
   query88  3264223522672235
   query89  439 329 298 298
   query90  1892216 209 209
   query91  145 146 113 113
   query92  81  65  60  60
   query93  1264997 577 577
   query94  648 424 308 308
   query95  380 302 289 289
   query96  518 624 280 280
   query97  3236331031453145
   query98  239 209 205 205
   query99  1502148012731273
   Total cold run time: 280794 ms
   Total hot run time: 193553 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go

Re: [PR] support ShowCatalogRecycleBinCommand [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49818:
URL: https://github.com/apache/doris/pull/49818#issuecomment-2781483403

   
   
   ClickBench: Total hot run time: 31.06 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit bcd109ec973e9b8d111d2bb18a2b972b1bcf572b, 
data reload: false
   
   query1   0.040.030.03
   query2   0.120.110.10
   query3   0.250.180.20
   query4   1.590.200.19
   query5   0.610.590.58
   query6   1.180.700.73
   query7   0.020.020.02
   query8   0.040.040.03
   query9   0.590.530.51
   query10  0.580.590.56
   query11  0.160.110.10
   query12  0.150.110.11
   query13  0.600.600.60
   query14  2.652.812.80
   query15  0.920.850.85
   query16  0.380.370.39
   query17  1.051.051.05
   query18  0.220.200.20
   query19  1.882.041.85
   query20  0.010.020.01
   query21  15.38   0.890.54
   query22  0.751.100.62
   query23  15.08   1.410.64
   query24  7.320.760.77
   query25  0.470.080.22
   query26  0.680.160.14
   query27  0.050.050.04
   query28  9.360.940.43
   query29  12.54   4.043.32
   query30  0.260.090.06
   query31  2.810.590.38
   query32  3.220.560.47
   query33  3.193.013.08
   query34  15.66   5.044.47
   query35  4.504.474.54
   query36  0.650.490.48
   query37  0.090.070.06
   query38  0.040.040.03
   query39  0.030.020.03
   query40  0.170.130.12
   query41  0.080.030.03
   query42  0.030.020.02
   query43  0.040.040.03
   Total cold run time: 105.44 s
   Total hot run time: 31.06 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](functions) Impl printf powered by fmt::sprintf [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49048:
URL: https://github.com/apache/doris/pull/49048#issuecomment-2781495219

   
   
   TPC-H: Total hot run time: 34250 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 80ae3ffc3b411a2420f148b068cd73560ffada4c, 
data reload: false
   
   -- Round 1 --
   q1   25633   504249944994
   q2   2062285 190 190
   q3   10378   1255696 696
   q4   10242   982 516 516
   q5   7518233223642332
   q6   187 160 130 130
   q7   887 731 610 610
   q8   9332131011621162
   q9   6923512751205120
   q10  6800230219061906
   q11  471 278 272 272
   q12  351 358 223 223
   q13  17796   374030643064
   q14  227 232 212 212
   q15  540 503 476 476
   q16  646 627 581 581
   q17  608 853 361 361
   q18  7498722072687220
   q19  1632941 543 543
   q20  346 334 224 224
   q21  3937334924632463
   q22  10781001955 955
   Total cold run time: 115092 ms
   Total hot run time: 34250 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5159509750685068
   q2   235 329 231 231
   q3   21362655
   q4   1381179313801380
   q5   4460438443714371
   q6   212 173 130 130
   q7   1986189517581758
   q8   2574251724722472
   q9   7289728470297029
   q10  2962319127442744
   q11  572 520 477 477
   q12  693 786 623 623
   q13  3555399633613361
   q14  297 327 272 272
   q15  528 495 483 483
   q16  633 675 658 658
   q17  1148148214281428
   q18  7590770074627462
   q19  816 853 932 853
   q20  1890193818071807
   q21  5160491048374837
   q22  1078106010521052
   Total cold run time: 52354 ms
   Total hot run time: 50718 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](functions) Impl printf powered by fmt::sprintf [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49048:
URL: https://github.com/apache/doris/pull/49048#issuecomment-2781499737

   
   
   TPC-DS: Total hot run time: 192267 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 80ae3ffc3b411a2420f148b068cd73560ffada4c, 
data reload: false
   
   query1   1409107810201020
   query2   6205194919171917
   query3   11154   463345944594
   query4   25409   23425   22899   22899
   query5   3609590 449 449
   query6   293 206 209 206
   query7   3987490 276 276
   query8   291 236 232 232
   query9   8500256425832564
   query10  450 340 266 266
   query11  15839   15234   14841   14841
   query12  173 110 108 108
   query13  1632518 392 392
   query14  9728623362286228
   query15  205 186 169 169
   query16  7629640 435 435
   query17  1252711 594 594
   query18  2040428 334 334
   query19  216 201 170 170
   query20  125 121 130 121
   query21  211 129 117 117
   query22  4559458841734173
   query23  33960   33310   33384   33310
   query24  8630242324452423
   query25  531 471 391 391
   query26  722 282 150 150
   query27  2939503 342 342
   query28  4627247224522452
   query29  616 576 433 433
   query30  301 217 195 195
   query31  928 916 788 788
   query32  76  59  67  59
   query33  532 412 319 319
   query34  814 876 520 520
   query35  835 872 800 800
   query36  991 1014919 919
   query37  118 104 79  79
   query38  4390418742704187
   query39  1512144414181418
   query40  218 119 115 115
   query41  56  52  56  52
   query42  123 107 112 107
   query43  508 511 475 475
   query44  1313813 820 813
   query45  186 186 171 171
   query46  834 1015646 646
   query47  1895191417911791
   query48  382 414 322 322
   query49  751 547 450 450
   query50  673 704 413 413
   query51  4176429441384138
   query52  127 115 104 104
   query53  235 259 189 189
   query54  593 593 518 518
   query55  83  82  86  82
   query56  303 325 309 309
   query57  1176120811421142
   query58  282 266 292 266
   query59  2806283126942694
   query60  344 334 320 320
   query61  131 132 141 132
   query62  783 736 676 676
   query63  235 191 223 191
   query64  32431076729 729
   query65  4458431943504319
   query66  945 426 322 322
   query67  16227   15424   15402   15402
   query68  8821913 522 522
   query69  479 337 256 256
   query70  1227110610851085
   query71  492 324 286 286
   query72  5864478448534784
   query73  763 683 357 357
   query74  9187907686368636
   query75  4056317427112711
   query76  36651195760 760
   query77  781 362 285 285
   query78  10025   10012   92739273
   query79  2541823 574 574
   query80  621 505 445 445
   query81  484 259 221 221
   query82  490 130 94  94
   query83  292 259 243 243
   query84  301 113 87  87
   query85  780 358 317 317
   query86  377 296 300 296
   query87  4466444843324332
   query88  3513224222462242
   query89  401 315 287 287
   query90  1794217 213 213
   query91  143 144 113 113
   query92  80  60  59  59
   query93  1909963 589 589
   query94  658 412 289 289
   query95  375 303 286 286
   query96  497 557 280 280
   query97  3183324231173117
   query98  238 216 196 196
   query99  1400143812541254
   Total cold run time: 280427 ms
   Total hot run time: 192267 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

(doris-website) branch asf-site updated (bbe3852470b -> 952340e94d4)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/doris-website.git


 discard bbe3852470b Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35
 new 952340e94d4 Automated deployment with doris branch @ 
0aae514566d8c54fc21945df2a2555fb7d65bd35

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (bbe3852470b)
\
 N -- N -- N   refs/heads/asf-site (952340e94d4)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/2.0/search-index.json   | 2 +-
 docs/3.0/search-index.json   | 2 +-
 docs/dev/search-index.json   | 2 +-
 search-index.json| 2 +-
 zh-CN/docs/2.0/search-index.json | 2 +-
 zh-CN/docs/3.0/search-index.json | 2 +-
 zh-CN/docs/dev/search-index.json | 2 +-
 zh-CN/search-index.json  | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](functions) Impl printf powered by fmt::sprintf [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49048:
URL: https://github.com/apache/doris/pull/49048#issuecomment-2781501777

   
   
   ClickBench: Total hot run time: 31.49 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 80ae3ffc3b411a2420f148b068cd73560ffada4c, 
data reload: false
   
   query1   0.040.040.03
   query2   0.120.110.09
   query3   0.230.190.19
   query4   1.590.190.19
   query5   0.610.560.58
   query6   1.220.710.71
   query7   0.030.020.01
   query8   0.050.040.03
   query9   0.580.510.52
   query10  0.580.590.56
   query11  0.160.110.10
   query12  0.140.110.11
   query13  0.610.600.60
   query14  2.722.802.83
   query15  0.920.850.84
   query16  0.390.390.39
   query17  1.021.001.03
   query18  0.210.200.20
   query19  1.921.961.82
   query20  0.020.020.01
   query21  15.38   0.860.54
   query22  0.751.210.68
   query23  14.90   1.380.64
   query24  7.001.191.09
   query25  0.470.240.06
   query26  0.620.160.14
   query27  0.050.040.05
   query28  9.640.860.42
   query29  12.59   4.043.28
   query30  0.240.090.07
   query31  2.820.600.38
   query32  3.230.560.46
   query33  2.973.003.11
   query34  15.86   5.114.58
   query35  4.654.564.56
   query36  0.670.490.48
   query37  0.080.060.07
   query38  0.050.040.04
   query39  0.030.020.03
   query40  0.190.130.14
   query41  0.080.040.02
   query42  0.040.020.02
   query43  0.030.030.03
   Total cold run time: 105.5 s
   Total hot run time: 31.49 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](functions) Impl printf powered by fmt::sprintf [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49048:
URL: https://github.com/apache/doris/pull/49048#issuecomment-2781540324

   # BE UT Coverage Report
   Increment line coverage `84.95% (79/93)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/80ae3ffc3b411a2420f148b068cd73560ffada4c_80ae3ffc3b411a2420f148b068cd73560ffada4c/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/80ae3ffc3b411a2420f148b068cd73560ffada4c_80ae3ffc3b411a2420f148b068cd73560ffada4c/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.23% (14003/26808) |
   | Line Coverage | 40.98% (120667/294457) |
   | Region Coverage   | 39.70% (61372/154608) |
   | Branch Coverage   | 34.32% (30652/89302) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feat][test](nereids)(array) support array_reduce and regression test [doris]

2025-04-06 Thread via GitHub


cyer commented on PR #48994:
URL: https://github.com/apache/doris/pull/48994#issuecomment-2781652889

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](match) add debug point to error log when enable debug point [doris]

2025-04-06 Thread via GitHub


airborne12 merged PR #49791:
URL: https://github.com/apache/doris/pull/49791


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (3640f6c2400 -> 6c147bbc78e)

2025-04-06 Thread airborne
This is an automated email from the ASF dual-hosted git repository.

airborne pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 3640f6c2400 [Bug][function] fix the string cast jsonb cause null map 
have not init value (#49810)
 add 6c147bbc78e [opt](match) add debug point to error log when enable 
debug point (#49791)

No new revisions were added by this update.

Summary of changes:
 be/src/vec/functions/match.cpp | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](columns) fix bug found by UT and add regression test (#48554) [doris]

2025-04-06 Thread via GitHub


jacktengg commented on PR #48854:
URL: https://github.com/apache/doris/pull/48854#issuecomment-2781853378

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris-kafka-connector) branch master updated: [Improve](case) add case for debezium update, delete and avro convert (#65)

2025-04-06 Thread diwu
This is an automated email from the ASF dual-hosted git repository.

diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-kafka-connector.git


The following commit(s) were added to refs/heads/master by this push:
 new d65a505  [Improve](case) add case for debezium update, delete and avro 
convert (#65)
d65a505 is described below

commit d65a5055d1ea9328efec3a97b97710fa06f6d2ba
Author: wudi <676366...@qq.com>
AuthorDate: Mon Apr 7 10:22:44 2025 +0800

[Improve](case) add case for debezium update, delete and avro convert (#65)
---
 .../connector/e2e/kafka/KafkaContainerService.java |   4 +
 .../e2e/kafka/KafkaContainerServiceImpl.java   |  50 +-
 .../e2e/sink/AbstractKafka2DorisSink.java  |  44 -
 .../e2e/sink/avro/AbstractAvroE2ESinkTest.java |  98 ++
 .../connector/e2e/sink/avro/AvroMsgE2ETest.java| 198 +
 .../e2e/sink/stringconverter/StringMsgE2ETest.java |  61 ---
 .../e2e/avro_converter/confluent_avro_convert.json |  23 +++
 .../e2e/avro_converter/confluent_avro_tab.sql  |  11 ++
 .../e2e/avro_converter/doris_avro_convert.json |  21 +++
 .../e2e/avro_converter/doris_avro_tab.sql  |  11 ++
 .../e2e/string_converter/debezium_dml_event.json   |  25 +++
 .../string_converter/debezium_dml_event_tab.sql|  11 ++
 12 files changed, 529 insertions(+), 28 deletions(-)

diff --git 
a/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerService.java
 
b/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerService.java
index 45616c4..2e9dc8d 100644
--- 
a/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerService.java
+++ 
b/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerService.java
@@ -25,6 +25,10 @@ public interface KafkaContainerService {
 
 void startContainer();
 
+void startSchemaRegistry();
+
+String getSchemaRegistryUrl();
+
 void startConnector();
 
 String getInstanceHostAndPort();
diff --git 
a/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerServiceImpl.java
 
b/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerServiceImpl.java
index 4e38ab3..ec39f49 100644
--- 
a/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerServiceImpl.java
+++ 
b/src/test/java/org/apache/doris/kafka/connector/e2e/kafka/KafkaContainerServiceImpl.java
@@ -26,6 +26,7 @@ import java.net.HttpURLConnection;
 import java.net.URL;
 import java.nio.file.Files;
 import java.nio.file.Paths;
+import java.time.Duration;
 import java.util.Objects;
 import java.util.Properties;
 import java.util.concurrent.ExecutorService;
@@ -41,7 +42,10 @@ import org.apache.http.impl.client.HttpClients;
 import org.apache.kafka.connect.cli.ConnectDistributed;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
+import org.testcontainers.containers.GenericContainer;
 import org.testcontainers.containers.KafkaContainer;
+import org.testcontainers.containers.Network;
+import org.testcontainers.containers.wait.strategy.Wait;
 import org.testcontainers.utility.DockerImageName;
 
 public class KafkaContainerServiceImpl implements KafkaContainerService {
@@ -60,9 +64,12 @@ public class KafkaContainerServiceImpl implements 
KafkaContainerService {
 private String kafkaServerHost;
 private int kafkaServerPort;
 private static final String CONNECT_PORT = "8083";
+private static final String REGISTRY_PORT = "8081";
 private static final String BOOTSTRAP_SERVERS = "bootstrap.servers";
 private final ExecutorService executorService = 
Executors.newSingleThreadExecutor();
 private static final int MAX_RETRIES = 5;
+private GenericContainer schemaRegistryContainer;
+private static Network network = Network.SHARED;
 
 @Override
 public String getInstanceHostAndPort() {
@@ -148,7 +155,7 @@ public class KafkaContainerServiceImpl implements 
KafkaContainerService {
 public void startContainer() {
 LOG.info("kafka server is about to be initialized.");
 kafkaContainer = new 
KafkaContainer(DockerImageName.parse(KAFKA_IMAGE));
-
+kafkaContainer.withNetwork(network).withNetworkAliases("kafka");
 kafkaContainer.start();
 try {
 Thread.sleep(5000);
@@ -166,12 +173,53 @@ public class KafkaContainerServiceImpl implements 
KafkaContainerService {
 kafkaServerPort);
 }
 
+@Override
+public void startSchemaRegistry() {
+LOG.info("start schema registry.");
+schemaRegistryContainer =
+new GenericContainer<>("confluentinc/cp-schema-registry:7.6.1")
+.withNetwork(network)
+.withExposedPorts(8081)
+.withNetworkAliases("schema-registry")
+.withEnv("SCHEMA_REGISTRY_HOST_NAME", 
"schema-registry")
+.withEnv(
+ 

Re: [PR] [fix] (inverted index) Disallow variant columns from using inverted index format v1 [doris]

2025-04-06 Thread via GitHub


hello-stephen commented on PR #49823:
URL: https://github.com/apache/doris/pull/49823#issuecomment-2782082881

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[I] [Bug] webui Log Analysis org.apache.doris.common.AnalysisException: errCode = 2, detailMessage = Syntax error [doris]

2025-04-06 Thread via GitHub


xhh0168 opened a new issue, #49824:
URL: https://github.com/apache/doris/issues/49824

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   apache-doris-3.0.3-bin-x64
   
   ### What's Wrong?
   
   using web-ui  ---> query --->  Log Analysis error   
   errCode = 2, detailMessage = Syntax error in line 1: ...'2025-04-07 
13:12:03' AND ) ORDER BY `created_... ^ Encountered: < Expected: 
IDENTIFIE
   
   2025-04-07 14:08:42,991 WARN (mysql-nio-pool-23|41912) 
[ConnectProcessor.handleQueryException():471] Process one query failed because.
   org.apache.doris.common.AnalysisException: errCode = 2, detailMessage = 
Syntax error in line 1:
   ...'2025-04-07 13:06:48' AND ) GROUP BY T ORDER ...
^
   Encountered: <
   Expected: IDENTIFIER
   
   at 
org.apache.doris.qe.ConnectProcessor.parse(ConnectProcessor.java:514) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.executeQuery(ConnectProcessor.java:295) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:225) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.handleQuery(MysqlConnectProcessor.java:285)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.dispatch(MysqlConnectProcessor.java:313)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.processOnce(MysqlConnectProcessor.java:483)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_352-352]
   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_352-352]
   at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_352-352]
   Caused by: org.apache.doris.common.AnalysisException: errCode = 2, 
detailMessage = Syntax error
   at 
org.apache.doris.analysis.SqlParser.unrecovered_syntax_error(SqlParser.java:2996)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at java_cup.runtime.lr_parser.parse(lr_parser.java:616) 
~[jflex-1.4.3.jar:?]
   at 
org.apache.doris.common.util.SqlParserUtils.getMultiStmts(SqlParserUtils.java:60)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.parse(ConnectProcessor.java:503) 
~[doris-fe.jar:1.2-SNAPSHOT]
   ... 9 more
   2025-04-07 14:08:43,061 WARN (mysql-nio-pool-23|41912) 
[ConnectProcessor.handleQueryException():471] Process one query failed because.
   org.apache.doris.common.AnalysisException: errCode = 2, detailMessage = 
Syntax error in line 1:
   ...'2025-04-07 13:06:48' AND ) ORDER BY `created_...
^
   Encountered: <
   Expected: IDENTIFIER
   
   at 
org.apache.doris.qe.ConnectProcessor.parse(ConnectProcessor.java:514) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.executeQuery(ConnectProcessor.java:295) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:225) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.handleQuery(MysqlConnectProcessor.java:285)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.dispatch(MysqlConnectProcessor.java:313)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.MysqlConnectProcessor.processOnce(MysqlConnectProcessor.java:483)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) 
~[doris-fe.jar:1.2-SNAPSHOT]
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
~[?:1.8.0_352-352]
   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
~[?:1.8.0_352-352]
   at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_352-352]
   Caused by: org.apache.doris.common.AnalysisException: errCode = 2, 
detailMessage = Syntax error
   at 
org.apache.doris.analysis.SqlParser.unrecovered_syntax_error(SqlParser.java:2996)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at java_cup.runtime.lr_parser.parse(lr_parser.java:616) 
~[jflex-1.4.3.jar:?]
   at 
org.apache.doris.common.util.SqlParserUtils.getMultiStmts(SqlParserUtils.java:60)
 ~[doris-fe.jar:1.2-SNAPSHOT]
   at 
org.apache.doris.qe.ConnectProcessor.parse(ConnectProcessor.java:503) 
~[doris-fe.jar:1.2-SNAPSHOT]
   ... 9 more
   2025-04-07 14:09:04,276 WARN (mysql-nio-pool-25|43072) 
[ProfileManager.pushProfile():216] Remove expired profile 
70498270bd6480d-971473aa8cc303ea, execution profiles , queryIdDeque size 100, 
prof

Re: [PR] [fix](group commit) reduce cpu cost for group_commit get_block [doris]

2025-04-06 Thread via GitHub


hello-stephen commented on PR #49822:
URL: https://github.com/apache/doris/pull/49822#issuecomment-2782133807

   # BE UT Coverage Report
   Increment line coverage `0.00% (0/22)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/3da47f3f6e3e421d67cd3d36a366ef6c65f64007_3da47f3f6e3e421d67cd3d36a366ef6c65f64007/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/3da47f3f6e3e421d67cd3d36a366ef6c65f64007_3da47f3f6e3e421d67cd3d36a366ef6c65f64007/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.23% (13998/26800) |
   | Line Coverage | 40.97% (120615/294387) |
   | Region Coverage   | 39.69% (61349/154588) |
   | Branch Coverage   | 34.31% (30628/89274) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](cloud) Set thread name for all background thread workers to improve observability [doris]

2025-04-06 Thread via GitHub


gavinchou commented on PR #49366:
URL: https://github.com/apache/doris/pull/49366#issuecomment-2782144045

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) do not throw exception in fold const rule [doris]

2025-04-06 Thread via GitHub


englefly commented on PR #49802:
URL: https://github.com/apache/doris/pull/49802#issuecomment-2782101275

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](prepared statement)Fix prepareCommand couldn't get fields metadata bug. [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49206:
URL: https://github.com/apache/doris/pull/49206#issuecomment-2781956802

   
   
   TPC-DS: Total hot run time: 193050 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 7a5b96f005ccdecf193adea757593d1cf119b6bb, 
data reload: false
   
   query1   1394105510641055
   query2   6244195419971954
   query3   10967   450144144414
   query4   52679   24931   22947   22947
   query5   5178502 446 446
   query6   390 199 199 199
   query7   5213500 288 288
   query8   339 256 241 241
   query9   6607260426142604
   query10  429 320 256 256
   query11  15134   15026   14828   14828
   query12  171 113 108 108
   query13  1243523 416 416
   query14  10143   639664616396
   query15  215 187 185 185
   query16  7080656 512 512
   query17  1077752 597 597
   query18  1561412 334 334
   query19  207 202 175 175
   query20  131 133 127 127
   query21  211 131 105 105
   query22  4296468741804180
   query23  34166   33400   33228   33228
   query24  6753243324152415
   query25  479 462 404 404
   query26  718 271 156 156
   query27  2399509 352 352
   query28  3261249524792479
   query29  584 565 431 431
   query30  276 234 190 190
   query31  876 874 825 825
   query32  74  68  61  61
   query33  463 371 309 309
   query34  777 869 531 531
   query35  810 837 767 767
   query36  960 1019934 934
   query37  124 100 77  77
   query38  4130416642124166
   query39  1504146914521452
   query40  207 117 110 110
   query41  53  51  52  51
   query42  136 113 110 110
   query43  511 531 492 492
   query44  1316828 814 814
   query45  185 175 169 169
   query46  845 1033663 663
   query47  1871191417481748
   query48  388 414 308 308
   query49  692 531 440 440
   query50  669 703 422 422
   query51  4313429541974197
   query52  110 110 100 100
   query53  225 263 195 195
   query54  589 594 537 537
   query55  83  82  79  79
   query56  320 294 285 285
   query57  1195117311161116
   query58  273 272 269 269
   query59  2967297027652765
   query60  347 344 327 327
   query61  138 134 123 123
   query62  746 754 674 674
   query63  226 194 195 194
   query64  18271104737 737
   query65  4503429742574257
   query66  753 398 310 310
   query67  15851   15664   15552   15552
   query68  7560920 526 526
   query69  540 301 258 258
   query70  1177112910701070
   query71  496 306 297 297
   query72  5953488649534886
   query73  1293713 351 351
   query74  9044916786418641
   query75  3747319627072707
   query76  43131192823 823
   query77  627 374 280 280
   query78  10036   10129   93829382
   query79  5842798 544 544
   query80  666 511 432 432
   query81  480 257 220 220
   query82  621 127 97  97
   query83  361 260 228 228
   query84  290 116 89  89
   query85  827 361 330 330
   query86  354 305 298 298
   query87  4592461645024502
   query88  3524220421962196
   query89  445 317 282 282
   query90  1969208 210 208
   query91  147 144 171 144
   query92  76  61  59  59
   query93  2900948 585 585
   query94  695 403 306 306
   query95  380 306 282 282
   query96  487 555 273 273
   query97  3241322030933093
   query98  222 214 208 208
   query99  1469142112651265
   Total cold run time: 304976 ms
   Total hot run time: 193050 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go 

svn commit: r76106 - in /dev/doris/doris-streamloader/1.0.3: ./ apache-doris-streamloader-1.0.3-src.tar.gz apache-doris-streamloader-1.0.3-src.tar.gz.asc apache-doris-streamloader-1.0.3-src.tar.gz.sha

2025-04-06 Thread diwu
Author: diwu
Date: Mon Apr  7 06:06:42 2025
New Revision: 76106

Log:
stream loader vote

Added:
dev/doris/doris-streamloader/1.0.3/

dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz   
(with props)

dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.asc
   (with props)

dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.sha512

Added: 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz
==
Binary file - no diff available.

Propchange: 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz
--
svn:mime-type = application/x-gzip

Added: 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.asc
==
Binary file - no diff available.

Propchange: 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.asc
--
svn:mime-type = application/pgp-signature

Added: 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.sha512
==
--- 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.sha512
 (added)
+++ 
dev/doris/doris-streamloader/1.0.3/apache-doris-streamloader-1.0.3-src.tar.gz.sha512
 Mon Apr  7 06:06:42 2025
@@ -0,0 +1 @@
+f2712e9e86420a697683a5ba32de8e1fc6a8d81fe2cea4422280a00cb0442716d4486454abe4af3540a0e4e5391e0de5a4427ebc6bc48702a29eac13e702dd34
  apache-doris-streamloader-1.0.3-src.tar.gz



-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](group commit) reduce cpu cost for group_commit get_block [doris]

2025-04-06 Thread via GitHub


mymeiyi commented on PR #49822:
URL: https://github.com/apache/doris/pull/49822#issuecomment-2782109591

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](log) Standardize S3 failure log formats to enable critical operation monitoring [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49813:
URL: https://github.com/apache/doris/pull/49813#issuecomment-2782146512

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement] (nereids) implement transactionBegin/Commit/RollbackCommand in nereids [doris]

2025-04-06 Thread via GitHub


starocean999 commented on code in PR #48993:
URL: https://github.com/apache/doris/pull/48993#discussion_r2030528109


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TransactionCommand.java:
##
@@ -0,0 +1,45 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+
+/**
+ * base class for all transaction commands
+ */
+public abstract class TransactionCommand extends Command implements 
ForwardWithSync {
+public TransactionCommand(PlanType type) {
+super(type);
+}
+
+@Override
+public StmtType stmtType() {
+return StmtType.DROP;

Review Comment:
   ```suggestion
   return StmtType.TRANSACTION;
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement] (nereids) implement transactionBegin/Commit/RollbackCommand in nereids [doris]

2025-04-06 Thread via GitHub


starocean999 commented on code in PR #48993:
URL: https://github.com/apache/doris/pull/48993#discussion_r2030527760


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TransactionCommand.java:
##
@@ -0,0 +1,45 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+
+/**
+ * base class for all transaction commands
+ */
+public abstract class TransactionCommand extends Command implements 
ForwardWithSync {

Review Comment:
   ```suggestion
   public abstract class TransactionCommand extends Command implements 
NoForward {
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement] (nereids) implement transactionBegin/Commit/RollbackCommand in nereids [doris]

2025-04-06 Thread via GitHub


starocean999 commented on code in PR #48993:
URL: https://github.com/apache/doris/pull/48993#discussion_r2030536160


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TransactionBeginCommand.java:
##
@@ -0,0 +1,107 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.analysis.RedirectStatus;
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.common.util.DebugUtil;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+import org.apache.doris.thrift.TTxnParams;
+import org.apache.doris.transaction.TransactionEntry;
+import org.apache.doris.transaction.TransactionStatus;
+
+import org.apache.logging.log4j.LogManager;
+import org.apache.logging.log4j.Logger;
+
+/**
+ * TransactionBeginCommand
+ */
+public class TransactionBeginCommand extends TransactionCommand {
+private static final Logger LOG = 
LogManager.getLogger(TransactionBeginCommand.class);
+private String label;
+
+public TransactionBeginCommand() {
+super(PlanType.TRANSACTION_BEGIN_COMMAND);
+this.label = "";
+}
+
+public TransactionBeginCommand(String label) {
+super(PlanType.TRANSACTION_BEGIN_COMMAND);
+this.label = label;
+}
+
+@Override
+public void doRun(ConnectContext ctx, StmtExecutor executor) throws 
Exception {
+validate(ctx);
+handleTransactionBegin(ctx);
+}
+
+private void validate(ConnectContext ctx) {
+if (label == null || label.isEmpty()) {
+label = "txn_insert_" + DebugUtil.printId(ctx.queryId());
+}
+if (ctx.getTxnEntry() == null) {
+ctx.setTxnEntry(new TransactionEntry());
+}
+ctx.getTxnEntry().setLabel(label);
+}
+
+@Override
+public RedirectStatus toRedirectStatus() {

Review Comment:
   ```suggestion
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement] (nereids) implement transactionBegin/Commit/RollbackCommand in nereids [doris]

2025-04-06 Thread via GitHub


starocean999 commented on code in PR #48993:
URL: https://github.com/apache/doris/pull/48993#discussion_r2030535607


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TransactionCommitCommand.java:
##
@@ -0,0 +1,94 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.analysis.RedirectStatus;
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+import org.apache.doris.transaction.TransactionEntry;
+import org.apache.doris.transaction.TransactionStatus;
+
+import org.apache.logging.log4j.LogManager;
+import org.apache.logging.log4j.Logger;
+
+/**
+ * TransactionCommitCommand
+ */
+public class TransactionCommitCommand extends TransactionCommand {
+private static final Logger LOG = 
LogManager.getLogger(TransactionCommitCommand.class);
+
+public TransactionCommitCommand() {
+super(PlanType.TRANSACTION_COMMIT_COMMAND);
+}
+
+@Override
+public void doRun(ConnectContext ctx, StmtExecutor executor) throws 
Exception {
+handleTransactionCommit(ctx);
+}
+
+@Override
+public RedirectStatus toRedirectStatus() {

Review Comment:
   ```suggestion
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement] (nereids) implement transactionBegin/Commit/RollbackCommand in nereids [doris]

2025-04-06 Thread via GitHub


starocean999 commented on code in PR #48993:
URL: https://github.com/apache/doris/pull/48993#discussion_r2030535342


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TransactionRollbackCommand.java:
##
@@ -0,0 +1,93 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.nereids.trees.plans.commands;
+
+import org.apache.doris.analysis.RedirectStatus;
+import org.apache.doris.analysis.StmtType;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.nereids.trees.plans.PlanType;
+import org.apache.doris.nereids.trees.plans.visitor.PlanVisitor;
+import org.apache.doris.qe.ConnectContext;
+import org.apache.doris.qe.StmtExecutor;
+import org.apache.doris.transaction.TransactionEntry;
+import org.apache.doris.transaction.TransactionStatus;
+
+import org.apache.logging.log4j.LogManager;
+import org.apache.logging.log4j.Logger;
+
+/**
+ * TransactionRollbackCommand
+ */
+public class TransactionRollbackCommand extends TransactionCommand {
+private static final Logger LOG = 
LogManager.getLogger(TransactionRollbackCommand.class);
+
+public TransactionRollbackCommand() {
+super(PlanType.TRANSACTION_ROLLBACK_COMMAND);
+}
+
+@Override
+public void doRun(ConnectContext ctx, StmtExecutor executor) throws 
Exception {
+handleTransactionRollback(ctx);
+}
+
+@Override
+public RedirectStatus toRedirectStatus() {

Review Comment:
   ```suggestion
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](cloud) Set thread name for all background thread workers to improve observability [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49366:
URL: https://github.com/apache/doris/pull/49366#issuecomment-2782159047

   TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311) 
Line Coverage: 66.13% (18185/27500)
Region Coverage: 65.56% (8956/13660)
Branch Coverage: 55.45% (4830/8710)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/b09c849722ec5d2eb652ada600417d0884179047_b09c849722ec5d2eb652ada600417d0884179047_cloud/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](full compaction) Should update tablet's rowsets and delete bitmaps under the same lock [doris]

2025-04-06 Thread via GitHub


bobhan1 commented on PR #49825:
URL: https://github.com/apache/doris/pull/49825#issuecomment-2782166198

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Test](nereids) Add ut for alter column/table stats command in nereids [doris]

2025-04-06 Thread via GitHub


yx-keith commented on PR #49278:
URL: https://github.com/apache/doris/pull/49278#issuecomment-2782155393

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](becore) be core when exist elegantly [doris]

2025-04-06 Thread via GitHub


Thearas commented on PR #49826:
URL: https://github.com/apache/doris/pull/49826#issuecomment-2782171346

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [bugfix](becore) be core when exist elegantly [doris]

2025-04-06 Thread via GitHub


yiguolei opened a new pull request, #49826:
URL: https://github.com/apache/doris/pull/49826

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](becore) be core when exist elegantly [doris]

2025-04-06 Thread via GitHub


yiguolei commented on PR #49826:
URL: https://github.com/apache/doris/pull/49826#issuecomment-2782172666

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Fix](full compaction) Should update tablet's rowsets and delete bitmaps under the same lock [doris]

2025-04-06 Thread via GitHub


bobhan1 opened a new pull request, #49825:
URL: https://github.com/apache/doris/pull/49825

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](becore) be core when exist elegantly [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49826:
URL: https://github.com/apache/doris/pull/49826#issuecomment-2782175316

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49704-branch-3.0 created (now a733a1ec2e8)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49704-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


  at a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)

No new revisions were added by this update.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [chore](log) Fix typo when meta-service checks priority_networks (#49704)

2025-04-06 Thread gavinchou
This is an automated email from the ASF dual-hosted git repository.

gavinchou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 9143001aeae [chore](log) Fix typo when meta-service checks 
priority_networks (#49704)
9143001aeae is described below

commit 9143001aeae23b5f1342df987b69ac93484d5c3e
Author: Gavin Chou 
AuthorDate: Mon Apr 7 14:41:29 2025 +0800

[chore](log) Fix typo when meta-service checks priority_networks (#49704)
---
 cloud/src/common/network_util.cpp | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/cloud/src/common/network_util.cpp 
b/cloud/src/common/network_util.cpp
index d31ca7ad937..afec16200e0 100644
--- a/cloud/src/common/network_util.cpp
+++ b/cloud/src/common/network_util.cpp
@@ -167,7 +167,7 @@ std::string get_local_ip(const std::string& 
priority_networks) {
 if (config::enable_loopback_address_for_ms || localhost_str != 
"127.0.0.1") return;
 LOG(WARNING) << "localhost IP is loopback address (127.0.0.1), "
  << "there may be multiple NICs for use, "
- << "please set priority_network with a CIDR expression in 
doris_cloud.conf "
+ << "please set priority_networks with a CIDR expression 
in doris_cloud.conf "
  << "to choose a non-loopback address accordingly";
 exit(-1);
 });


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](log) Fix typo when meta-service checks priority_networks [doris]

2025-04-06 Thread via GitHub


gavinchou merged PR #49704:
URL: https://github.com/apache/doris/pull/49704


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [chore](log) Fix typo when meta-service checks priority_networks #49704 [doris]

2025-04-06 Thread via GitHub


Thearas commented on PR #49827:
URL: https://github.com/apache/doris/pull/49827#issuecomment-2782185456

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49704-branch-3.0 updated (a733a1ec2e8 -> 476a1273e56)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49704-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


from a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)
 add 476a1273e56 [chore](log) Fix typo when meta-service checks 
priority_networks (#49704)

No new revisions were added by this update.

Summary of changes:
 cloud/src/common/network_util.cpp | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [chore](log) Standardize S3 failure log formats to enable critical operation monitoring (#49813)

2025-04-06 Thread dataroaring
This is an automated email from the ASF dual-hosted git repository.

dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 180e0aa4548 [chore](log) Standardize S3 failure log formats to enable 
critical operation monitoring (#49813)
180e0aa4548 is described below

commit 180e0aa45482d60d920562a9f1b2e94bde175f94
Author: Gavin Chou 
AuthorDate: Mon Apr 7 14:44:05 2025 +0800

[chore](log) Standardize S3 failure log formats to enable critical 
operation monitoring (#49813)


This change unifies S3 error logging patterns for four critical
operations that require alerting:
* failed to complete multipart upload
* failed to upload part
* failed to put object
* failed to get object.*\.(dat|idx) (specific to data/index files)
---
 be/src/io/fs/s3_file_reader.cpp | 16 +---
 be/src/io/fs/s3_file_system.cpp |  2 +-
 be/src/io/fs/s3_file_writer.cpp | 15 ---
 3 files changed, 22 insertions(+), 11 deletions(-)

diff --git a/be/src/io/fs/s3_file_reader.cpp b/be/src/io/fs/s3_file_reader.cpp
index 86590d91632..80c58235300 100644
--- a/be/src/io/fs/s3_file_reader.cpp
+++ b/be/src/io/fs/s3_file_reader.cpp
@@ -132,6 +132,7 @@ Status S3FileReader::read_at_impl(size_t offset, Slice 
result, size_t* bytes_rea
 
 int total_sleep_time = 0;
 while (retry_count <= max_retries) {
+*bytes_read = 0;
 s3_file_reader_read_counter << 1;
 // clang-format off
 auto resp = client->get_object( { .bucket = _bucket, .key = _key, },
@@ -157,8 +158,12 @@ Status S3FileReader::read_at_impl(size_t offset, Slice 
result, size_t* bytes_rea
 }
 }
 if (*bytes_read != bytes_req) {
-return Status::InternalError("failed to read (bytes read: {}, 
bytes req: {})",
- *bytes_read, bytes_req);
+std::string msg = fmt::format(
+"failed to get object, path={} offset={} bytes_req={} 
bytes_read={} "
+"file_size={} tries={}",
+_path.native(), offset, bytes_req, *bytes_read, 
_file_size, (retry_count + 1));
+LOG(WARNING) << msg;
+return Status::InternalError(msg);
 }
 _s3_stats.total_bytes_read += bytes_req;
 s3_bytes_read_total << bytes_req;
@@ -170,7 +175,12 @@ Status S3FileReader::read_at_impl(size_t offset, Slice 
result, size_t* bytes_rea
 }
 return Status::OK();
 }
-return Status::InternalError("failed to read from s3, exceeded maximum 
retries");
+std::string msg = fmt::format(
+"failed to get object, path={} offset={} bytes_req={} 
bytes_read={} file_size={} "
+"tries={}",
+_path.native(), offset, bytes_req, *bytes_read, _file_size, 
(max_retries + 1));
+LOG(WARNING) << msg;
+return Status::InternalError(msg);
 }
 
 void S3FileReader::_collect_profile_before_close() {
diff --git a/be/src/io/fs/s3_file_system.cpp b/be/src/io/fs/s3_file_system.cpp
index d841c79ed66..88835e932f7 100644
--- a/be/src/io/fs/s3_file_system.cpp
+++ b/be/src/io/fs/s3_file_system.cpp
@@ -107,7 +107,7 @@ Status ObjClientHolder::reset(const S3ClientConf& conf) {
 return Status::InvalidArgument("failed to init s3 client with conf 
{}", conf.to_string());
 }
 
-LOG(INFO) << "reset s3 client with new conf: " << conf.to_string();
+LOG(WARNING) << "reset s3 client with new conf: " << conf.to_string();
 
 {
 std::lock_guard lock(_mtx);
diff --git a/be/src/io/fs/s3_file_writer.cpp b/be/src/io/fs/s3_file_writer.cpp
index edec1e17aef..d5a5cd00cea 100644
--- a/be/src/io/fs/s3_file_writer.cpp
+++ b/be/src/io/fs/s3_file_writer.cpp
@@ -292,15 +292,15 @@ void S3FileWriter::_upload_one_part(int64_t part_num, 
UploadFileBuffer& buf) {
 }
 const auto& client = _obj_client->get();
 if (nullptr == client) {
-LOG_WARNING("failed at key: {}, load part {} bacause of invalid obj 
client",
+LOG_WARNING("failed to upload part, key={}, part_num={} bacause of 
null obj client",
 _obj_storage_path_opts.key, part_num);
 buf.set_status(Status::InternalError("invalid obj storage 
client"));
 return;
 }
 auto resp = client->upload_part(_obj_storage_path_opts, 
buf.get_string_view_data(), part_num);
 if (resp.resp.status.code != ErrorCode::OK) {
-LOG_INFO("failed at key: {}, load part {}, st {}", 
_obj_storage_path_opts.key, part_num,
- resp.resp.status.msg);
+LOG_WARNING("failed to upload part, key={}, part_num={}, status={}",
+_obj_storage_path_opts.key, part_num, 
resp.resp.status.msg);
 buf.set_status(Status(resp.resp.status.code, 
std::move(resp.resp.status.msg)));
 return;
 }
@@ -347,7 +347,8 @@ Status S3FileWriter::_complete() {
 if (_faile

[PR] branch-3.0: [chore](log) Fix typo when meta-service checks priority_networks #49704 [doris]

2025-04-06 Thread via GitHub


github-actions[bot] opened a new pull request, #49827:
URL: https://github.com/apache/doris/pull/49827

   Cherry-picked from #49704


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [chore](log) Fix typo when meta-service checks priority_networks #49704 [doris]

2025-04-06 Thread via GitHub


dataroaring closed pull request #49827: branch-3.0: [chore](log) Fix typo when 
meta-service checks priority_networks #49704
URL: https://github.com/apache/doris/pull/49827


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](log) Standardize S3 failure log formats to enable critical operation monitoring [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49813:
URL: https://github.com/apache/doris/pull/49813#issuecomment-2782186836

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix] (inverted index) Disallow variant columns from using inverted index format v1 [doris]

2025-04-06 Thread via GitHub


csun5285 commented on PR #49823:
URL: https://github.com/apache/doris/pull/49823#issuecomment-2782188128

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](log) Standardize S3 failure log formats to enable critical operation monitoring [doris]

2025-04-06 Thread via GitHub


dataroaring merged PR #49813:
URL: https://github.com/apache/doris/pull/49813


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49813-branch-3.0 created (now a733a1ec2e8)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49813-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


  at a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)

No new revisions were added by this update.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix] (inverted index) Disallow variant columns from using inverted index format v1 [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49823:
URL: https://github.com/apache/doris/pull/49823#issuecomment-2782188932

   
   
   TPC-H: Total hot run time: 35108 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 646d8042c3a8a9681717107355b7402d648f0663, 
data reload: false
   
   -- Round 1 --
   q1   25675   506750225022
   q2   2070289 202 202
   q3   10379   1232707 707
   q4   10219   1030544 544
   q5   7519231623572316
   q6   185 166 133 133
   q7   922 769 615 615
   q8   9329132411331133
   q9   6898522651765176
   q10  6824227919031903
   q11  476 289 285 285
   q12  354 368 228 228
   q13  17784   369631193119
   q14  229 231 203 203
   q15  518 495 485 485
   q16  639 622 586 586
   q17  571 863 357 357
   q18  7562733970847084
   q19  1222952 562 562
   q20  348 337 227 227
   q21  4034353532203220
   q22  1095100610011001
   Total cold run time: 114852 ms
   Total hot run time: 35108 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   5227513051565130
   q2   238 319 225 225
   q3   2173264922622262
   q4   1452187615171517
   q5   4425442443744374
   q6   220 189 130 130
   q7   2014194318231823
   q8   2566255925382538
   q9   7400726072267226
   q10  3063322028052805
   q11  594 508 493 493
   q12  702 775 622 622
   q13  3522394933993399
   q14  278 295 264 264
   q15  528 471 485 471
   q16  638 708 642 642
   q17  1145154013881388
   q18  7691763475037503
   q19  811 801 810 801
   q20  1948204818591859
   q21  5379479747834783
   q22  1126107810611061
   Total cold run time: 53140 ms
   Total hot run time: 51316 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] branch-3.0: [chore](log) Standardize S3 failure log formats to enable critical operation monitoring #49813 [doris]

2025-04-06 Thread via GitHub


github-actions[bot] opened a new pull request, #49828:
URL: https://github.com/apache/doris/pull/49828

   Cherry-picked from #49813


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](cloud-mow)Add more delete bitmap lock case [doris]

2025-04-06 Thread via GitHub


cosven commented on code in PR #49204:
URL: https://github.com/apache/doris/pull/49204#discussion_r203052


##
regression-test/suites/fault_injection_p0/cloud/test_delete_bitmap_lock_with_restart.groovy:
##
@@ -0,0 +1,316 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+import org.apache.doris.regression.suite.ClusterOptions
+
+suite("test_delete_bitmap_lock_with_restart", "docker") {
+if (!isCloudMode()) {
+return
+}
+def options = new ClusterOptions()
+options.feConfigs += [
+'cloud_cluster_check_interval_second=1',
+'sys_log_verbose_modules=org',
+'heartbeat_interval_second=1'
+]
+options.setFeNum(1)
+options.setBeNum(1)
+options.enableDebugPoints()
+options.cloudMode = true
+
+def customFeConfig1 = [meta_service_rpc_retry_times: 5]
+def tableName = "tbl_basic"
+def do_stream_load = {
+streamLoad {
+table "${tableName}"
+
+set 'column_separator', ','
+set 'columns', 'id, name, score'
+file "test_stream_load.csv"
+
+time 1 // limit inflight 10s
+
+check { result, exception, startTime, endTime ->
+log.info("Stream load result: ${result}")
+def json = parseJson(result)
+assertEquals("success", json.Status.toLowerCase())
+}
+}
+}
+//1. load
+docker(options) {
+sql """ drop table if exists ${tableName}; """
+
+sql """
+CREATE TABLE `${tableName}` (
+`id` int(11) NOT NULL,
+`name` varchar(10) NULL,
+`score` int(11) NULL
+) ENGINE=OLAP
+UNIQUE KEY(`id`)
+DISTRIBUTED BY HASH(`id`) BUCKETS 1
+PROPERTIES (
+"disable_auto_compaction" = "true",
+"enable_unique_key_merge_on_write" = "true",
+"replication_num" = "1"
+);
+"""
+do_stream_load()
+
GetDebugPoint().enableDebugPointForAllBEs("CloudEngineCalcDeleteBitmapTask.handle.inject_sleep",
 [percent: "1.0", sleep: "15"])
+Thread.startDaemon {
+do_stream_load()
+}
+// 1. load + restart fe
+cluster.restartFrontends()
+def now = System.currentTimeMillis()
+do_stream_load()
+def time_cost = System.currentTimeMillis() - now
+log.info("time_cost(ms): ${time_cost}")
+assertTrue(time_cost > 3, "wait time should bigger than 30s")
+
+// 2. load + restart be
+
+Thread.startDaemon {
+do_stream_load()
+}
+cluster.restartBackends()
+now = System.currentTimeMillis()
+do_stream_load()
+time_cost = System.currentTimeMillis() - now
+log.info("time_cost(ms): ${time_cost}")
+assertTrue(time_cost < 1, "wait time should bigger than 10s")
+}
+//2. compaction
+options.beConfigs += [
+'delete_bitmap_lock_expiration_seconds=60',
+]
+docker(options) {
+def backendId_to_backendIP = [:]
+def backendId_to_backendHttpPort = [:]
+getBackendIpHttpPort(backendId_to_backendIP, 
backendId_to_backendHttpPort)
+
+def getTabletStatus = { be_host, be_http_port, tablet_id ->
+boolean running = true
+Thread.sleep(1000)
+StringBuilder sb = new StringBuilder();
+sb.append("curl -X GET http://${be_host}:${be_http_port}";)
+sb.append("/api/compaction/show?tablet_id=")
+sb.append(tablet_id)
+
+String command = sb.toString()
+logger.info(command)
+process = command.execute()
+code = process.waitFor()
+out = process.getText()
+logger.info("Get tablet status:  =" + code + ", out=" + out)
+assertEquals(code, 0)
+def tabletStatus = parseJson(out.trim())
+return tabletStatus
+}
+def triggerCompaction = { be_host, be_http_port, compact_type, 
tablet_id ->
+if (compact_type == "cumulative") {
+def (code_1, out_1, err_1) = 
be_run_cumulative_compaction(be_host, be_http_port, tab

Re: [PR] branch-3.0: [chore](log) Standardize S3 failure log formats to enable critical operation monitoring #49813 [doris]

2025-04-06 Thread via GitHub


Thearas commented on PR #49828:
URL: https://github.com/apache/doris/pull/49828#issuecomment-2782189951

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [chore](log) Standardize S3 failure log formats to enable critical operation monitoring #49813 [doris]

2025-04-06 Thread via GitHub


Thearas commented on PR #49828:
URL: https://github.com/apache/doris/pull/49828#issuecomment-2782190068

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-49813-branch-3.0 updated (a733a1ec2e8 -> b5d5ae97c79)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-49813-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


from a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)
 add b5d5ae97c79 [chore](log) Standardize S3 failure log formats to enable 
critical operation monitoring (#49813)

No new revisions were added by this update.

Summary of changes:
 be/src/io/fs/s3_file_reader.cpp | 16 +---
 be/src/io/fs/s3_file_system.cpp |  2 +-
 be/src/io/fs/s3_file_writer.cpp | 15 ---
 3 files changed, 22 insertions(+), 11 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](cloud-mow)Add more delete bitmap lock case [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49204:
URL: https://github.com/apache/doris/pull/49204#issuecomment-2782193841

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] Fix deadlink from discussions [doris-website]

2025-04-06 Thread via GitHub


KassieZ opened a new pull request, #2263:
URL: https://github.com/apache/doris-website/pull/2263

   ## Versions 
   
   - [ ] dev
   - [ ] 3.0
   - [ ] 2.1
   - [ ] 2.0
   
   ## Languages
   
   - [ ] Chinese
   - [ ] English
   
   ## Docs Checklist
   
   - [ ] Checked by AI
   - [ ] Test Cases Built
   
   https://github.com/apache/doris/discussions/49329
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](cloud-mow)Add more delete bitmap lock case [doris]

2025-04-06 Thread via GitHub


cosven commented on code in PR #49204:
URL: https://github.com/apache/doris/pull/49204#discussion_r2030556999


##
regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_delete_bitmap_lock_case.groovy:
##
@@ -0,0 +1,784 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+import java.util.concurrent.TimeUnit
+import org.awaitility.Awaitility
+
+suite("test_cloud_mow_delete_bitmap_lock_case", "nonConcurrent") {
+if (!isCloudMode()) {
+return
+}
+GetDebugPoint().clearDebugPointsForAllFEs()
+
+def backendId_to_backendIP = [:]
+def backendId_to_backendHttpPort = [:]
+def backendId_to_params = [string: [:]]
+getBackendIpHttpPort(backendId_to_backendIP, backendId_to_backendHttpPort);
+
+def set_be_param = { paramName, paramValue ->
+// for eache be node, set paramName=paramValue
+for (String id in backendId_to_backendIP.keySet()) {
+def beIp = backendId_to_backendIP.get(id)
+def bePort = backendId_to_backendHttpPort.get(id)
+def (code, out, err) = curl("POST", 
String.format("http://%s:%s/api/update_config?%s=%s";, beIp, bePort, paramName, 
paramValue))
+assertTrue(out.contains("OK"))
+}
+}
+
+def reset_be_param = { paramName ->
+// for eache be node, reset paramName to default
+for (String id in backendId_to_backendIP.keySet()) {
+def beIp = backendId_to_backendIP.get(id)
+def bePort = backendId_to_backendHttpPort.get(id)
+def original_value = backendId_to_params.get(id).get(paramName)
+def (code, out, err) = curl("POST", 
String.format("http://%s:%s/api/update_config?%s=%s";, beIp, bePort, paramName, 
original_value))
+assertTrue(out.contains("OK"))
+}
+}
+
+def get_be_param = { paramName ->
+// for eache be node, get param value by default
+def paramValue = ""
+for (String id in backendId_to_backendIP.keySet()) {
+def beIp = backendId_to_backendIP.get(id)
+def bePort = backendId_to_backendHttpPort.get(id)
+// get the config value from be
+def (code, out, err) = curl("GET", 
String.format("http://%s:%s/api/show_config?conf_item=%s";, beIp, bePort, 
paramName))
+assertTrue(code == 0)
+assertTrue(out.contains(paramName))
+// parsing
+def resultList = parseJson(out)[0]
+assertTrue(resultList.size() == 4)
+// get original value
+paramValue = resultList[2]
+backendId_to_params.get(id, [:]).put(paramName, paramValue)
+}
+}
+
+def customFeConfig1 = [calculate_delete_bitmap_task_timeout_seconds: 2, 
meta_service_rpc_retry_times: 5]
+def customFeConfig2 = [delete_bitmap_lock_expiration_seconds: 2, 
meta_service_rpc_retry_times: 5]
+def customFeConfig3 = [mow_calculate_delete_bitmap_retry_times: 1]
+def customFeConfig4 = [calculate_delete_bitmap_task_timeout_seconds: 2, 
mow_calculate_delete_bitmap_retry_times: 1]
+def customFeConfig5 = [meta_service_rpc_retry_times: 5]
+def tableName = "tbl_basic"
+String[][] backends = sql """ show backends """
+assertTrue(backends.size() > 0)
+String backendId;
+def backendIdToBackendIP = [:]
+def backendIdToBackendBrpcPort = [:]
+for (String[] backend in backends) {
+if (backend[9].equals("true")) {
+backendIdToBackendIP.put(backend[0], backend[1])
+backendIdToBackendBrpcPort.put(backend[0], backend[5])
+}
+}
+
+backendId = backendIdToBackendIP.keySet()[0]
+def getMetricsMethod = { check_func ->
+httpTest {
+endpoint backendIdToBackendIP.get(backendId) + ":" + 
backendIdToBackendBrpcPort.get(backendId)
+uri "/brpc_metrics"
+op "get"
+check check_func
+}
+}
+
+int total_retry = 0;
+int last_total_retry = -1;
+
+def getTotalRetry = {
+getMetricsMethod.call() { respCode, body ->
+logger.info("get total retry resp Code {}", 
"${respCode}".toString())
+assertEquals("${respCode}".toString(), "200")
+Stri

Re: [PR] [opt](nereids) do not throw exception in fold const rule [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49802:
URL: https://github.com/apache/doris/pull/49802#issuecomment-2782194916

   
   
   TPC-DS: Total hot run time: 193369 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 72a88630ead931577823eb22d8d6e837d1daa4bd, 
data reload: false
   
   query1   1409103010101010
   query2   6222198419161916
   query3   10995   442644674426
   query4   57563   24803   22853   22853
   query5   4759507 469 469
   query6   370 224 217 217
   query7   4955501 278 278
   query8   339 243 243 243
   query9   6358259326312593
   query10  430 333 255 255
   query11  14976   14963   14840   14840
   query12  166 111 109 109
   query13  1103515 392 392
   query14  10164   644364046404
   query15  214 200 187 187
   query16  7059635 510 510
   query17  1098725 594 594
   query18  1579415 316 316
   query19  191 181 162 162
   query20  121 116 113 113
   query21  212 127 108 108
   query22  4591465946354635
   query23  33848   33413   33630   33413
   query24  6664246124452445
   query25  475 463 447 447
   query26  669 271 152 152
   query27  2211514 334 334
   query28  3120247724402440
   query29  606 570 429 429
   query30  281 221 197 197
   query31  883 858 785 785
   query32  73  64  65  64
   query33  439 355 300 300
   query34  771 876 544 544
   query35  829 853 765 765
   query36  961 997 897 897
   query37  118 101 75  75
   query38  4246422841914191
   query39  1507144314921443
   query40  223 125 108 108
   query41  54  54  51  51
   query42  135 118 115 115
   query43  501 513 497 497
   query44  1316841 816 816
   query45  176 173 167 167
   query46  854 1047651 651
   query47  1888193418601860
   query48  381 412 310 310
   query49  704 496 413 413
   query50  679 721 415 415
   query51  4247427742694269
   query52  121 105 105 105
   query53  244 272 183 183
   query54  577 595 505 505
   query55  84  84  81  81
   query56  321 289 328 289
   query57  1182119411741174
   query58  298 262 253 253
   query59  2852283026532653
   query60  328 313 306 306
   query61  147 121 123 121
   query62  725 733 658 658
   query63  222 186 186 186
   query64  14611011688 688
   query65  4280422241964196
   query66  713 424 320 320
   query67  16369   15706   15421   15421
   query68  5559851 533 533
   query69  565 320 298 298
   query70  1165107211051072
   query71  450 334 301 301
   query72  6147493350004933
   query73  1216726 348 348
   query74  8822920087968796
   query75  3482325427182718
   query76  38801191752 752
   query77  559 373 281 281
   query78  10105   10018   93049304
   query79  3014827 568 568
   query80  973 499 529 499
   query81  511 260 216 216
   query82  727 126 102 102
   query83  416 243 233 233
   query84  292 110 86  86
   query85  787 355 314 314
   query86  445 305 279 279
   query87  4480447943824382
   query88  3673225922542254
   query89  407 312 279 279
   query90  1838214 214 214
   query91  145 145 111 111
   query92  80  61  58  58
   query93  2834930 580 580
   query94  701 425 305 305
   query95  368 300 294 294
   query96  483 577 276 276
   query97  3261323931253125
   query98  233 210 197 197
   query99  1433139012991299
   Total cold run time: 302708 ms
   Total hot run time: 193369 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go

Re: [PR] Fix deadlink from discussions [doris-website]

2025-04-06 Thread via GitHub


KassieZ closed pull request #2263: Fix deadlink from discussions
URL: https://github.com/apache/doris-website/pull/2263


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](nereids) do not throw exception in fold const rule [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49802:
URL: https://github.com/apache/doris/pull/49802#issuecomment-2782205581

   
   
   ClickBench: Total hot run time: 31.18 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 72a88630ead931577823eb22d8d6e837d1daa4bd, 
data reload: false
   
   query1   0.030.040.02
   query2   0.120.110.10
   query3   0.250.190.19
   query4   1.600.190.20
   query5   0.600.580.58
   query6   1.200.720.71
   query7   0.020.020.02
   query8   0.040.030.04
   query9   0.580.520.51
   query10  0.570.600.57
   query11  0.160.100.10
   query12  0.150.110.12
   query13  0.620.600.60
   query14  2.662.702.67
   query15  0.920.860.84
   query16  0.380.370.39
   query17  1.041.001.04
   query18  0.200.200.19
   query19  1.871.851.90
   query20  0.020.010.01
   query21  15.38   0.900.54
   query22  0.751.190.70
   query23  14.87   1.420.61
   query24  6.841.080.84
   query25  0.460.140.13
   query26  0.660.170.14
   query27  0.050.050.05
   query28  9.700.850.44
   query29  12.55   4.003.35
   query30  0.250.100.06
   query31  2.820.580.38
   query32  3.220.550.47
   query33  3.033.143.04
   query34  15.79   5.154.51
   query35  4.504.544.47
   query36  0.670.500.48
   query37  0.080.060.06
   query38  0.050.040.03
   query39  0.040.020.03
   query40  0.160.140.13
   query41  0.080.020.02
   query42  0.040.020.02
   query43  0.030.040.03
   Total cold run time: 105.05 s
   Total hot run time: 31.18 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-47182-branch-3.0 created (now a733a1ec2e8)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-47182-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


  at a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)

No new revisions were added by this update.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-47182-branch-2.1 deleted (was aad189cf40b)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-47182-branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git


 was aad189cf40b [feature](function) upper lower support utf8 input  
(#49756)

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](cloud-mow)Add more delete bitmap lock case [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49204:
URL: https://github.com/apache/doris/pull/49204#issuecomment-2782193870

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](cloud-mow)Add more delete bitmap lock case [doris]

2025-04-06 Thread via GitHub


hello-stephen commented on PR #49204:
URL: https://github.com/apache/doris/pull/49204#issuecomment-2782190992

   # BE UT Coverage Report
   Increment line coverage `0.00% (0/26)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/93535f2aec2e5769ab9ea77ef4ab9c3dd267bbfc_93535f2aec2e5769ab9ea77ef4ab9c3dd267bbfc/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/93535f2aec2e5769ab9ea77ef4ab9c3dd267bbfc_93535f2aec2e5769ab9ea77ef4ab9c3dd267bbfc/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 52.26% (14022/26831) |
   | Line Coverage | 41.05% (121063/294921) |
   | Region Coverage   | 39.77% (61604/154889) |
   | Branch Coverage   | 34.45% (30845/89542) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] branch-3.0: [chore](log) Standardize S3 failure log formats to enable critical operation monitoring #49813 [doris]

2025-04-06 Thread via GitHub


dataroaring closed pull request #49828: branch-3.0: [chore](log) Standardize S3 
failure log formats to enable critical operation monitoring #49813
URL: https://github.com/apache/doris/pull/49828


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](query tvf): resolve column mismatch error in JDBC query function [doris]

2025-04-06 Thread via GitHub


XnY-wei opened a new pull request, #49829:
URL: https://github.com/apache/doris/pull/49829

   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [x] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [x] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [x] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch auto-pick-47182-branch-3.0 deleted (was a733a1ec2e8)

2025-04-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch auto-pick-47182-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git


 was a733a1ec2e8 branch-3.0: [case](mtmv)add case for insert overwrite of 
mtmv force drop partition #48946 (#49799)

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Fix thrift core in asan mode [doris]

2025-04-06 Thread via GitHub


hello-stephen commented on PR #49819:
URL: https://github.com/apache/doris/pull/49819#issuecomment-2781924224

   # BE UT Coverage Report
   Increment line coverage `0.00% (0/2)` :tada:
   
   [Increment coverage 
report](http://coverage.selectdb-in.cc/coverage/ca8c9be865c4852e617b8c7e12c835e2969b9a6e_ca8c9be865c4852e617b8c7e12c835e2969b9a6e/increment_report/index.html)
   [Complete coverage 
report](http://coverage.selectdb-in.cc/coverage/ca8c9be865c4852e617b8c7e12c835e2969b9a6e_ca8c9be865c4852e617b8c7e12c835e2969b9a6e/report/index.html)
   | Category  | Coverage   |
   |---||
   | Function Coverage | 39.12% (10246/26191) |
   | Line Coverage | 30.46% (87367/286787) |
   | Region Coverage   | 29.52% (44925/152195) |
   | Branch Coverage   | 26.04% (22877/87838) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix unix_timestamp [doris]

2025-04-06 Thread via GitHub


github-actions[bot] commented on PR #49686:
URL: https://github.com/apache/doris/pull/49686#issuecomment-2781924309

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids) fix unix_timestamp [doris]

2025-04-06 Thread via GitHub


LiBinfeng-01 commented on PR #49686:
URL: https://github.com/apache/doris/pull/49686#issuecomment-2781923824

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [ut](column_variant)update ut cases and some fix [doris]

2025-04-06 Thread via GitHub


eldenmoon commented on code in PR #49776:
URL: https://github.com/apache/doris/pull/49776#discussion_r2030394674


##
run-be-ut.sh:
##
@@ -37,6 +37,7 @@ set +o posix
 
 ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")" &>/dev/null && pwd)"
 
+export ROOT

Review Comment:
   not modify this



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] Fix thrift core in asan mode [doris]

2025-04-06 Thread via GitHub


doris-robot commented on PR #49819:
URL: https://github.com/apache/doris/pull/49819#issuecomment-2781924789

   
   
   TPC-DS: Total hot run time: 196457 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit ca8c9be865c4852e617b8c7e12c835e2969b9a6e, 
data reload: false
   
   query1   1285913 980 913
   query2   6234199719451945
   query3   10961   443044454430
   query4   65788   28752   23285   23285
   query5   4943485 433 433
   query6   411 186 177 177
   query7   5650316 302 302
   query8   305 223 225 223
   query9   9042259225992592
   query10  462 269 251 251
   query11  17485   15086   15642   15086
   query12  158 101 106 101
   query13  1520456 436 436
   query14  10938   707672927076
   query15  207 177 187 177
   query16  7064517 491 491
   query17  1104600 586 586
   query18  1966322 324 322
   query19  243 168 167 167
   query20  116 108 113 108
   query21  204 103 102 102
   query22  4654465044824482
   query23  34598   33646   33882   33646
   query24  6115292729782927
   query25  539 441 454 441
   query26  674 176 169 169
   query27  1938356 352 352
   query28  4157245124682451
   query29  733 450 440 440
   query30  238 166 162 162
   query31  1018829 859 829
   query32  66  59  54  54
   query33  434 295 305 295
   query34  906 511 510 510
   query35  840 751 737 737
   query36  1088949 986 949
   query37  114 65  69  65
   query38  4056394839923948
   query39  1488146015011460
   query40  209 96  97  96
   query41  48  47  46  46
   query42  113 103 104 103
   query43  542 500 495 495
   query44  1182823 815 815
   query45  181 167 168 167
   query46  1157772 731 731
   query47  1976190618961896
   query48  479 403 398 398
   query49  720 407 385 385
   query50  853 415 434 415
   query51  7276720970317031
   query52  94  92  86  86
   query53  258 176 178 176
   query54  570 460 441 441
   query55  78  73  73  73
   query56  267 242 246 242
   query57  1246112411171117
   query58  210 206 201 201
   query59  3077299629232923
   query60  277 252 258 252
   query61  114 111 108 108
   query62  768 666 677 666
   query63  219 193 200 193
   query64  1376669 637 637
   query65  3217317431913174
   query66  712 296 307 296
   query67  16014   15593   15655   15593
   query68  4005574 567 567
   query69  434 274 265 265
   query70  1195109811421098
   query71  348 266 260 260
   query72  6411411140864086
   query73  741 342 363 342
   query74  9293913890099009
   query75  3356265426762654
   query76  1999110810071007
   query77  495 268 274 268
   query78  10520   955895969558
   query79  1476591 599 591
   query80  842 431 422 422
   query81  507 237 239 237
   query82  126094  87  87
   query83  247 144 146 144
   query84  286 79  80  79
   query85  881 316 297 297
   query86  326 299 265 265
   query87  4449433242844284
   query88  3715238223662366
   query89  415 292 293 292
   query90  2015182 190 182
   query91  183 153 150 150
   query92  68  49  48  48
   query93  1893551 552 551
   query94  857 307 298 298
   query95  357 255 256 255
   query96  606 286 288 286
   query97  3328313131743131
   query98  212 222 200 200
   query99  1542130213331302
   Total cold run time: 317237 ms
   Total hot run time: 196457 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to

  1   2   3   >