Re: [PR] [fix](regression-test) adjust hudi cases (#46473) [doris]
morningman commented on PR #46489: URL: https://github.com/apache/doris/pull/46489#issuecomment-2574242283 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46485-branch-2.1 created (now 03a3f37cc4e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46485-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-flink-connector) branch master updated: [Chore] Improve some log output (#535)
This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-flink-connector.git
The following commit(s) were added to refs/heads/master by this push:
new df088ba8 [Chore] Improve some log output (#535)
df088ba8 is described below
commit df088ba8f905c518238b8a8af7521a9ec346bedc
Author: wudi <676366...@qq.com>
AuthorDate: Tue Jan 7 09:59:31 2025 +0800
[Chore] Improve some log output (#535)
---
.../apache/doris/flink/sink/committer/DorisCommitter.java| 12
.../org/apache/doris/flink/sink/writer/DorisStreamLoad.java | 5 -
.../java/org/apache/doris/flink/sink/writer/DorisWriter.java | 1 -
3 files changed, 12 insertions(+), 6 deletions(-)
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/committer/DorisCommitter.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/committer/DorisCommitter.java
index e73d96cd..b1a70059 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/committer/DorisCommitter.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/committer/DorisCommitter.java
@@ -128,12 +128,16 @@ public class DorisCommitter implements
Committer, Closeable {
jsonMapper.readValue(
loadResult,
new TypeReference>() {});
-if (!res.get("status").equals(SUCCESS)
-&& !ResponseUtil.isCommitted(res.get("msg"))) {
+if (res.get("status").equals(SUCCESS)) {
+LOG.info("load result {}", loadResult);
+} else if (ResponseUtil.isCommitted(res.get("msg"))) {
+LOG.info(
+"transaction {} has already committed
successfully, skipping, load response is {}",
+committable.getTxnID(),
+res.get("msg"));
+} else {
throw new DorisRuntimeException(
"commit transaction failed " + loadResult);
-} else {
-LOG.info("load result {}", loadResult);
}
return;
}
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisStreamLoad.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisStreamLoad.java
index 02c2df49..f900f741 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisStreamLoad.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisStreamLoad.java
@@ -391,7 +391,10 @@ public class DorisStreamLoad implements Serializable {
String msg = res.get("msg");
// transaction already aborted
if (msg != null && ResponseUtil.isAborted(msg)) {
-LOG.warn("Failed to abort transaction, {}", msg);
+LOG.info(
+"transaction {} may have already been successfully
aborted, skipping, abort response is {}",
+txnID,
+msg);
return;
}
diff --git
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisWriter.java
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisWriter.java
index fdb797f9..8e28213d 100644
---
a/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisWriter.java
+++
b/flink-doris-connector/src/main/java/org/apache/doris/flink/sink/writer/DorisWriter.java
@@ -458,7 +458,6 @@ public class DorisWriter
if (scheduledExecutorService != null) {
scheduledExecutorService.shutdownNow();
}
-LOG.info("Try to abort txn before closing.");
abortPossibleSuccessfulTransaction();
if (dorisStreamLoadMap != null && !dorisStreamLoadMap.isEmpty()) {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46384-branch-2.1 created (now 03a3f37cc4e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46384-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hive) sync DDL command to other FE [doris]
morningman commented on PR #46326: URL: https://github.com/apache/doris/pull/46326#issuecomment-2574243878 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (f2bc2e32ad6 -> ae6d8d0ff39)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard f2bc2e32ad6 Automated deployment with doris branch @ c5ea31e3b0a8576a87d8a4f19e8210899811612b new ae6d8d0ff39 Automated deployment with doris branch @ c5ea31e3b0a8576a87d8a4f19e8210899811612b This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (f2bc2e32ad6) \ N -- N -- N refs/heads/asf-site (ae6d8d0ff39) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/1.2/search-index.json | 2 +- docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/1.2/search-index.json | 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 10 files changed, 10 insertions(+), 10 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](thrift) remove some useless thrift definitions [doris]
yiguolei commented on PR #46492: URL: https://github.com/apache/doris/pull/46492#issuecomment-2574251996 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) opt range inference for or expression when out of order [doris]
yujun777 commented on PR #46303: URL: https://github.com/apache/doris/pull/46303#issuecomment-2574251990 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](fe) Ignore `removeDroppedFrontends` when fe using metadata fail… [doris]
SWJTU-ZhangLei commented on PR #46446: URL: https://github.com/apache/doris/pull/46446#issuecomment-2574255812 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
dataroaring closed pull request #46490: branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 URL: https://github.com/apache/doris/pull/46490 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
hello-stephen commented on PR #46491: URL: https://github.com/apache/doris/pull/46491#issuecomment-2574242925 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
dataroaring closed pull request #46491: branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 URL: https://github.com/apache/doris/pull/46491 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
Thearas commented on PR #46490: URL: https://github.com/apache/doris/pull/46490#issuecomment-2574242910 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
github-actions[bot] opened a new pull request, #46491: URL: https://github.com/apache/doris/pull/46491 Cherry-picked from #46485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Spark 3.3.0 support [doris-spark-connector]
JNSimba closed pull request #57: Spark 3.3.0 support URL: https://github.com/apache/doris-spark-connector/pull/57 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Spark 3.3.0 support [doris-spark-connector]
JNSimba commented on PR #57: URL: https://github.com/apache/doris-spark-connector/pull/57#issuecomment-2574242718 Spark 3.3.0 already supports -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (a9c3d468b80 -> 732d37689ff)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from a9c3d468b80 [fix](regression-test) adjust hudi cases (#46473) add 732d37689ff [fix](hms)fix hive catalog follower not get event. (#46485) No new revisions were added by this update. Summary of changes: .../doris/datasource/hive/HMSExternalCatalog.java | 28 +++--- .../hive/event/MetastoreEventsProcessor.java | 2 +- 2 files changed, 15 insertions(+), 15 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Compatible with Spark4 and Scala 2.13 [doris-spark-connector]
JNSimba commented on PR #216: URL: https://github.com/apache/doris-spark-connector/pull/216#issuecomment-2574242083 Thank you for your contribution. You can submit a spark4 module based on the latest master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](join) fix columnstr64's offset overflow on serialize_value_into_arena [doris]
HappenLee commented on code in PR #46461:
URL: https://github.com/apache/doris/pull/46461#discussion_r1904814941
##
be/src/vec/columns/column_string.cpp:
##
@@ -399,8 +399,8 @@ template
StringRef ColumnStr::serialize_value_into_arena(size_t n, Arena& arena,
char const*& begin) const {
// Use uint32 instead of size_t to reduce agg key's length.
Review Comment:
remove the comment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](stream-load) add observability on commit and publish cost time [doris]
doris-robot commented on PR #46487: URL: https://github.com/apache/doris/pull/46487#issuecomment-2574243707 TPC-H: Total hot run time: 32668 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 50ab859234539ed742c06055b17480d3509e0d75, data reload: false -- Round 1 -- q1 17570 613367146133 q2 2047311 169 169 q3 10411 1254721 721 q4 10236 848 427 427 q5 8032218619261926 q6 207 181 144 144 q7 885 749 597 597 q8 9239135911671167 q9 5228492850384928 q10 6900232119111911 q11 494 283 257 257 q12 346 370 224 224 q13 17847 360830353035 q14 248 237 214 214 q15 555 517 499 499 q16 612 626 592 592 q17 560 840 319 319 q18 6883654664066406 q19 1992971 544 544 q20 300 323 186 186 q21 2807211619621962 q22 360 333 307 307 Total cold run time: 103759 ms Total hot run time: 32668 ms - Round 2, with runtime_filter_mode=off - q1 6298621361986198 q2 240 323 229 229 q3 2250266523382338 q4 1367179213451345 q5 4300473848504738 q6 191 185 143 143 q7 2078196118231823 q8 2647278226632663 q9 7325730373067303 q10 3096335128632863 q11 563 508 508 508 q12 639 740 614 614 q13 3464386932903290 q14 306 303 281 281 q15 568 516 497 497 q16 672 728 657 657 q17 1211174012581258 q18 7697746773477347 q19 860 120410271027 q20 1990206818501850 q21 5531535347324732 q22 604 603 615 603 Total cold run time: 53897 ms Total hot run time: 52307 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore] Improve some log output [doris-flink-connector]
JNSimba merged PR #535: URL: https://github.com/apache/doris-flink-connector/pull/535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression-test) adjust hudi cases (#46473) [doris]
morningman commented on PR #46488: URL: https://github.com/apache/doris/pull/46488#issuecomment-2574239504 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](thrift) remove some useless thrift definitions [doris]
Thearas commented on PR #46492: URL: https://github.com/apache/doris/pull/46492#issuecomment-2574247010 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](thrift) remove some useless thrift definitions [doris]
yiguolei opened a new pull request, #46492: URL: https://github.com/apache/doris/pull/46492 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) insert into with cte cannot be explained [doris]
morrySnow merged PR #46384: URL: https://github.com/apache/doris/pull/46384 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](MTMV) catch all exception when get mtmvs to avoid plan failed [doris]
github-actions[bot] commented on PR #46474: URL: https://github.com/apache/doris/pull/46474#issuecomment-2574251224 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](variable) variable version not persist in image [doris]
github-actions[bot] commented on PR #46463: URL: https://github.com/apache/doris/pull/46463#issuecomment-2574250338 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](variable) variable version not persist in image [doris]
github-actions[bot] commented on PR #46463: URL: https://github.com/apache/doris/pull/46463#issuecomment-2574250287 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46384-branch-3.0 created (now d5bfe019f8e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46384-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at d5bfe019f8e branch-3.0: [fix](index meta) make has_inverted_index function more robust #46364 (#46429) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (732d37689ff -> aba84f97aa9)
This is an automated email from the ASF dual-hosted git repository. morrysnow pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 732d37689ff [fix](hms)fix hive catalog follower not get event. (#46485) add aba84f97aa9 [fix](Nereids) insert into with cte cannot be explained (#46384) No new revisions were added by this update. Summary of changes: .../nereids/trees/plans/commands/insert/InsertIntoTableCommand.java | 6 +- regression-test/suites/nereids_p0/explain/explain_dml.groovy| 2 ++ 2 files changed, 7 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](stream-load) add observability on commit and publish cost time [doris]
doris-robot commented on PR #46487: URL: https://github.com/apache/doris/pull/46487#issuecomment-2574252367 TeamCity be ut coverage result: Function Coverage: 38.88% (10128/26048) Line Coverage: 29.93% (85721/286407) Region Coverage: 29.02% (43727/150670) Branch Coverage: 25.56% (22321/87316) Coverage Report: http://coverage.selectdb-in.cc/coverage/50ab859234539ed742c06055b17480d3509e0d75_50ab859234539ed742c06055b17480d3509e0d75/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](mtmv) Optimize get available materialized view logic by reducing partition version comparison [doris]
seawinde commented on PR #46479: URL: https://github.com/apache/doris/pull/46479#issuecomment-2574253140 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) let Physical plan compute logicalProperties.datatrait [doris]
github-actions[bot] commented on PR #46401: URL: https://github.com/apache/doris/pull/46401#issuecomment-2574253958 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) let Physical plan compute logicalProperties.datatrait [doris]
github-actions[bot] commented on PR #46401: URL: https://github.com/apache/doris/pull/46401#issuecomment-2574253931 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46384-branch-3.0 deleted (was d5bfe019f8e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46384-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git was d5bfe019f8e branch-3.0: [fix](index meta) make has_inverted_index function more robust #46364 (#46429) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46384-branch-2.1 deleted (was 03a3f37cc4e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46384-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [bugfix](be) the config could not be modified on line (#46470)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ae36af95f50 [bugfix](be) the config could not be modified on line
(#46470)
ae36af95f50 is described below
commit ae36af95f50dd2b0dd500c97bcb8193e14af4af4
Author: yiguolei
AuthorDate: Tue Jan 7 10:15:35 2025 +0800
[bugfix](be) the config could not be modified on line (#46470)
This value is saved in some type description, could not be modified
online. User should restart BE after modify this value.
For example,
static TypeDescriptor create_string_type() {
TypeDescriptor ret;
ret.type = TYPE_STRING;
ret.len = config::string_type_length_soft_limit_bytes;
return ret;
}
---
be/src/common/config.cpp | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/be/src/common/config.cpp b/be/src/common/config.cpp
index 218dc2ae6b1..82bfa49e305 100644
--- a/be/src/common/config.cpp
+++ b/be/src/common/config.cpp
@@ -915,7 +915,7 @@ DEFINE_String(rpc_load_balancer, "rr");
// a soft limit of string type length, the hard limit is 2GB - 4, but if too
long will cause very low performance,
// so we set a soft limit, default is 1MB
-DEFINE_mInt32(string_type_length_soft_limit_bytes, "1048576");
+DEFINE_Int32(string_type_length_soft_limit_bytes, "1048576");
DEFINE_Validator(string_type_length_soft_limit_bytes,
[](const int config) -> bool { return config > 0 && config <=
2147483643; });
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](stream-load) add observability on commit and publish cost time [doris]
doris-robot commented on PR #46487: URL: https://github.com/apache/doris/pull/46487#issuecomment-2574260868 ClickBench: Total hot run time: 30.55 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 50ab859234539ed742c06055b17480d3509e0d75, data reload: false query1 0.040.030.03 query2 0.060.040.03 query3 0.230.070.07 query4 1.610.100.10 query5 0.430.410.40 query6 1.170.650.65 query7 0.020.020.02 query8 0.040.030.04 query9 0.570.490.52 query10 0.560.570.54 query11 0.140.100.10 query12 0.140.110.11 query13 0.610.600.60 query14 2.712.732.74 query15 0.880.820.82 query16 0.390.380.38 query17 1.071.071.06 query18 0.230.210.21 query19 1.971.951.88 query20 0.010.020.01 query21 15.36 0.920.58 query22 0.760.700.56 query23 15.48 1.480.58 query24 3.810.370.79 query25 0.190.160.06 query26 0.320.160.14 query27 0.060.060.04 query28 13.74 1.521.04 query29 12.59 3.943.25 query30 0.250.090.06 query31 2.830.610.39 query32 3.240.540.48 query33 3.073.033.20 query34 16.77 5.114.49 query35 4.474.434.46 query36 0.810.490.49 query37 0.090.070.06 query38 0.040.040.03 query39 0.030.020.03 query40 0.160.120.13 query41 0.070.030.02 query42 0.040.030.02 query43 0.040.040.03 Total cold run time: 107.1 s Total hot run time: 30.55 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](be) the config could not be modified on line [doris]
yiguolei merged PR #46470: URL: https://github.com/apache/doris/pull/46470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [bugfix](be) the config could not be modified on line #46470 [doris]
github-actions[bot] opened a new pull request, #46494: URL: https://github.com/apache/doris/pull/46494 Cherry-picked from #46470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46470-branch-3.0 updated (cda702319f4 -> c8f0c2dbbe0)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46470-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from cda702319f4 [fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454) add c8f0c2dbbe0 [bugfix](be) the config could not be modified on line (#46470) No new revisions were added by this update. Summary of changes: be/src/common/config.cpp | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) the config could not be modified on line #46470 [doris]
dataroaring closed pull request #46494: branch-3.0: [bugfix](be) the config could not be modified on line #46470 URL: https://github.com/apache/doris/pull/46494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) the config could not be modified on line #46470 [doris]
hello-stephen commented on PR #46494: URL: https://github.com/apache/doris/pull/46494#issuecomment-2574263225 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46470-branch-3.0 created (now cda702319f4)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46470-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at cda702319f4 [fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) the config could not be modified on line #46470 [doris]
hello-stephen commented on PR #46494: URL: https://github.com/apache/doris/pull/46494#issuecomment-2574263180 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](mow) add observability on commit and publish cost time [doris]
hust-hhb commented on PR #46487: URL: https://github.com/apache/doris/pull/46487#issuecomment-2574264020 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Feature] backup privileges catalogs workloadgroups [doris]
justfortaste opened a new pull request, #46495: URL: https://github.com/apache/doris/pull/46495 ### What problem does this PR solve? https://doc.weixin.qq.com/doc/w3_AGkArQbjACc5rBcdFOxQcaBSzESxW?scode=AJEAIQdfAAosLUmBoQAGkArQbjACc Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature] backup privileges catalogs workloadgroups [doris]
hello-stephen commented on PR #46495: URL: https://github.com/apache/doris/pull/46495#issuecomment-2574271326 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature] backup privileges catalogs workloadgroups [doris]
justfortaste commented on PR #46495: URL: https://github.com/apache/doris/pull/46495#issuecomment-2574271550 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] 数据导入方式routine stream brocker load 的方式选择，哪种适应什么场景，怎么调优呢 [doris-website]
Githuboi opened a new issue, #1720: URL: https://github.com/apache/doris-website/issues/1720 Path:/zh-CN/docs/data-operate/import/load-data-convert -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](variable) variable version not persist in image (#46463)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 4f3b9bb0eb1 [fix](variable) variable version not persist in image
(#46463)
4f3b9bb0eb1 is described below
commit 4f3b9bb0eb12a666c39c8e4e55d3b3e7703ff2fc
Author: morrySnow
AuthorDate: Tue Jan 7 10:28:35 2025 +0800
[fix](variable) variable version not persist in image (#46463)
### What problem does this PR solve?
Related PR: #41607 #45648
Problem Summary:
org.apache.doris.qe.GlobalVariable#getPersistentGlobalVarNames should
use bit and to check whether variable is Global
---
fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java | 5 ++---
1 file changed, 2 insertions(+), 3 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java
index e3639596ed3..ed4f1757daf 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java
@@ -92,7 +92,7 @@ public final class GlobalVariable {
// 0: table names are stored as specified and comparisons are case
sensitive.
// 1: table names are stored in lowercase on disk and comparisons are not
case sensitive.
// 2: table names are stored as given but compared in lowercase.
-@VariableMgr.VarAttr(name = LOWER_CASE_TABLE_NAMES, flag =
VariableMgr.READ_ONLY)
+@VariableMgr.VarAttr(name = LOWER_CASE_TABLE_NAMES, flag =
VariableMgr.READ_ONLY | VariableMgr.GLOBAL)
public static int lowerCaseTableNames = 0;
@VariableMgr.VarAttr(name = LICENSE, flag = VariableMgr.READ_ONLY)
@@ -200,8 +200,7 @@ public final class GlobalVariable {
List varNames = Lists.newArrayList();
for (Field field : GlobalVariable.class.getDeclaredFields()) {
VariableMgr.VarAttr attr =
field.getAnnotation(VariableMgr.VarAttr.class);
-// Since the flag of lower_case_table_names is READ_ONLY, it is
handled separately here.
-if (attr != null && (attr.flag() == VariableMgr.GLOBAL ||
attr.name().equals(LOWER_CASE_TABLE_NAMES))) {
+if (attr != null && (attr.flag() & VariableMgr.GLOBAL) != 0) {
varNames.add(attr.name());
}
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](variable) variable version not persist in image [doris]
morrySnow merged PR #46463: URL: https://github.com/apache/doris/pull/46463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](shellcheck) fix hive-metastore and enable shellcheck in docker [doris]
suxiaogang223 opened a new pull request, #46496: URL: https://github.com/apache/doris/pull/46496 Problem Summary: This pull request includes changes to the `.github/workflows/code-checks.yml` and `docker/thirdparties/docker-compose/hive/scripts/hive-metastore.sh` files. The most important changes involve updating the shell checker exclusions and modifying the script execution behavior for the Hive metastore. ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](shellcheck) fix hive-metastore and enable shellcheck in docker [doris]
Thearas commented on PR #46496: URL: https://github.com/apache/doris/pull/46496#issuecomment-2574273297 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46463-branch-3.0 updated (cda702319f4 -> edc052d5130)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46463-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from cda702319f4 [fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454) add edc052d5130 [fix](variable) variable version not persist in image (#46463) No new revisions were added by this update. Summary of changes: fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Bug] (pipelineX) [doris]
liutang123 opened a new issue, #46498:
URL: https://github.com/apache/doris/issues/46498
### Search before asking
- [X] I had searched in the
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no
similar issues.
### Version
2.1.7
### What's Wrong?
When execute nested loop join in pipelineX and old planner, an `DCHECK`
error occur.
be.INFO
```
F20250106 17:17:31.337930 558416 block.cpp:731] Check failed:
d.column->use_count() == 1 (2 vs. 1) 0x618e0a20 block use count: , [
channel_id, 2], [__DORIS_DELETE_SIGN__, 1], [channel_id, 1], [event_date,
1], [__DORIS_DELETE_SIGN__, 1]
```
be.out
```
8# doris::vectorized::Block::clear_column_data(int) in
/usr/local/service/doris/lib/be/doris_be
9#
doris::pipeline::NestedLoopJoinProbeOperatorX::pull(doris::RuntimeState*,
doris::vectorized::Block*, bool*) const at /root/tc/be/sr
c/pipeline/exec/nested_loop_join_probe_operator.cpp:547
10#
doris::pipeline::StatefulOperatorX::get_block(doris::RuntimeState*,
doris::vectoriz
ed::Block*, bool*) at /root/tc/be/src/pipeline/pipeline_x/operator.cpp:571
11#
doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*,
doris::vectorized::Block*, bool*) at /root/tc/be/src
/pipeline/pipeline_x/operator.cpp:292
12# doris::pipeline::PipelineXTask::execute(bool*) at
/root/tc/be/src/pipeline/pipeline_x/pipeline_x_task.cpp:342
13# doris::pipeline::TaskScheduler::_do_work(unsigned long) at
/root/tc/be/src/pipeline/task_scheduler.cpp:347
14# doris::pipeline::TaskScheduler::start()::$_0::operator()() const at
/root/tc/be/src/pipeline/task_scheduler.cpp:218
15# void std::__invoke_impl(std::__invoke_other,
doris::pipeline::TaskScheduler::s
tart()::$_0&) at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61
16# std::enable_if, void>::type
std::__invoke_r(doris::pipeline::TaskScheduler::start()::$_0&)
at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-li
nux-gnu/11/../../../../include/c++/11/bits/invoke.h:117
17# std::_Function_handler::_M_invoke(std::_Any_data const&)
at /var/local/ldb-t
oolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
18# std::function::operator()() const at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/1
1/bits/std_function.h:560
19# doris::FunctionRunnable::run() at /root/tc/be/src/util/threadpool.cpp:48
20# doris::ThreadPool::dispatch_thread() at
/root/tc/be/src/util/threadpool.cpp:544
21# void std::__invoke_impl(std::__invoke_memfun_deref, void (doris::ThreadP
ool::*&)(), doris::ThreadPool*&) at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.
h:74
22# std::__invoke_result::type std::__invoke(void (doris::ThreadPool::*&)(), doris::ThreadPool*&) at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../
../../../include/c++/11/bits/invoke.h:96
23# void std::_Bind::__call(std::tuple<>&&, std::_Index_tuple<0ul>) at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/functional:420
24# void std::_Bind::operator()<, void>() at
/var/local/ldb-toolchain/bin/../lib/gcc
/x86_64-linux-gnu/11/../../../../include/c++/11/functional:503
25# void std::__invoke_impl&>(std::__invoke_other,
std::_Bind&) at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/
11/bits/invoke.h:61
26# std::enable_if&>, void>::type std::__invoke_r<
void, std::_Bind&>(std::_Bind&) a
t
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:117
27# std::_Function_handler >::_M_invoke(std::_Any_data
const&) a
t
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
28# std::function::operator()() const at
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/1
1/bits/std_function.h:560
29# doris::Thread::supervise_thread(void*) at
/root/tc/be/src/util/thread.cpp:498
30# start_thread in /lib64/libpthread.so.0
31# __clone in /lib64/libc.so.6
```
### What You Expected?
No `DCHECK` occur.
### How to Reproduce?
1. build doris be with asan.
2. create table
```
CREATE TABLE `dbgr` (
`event_date` int NULL DEFAULT "0" COMMENT '天',
`c_id` int NULL DEFAULT "0" COMMENT '渠道ID',
INDEX event_date (`event_date`) USING INVERTED
) ENGINE=OLAP
UNIQUE KEY(`event_date`)
COMMENT ''
PARTITION BY RANGE(`event_date`)
(PARTITION p_min VALUES [("-2147483648"), ("20220500")),
PARTITION p_202206 VALUES [("20220500"), ("20220600")),
PARTITION p_202207 VALUES [("20220600"), ("20220700")),
PARTITION p_202413 VALUES [("20241200"), ("20250100")),
PARTITION p_max VALU
Re: [PR] branch-3.0: [fix](variable) variable version not persist in image #46463 [doris]
Thearas commented on PR #46497: URL: https://github.com/apache/doris/pull/46497#issuecomment-2574274077 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46463-branch-3.0 created (now cda702319f4)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46463-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at cda702319f4 [fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46485-branch-3.0 created (now d5bfe019f8e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46485-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at d5bfe019f8e branch-3.0: [fix](index meta) make has_inverted_index function more robust #46364 (#46429) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
Thearas commented on PR #46490: URL: https://github.com/apache/doris/pull/46490#issuecomment-2574242967 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46485-branch-3.0 updated (d5bfe019f8e -> 7db9117b990)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46485-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git from d5bfe019f8e branch-3.0: [fix](index meta) make has_inverted_index function more robust #46364 (#46429) add 7db9117b990 [fix](hms)fix hive catalog follower not get event. (#46485) No new revisions were added by this update. Summary of changes: .../doris/datasource/hive/HMSExternalCatalog.java | 28 +++--- .../hive/event/MetastoreEventsProcessor.java | 2 +- 2 files changed, 15 insertions(+), 15 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
hello-stephen commented on PR #46491: URL: https://github.com/apache/doris/pull/46491#issuecomment-2574242978 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46485-branch-2.1 updated (03a3f37cc4e -> 7429ff0f60c)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46485-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) add 7429ff0f60c [fix](hms)fix hive catalog follower not get event. (#46485) No new revisions were added by this update. Summary of changes: .../doris/datasource/hive/HMSExternalCatalog.java | 28 +++--- .../hive/event/MetastoreEventsProcessor.java | 2 +- 2 files changed, 15 insertions(+), 15 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-2.1: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
github-actions[bot] opened a new pull request, #46490: URL: https://github.com/apache/doris/pull/46490 Cherry-picked from #46485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](stream-load) add observability on commit and publish cost time [doris]
doris-robot commented on PR #46487: URL: https://github.com/apache/doris/pull/46487#issuecomment-2574256584 TPC-DS: Total hot run time: 196818 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 50ab859234539ed742c06055b17480d3509e0d75, data reload: false query1 1300956 915 915 query2 6399235724472357 query3 10968 476847704768 query4 33085 23950 23396 23396 query5 4003612 443 443 query6 273 199 191 191 query7 3978503 303 303 query8 298 249 231 231 query9 9523265426372637 query10 471 310 242 242 query11 17994 15372 15191 15191 query12 159 109 101 101 query13 1554516 401 401 query14 10193 713272717132 query15 231 203 208 203 query16 8035626 447 447 query17 1616777 608 608 query18 2129430 343 343 query19 199 194 165 165 query20 127 119 116 116 query21 211 132 113 113 query22 4751454746064547 query23 34629 33563 33715 33563 query24 6697233924032339 query25 482 476 384 384 query26 731 278 154 154 query27 2221462 340 340 query28 5411248124892481 query29 725 556 427 427 query30 202 185 149 149 query31 983 941 882 882 query32 84 58 58 58 query33 488 358 296 296 query34 753 836 516 516 query35 818 848 756 756 query36 10151048959 959 query37 121 102 75 75 query38 4260430841544154 query39 1519147114741471 query40 202 125 111 111 query41 45 47 44 44 query42 118 110 104 104 query43 518 541 488 488 query44 1329818 826 818 query45 186 172 177 172 query46 880 1048657 657 query47 2011202119461946 query48 390 416 341 341 query49 725 484 403 403 query50 666 683 410 410 query51 7207715772317157 query52 105 101 91 91 query53 234 254 186 186 query54 471 507 408 408 query55 92 94 80 80 query56 264 260 252 252 query57 1246122911661166 query58 248 223 242 223 query59 3187328331383138 query60 278 271 249 249 query61 116 114 119 114 query62 855 827 744 744 query63 229 188 203 188 query64 36401022654 654 query65 3328325133043251 query66 816 413 307 307 query67 16326 15842 15492 15492 query68 9707690 509 509 query69 474 301 255 255 query70 1195115911101110 query71 433 298 256 256 query72 6310386038963860 query73 645 744 351 351 query74 10251 922588818881 query75 4602316126422642 query76 43241187783 783 query77 787 370 270 270 query78 10412 10095 95539553 query79 5518762 587 587 query80 723 516 466 466 query81 493 274 235 235 query82 605 160 127 127 query83 201 161 149 149 query84 285 93 74 74 query85 782 360 316 316 query86 350 316 301 301 query87 4430437045184370 query88 4567219221702170 query89 454 323 295 295 query90 1963189 187 187 query91 130 132 105 105 query92 69 53 51 51 query93 2937795 525 525 query94 668 387 279 279 query95 342 266 251 251 query96 483 609 315 315 query97 2912300528662866 query98 225 204 197 197 query99 1699155414341434 Total cold run time: 303324 ms Total hot run time: 196818 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [bugfix](be) the config could not be modified on line [doris]
github-actions[bot] commented on PR #46470: URL: https://github.com/apache/doris/pull/46470#issuecomment-2574256048 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bugfix](be) the config could not be modified on line [doris]
github-actions[bot] commented on PR #46470: URL: https://github.com/apache/doris/pull/46470#issuecomment-2574256015 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](pipelineX) fix DCHECK error when reuse _join_block in nested lo… [doris]
liutang123 opened a new pull request, #46493: URL: https://github.com/apache/doris/pull/46493 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46473-branch-2.1 created (now 03a3f37cc4e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46473-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](thrift) remove some useless thrift definitions [doris]
github-actions[bot] commented on PR #46492: URL: https://github.com/apache/doris/pull/46492#issuecomment-2574256822 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-3.0 updated: [fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new cda702319f4 [fix](hive)fix hive insert only translaction
table.(#45753)(#46385) (#46454)
cda702319f4 is described below
commit cda702319f4b47582ce38d3b906aaf1e5675d05d
Author: daidai
AuthorDate: Tue Jan 7 10:11:53 2025 +0800
[fix](hive)fix hive insert only translaction table.(#45753)(#46385) (#46454)
### What problem does this PR solve?
bp #45753 : fix read hive insert only Transaction table.
bp #46385 , #45999 : fix #45753 case unstable.
---
.../scripts/create_preinstalled_scripts/run25.hql | 53 ++
.../doris/datasource/hive/HMSExternalTable.java| 16 ++--
.../doris/datasource/hive/HiveMetaStoreCache.java | 49 +++--
.../doris/datasource/hive/HiveMetadataOps.java | 25 +++
.../org/apache/doris/datasource/hive/HiveUtil.java | 22 ++
.../doris/datasource/hive/source/HiveScanNode.java | 11 ++-
.../commands/insert/InsertIntoTableCommand.java| 3 +
.../hive/test_transactional_hive.out | 46
.../hive/test_hive_translation_insert_only.out | 20 +
.../hive/test_transactional_hive.groovy| 70 ++
.../hive/test_hive_translation_insert_only.groovy | 85 ++
11 files changed, 371 insertions(+), 29 deletions(-)
diff --git
a/docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run25.hql
b/docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run25.hql
index 814df4cdc5f..66e73f51df8 100755
---
a/docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run25.hql
+++
b/docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run25.hql
@@ -41,3 +41,56 @@ insert into orc_full_acid_par PARTITION(part_col=20230102)
values
(6, 'F');
update orc_full_acid_par set value = 'BB' where id = 2;
+
+
+
+
+create table orc_to_acid_tb (id INT, value STRING)
+PARTITIONED BY (part_col INT)
+CLUSTERED BY (id) INTO 3 BUCKETS
+STORED AS ORC;
+INSERT INTO TABLE orc_to_acid_tb PARTITION (part_col=101) VALUES (1, 'A'), (3,
'C');
+INSERT INTO TABLE orc_to_acid_tb PARTITION (part_col=102) VALUES (2, 'B');
+ALTER TABLE orc_to_acid_tb SET TBLPROPERTIES ('transactional'='true');
+
+
+create table orc_to_acid_compacted_tb (id INT, value STRING)
+PARTITIONED BY (part_col INT)
+CLUSTERED BY (id) INTO 3 BUCKETS
+STORED AS ORC;
+INSERT INTO TABLE orc_to_acid_compacted_tb PARTITION (part_col=101) VALUES (1,
'A'), (3, 'C');
+INSERT INTO TABLE orc_to_acid_compacted_tb PARTITION (part_col=102) VALUES (2,
'B');
+ALTER TABLE orc_to_acid_compacted_tb SET TBLPROPERTIES
('transactional'='true');
+ALTER TABLE orc_to_acid_compacted_tb partition(part_col='101') COMPACT 'major'
and wait;
+ALTER TABLE orc_to_acid_compacted_tb partition(part_col='102') COMPACT 'major'
and wait;
+INSERT INTO TABLE orc_to_acid_compacted_tb PARTITION (part_col=102) VALUES (4,
'D');
+update orc_to_acid_compacted_tb set value = "CC" where id = 3;
+update orc_to_acid_compacted_tb set value = "BB" where id = 2;
+
+
+create table orc_acid_minor (id INT, value STRING)
+CLUSTERED BY (id) INTO 3 BUCKETS
+STORED AS ORC
+TBLPROPERTIES ('transactional' = 'true');
+insert into orc_acid_minor values (1, 'A');
+insert into orc_acid_minor values (2, 'B');
+insert into orc_acid_minor values (3, 'C');
+update orc_acid_minor set value = "BB" where id = 2;
+ALTER TABLE orc_acid_minor COMPACT 'minor' and wait;
+insert into orc_acid_minor values (4, 'D');
+update orc_acid_minor set value = "DD" where id = 4;
+DELETE FROM orc_acid_minor WHERE id = 3;
+
+
+create table orc_acid_major (id INT, value STRING)
+CLUSTERED BY (id) INTO 3 BUCKETS
+STORED AS ORC
+TBLPROPERTIES ('transactional' = 'true');
+insert into orc_acid_major values (1, 'A');
+insert into orc_acid_major values (2, 'B');
+insert into orc_acid_major values (3, 'C');
+update orc_acid_major set value = "BB" where id = 2;
+ALTER TABLE orc_acid_major COMPACT 'minor' and wait;
+insert into orc_acid_major values (4, 'D');
+update orc_acid_major set value = "DD" where id = 4;
+DELETE FROM orc_acid_major WHERE id = 3;
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java
b/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java
index 71c7308b079..b554f508103 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java
@@ -30,6 +30,7 @@ import org.apache.doris.catalog.Type;
import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.Config;
import org.apache.doris.common.DdlException;
+import org.apache.doris.common.UserException;
import
Re: [PR] [fix](hive)fix hive insert only translaction table.(#45753)(#46385) [doris]
morningman merged PR #46454: URL: https://github.com/apache/doris/pull/46454 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](thrift) remove some useless thrift definitions [doris]
github-actions[bot] commented on PR #46492: URL: https://github.com/apache/doris/pull/46492#issuecomment-2574256798 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enchancement](join) do not build non-output column on join probe [doris]
github-actions[bot] commented on PR #46203: URL: https://github.com/apache/doris/pull/46203#issuecomment-2574268111 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enchancement](join) do not build non-output column on join probe [doris]
github-actions[bot] commented on PR #46203: URL: https://github.com/apache/doris/pull/46203#issuecomment-2574268068 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](variable) variable version not persist in image #46463 [doris]
dataroaring closed pull request #46499: branch-2.1: [fix](variable) variable version not persist in image #46463 URL: https://github.com/apache/doris/pull/46499 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] merge master [doris]
eldenmoon merged PR #46486: URL: https://github.com/apache/doris/pull/46486 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](MTMV) catch all exception when get mtmvs to avoid plan failed [doris]
morrySnow commented on PR #46474: URL: https://github.com/apache/doris/pull/46474#issuecomment-2574273524 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](variable) variable version not persist in image #46463 [doris]
hello-stephen commented on PR #46499: URL: https://github.com/apache/doris/pull/46499#issuecomment-2574275068 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](variable) variable version not persist in image #46463 [doris]
dataroaring closed pull request #46497: branch-3.0: [fix](variable) variable version not persist in image #46463 URL: https://github.com/apache/doris/pull/46497 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](variable) variable version not persist in image #46463 [doris]
Thearas commented on PR #46497: URL: https://github.com/apache/doris/pull/46497#issuecomment-2574274146 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](variable) variable version not persist in image #46463 [doris]
hello-stephen commented on PR #46499: URL: https://github.com/apache/doris/pull/46499#issuecomment-2574275126 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-2.1: [fix](variable) variable version not persist in image #46463 [doris]
github-actions[bot] opened a new pull request, #46499: URL: https://github.com/apache/doris/pull/46499 Cherry-picked from #46463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](shellcheck) fix hive-metastore and enable shellcheck in docker [doris]
suxiaogang223 commented on PR #46496: URL: https://github.com/apache/doris/pull/46496#issuecomment-2574275843 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [fix](variable) variable version not persist in image #46463 [doris]
github-actions[bot] opened a new pull request, #46497: URL: https://github.com/apache/doris/pull/46497 Cherry-picked from #46463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46463-branch-2.1 created (now 03a3f37cc4e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46463-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git at 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-46463-branch-2.1 updated (03a3f37cc4e -> 04b140ef211)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-46463-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from 03a3f37cc4e [fix](index meta) make has_inverted_index function more robust #46364 (#46428) add 04b140ef211 [fix](variable) variable version not persist in image (#46463) No new revisions were added by this update. Summary of changes: fe/fe-core/src/main/java/org/apache/doris/qe/GlobalVariable.java | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](HMSExternalTable) refactor code [doris]
morningman commented on code in PR #46466:
URL: https://github.com/apache/doris/pull/46466#discussion_r1904830394
##
fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSDlaTable.java:
##
@@ -0,0 +1,71 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.datasource.hive;
+
+import org.apache.doris.catalog.Column;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.MTMV;
+import org.apache.doris.catalog.PartitionItem;
+import org.apache.doris.catalog.PartitionType;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.common.DdlException;
+import org.apache.doris.datasource.mvcc.MvccSnapshot;
+import org.apache.doris.mtmv.MTMVBaseTableIf;
+import org.apache.doris.mtmv.MTMVRefreshContext;
+import org.apache.doris.mtmv.MTMVSnapshotIf;
+
+import java.util.List;
+import java.util.Map;
+import java.util.Optional;
+import java.util.Set;
+
+public abstract class HMSDlaTable implements MTMVBaseTableIf {
Review Comment:
Add some comment for this class.
eg, why need this class, what's is purpose?
##
fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveExternalTable.java:
##
@@ -0,0 +1,135 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.datasource.hive;
+
+import org.apache.doris.catalog.Column;
+import org.apache.doris.catalog.Env;
+import org.apache.doris.catalog.PartitionItem;
+import org.apache.doris.catalog.PartitionType;
+import org.apache.doris.common.AnalysisException;
+import org.apache.doris.datasource.mvcc.MvccSnapshot;
+import org.apache.doris.mtmv.MTMVMaxTimestampSnapshot;
+import org.apache.doris.mtmv.MTMVRefreshContext;
+import org.apache.doris.mtmv.MTMVSnapshotIf;
+import org.apache.doris.mtmv.MTMVTimestampSnapshot;
+
+import com.google.common.collect.Lists;
+import org.apache.commons.collections.CollectionUtils;
+
+import java.util.List;
+import java.util.Map;
+import java.util.Optional;
+import java.util.Set;
+
+public class HiveExternalTable extends HMSDlaTable {
Review Comment:
```suggestion
public class HiveDlaTable extends HMSDlaTable {
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](hms)fix hive catalog follower not get event. #46485 [doris]
doris-robot commented on PR #46491: URL: https://github.com/apache/doris/pull/46491#issuecomment-2574278148 TPC-H: Total hot run time: 40877 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7db9117b99002a9ef75cecabc4dc116d1fdc6ac0, data reload: false -- Round 1 -- q1 17602 743072517251 q2 2050169 158 158 q3 10596 108011811080 q4 10570 713 724 713 q5 7739283827942794 q6 242 157 151 151 q7 999 601 603 601 q8 9360196020491960 q9 6600641464146414 q10 6988227022822270 q11 470 256 266 256 q12 414 215 208 208 q13 17807 299429902990 q14 241 216 221 216 q15 588 526 530 526 q16 675 613 609 609 q17 979 587 554 554 q18 7294664866956648 q19 1406103310681033 q20 467 205 196 196 q21 4043330632543254 q22 1094997 995 995 Total cold run time: 108224 ms Total hot run time: 40877 ms - Round 2, with runtime_filter_mode=off - q1 7372732873057305 q2 324 238 232 232 q3 2907294229292929 q4 2057183018331830 q5 5752575557255725 q6 227 144 143 143 q7 2253178918771789 q8 3392362236633622 q9 9083919090769076 q10 3670360536343605 q11 621 520 515 515 q12 853 653 676 653 q13 16325 313532203135 q14 312 288 285 285 q15 587 541 555 541 q16 735 652 661 652 q17 1850165616431643 q18 8197767675937593 q19 1723152914701470 q20 2100185818501850 q21 5525545254605452 q22 1114104810481048 Total cold run time: 76979 ms Total hot run time: 61093 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](vec) opt the date/datetime is invalid func performance [doris]
github-actions[bot] commented on PR #41986: URL: https://github.com/apache/doris/pull/41986#issuecomment-2574280928 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](shellcheck) fix hive-metastore and enable shellcheck in docker [doris]
suxiaogang223 commented on PR #46496: URL: https://github.com/apache/doris/pull/46496#issuecomment-2574281017 run external -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](nereids) fix sql cache bug and some tests (#46443)
This is an automated email from the ASF dual-hosted git repository.
huajianlan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new e718c0b8d1a [fix](nereids) fix sql cache bug and some tests (#46443)
e718c0b8d1a is described below
commit e718c0b8d1ae104b5d7c005b6fe75246a6296e1e
Author: 924060929
AuthorDate: Tue Jan 7 10:44:54 2025 +0800
[fix](nereids) fix sql cache bug and some tests (#46443)
1. use retry to fix unstable test `colocate_union_numbers`,
`prune_bucket_with_bucket_shuffle_join`
2. fix failed test `explain`, this bug only exists in master branch,
introduced by #40202
3. fix sql cache bug which use stale cache after drop table and
create(table id changed), test in `parse_sql_from_sql_cache`, introduced
by #33262
4. regression test add `foreachFrontends`, `foreachBackends`, `retry`
function
---
.../doris/common/cache/NereidsSqlCacheManager.java | 62 +-
.../org/apache/doris/nereids/SqlCacheContext.java | 28 +-
.../org/apache/doris/nereids/StatementContext.java |2 +-
.../doris/nereids/trees/plans/AbstractPlan.java|4 +-
.../org/apache/doris/regression/suite/Suite.groovy | 39 +-
.../cache/parse_sql_from_sql_cache.groovy | 1536 ++--
.../distribute/colocate_union_numbers.groovy | 28 +-
.../prune_bucket_with_bucket_shuffle_join.groovy | 28 +-
.../suites/nereids_syntax_p0/explain.groovy|5 +-
9 files changed, 898 insertions(+), 834 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/common/cache/NereidsSqlCacheManager.java
b/fe/fe-core/src/main/java/org/apache/doris/common/cache/NereidsSqlCacheManager.java
index aba0decb76e..2aca4d5f1ef 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/common/cache/NereidsSqlCacheManager.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/common/cache/NereidsSqlCacheManager.java
@@ -23,6 +23,7 @@ import org.apache.doris.catalog.Env;
import org.apache.doris.catalog.OlapTable;
import org.apache.doris.catalog.Partition;
import org.apache.doris.catalog.TableIf;
+import org.apache.doris.catalog.TableIf.TableType;
import org.apache.doris.catalog.View;
import org.apache.doris.common.Config;
import org.apache.doris.common.ConfigBase.DefaultConfHandler;
@@ -39,6 +40,7 @@ import org.apache.doris.nereids.SqlCacheContext.CacheKeyType;
import org.apache.doris.nereids.SqlCacheContext.FullColumnName;
import org.apache.doris.nereids.SqlCacheContext.FullTableName;
import org.apache.doris.nereids.SqlCacheContext.ScanTable;
+import org.apache.doris.nereids.SqlCacheContext.TableVersion;
import org.apache.doris.nereids.StatementContext;
import org.apache.doris.nereids.analyzer.UnboundVariable;
import org.apache.doris.nereids.parser.NereidsParser;
@@ -199,14 +201,14 @@ public class NereidsSqlCacheManager {
.getSqlCacheContext().ifPresent(ctx ->
ctx.setCacheKeyType(CacheKeyType.MD5));
if (sqlCacheContextWithVariable != null) {
-return tryParseSqlWithoutCheckVariable(
-connectContext, md5CacheKey,
sqlCacheContextWithVariable, currentUserIdentity
+return tryParseSql(
+connectContext, md5CacheKey,
sqlCacheContextWithVariable, currentUserIdentity, true
);
} else {
return Optional.empty();
}
} else {
-return tryParseSqlWithoutCheckVariable(connectContext, key,
sqlCacheContext, currentUserIdentity);
+return tryParseSql(connectContext, key, sqlCacheContext,
currentUserIdentity, false);
}
}
@@ -223,9 +225,9 @@ public class NereidsSqlCacheManager {
return NereidsParser.removeCommentAndTrimBlank(sql);
}
-private Optional tryParseSqlWithoutCheckVariable(
-ConnectContext connectContext, String key,
-SqlCacheContext sqlCacheContext, UserIdentity currentUserIdentity)
{
+private Optional tryParseSql(
+ConnectContext connectContext, String key, SqlCacheContext
sqlCacheContext,
+UserIdentity currentUserIdentity, boolean checkUserVariable) {
Env env = connectContext.getEnv();
if (!tryLockTables(connectContext, env, sqlCacheContext)) {
@@ -259,8 +261,12 @@ public class NereidsSqlCacheManager {
try {
Optional resultSetInFe =
sqlCacheContext.getResultSetInFe();
-List currentVariables =
resolveUserVariables(sqlCacheContext);
-boolean usedVariablesChanged =
usedVariablesChanged(currentVariables, sqlCacheContext);
+List currentVariables = ImmutableList.of();
+if (checkUserVariable) {
+currentVariables = resolveUserVariables(sqlCacheContext);
+}
+boolean usedVariablesChanged
+= checkUs
Re: [PR] [fix](fe) Ignore `removeDroppedFrontends` when fe using metadata fail… [doris]
doris-robot commented on PR #46446: URL: https://github.com/apache/doris/pull/46446#issuecomment-2574286621 TPC-H: Total hot run time: 32543 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d35557bc5e8bafe12e983d55de45ec261107056d, data reload: false -- Round 1 -- q1 17590 614860056005 q2 2063300 172 172 q3 10419 1196732 732 q4 10230 866 441 441 q5 7948215819771977 q6 205 192 144 144 q7 890 766 600 600 q8 9227135711421142 q9 5271493049244924 q10 6782231318801880 q11 476 285 261 261 q12 341 363 236 236 q13 17858 370429962996 q14 239 240 216 216 q15 559 513 514 513 q16 658 631 582 582 q17 587 843 339 339 q18 6864651163366336 q19 1851964 553 553 q20 314 324 192 192 q21 3140223019921992 q22 364 335 310 310 Total cold run time: 103876 ms Total hot run time: 32543 ms - Round 2, with runtime_filter_mode=off - q1 6241619062286190 q2 241 327 235 235 q3 2216266823112311 q4 1437185013841384 q5 4311474548244745 q6 192 184 144 144 q7 2044194317911791 q8 2648287126852685 q9 7389733973067306 q10 3122333928702870 q11 572 528 485 485 q12 641 736 567 567 q13 3474385932203220 q14 278 306 301 301 q15 568 516 505 505 q16 662 696 661 661 q17 1221175212741274 q18 7622746374007400 q19 830 110811281108 q20 2086206818871887 q21 5813528349374937 q22 609 622 604 604 Total cold run time: 54217 ms Total hot run time: 52610 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Enhancement] Support for paimon 1.0 [doris]
medivh511 opened a new issue, #46500: URL: https://github.com/apache/doris/issues/46500 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description The paimon has released its latest stable version 1.0, please support for this version. Thanks! ### Solution _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) the config could not be modified on line #46470 [doris]
doris-robot commented on PR #46494: URL: https://github.com/apache/doris/pull/46494#issuecomment-2574279507 TPC-H: Total hot run time: 40687 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c8f0c2dbbe03d24607a315b5b6c4f19a4817ec6e, data reload: false -- Round 1 -- q1 17750 744772947294 q2 2133172 167 167 q3 11527 108611101086 q4 10216 734 692 692 q5 7740281627622762 q6 236 147 145 145 q7 966 628 609 609 q8 9343190519971905 q9 6636640863246324 q10 6927225722752257 q11 457 263 257 257 q12 408 216 217 216 q13 17770 298830082988 q14 249 211 209 209 q15 550 529 507 507 q16 658 607 617 607 q17 958 560 527 527 q18 7297670068236700 q19 1397982 984 982 q20 465 198 195 195 q21 4026336432773277 q22 1101995 981 981 Total cold run time: 108810 ms Total hot run time: 40687 ms - Round 2, with runtime_filter_mode=off - q1 7267720373007203 q2 328 247 226 226 q3 2949305530183018 q4 2023176517821765 q5 5652572857055705 q6 220 140 137 137 q7 2146177218011772 q8 3371351434493449 q9 8775885688178817 q10 3573353334903490 q11 603 516 500 500 q12 798 590 643 590 q13 8351310132293101 q14 312 296 291 291 q15 575 507 513 507 q16 700 651 673 651 q17 1808157315641564 q18 7835743974497439 q19 1649154115471541 q20 2054176118521761 q21 5430529853535298 q22 1034988 988 Total cold run time: 67530 ms Total hot run time: 59813 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) opt range inference for or expression when out of order [doris]
doris-robot commented on PR #46303: URL: https://github.com/apache/doris/pull/46303#issuecomment-2574284607 TPC-H: Total hot run time: 32772 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 166233f7a9445785d7ffcb47cb673035c839566a, data reload: false -- Round 1 -- q1 17586 615161096109 q2 2058296 174 174 q3 10518 1282752 752 q4 10261 860 440 440 q5 8754218819611961 q6 214 184 150 150 q7 889 748 616 616 q8 9234136011081108 q9 5203485249394852 q10 6755233118651865 q11 483 277 250 250 q12 350 372 234 234 q13 17924 382330763076 q14 255 233 217 217 q15 562 505 501 501 q16 622 602 592 592 q17 572 838 317 317 q18 6879645464906454 q19 22071034582 582 q20 315 315 186 186 q21 2790220620222022 q22 363 338 314 314 Total cold run time: 104794 ms Total hot run time: 32772 ms - Round 2, with runtime_filter_mode=off - q1 6325626662936266 q2 240 326 228 228 q3 2267263223152315 q4 1391180013301330 q5 4334473548624735 q6 189 185 144 144 q7 2052197717981798 q8 2661278826942694 q9 7285725272717252 q10 3056335728422842 q11 568 508 500 500 q12 652 743 565 565 q13 3492390331723172 q14 286 322 305 305 q15 569 536 512 512 q16 662 683 641 641 q17 1206172312641264 q18 7735752372557255 q19 822 115311501150 q20 1957213818671867 q21 5799529747774777 q22 625 654 577 577 Total cold run time: 54173 ms Total hot run time: 52189 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enchancement](join) do not build non-output column on join probe [doris]
BiteThet commented on PR #46203: URL: https://github.com/apache/doris/pull/46203#issuecomment-2574283672 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](mtmv) Optimize get available materialized view logic by reducing partition version comparison [doris]
doris-robot commented on PR #46479: URL: https://github.com/apache/doris/pull/46479#issuecomment-2574286536 TPC-H: Total hot run time: 32625 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 71ca154d6ca4f16389f8101b4f23efa8611cc3a2, data reload: false -- Round 1 -- q1 17576 610960056005 q2 2040309 164 164 q3 10445 1237753 753 q4 10246 862 436 436 q5 8287219019831983 q6 202 185 148 148 q7 892 761 614 614 q8 9231132511781178 q9 5237490850284908 q10 6759230118761876 q11 487 281 251 251 q12 342 362 218 218 q13 17804 387830333033 q14 236 223 213 213 q15 564 495 495 495 q16 626 633 577 577 q17 576 856 340 340 q18 6916642363696369 q19 2530951 539 539 q20 299 306 191 191 q21 2930220220182018 q22 351 338 316 316 Total cold run time: 104576 ms Total hot run time: 32625 ms - Round 2, with runtime_filter_mode=off - q1 6316641262056205 q2 232 323 224 224 q3 2224265922972297 q4 1437186214071407 q5 4320475048744750 q6 187 182 140 140 q7 2048196918181818 q8 2631280526582658 q9 7386730774117307 q10 3073338627512751 q11 579 516 528 516 q12 655 763 644 644 q13 3495379132753275 q14 301 304 280 280 q15 583 526 521 521 q16 659 685 648 648 q17 1217172612511251 q18 7613763874927492 q19 808 117811081108 q20 1967204019471947 q21 515950735073 q22 624 615 610 610 Total cold run time: 53910 ms Total hot run time: 52922 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids) fix sql cache bug and some tests [doris]
924060929 merged PR #46443: URL: https://github.com/apache/doris/pull/46443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](vec) opt the date/datetime is invalid func performance [doris]
HappenLee merged PR #41986: URL: https://github.com/apache/doris/pull/41986 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
