[GitHub] [doris] github-actions[bot] commented on pull request #21522: [improvement](memory) Refactor doris cache GC
github-actions[bot] commented on PR #21522: URL: https://github.com/apache/doris/pull/21522#issuecomment-1630260808 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21712: [Chore](status) avoid empty error msg on status (#21454)
github-actions[bot] commented on PR #21712: URL: https://github.com/apache/doris/pull/21712#issuecomment-1630263875 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21661: [pipeline](ckb) trigger new ckb pipeline, even pr id also run
github-actions[bot] commented on PR #21661: URL: https://github.com/apache/doris/pull/21661#issuecomment-1630266274 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann closed pull request #21687: [enhance](Nereids) remove unuseless stats calculation in CostAndEnforce
XieJiann closed pull request #21687: [enhance](Nereids) remove unuseless stats calculation in CostAndEnforce URL: https://github.com/apache/doris/pull/21687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #21706: [Bug](dynamic table) set all CreateTableStmt from cup parser dynamic table flag false
yiguolei merged PR #21706: URL: https://github.com/apache/doris/pull/21706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [Bug](dynamic table) set all CreateTableStmt from cup parser dynamic table flag false (#21706)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new b2c7a4575c [Bug](dynamic table) set all CreateTableStmt from cup
parser dynamic table flag false (#21706)
b2c7a4575c is described below
commit b2c7a4575c9fb3c420ac09205720ccfaf4d7895e
Author: lihangyu <15605149...@163.com>
AuthorDate: Tue Jul 11 15:23:27 2023 +0800
[Bug](dynamic table) set all CreateTableStmt from cup parser dynamic table
flag false (#21706)
---
fe/fe-core/src/main/cup/sql_parser.cup | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/fe/fe-core/src/main/cup/sql_parser.cup
b/fe/fe-core/src/main/cup/sql_parser.cup
index e3f0508543..ef95f1a5a5 100644
--- a/fe/fe-core/src/main/cup/sql_parser.cup
+++ b/fe/fe-core/src/main/cup/sql_parser.cup
@@ -1846,7 +1846,7 @@ create_stmt ::=
opt_ext_properties:extProperties
{:
RESULT = new CreateTableStmt(ifNotExists, isExternal, name, columns,
null, engineName, keys, partition,
-distribution, tblProperties, extProperties, tableComment, index, true);
+distribution, tblProperties, extProperties, tableComment, index,
false);
:}
| KW_CREATE opt_external:isExternal KW_TABLE opt_if_not_exists:ifNotExists
table_name:name
LPAREN column_definition_list:columns COMMA
index_definition_list:indexes RPAREN opt_engine:engineName
@@ -1872,7 +1872,7 @@ create_stmt ::=
opt_ext_properties:extProperties
{:
RESULT = new CreateTableStmt(ifNotExists, isExternal, name, columns,
indexes, engineName, keys, partition,
-distribution, tblProperties, extProperties, tableComment, index, true);
+distribution, tblProperties, extProperties, tableComment, index,
false);
:}
| KW_CREATE opt_external:isExternal KW_TABLE opt_if_not_exists:ifNotExists
table_name:name KW_ENGINE EQUAL ident:engineName
properties:properties opt_comment:tableComment
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21661: [pipeline](ckb) trigger new ckb pipeline, even pr id also run
github-actions[bot] commented on PR #21661: URL: https://github.com/apache/doris/pull/21661#issuecomment-1630289156 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #21661: [pipeline](ckb) trigger new ckb pipeline, even pr id also run
yiguolei merged PR #21661: URL: https://github.com/apache/doris/pull/21661 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [pipeline](ckb) trigger new ckb pipeline, even pr id also run (#21661)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 4cbd99ad9b [pipeline](ckb) trigger new ckb pipeline, even pr id also
run (#21661)
4cbd99ad9b is described below
commit 4cbd99ad9bf79575e99bfa8f4ef2c8ed7394b7cd
Author: Dongyang Li
AuthorDate: Tue Jul 11 15:24:26 2023 +0800
[pipeline](ckb) trigger new ckb pipeline, even pr id also run (#21661)
* [pipeline](ckb) also trigger new ckb pipeline
* [pipeline](ckb) all pr run ckb pipeline
* change required
-
Co-authored-by: stephen
---
.asf.yaml | 2 +-
.github/workflows/auto_trigger_teamcity.yml | 4 ++--
regression-test/pipeline/common/check-pr-if-need-run-build.sh | 1 -
3 files changed, 3 insertions(+), 4 deletions(-)
diff --git a/.asf.yaml b/.asf.yaml
index 80dd4aafb9..13c793e126 100644
--- a/.asf.yaml
+++ b/.asf.yaml
@@ -58,7 +58,7 @@ github:
- Build Documents
- BE UT (Clang)
- ShellCheck
- - clickbench (benchmark)
+ - clickbench-new (clickbench)
- BE UT (macOS)
- Build Third Party Libraries (Linux)
- Build Third Party Libraries (macOS)
diff --git a/.github/workflows/auto_trigger_teamcity.yml
b/.github/workflows/auto_trigger_teamcity.yml
index 9ffd5a8b92..b019946a1b 100644
--- a/.github/workflows/auto_trigger_teamcity.yml
+++ b/.github/workflows/auto_trigger_teamcity.yml
@@ -57,7 +57,7 @@ jobs:
echo "latest_commit_id : ${{ env.LATEST_COMMIT }}"
if [[ "${comment_message}" =~ "run" && "${comment_message}" =~
"buildall" && ! "${comment_message}" =~ "Thanks for your contribution" ]]; then
-trigger_pipelines="Doris_Doris_FeUt Doris_DorisBeUt_BeUt
Doris_DorisCompile_Compile Doris_Benchmark_Clickbench
Doris_ArmPipeline_P0Regression ${trigger_pipelines}"
+trigger_pipelines="Doris_Doris_FeUt Doris_DorisBeUt_BeUt
Doris_DorisCompile_Compile Doris_Benchmark_Clickbench
Doris_Performance_Clickbench_ClickbenchNew Doris_ArmPipeline_P0Regression
${trigger_pipelines}"
fi
if [[ "${comment_message}" =~ "run" && ( "${comment_message}" =~
"p0" || "${comment_message}" =~ "external" ) && ! "${comment_message}" =~
"Thanks for your contribution" ]]; then
trigger_pipelines="Doris_DorisRegression_P0Regression
${trigger_pipelines}"
@@ -78,7 +78,7 @@ jobs:
trigger_pipelines="Doris_DorisCompile_Compile
${trigger_pipelines}"
fi
if [[ "${comment_message}" =~ "run" && "${comment_message}" =~
"clickbench" && ! "${comment_message}" =~ "Thanks for your contribution" ]];
then
-trigger_pipelines="Doris_Benchmark_Clickbench
${trigger_pipelines}"
+trigger_pipelines="Doris_Benchmark_Clickbench
Doris_Performance_Clickbench_ClickbenchNew ${trigger_pipelines}"
fi
if [[ "${comment_message}" =~ "run" && "${comment_message}" =~ "arm"
&& ! "${comment_message}" =~ "Thanks for your contribution" ]]; then
trigger_pipelines="Doris_ArmPipeline_P0Regression
${trigger_pipelines}"
diff --git a/regression-test/pipeline/common/check-pr-if-need-run-build.sh
b/regression-test/pipeline/common/check-pr-if-need-run-build.sh
index 5fd8016f30..77eced6422 100755
--- a/regression-test/pipeline/common/check-pr-if-need-run-build.sh
+++ b/regression-test/pipeline/common/check-pr-if-need-run-build.sh
@@ -142,7 +142,6 @@ need_run_arm_regression_p0() {
}
need_run_ckb() {
-if [[ $(($1 % 2)) -eq 0 ]]; then echo "the pull request id is even, return
no need" && return 1; fi
if ! _get_pr_changed_files "$1"; then echo "get pr changed files failed,
return need" && return 0; fi
for af in ${all_files}; do
if [[ "${af}" == 'be'* ]] ||
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei closed pull request #21552: Bump google.golang.org/grpc from 1.41.0 to 1.53.0 in /extension/beats
yiguolei closed pull request #21552: Bump google.golang.org/grpc from 1.41.0 to 1.53.0 in /extension/beats URL: https://github.com/apache/doris/pull/21552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dependabot[bot] commented on pull request #21552: Bump google.golang.org/grpc from 1.41.0 to 1.53.0 in /extension/beats
dependabot[bot] commented on PR #21552: URL: https://github.com/apache/doris/pull/21552#issuecomment-1630293009 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei closed pull request #21550: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /fe
yiguolei closed pull request #21550: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /fe URL: https://github.com/apache/doris/pull/21550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dependabot[bot] commented on pull request #21550: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /fe
dependabot[bot] commented on PR #21550: URL: https://github.com/apache/doris/pull/21550#issuecomment-1630293220 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dependabot/go_modules/extension/beats/google.golang.org/grpc-1.53.0 deleted (was 6186fb6a53)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/extension/beats/google.golang.org/grpc-1.53.0 in repository https://gitbox.apache.org/repos/asf/doris.git was 6186fb6a53 Bump google.golang.org/grpc from 1.41.0 to 1.53.0 in /extension/beats The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei closed pull request #21551: Bump grpc-protobuf from 1.44.1 to 1.53.0 in /samples/doris-demo/remote-udf-java-demo
yiguolei closed pull request #21551: Bump grpc-protobuf from 1.44.1 to 1.53.0 in /samples/doris-demo/remote-udf-java-demo URL: https://github.com/apache/doris/pull/21551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dependabot/maven/fe/io.grpc-grpc-protobuf-1.53.0 deleted (was a562c20b03)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/fe/io.grpc-grpc-protobuf-1.53.0 in repository https://gitbox.apache.org/repos/asf/doris.git was a562c20b03 Bump grpc-protobuf from 1.30.0 to 1.53.0 in /fe The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dependabot[bot] commented on pull request #21551: Bump grpc-protobuf from 1.44.1 to 1.53.0 in /samples/doris-demo/remote-udf-java-demo
dependabot[bot] commented on PR #21551: URL: https://github.com/apache/doris/pull/21551#issuecomment-1630293684 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann commented on pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost
XieJiann commented on PR #21693: URL: https://github.com/apache/doris/pull/21693#issuecomment-1630293802 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei closed pull request #21549: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /samples/doris-demo/remote-udaf-java-demo
yiguolei closed pull request #21549: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /samples/doris-demo/remote-udaf-java-demo URL: https://github.com/apache/doris/pull/21549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dependabot[bot] commented on pull request #21549: Bump grpc-protobuf from 1.30.0 to 1.53.0 in /samples/doris-demo/remote-udaf-java-demo
dependabot[bot] commented on PR #21549: URL: https://github.com/apache/doris/pull/21549#issuecomment-1630293894 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dependabot/maven/samples/doris-demo/remote-udf-java-demo/io.grpc-grpc-protobuf-1.53.0 deleted (was c0268598af)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/samples/doris-demo/remote-udf-java-demo/io.grpc-grpc-protobuf-1.53.0 in repository https://gitbox.apache.org/repos/asf/doris.git was c0268598af Bump grpc-protobuf in /samples/doris-demo/remote-udf-java-demo The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch dependabot/maven/samples/doris-demo/remote-udaf-java-demo/io.grpc-grpc-protobuf-1.53.0 deleted (was 932fea7706)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/samples/doris-demo/remote-udaf-java-demo/io.grpc-grpc-protobuf-1.53.0 in repository https://gitbox.apache.org/repos/asf/doris.git was 932fea7706 Bump grpc-protobuf in /samples/doris-demo/remote-udaf-java-demo The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] HHoflittlefish777 commented on pull request #21634: [Refactor](load) refactor memtable flush actively
HHoflittlefish777 commented on PR #21634: URL: https://github.com/apache/doris/pull/21634#issuecomment-1630322883 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21619: [fix](mow) fix flush_single_block core in calc_segment_delete_bitmap
github-actions[bot] commented on PR #21619: URL: https://github.com/apache/doris/pull/21619#issuecomment-1630329004 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21619: [fix](mow) fix flush_single_block core in calc_segment_delete_bitmap
github-actions[bot] commented on PR #21619: URL: https://github.com/apache/doris/pull/21619#issuecomment-1630329075 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost
hello-stephen commented on PR #21693: URL: https://github.com/apache/doris/pull/21693#issuecomment-1630331042 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 49.27 seconds stream load tsv: 456 seconds loaded 74807831229 Bytes, about 156 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 57 seconds loaded 1101869774 Bytes, about 18 MB/s stream load parquet: 29 seconds loaded 861443392 Bytes, about 28 MB/s insert into select: 25.7 seconds inserted 1000 Rows, about 389K ops/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711075332_clickbench_pr_176295.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21696: [Fix](executor)Fix scan entity core
github-actions[bot] commented on PR #21696: URL: https://github.com/apache/doris/pull/21696#issuecomment-1630331595 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21696: [Fix](executor)Fix scan entity core
github-actions[bot] commented on PR #21696: URL: https://github.com/apache/doris/pull/21696#issuecomment-1630331673 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #21696: [Fix](executor)Fix scan entity core
yiguolei merged PR #21696: URL: https://github.com/apache/doris/pull/21696 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [Fix](executor)Fix scan entity core #21696
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new d3317aa33b [Fix](executor)Fix scan entity core #21696
d3317aa33b is described below
commit d3317aa33b9a01bb3b5ebad1e761df5ea38e747c
Author: wangbo
AuthorDate: Tue Jul 11 15:56:13 2023 +0800
[Fix](executor)Fix scan entity core #21696
After the last time to call scan_task.scan_func()，the should be ended, this
means PipelineFragmentContext could be released.
Then after PipelineFragmentContext is released, visiting its field such as
query_ctx or _state may cause core dump.
But it can only explain core 2
void ScannerScheduler::_task_group_scanner_scan(ScannerScheduler* scheduler,
taskgroup::ScanTaskTaskGroupQueue* scan_queue) {
while (!_is_closed) {
taskgroup::ScanTask scan_task;
auto success = scan_queue->take(&scan_task);
if (success) {
int64_t time_spent = 0;
{
SCOPED_RAW_TIMER(&time_spent);
scan_task.scan_func();
}
scan_queue->update_statistics(scan_task, time_spent);
}
}
}
---
be/src/vec/exec/scan/scan_task_queue.cpp | 11 +++
be/src/vec/exec/scan/scan_task_queue.h | 4 +++-
be/src/vec/exec/scan/scanner_scheduler.cpp | 4 +++-
3 files changed, 13 insertions(+), 6 deletions(-)
diff --git a/be/src/vec/exec/scan/scan_task_queue.cpp
b/be/src/vec/exec/scan/scan_task_queue.cpp
index 538f77211c..89235b6b7a 100644
--- a/be/src/vec/exec/scan/scan_task_queue.cpp
+++ b/be/src/vec/exec/scan/scan_task_queue.cpp
@@ -24,11 +24,14 @@
namespace doris {
namespace taskgroup {
static void empty_function() {}
-ScanTask::ScanTask() : ScanTask(empty_function, nullptr, 1) {}
+ScanTask::ScanTask() : ScanTask(empty_function, nullptr, nullptr, 1) {}
ScanTask::ScanTask(WorkFunction scan_func, vectorized::ScannerContext*
scanner_context,
- int priority)
-: scan_func(std::move(scan_func)), scanner_context(scanner_context),
priority(priority) {}
+ TGSTEntityPtr scan_entity, int priority)
+: scan_func(std::move(scan_func)),
+ scanner_context(scanner_context),
+ scan_entity(scan_entity),
+ priority(priority) {}
ScanTaskQueue::ScanTaskQueue() :
_queue(config::doris_scanner_thread_pool_queue_size) {}
@@ -98,7 +101,7 @@ bool ScanTaskTaskGroupQueue::push_back(ScanTask scan_task) {
}
void ScanTaskTaskGroupQueue::update_statistics(ScanTask scan_task, int64_t
time_spent) {
-auto* entity =
scan_task.scanner_context->get_task_group()->local_scan_task_entity();
+auto* entity = scan_task.scan_entity;
std::unique_lock lock(_rs_mutex);
auto find_entity = _group_entities.find(entity);
bool is_in_queue = find_entity != _group_entities.end();
diff --git a/be/src/vec/exec/scan/scan_task_queue.h
b/be/src/vec/exec/scan/scan_task_queue.h
index f3c3b792a4..c694859e3c 100644
--- a/be/src/vec/exec/scan/scan_task_queue.h
+++ b/be/src/vec/exec/scan/scan_task_queue.h
@@ -33,7 +33,8 @@ static constexpr auto WAIT_CORE_TASK_TIMEOUT_MS = 100;
// Like PriorityThreadPool::Task
struct ScanTask {
ScanTask();
-ScanTask(WorkFunction scan_func, vectorized::ScannerContext*
scanner_context, int priority);
+ScanTask(WorkFunction scan_func, vectorized::ScannerContext*
scanner_context,
+ TGSTEntityPtr scan_entity, int priority);
bool operator<(const ScanTask& o) const { return priority < o.priority; }
ScanTask& operator++() {
priority += 2;
@@ -42,6 +43,7 @@ struct ScanTask {
WorkFunction scan_func;
vectorized::ScannerContext* scanner_context;
+TGSTEntityPtr scan_entity;
int priority;
};
diff --git a/be/src/vec/exec/scan/scanner_scheduler.cpp
b/be/src/vec/exec/scan/scanner_scheduler.cpp
index a798d097a2..c37760167f 100644
--- a/be/src/vec/exec/scan/scanner_scheduler.cpp
+++ b/be/src/vec/exec/scan/scanner_scheduler.cpp
@@ -226,7 +226,9 @@ void ScannerScheduler::_schedule_scanners(ScannerContext*
ctx) {
auto work_func = [this, scanner = *iter, ctx] {
this->_scanner_scan(this, ctx, scanner);
};
-taskgroup::ScanTask scan_task = {work_func, ctx, nice};
+taskgroup::ScanTask scan_task = {
+work_func, ctx,
ctx->get_task_group()->local_scan_task_entity(),
+nice};
ret =
_task_group_local_scan_queue->push_back(scan_task);
} else {
PriorityThreadPool::Task task;
---
[doris] branch master updated (d3317aa33b -> da86d2ff65)
This is an automated email from the ASF dual-hosted git repository. dataroaring pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from d3317aa33b [Fix](executor)Fix scan entity core #21696 add da86d2ff65 [fix](mow) fix flush_single_block core in calc_segment_delete_bitmap (#21619) No new revisions were added by this update. Summary of changes: be/src/olap/rowset/beta_rowset_writer.cpp | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21501: [log](profile) add doris version info to query profile
github-actions[bot] commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630335207 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21501: [log](profile) add doris version info to query profile
github-actions[bot] commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630335288 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring merged pull request #21619: [fix](mow) fix flush_single_block core in calc_segment_delete_bitmap
dataroaring merged PR #21619: URL: https://github.com/apache/doris/pull/21619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost
hello-stephen commented on PR #21693: URL: https://github.com/apache/doris/pull/21693#issuecomment-1630338399 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 53.48 seconds stream load tsv: 500 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.5 seconds inserted 1000 Rows, about 350K ops/s storage size: 17164743689 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711155843_clickbench_pr_176296.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost
hello-stephen commented on PR #21693: URL: https://github.com/apache/doris/pull/21693#issuecomment-1630340954 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 55.78 seconds stream load tsv: 502 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.6 seconds inserted 1000 Rows, about 349K ops/s storage size: 17170275794 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711160032_clickbench_pr_176298.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #21539: [Enhancement](Nereids)enable nereids DML by default.
sohardforaname commented on PR #21539: URL: https://github.com/apache/doris/pull/21539#issuecomment-1630341435 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dutyu commented on pull request #21589: [Enhancement](multi-catalog) Merge hms events every round to speed up events processing.
dutyu commented on PR #21589: URL: https://github.com/apache/doris/pull/21589#issuecomment-1630351814 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21326: [enhancement](nereids) Support or to in conversion
github-actions[bot] commented on PR #21326: URL: https://github.com/apache/doris/pull/21326#issuecomment-1630359971 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21326: [enhancement](nereids) Support or to in conversion
github-actions[bot] commented on PR #21326: URL: https://github.com/apache/doris/pull/21326#issuecomment-1630360053 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21377: [improvement](nereids) show stats with updated time
github-actions[bot] commented on PR #21377: URL: https://github.com/apache/doris/pull/21377#issuecomment-1630361073 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21377: [improvement](nereids) show stats with updated time
github-actions[bot] commented on PR #21377: URL: https://github.com/apache/doris/pull/21377#issuecomment-1630361142 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dutyu commented on pull request #21589: [Enhancement](multi-catalog) Merge hms events every round to speed up events processing.
dutyu commented on PR #21589: URL: https://github.com/apache/doris/pull/21589#issuecomment-1630362880 > Do we need to refine the canBeBatched logic for add partition event, alter partition event, and drop partition event? For example, the drop partition can ignore the previous add partition and alter partition I think it's worth to do, but i do not overwrite it now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 opened a new pull request, #21713: [imporve](udaf) refactor java-udaf executor by using for loop
zhangstar333 opened a new pull request, #21713: URL: https://github.com/apache/doris/pull/21713 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21469: [enhancement](nereids) Update consumer's stats
github-actions[bot] commented on PR #21469: URL: https://github.com/apache/doris/pull/21469#issuecomment-1630368720 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21469: [enhancement](nereids) Update consumer's stats
github-actions[bot] commented on PR #21469: URL: https://github.com/apache/doris/pull/21469#issuecomment-1630368788 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zclllyybb commented on pull request #21501: [log](profile) add doris version info to query profile
zclllyybb commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630370321 run build all -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #21024: [Fix](planner)fix failed running alias function with an alias function in original function.
sohardforaname commented on PR #21024: URL: https://github.com/apache/doris/pull/21024#issuecomment-1630370694 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zclllyybb commented on pull request #21501: [log](profile) add doris version info to query profile
zclllyybb commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630370718 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21528: [enhancement](nereids) Update tbl stats after system job succeeded
github-actions[bot] commented on PR #21528: URL: https://github.com/apache/doris/pull/21528#issuecomment-1630371029 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21528: [enhancement](nereids) Update tbl stats after system job succeeded
github-actions[bot] commented on PR #21528: URL: https://github.com/apache/doris/pull/21528#issuecomment-1630371102 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] englefly commented on pull request #21377: [improvement](stats) show stats with updated time
englefly commented on PR #21377: URL: https://github.com/apache/doris/pull/21377#issuecomment-1630371858 说明部分是不是给反了，before和after -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #21497: [Fix](planner)fix rewritten alias function's original function is not analyzed again
sohardforaname commented on PR #21497: URL: https://github.com/apache/doris/pull/21497#issuecomment-1630377095 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #18257: [Feature](Nereids)support udf for Nereids
sohardforaname commented on PR #18257: URL: https://github.com/apache/doris/pull/18257#issuecomment-1630378009 run fe ut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xutaoustc opened a new issue, #21714: [Enhancement] show stream load does not show transaction ID
xutaoustc opened a new issue, #21714: URL: https://github.com/apache/doris/issues/21714 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description show stream load does not show transaction ID ### Solution Should show the transaction ID in streamLoad ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei commented on pull request #21482: [enhancement](nereids) Sync stats across FE cluster after analyze
yiguolei commented on PR #21482: URL: https://github.com/apache/doris/pull/21482#issuecomment-1630391160 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhannngchen commented on pull request #21571: [Fix](Core) Fix core caused by null MowContext ptr
zhannngchen commented on PR #21571: URL: https://github.com/apache/doris/pull/21571#issuecomment-1630406206 it's fixed by #21619, we can close this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #21635: [refactor](load) cleanup segment flush logic in beta rowset writer
kaijchen commented on PR #21635: URL: https://github.com/apache/doris/pull/21635#issuecomment-1630412720 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 commented on pull request #21713: [imporve](udaf) refactor java-udaf executor by using for loop
zhangstar333 commented on PR #21713: URL: https://github.com/apache/doris/pull/21713#issuecomment-1630415765 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21635: [refactor](load) cleanup segment flush logic in beta rowset writer
github-actions[bot] commented on PR #21635: URL: https://github.com/apache/doris/pull/21635#issuecomment-1630416456 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] amorynan opened a new pull request, #21716: [FIX](serde)Fix decimal for arrow serde
amorynan opened a new pull request, #21716: URL: https://github.com/apache/doris/pull/21716 ## Proposed changes Issue Number: close #xxx when read decimal value from arrow serde , got wrong value. ``` mysql> select f_decimal from doris_source_test_numberic; +--+ | f_decimal | +--+ | -123456789012.123456 | | 0.00 | | 123456789012.123456 | +--+ 3 rows in set (0.01 sec)mysql> desc doris_source_test_numberic -> ; ++--+--+---+-+---+ | Field | Type | Null | Key | Default | Extra | ++--+--+---+-+---+ | f_int | INT | Yes | true | NULL | | | f_bigint | BIGINT | Yes | false | NULL | NONE | | f_tinyint | TINYINT | Yes | false | NULL | NONE | | f_smallint | SMALLINT | Yes | false | NULL | NONE | | f_largeint | LARGEINT | Yes | false | NULL | NONE | | f_float | FLOAT | Yes | false | NULL | NONE | | f_double | DOUBLE | Yes | false | NULL | NONE | | f_decimal | DECIMALV3(18, 6) | Yes | false | NULL | NONE | ++--+--+---+-+---+ 8 rows in set (0.00 sec) ```  ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange opened a new pull request, #21715: [imporve](bloomfilter) refactor runtime_filter_mgr with bloomfilter
Mryange opened a new pull request, #21715: URL: https://github.com/apache/doris/pull/21715 ## Proposed changes 1. Reduced the granularity of the lock. In the past, the entire map was locked 2. map --> map 3. The first bf does not need to init ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt opened a new pull request, #21717: [Chore](column) remove unused code of predicate_column
BiteThet opened a new pull request, #21717: URL: https://github.com/apache/doris/pull/21717 ## Proposed changes remove unused code of predicate_column ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on pull request #21717: [Chore](column) remove unused code of predicate_column
BiteThet commented on PR #21717: URL: https://github.com/apache/doris/pull/21717#issuecomment-1630444686 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] englefly commented on pull request #21326: [enhancement](nereids) Support or to in conversion
englefly commented on PR #21326: URL: https://github.com/apache/doris/pull/21326#issuecomment-1630443763 this pr does not cover some cases which are covered by original planner. refer to ut: testWideCommonFactorsWithEqualPredicate() (tb1.k1=1 and tb2.k1=1) or (tb1.k1 =2 and tb2.k1=2) => tb1.k1 in (1, 2) and tb2.k1 in (1, 2) and [...] we need another pr to fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21539: [Enhancement](Nereids)enable nereids DML by default.
hello-stephen commented on PR #21539: URL: https://github.com/apache/doris/pull/21539#issuecomment-1630445352 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 51.44 seconds stream load tsv: 439 seconds loaded 74807831229 Bytes, about 162 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 57 seconds loaded 1101869774 Bytes, about 18 MB/s stream load parquet: 28 seconds loaded 861443392 Bytes, about 29 MB/s insert into select: 26.0 seconds inserted 1000 Rows, about 384K ops/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711090557_clickbench_pr_176310.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21716: [FIX](serde)Fix decimal for arrow serde
github-actions[bot] commented on PR #21716: URL: https://github.com/apache/doris/pull/21716#issuecomment-1630447051 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on pull request #21717: [Chore](column) remove unused code of predicate_column
BiteThet commented on PR #21717: URL: https://github.com/apache/doris/pull/21717#issuecomment-1630448786 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann commented on pull request #21660: [fix](Nereids) build internal table in FeService
XieJiann commented on PR #21660: URL: https://github.com/apache/doris/pull/21660#issuecomment-1630451671 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21539: [Enhancement](Nereids)enable nereids DML by default.
hello-stephen commented on PR #21539: URL: https://github.com/apache/doris/pull/21539#issuecomment-1630453852 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 56.4 seconds stream load tsv: 501 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.0 seconds inserted 1000 Rows, about 344K ops/s storage size: 17165608673 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711171155_clickbench_pr_176313.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21501: [log](profile) add doris version info to query profile
hello-stephen commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630453692 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 52.04 seconds stream load tsv: 501 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.7 seconds inserted 1000 Rows, about 348K ops/s storage size: 17166280680 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711171147_clickbench_pr_176331.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21501: [log](profile) add doris version info to query profile
hello-stephen commented on PR #21501: URL: https://github.com/apache/doris/pull/21501#issuecomment-1630453528 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 54.06 seconds stream load tsv: 502 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.1 seconds inserted 1000 Rows, about 343K ops/s storage size: 17169056973 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711171141_clickbench_pr_176335.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21717: [Chore](column) remove unused code of predicate_column
github-actions[bot] commented on PR #21717: URL: https://github.com/apache/doris/pull/21717#issuecomment-1630454398 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21539: [Enhancement](Nereids)enable nereids DML by default.
hello-stephen commented on PR #21539: URL: https://github.com/apache/doris/pull/21539#issuecomment-1630455097 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 51.74 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.9 seconds inserted 1000 Rows, about 346K ops/s storage size: 17163982675 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711171243_clickbench_pr_176311.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21716: [FIX](serde)Fix decimal for arrow serde
github-actions[bot] commented on PR #21716: URL: https://github.com/apache/doris/pull/21716#issuecomment-1630456359 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21716: [FIX](serde)Fix decimal for arrow serde
github-actions[bot] commented on PR #21716: URL: https://github.com/apache/doris/pull/21716#issuecomment-1630456430 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] amorynan commented on pull request #21716: [FIX](serde)Fix decimal for arrow serde
amorynan commented on PR #21716: URL: https://github.com/apache/doris/pull/21716#issuecomment-1630457068 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #21717: [Chore](column) remove unused code of predicate_column
github-actions[bot] commented on PR #21717: URL: https://github.com/apache/doris/pull/21717#issuecomment-1630459109 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21497: [Fix](planner)fix rewritten alias function's original function is not analyzed again
hello-stephen commented on PR #21497: URL: https://github.com/apache/doris/pull/21497#issuecomment-1630464626 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 53.64 seconds stream load tsv: 501 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 30 seconds loaded 861443392 Bytes, about 27 MB/s insert into select: 89.1 seconds inserted 1000 Rows, about 112K ops/s storage size: 17162152081 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711171909_clickbench_pr_176340.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 closed pull request #21672: [typo](docs) remove invalid document descriptions and uri
vinlee19 closed pull request #21672: [typo](docs) remove invalid document descriptions and uri URL: https://github.com/apache/doris/pull/21672 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21635: [refactor](load) cleanup segment flush logic in beta rowset writer
hello-stephen commented on PR #21635: URL: https://github.com/apache/doris/pull/21635#issuecomment-1630471002 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 54.57 seconds stream load tsv: 502 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.6 seconds inserted 1000 Rows, about 349K ops/s storage size: 17161465078 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711172338_clickbench_pr_176352.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] starocean999 opened a new pull request, #21718: [fix](draft)push conjuncts into SetOperationStmt inline view
starocean999 opened a new pull request, #21718: URL: https://github.com/apache/doris/pull/21718 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] starocean999 commented on pull request #21718: [fix](draft)push conjuncts into SetOperationStmt inline view
starocean999 commented on PR #21718: URL: https://github.com/apache/doris/pull/21718#issuecomment-1630473504 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21589: [Enhancement](multi-catalog) Merge hms events every round to speed up events processing.
hello-stephen commented on PR #21589: URL: https://github.com/apache/doris/pull/21589#issuecomment-1630475214 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.75 seconds stream load tsv: 502 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 28.4 seconds inserted 1000 Rows, about 352K ops/s storage size: 17169533993 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711172644_clickbench_pr_176364.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] freemandealer commented on pull request #21634: [Refactor](load) refactor memtable flush actively
freemandealer commented on PR #21634: URL: https://github.com/apache/doris/pull/21634#issuecomment-1630479607 run p1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21497: [Fix](planner)fix rewritten alias function's original function is not analyzed again
hello-stephen commented on PR #21497: URL: https://github.com/apache/doris/pull/21497#issuecomment-1630483491 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 49.63 seconds stream load tsv: 450 seconds loaded 74807831229 Bytes, about 158 MB/s stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s stream load orc: 57 seconds loaded 1101869774 Bytes, about 18 MB/s stream load parquet: 28 seconds loaded 861443392 Bytes, about 29 MB/s insert into select: 67.7 seconds inserted 1000 Rows, about 147K ops/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711093252_clickbench_pr_176339.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #20716: [Feature](Nereids) Add nereids unit test and refactor user feature of minidump
github-actions[bot] commented on PR #20716:
URL: https://github.com/apache/doris/pull/20716#issuecomment-163049
`sh-checker report`
To get the full details, please check in the
[job]("https://github.com/apache/doris/actions/runs/5518339933";) output.
shellcheck errors
```
'shellcheck ' returned error 1 finding the following syntactical issues:
--
In minidump/nereids_ut.sh line 172:
${JAVA} "${final_java_opt}" -Xmx2g
org.apache.doris.nereids.minidump.Minidump "${dir}" "${OPT_VERSION}" "$@" >
"${temp_file}"result=$(cat "${temp_file}")
^^ SC2094 (info): Make
sure not to read and write the same file in the same pipeline.
^---^ SC2046 (warning): Quote this to prevent word splitting.
^^ SC2094 (info): Make sure not to read and write the same file in
the same pipeline.
For more information:
https://www.shellcheck.net/wiki/SC2046 -- Quote this to prevent word
splitt...
https://www.shellcheck.net/wiki/SC2094 -- Make sure not to read and write
t...
--
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=
above the line that contains the issue, where is the error code;
3. Add '-e ' to the SHELLCHECK_OPTS setting in your .yml action file.
```
shfmt errors
```
'shfmt ' returned error 1 finding the following formatting issues:
--
--- minidump/nereids_ut.sh.orig
+++ minidump/nereids_ut.sh
@@ -169,7 +169,7 @@
if [[ -d "${dir}" ]]; then # Check if the path is a directory
query_id=${dir: -33}
temp_file=${LOG_DIR}/temp
-${JAVA} "${final_java_opt}" -Xmx2g
org.apache.doris.nereids.minidump.Minidump "${dir}" "${OPT_VERSION}" "$@" >
"${temp_file}"result=$(cat "${temp_file}")
+${JAVA} "${final_java_opt}" -Xmx2g
org.apache.doris.nereids.minidump.Minidump "${dir}" "${OPT_VERSION}" "$@"
result=$(cat "${temp_file}") >"${temp_file}"
echo "${query_id_head} ${query_id} ${sql_head} ${result}" | tee
>>"${LOG_DIR}/minidump.out"
fi
done
--
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #20716: [Feature](Nereids) Add nereids unit test and refactor user feature of minidump
github-actions[bot] commented on PR #20716:
URL: https://github.com/apache/doris/pull/20716#issuecomment-1630504822
`sh-checker report`
To get the full details, please check in the
[job]("https://github.com/apache/doris/actions/runs/5518366132";) output.
shellcheck errors
```
'shellcheck ' returned error 1 finding the following syntactical issues:
--
In minidump/nereids_ut.sh line 172:
${JAVA} "${final_java_opt}" -Xmx2g
org.apache.doris.nereids.minidump.Minidump "${dir}" "${OPT_VERSION}" "$@"
result=$(cat "${temp_file}") >"${temp_file}"
^---^ SC2046
(warning): Quote this to prevent word splitting.
^^ SC2094
(info): Make sure not to read and write the same file in the same pipeline.
^^ SC2094 (info): Make sure not to read and write the same file in
the same pipeline.
For more information:
https://www.shellcheck.net/wiki/SC2046 -- Quote this to prevent word
splitt...
https://www.shellcheck.net/wiki/SC2094 -- Make sure not to read and write
t...
--
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=
above the line that contains the issue, where is the error code;
3. Add '-e ' to the SHELLCHECK_OPTS setting in your .yml action file.
```
shfmt errors
```
'shfmt ' found no issues.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] freemandealer opened a new pull request, #21719: [fix](config) set FE header size limit to 1MB from 10k
freemandealer opened a new pull request, #21719: URL: https://github.com/apache/doris/pull/21719 Enlarge jetty_server_max_http_header_size to avoid Request Header Fields Too Large error when streamloading to FE. ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 closed pull request #21720: [typo](docs) : modify bitmap_and_not document
vinlee19 closed pull request #21720: [typo](docs) : modify bitmap_and_not document URL: https://github.com/apache/doris/pull/21720 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 opened a new pull request, #21720: [typo](docs) : modify bitmap_and_not document
vinlee19 opened a new pull request, #21720: URL: https://github.com/apache/doris/pull/21720 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21635: [refactor](load) cleanup segment flush logic in beta rowset writer
hello-stephen commented on PR #21635: URL: https://github.com/apache/doris/pull/21635#issuecomment-1630531018 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.75 seconds stream load tsv: 445 seconds loaded 74807831229 Bytes, about 160 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 56 seconds loaded 1101869774 Bytes, about 18 MB/s stream load parquet: 28 seconds loaded 861443392 Bytes, about 29 MB/s insert into select: 25.9 seconds inserted 1000 Rows, about 386K ops/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711095933_clickbench_pr_176357.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-thirdparty] qidaye merged pull request #99: [Compile] fix compile problem
qidaye merged PR #99: URL: https://github.com/apache/doris-thirdparty/pull/99 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-thirdparty] branch clucene updated: [Compile] fix compile problem (#99)
This is an automated email from the ASF dual-hosted git repository.
jianliangqi pushed a commit to branch clucene
in repository https://gitbox.apache.org/repos/asf/doris-thirdparty.git
The following commit(s) were added to refs/heads/clucene by this push:
new 34c2c671 [Compile] fix compile problem (#99)
34c2c671 is described below
commit 34c2c6712e27a8c94e9cdb426a0a74ad4bd7d7e5
Author: airborne12
AuthorDate: Tue Jul 11 17:59:35 2023 +0800
[Compile] fix compile problem (#99)
---
src/core/CLucene/analysis/AnalysisHeader.h | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/src/core/CLucene/analysis/AnalysisHeader.h
b/src/core/CLucene/analysis/AnalysisHeader.h
index c1d3381f..8a52350c 100644
--- a/src/core/CLucene/analysis/AnalysisHeader.h
+++ b/src/core/CLucene/analysis/AnalysisHeader.h
@@ -10,7 +10,6 @@
#include "CLucene/index/Payload.h"
#include "CLucene/util/VoidList.h"
#include "CLucene/LuceneThreads.h"
-#include "CLucene/config/repl_tchar.h"
CL_CLASS_DEF(util,Reader)
CL_CLASS_DEF(util,IReader)
@@ -227,7 +226,7 @@ inline size_t Token::termLength(){
template <>
inline size_t Token::termLength(){
if ( _termTextLen == -1 ) //it was invalidated by growBuffer
-_termTextLen = _tcslen((TCHAR*)_buffer);
+_termTextLen = wcslen((TCHAR*)_buffer);
return _termTextLen;
};
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 opened a new pull request, #21721: [typo](docs): modify bitmap_and_not function document
vinlee19 opened a new pull request, #21721: URL: https://github.com/apache/doris/pull/21721 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zclllyybb opened a new pull request, #21722: [feature](function) support time_to_sec
zclllyybb opened a new pull request, #21722:
URL: https://github.com/apache/doris/pull/21722
## Proposed changes
Issue Number: close #xxx
```
mysql >select sec_to_time(time_to_sec(cast('16:32:18' as time)));
++
| sec_to_time(time_to_sec(CAST('16:32:18' AS TIME))) |
++
| 16:32:18 |
++
1 row in set (0.53 sec)
```
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21718: [fix](draft)push conjuncts into SetOperationStmt inline view
hello-stephen commented on PR #21718: URL: https://github.com/apache/doris/pull/21718#issuecomment-1630536036 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 54.03 seconds stream load tsv: 500 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.4 seconds inserted 1000 Rows, about 352K ops/s storage size: 17156924169 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711180248_clickbench_pr_176420.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zclllyybb commented on pull request #21722: [feature](function) support time_to_sec
zclllyybb commented on PR #21722: URL: https://github.com/apache/doris/pull/21722#issuecomment-1630536064 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21715: [imporve](bloomfilter) refactor runtime_filter_mgr with bloomfilter
hello-stephen commented on PR #21715: URL: https://github.com/apache/doris/pull/21715#issuecomment-1630536204 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 50.93 seconds stream load tsv: 500 seconds loaded 74807831229 Bytes, about 142 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17169861707 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711180256_clickbench_pr_176419.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21718: [fix](draft)push conjuncts into SetOperationStmt inline view
hello-stephen commented on PR #21718: URL: https://github.com/apache/doris/pull/21718#issuecomment-1630537769 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 50.21 seconds stream load tsv: 498 seconds loaded 74807831229 Bytes, about 143 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 30 seconds loaded 861443392 Bytes, about 27 MB/s insert into select: 28.7 seconds inserted 1000 Rows, about 348K ops/s storage size: 17162286949 Bytes https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230711180400_clickbench_pr_176423.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
