[GitHub] [doris] liaoxin01 opened a new pull request, #12886: [feature-wip](unique-key-merge-on-write) unique key with merge on write table support schema change

2022-09-22 Thread GitBox
liaoxin01 opened a new pull request, #12886: URL: https://github.com/apache/doris/pull/12886 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [

[GitHub] [doris] dutyu opened a new pull request, #12887: [enhancement](AuditLoaderPlugin): add audit queue capacity configurat…

2022-09-22 Thread GitBox
dutyu opened a new pull request, #12887: URL: https://github.com/apache/doris/pull/12887 …ion and improve performance for datetime format. # Proposed changes Ease the audit log discard problem for auditloader plugin. Issue Number: close #12885 ## Problem summary

[GitHub] [doris] mrhhsg opened a new pull request, #12888: [bugfix](scanner) remove invalid of '[[noreturn]]'

2022-09-22 Thread GitBox
mrhhsg opened a new pull request, #12888: URL: https://github.com/apache/doris/pull/12888 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes

[GitHub] [doris] superhanliu2 commented on a diff in pull request #12837: Update vars.sh

2022-09-22 Thread GitBox
superhanliu2 commented on code in PR #12837: URL: https://github.com/apache/doris/pull/12837#discussion_r977643300 ## thirdparty/vars.sh: ## @@ -288,7 +288,7 @@ JEMALLOC_SOURCE="jemalloc-5.2.1" JEMALLOC_MD5SUM="3d41fbf006e6ebffd489bdb304d009ae" # cctz -CCTZ_DOWNLOAD="https:/

[GitHub] [doris] superhanliu2 commented on a diff in pull request #12837: Update vars.sh

2022-09-22 Thread GitBox
superhanliu2 commented on code in PR #12837: URL: https://github.com/apache/doris/pull/12837#discussion_r977643300 ## thirdparty/vars.sh: ## @@ -288,7 +288,7 @@ JEMALLOC_SOURCE="jemalloc-5.2.1" JEMALLOC_MD5SUM="3d41fbf006e6ebffd489bdb304d009ae" # cctz -CCTZ_DOWNLOAD="https:/

[GitHub] [doris] xinyiZzz opened a new pull request, #12889: [branch-1.1-lts](cherry-pick) Some fixes for mem tracker

2022-09-22 Thread GitBox
xinyiZzz opened a new pull request, #12889: URL: https://github.com/apache/doris/pull/12889 # Proposed changes Issue Number: close #xxx ## Problem summary cherry-pick: https://github.com/apache/doris/pull/12666 https://github.com/apache/doris/pull/12339 https://g

[GitHub] [doris] xinyiZzz merged pull request #12889: [branch-1.1-lts](cherry-pick) Some fixes for mem tracker

2022-09-22 Thread GitBox
xinyiZzz merged PR #12889: URL: https://github.com/apache/doris/pull/12889 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] jackwener opened a new pull request, #12890: [fix](Nereids): fix Outer LAsscom and improve onConditon checker

2022-09-22 Thread GitBox
jackwener opened a new pull request, #12890: URL: https://github.com/apache/doris/pull/12890 # Proposed changes Issue Number: close #xxx ## Problem summary - fix Outer LAsscom, current forgot to check onCondtion for Outer LAsscom - improve onConditon checker. ##

[GitHub] [doris] morrySnow closed pull request #12876: test bucket shuffle

2022-09-22 Thread GitBox
morrySnow closed pull request #12876: test bucket shuffle URL: https://github.com/apache/doris/pull/12876 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail

[GitHub] [doris] morrySnow opened a new pull request, #12891: [enhancement](Nereids) plan bucket shuffle join on fragment without scan node

2022-09-22 Thread GitBox
morrySnow opened a new pull request, #12891: URL: https://github.com/apache/doris/pull/12891 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] zhannngchen commented on a diff in pull request #12866: [enhancement](compaction) introduce segment compaction (#12609)

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12866: URL: https://github.com/apache/doris/pull/12866#discussion_r977657612 ## be/src/olap/olap_server.cpp: ## @@ -700,6 +708,19 @@ Status StorageEngine::submit_quick_compaction_task(TabletSharedPtr tablet) { return Status::OK(); }

[GitHub] [doris] zhannngchen commented on a diff in pull request #12866: [enhancement](compaction) introduce segment compaction (#12609)

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12866: URL: https://github.com/apache/doris/pull/12866#discussion_r977716456 ## be/src/olap/rowset/beta_rowset_writer.cpp: ## @@ -102,6 +110,284 @@ Status BetaRowsetWriter::add_block(const vectorized::Block* block) { return _add_block(b

[GitHub] [doris] HappenLee opened a new pull request, #12892: [config](vec) control num free block by be config

2022-09-22 Thread GitBox
HappenLee opened a new pull request, #12892: URL: https://github.com/apache/doris/pull/12892 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] github-actions[bot] commented on pull request #12867: [Improvement](predicate) Replace for-loop by memcpy

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12867: URL: https://github.com/apache/doris/pull/12867#issuecomment-1255102655 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #12867: [Improvement](predicate) Replace for-loop by memcpy

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12867: URL: https://github.com/apache/doris/pull/12867#issuecomment-1255102723 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] zhannngchen commented on a diff in pull request #12866: [enhancement](compaction) introduce segment compaction (#12609)

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12866: URL: https://github.com/apache/doris/pull/12866#discussion_r977743775 ## be/src/olap/rowset/beta_rowset_writer.cpp: ## @@ -102,6 +110,284 @@ Status BetaRowsetWriter::add_block(const vectorized::Block* block) { return _add_block(b

[GitHub] [doris] BePPPower commented on a diff in pull request #12848: [feature-wip](new-scan)Add new jdbc scanner and new jdbc scan node

2022-09-22 Thread GitBox
BePPPower commented on code in PR #12848: URL: https://github.com/apache/doris/pull/12848#discussion_r977757888 ## be/src/vec/exec/scan/new_jdbc_scan_node.cpp: ## @@ -0,0 +1,62 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agre

[GitHub] [doris] zhannngchen commented on a diff in pull request #12866: [enhancement](compaction) introduce segment compaction (#12609)

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12866: URL: https://github.com/apache/doris/pull/12866#discussion_r977705741 ## be/src/olap/rowset/beta_rowset_writer.cpp: ## @@ -309,12 +641,23 @@ Status BetaRowsetWriter::_create_segment_writer( DCHECK(file_writer != nullptr); seg

[GitHub] [doris] BePPPower commented on a diff in pull request #12848: [feature-wip](new-scan)Add new jdbc scanner and new jdbc scan node

2022-09-22 Thread GitBox
BePPPower commented on code in PR #12848: URL: https://github.com/apache/doris/pull/12848#discussion_r977757888 ## be/src/vec/exec/scan/new_jdbc_scan_node.cpp: ## @@ -0,0 +1,62 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agre

[GitHub] [doris] morningman opened a new pull request, #12893: [improvement](load) support loading data with missing column

2022-09-22 Thread GitBox
morningman opened a new pull request, #12893: URL: https://github.com/apache/doris/pull/12893 # Proposed changes Issue Number: close #xxx ## Problem summary This PR is from #11742, and add arrow reader support. If there are 5 columns in table and 4 columns in file,

[GitHub] [doris] englefly opened a new pull request, #12894: [feature](nereids) extract single table expression for push down

2022-09-22 Thread GitBox
englefly opened a new pull request, #12894: URL: https://github.com/apache/doris/pull/12894 # Proposed changes TPCH q7, we have expression like ``` (n1.n_name = 'FRANCE' and n2.n_name = 'GERMANY') or (n1.n_name = 'GERMANY' and n2.n_name = 'FRANCE')``` this expression implies

[GitHub] [doris] zhannngchen closed pull request #12862: [debug](test)a test pr for qa pipeline debug, will not merge

2022-09-22 Thread GitBox
zhannngchen closed pull request #12862: [debug](test)a test pr for qa pipeline debug, will not merge URL: https://github.com/apache/doris/pull/12862 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [doris] dinggege1024 opened a new issue, #12895: [Enhancement] spark load support ORC format table

2022-09-22 Thread GitBox
dinggege1024 opened a new issue, #12895: URL: https://github.com/apache/doris/issues/12895 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description Until

[GitHub] [doris] sahilm-10 commented on issue #11706: Good First Issue

2022-09-22 Thread GitBox
sahilm-10 commented on issue #11706: URL: https://github.com/apache/doris/issues/11706#issuecomment-1255198436 @luzhijing I am interested in DOCS & BLOGS TRANSLATION. I am new to Open-Source, if there's any post remaining to assign , Please assign me. I want to contribute. -- This is an

[GitHub] [doris] HappenLee commented on pull request #12892: [config](vec) control num free block by be config

2022-09-22 Thread GitBox
HappenLee commented on PR #12892: URL: https://github.com/apache/doris/pull/12892#issuecomment-1255210036 > please also modify free block in `src/vec/exec/scan/scanner_context.cpp` just a test pr in branch `opt_perf`, if it's effective, I will create a new pr to do this in `master` br

[GitHub] [doris] wsjz opened a new pull request, #12896: [feature-wip](parquet-reader) refactor parquet_predicate

2022-09-22 Thread GitBox
wsjz opened a new pull request, #12896: URL: https://github.com/apache/doris/pull/12896 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes

[GitHub] [doris] github-actions[bot] commented on pull request #12838: [Bug](view) Show create view support comment

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12838: URL: https://github.com/apache/doris/pull/12838#issuecomment-1255403424 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #12838: [Bug](view) Show create view support comment

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12838: URL: https://github.com/apache/doris/pull/12838#issuecomment-1255403458 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #12820: [fix](streamload&sink) release and allocate memory in the same tracker

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12820: URL: https://github.com/apache/doris/pull/12820#issuecomment-1255513860 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] closed pull request #8603: fix string default value bug

2022-09-22 Thread GitBox
github-actions[bot] closed pull request #8603: fix string default value bug URL: https://github.com/apache/doris/pull/8603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [doris] yiguolei merged pull request #12870: [Bug](date)(1.1-lts) Fix wrong result produced by date function

2022-09-22 Thread GitBox
yiguolei merged PR #12870: URL: https://github.com/apache/doris/pull/12870 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei merged pull request #12869: [Bug](date)(1.1-lts) Fix wrong type in TimestampArithmeticExpr

2022-09-22 Thread GitBox
yiguolei merged PR #12869: URL: https://github.com/apache/doris/pull/12869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei merged pull request #12873: [feature](outfile)(1.1-lts) support parquet writer

2022-09-22 Thread GitBox
yiguolei merged PR #12873: URL: https://github.com/apache/doris/pull/12873 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei merged pull request #12838: [Bug](view) Show create view support comment

2022-09-22 Thread GitBox
yiguolei merged PR #12838: URL: https://github.com/apache/doris/pull/12838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei closed issue #12759: [Bug] Creating a view with comment does not take effect

2022-09-22 Thread GitBox
yiguolei closed issue #12759: [Bug] Creating a view with comment does not take effect URL: https://github.com/apache/doris/issues/12759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [doris] yiguolei merged pull request #12814: [test](test_with)add with_case test

2022-09-22 Thread GitBox
yiguolei merged PR #12814: URL: https://github.com/apache/doris/pull/12814 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei merged pull request #12730: [Refactor](parquet) refactor parquet write to uniform and consistent logic

2022-09-22 Thread GitBox
yiguolei merged PR #12730: URL: https://github.com/apache/doris/pull/12730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei merged pull request #12731: [typo](docs) Changing the Jump Address of SparkLoad in BrokerLoad

2022-09-22 Thread GitBox
yiguolei merged PR #12731: URL: https://github.com/apache/doris/pull/12731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] luzhijing closed issue #11331: [Feature] The poseexplode function support like hive.

2022-09-22 Thread GitBox
luzhijing closed issue #11331: [Feature] The poseexplode function support like hive. URL: https://github.com/apache/doris/issues/11331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [doris] morningman commented on a diff in pull request #12848: [feature-wip](new-scan)Add new jdbc scanner and new jdbc scan node

2022-09-22 Thread GitBox
morningman commented on code in PR #12848: URL: https://github.com/apache/doris/pull/12848#discussion_r978206551 ## be/src/vec/exec/scan/new_jdbc_scan_node.cpp: ## @@ -0,0 +1,62 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agr

[GitHub] [doris] luzhijing commented on issue #11706: Good First Issue

2022-09-22 Thread GitBox
luzhijing commented on issue #11706: URL: https://github.com/apache/doris/issues/11706#issuecomment-1255717711 > @luzhijing I am interested in DOCS & BLOGS TRANSLATION. I am new to Open-Source, if there's any post remaining to assign , Please assign me. I want to contribute. Welcome!

[GitHub] [doris] liaoxin01 commented on a diff in pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
liaoxin01 commented on code in PR #12875: URL: https://github.com/apache/doris/pull/12875#discussion_r978212087 ## be/src/olap/rowset/beta_rowset_writer.h: ## @@ -69,6 +69,7 @@ class BetaRowsetWriter : public RowsetWriter { RowsetTypePB type() const override { return Rowset

[GitHub] [doris] morningman commented on a diff in pull request #12896: [feature-wip](parquet-reader) refactor parquet_predicate

2022-09-22 Thread GitBox
morningman commented on code in PR #12896: URL: https://github.com/apache/doris/pull/12896#discussion_r978212119 ## be/src/vec/exec/format/parquet/vparquet_reader.h: ## @@ -74,7 +75,7 @@ class ParquetReader : public GenericReader { virtual ~ParquetReader(); -Status

[GitHub] [doris] liaoxin01 commented on a diff in pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
liaoxin01 commented on code in PR #12875: URL: https://github.com/apache/doris/pull/12875#discussion_r978213928 ## be/src/olap/rowset/beta_rowset_writer.h: ## @@ -93,7 +94,6 @@ class BetaRowsetWriter : public RowsetWriter { /// Because we want to flush memtables in parallel

[GitHub] [doris] zhannngchen commented on a diff in pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12875: URL: https://github.com/apache/doris/pull/12875#discussion_r978214486 ## be/src/olap/rowset/beta_rowset_writer.h: ## @@ -69,6 +69,7 @@ class BetaRowsetWriter : public RowsetWriter { RowsetTypePB type() const override { return Rows

[GitHub] [doris-website] hf200012 merged pull request #111: [docs](date)Optimized date function doc order and add partial function doc

2022-09-22 Thread GitBox
hf200012 merged PR #111: URL: https://github.com/apache/doris-website/pull/111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris

[GitHub] [doris] morrySnow commented on a diff in pull request #12151: [Nereids][Feature] Constant fold of an expression

2022-09-22 Thread GitBox
morrySnow commented on code in PR #12151: URL: https://github.com/apache/doris/pull/12151#discussion_r977225255 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rewrite/rules/TypeCoercion.java: ## @@ -82,6 +85,23 @@ public Expression visitBinaryOperator(Bina

[GitHub] [doris] cambyzju opened a new pull request, #12897: [draft](cooldown) support local cache gc by disk usage

2022-09-22 Thread GitBox
cambyzju opened a new pull request, #12897: URL: https://github.com/apache/doris/pull/12897 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Ye

[GitHub] [doris] AshinGau opened a new pull request, #12898: [feature-wip](parquet-reader) pre read page data in advance to avoid frequent seek

2022-09-22 Thread GitBox
AshinGau opened a new pull request, #12898: URL: https://github.com/apache/doris/pull/12898 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Ye

[GitHub] [doris] BePPPower opened a new pull request, #12899: [feature-wip](new-scan)Add new odbc scanner and new odbc scan node

2022-09-22 Thread GitBox
BePPPower opened a new pull request, #12899: URL: https://github.com/apache/doris/pull/12899 # Proposed changes Related pr: https://github.com/apache/doris/pull/11582 This pr is the new odbc scan node and new odbc scanner. ## Problem summary Describe your changes.

[GitHub] [doris] lide-reed opened a new issue, #12900: [Bug] BE Core dump

2022-09-22 Thread GitBox
lide-reed opened a new issue, #12900: URL: https://github.com/apache/doris/issues/12900 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version Doris 1.1.2-

[GitHub] [doris] adonis0147 merged pull request #12762: [feature-wip](MTMV) Support showing and dropping materialized view for multiple tables

2022-09-22 Thread GitBox
adonis0147 merged PR #12762: URL: https://github.com/apache/doris/pull/12762 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

[GitHub] [doris] qzsee commented on a diff in pull request #12151: [Nereids][Feature] Constant fold of an expression

2022-09-22 Thread GitBox
qzsee commented on code in PR #12151: URL: https://github.com/apache/doris/pull/12151#discussion_r978227226 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rewrite/rules/FoldConstantRuleOnFE.java: ## @@ -0,0 +1,310 @@ +// Licensed to the Apache Software Fou

[GitHub] [doris] qzsee commented on a diff in pull request #12151: [Nereids][Feature] Constant fold of an expression

2022-09-22 Thread GitBox
qzsee commented on code in PR #12151: URL: https://github.com/apache/doris/pull/12151#discussion_r978227682 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rewrite/rules/FoldConstantRuleOnFE.java: ## @@ -0,0 +1,310 @@ +// Licensed to the Apache Software Fou

[GitHub] [doris] github-actions[bot] commented on pull request #12878: [typo](docs)Optimized date function doc order and add partial function doc

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12878: URL: https://github.com/apache/doris/pull/12878#issuecomment-1255749367 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #12878: [typo](docs)Optimized date function doc order and add partial function doc

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12878: URL: https://github.com/apache/doris/pull/12878#issuecomment-1255749381 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] qzsee commented on a diff in pull request #12151: [Nereids][Feature] Constant fold of an expression

2022-09-22 Thread GitBox
qzsee commented on code in PR #12151: URL: https://github.com/apache/doris/pull/12151#discussion_r978232138 ## fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/ExecutableFunctions.java: ## @@ -0,0 +1,243 @@ +// Licensed to the Apache Software Foundat

[GitHub] [doris] morningman merged pull request #12840: [test](Nereids) add TPC-H Q2 as regression test case

2022-09-22 Thread GitBox
morningman merged PR #12840: URL: https://github.com/apache/doris/pull/12840 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

[GitHub] [doris] github-actions[bot] commented on pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12875: URL: https://github.com/apache/doris/pull/12875#issuecomment-1255762278 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #12839: [Improvement](statistics) collect statistics in parallel and add test cases

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12839: URL: https://github.com/apache/doris/pull/12839#issuecomment-1255762792 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #12839: [Improvement](statistics) collect statistics in parallel and add test cases

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12839: URL: https://github.com/apache/doris/pull/12839#issuecomment-1255762811 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] cambyzju commented on a diff in pull request #12897: [draft](cooldown) support local cache gc by disk usage

2022-09-22 Thread GitBox
cambyzju commented on code in PR #12897: URL: https://github.com/apache/doris/pull/12897#discussion_r978243282 ## be/src/common/config.h: ## @@ -844,6 +844,7 @@ CONF_mString(file_cache_type, ""); CONF_Validator(file_cache_type, [](const std::string config) -> bool { return

[GitHub] [doris] cambyzju commented on a diff in pull request #12897: [draft](cooldown) support local cache gc by disk usage

2022-09-22 Thread GitBox
cambyzju commented on code in PR #12897: URL: https://github.com/apache/doris/pull/12897#discussion_r978244404 ## be/src/io/cache/file_cache_manager.h: ## @@ -47,10 +50,20 @@ class FileCacheManager { bool exist(const std::string& cache_path); +void add_used_file_siz

[GitHub] [doris] yiguolei commented on pull request #12496: [enhancement](memory) Jemalloc performance optimization and compatibility with MemTracker

2022-09-22 Thread GitBox
yiguolei commented on PR #12496: URL: https://github.com/apache/doris/pull/12496#issuecomment-1255773941 both clickhouse and pingcap has swtiched to jemalloc. https://github.com/ClickHouse/ClickHouse/pull/2773 https://github.com/pingcap/tiflash/pull/424 -- This is an automated messag

[GitHub] [doris] morrySnow merged pull request #12839: [Improvement](statistics) collect statistics in parallel and add test cases

2022-09-22 Thread GitBox
morrySnow merged PR #12839: URL: https://github.com/apache/doris/pull/12839 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

[GitHub] [doris] dutyu opened a new pull request, #12901: [enhancement](load) enhance load from orc file

2022-09-22 Thread GitBox
dutyu opened a new pull request, #12901: URL: https://github.com/apache/doris/pull/12901 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes

[GitHub] [doris] morrySnow commented on a diff in pull request #12785: [Feature](Nereids) Set pre-aggregation status for OLAP table scan.

2022-09-22 Thread GitBox
morrySnow commented on code in PR #12785: URL: https://github.com/apache/doris/pull/12785#discussion_r978252987 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/mv/SelectRollupWithAggregate.java: ## @@ -172,23 +183,33 @@ public List buildRules() { /** * Sele

[GitHub] [doris] weizhengte opened a new pull request, #12902: [fix](Test): fix a test failure problem after merging

2022-09-22 Thread GitBox
weizhengte opened a new pull request, #12902: URL: https://github.com/apache/doris/pull/12902 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ]

[GitHub] [doris] zenoyang commented on a diff in pull request #12852: [Improvement](dict) optimize dictionary column

2022-09-22 Thread GitBox
zenoyang commented on code in PR #12852: URL: https://github.com/apache/doris/pull/12852#discussion_r978259350 ## be/src/vec/columns/column_dictionary.h: ## @@ -360,40 +356,50 @@ class ColumnDictionary final : public COWHelper> { if (code >= 0) { re

[GitHub] [doris] Jibing-Li opened a new pull request, #12903: [fix](new-scan)Add format type to TFileScanRangeParams, get parquet column type from SchemaElement.type first.

2022-09-22 Thread GitBox
Jibing-Li opened a new pull request, #12903: URL: https://github.com/apache/doris/pull/12903 # Proposed changes Fix bugs: 1. Fe need to send file format (e.g. parquet, orc ...) to be while processing load jobs using new scanner. 2. Try to get parquet file column type from Schema

[GitHub] [doris] liaoxin01 commented on a diff in pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
liaoxin01 commented on code in PR #12875: URL: https://github.com/apache/doris/pull/12875#discussion_r978267224 ## be/src/olap/rowset/beta_rowset_writer.cpp: ## @@ -346,7 +345,13 @@ Status BetaRowsetWriter::_flush_segment_writer(std::unique_ptr l(_lock); +_segment_num_r

[GitHub] [doris] JNSimba opened a new pull request, #12904: [improvement](aduit-plugin) Audit logs are missing and refreshed irregularly

2022-09-22 Thread GitBox
JNSimba opened a new pull request, #12904: URL: https://github.com/apache/doris/pull/12904 ## Problem summary 1.The audit log is sometimes lost. The related logs are as follows: `encounter exception when putting current audit batch, discard current audit event` 2.The audit log d

[GitHub] [doris] zhannngchen commented on a diff in pull request #12875: [feature-wip](unique-key-merge-on-write) fix thread safe issue in BetaRowsetWriter

2022-09-22 Thread GitBox
zhannngchen commented on code in PR #12875: URL: https://github.com/apache/doris/pull/12875#discussion_r978271412 ## be/src/olap/rowset/beta_rowset_writer.cpp: ## @@ -346,7 +345,13 @@ Status BetaRowsetWriter::_flush_segment_writer(std::unique_ptr l(_lock); +_segment_num

[GitHub] [doris] morningman commented on a diff in pull request #12904: [improvement](aduit-plugin) Audit logs are missing and refreshed irregularly

2022-09-22 Thread GitBox
morningman commented on code in PR #12904: URL: https://github.com/apache/doris/pull/12904#discussion_r978272759 ## fe_plugins/auditloader/src/main/java/org/apache/doris/plugin/audit/AuditLoaderPlugin.java: ## @@ -134,12 +134,12 @@ public boolean eventFilter(AuditEvent.EventType

[GitHub] [doris] github-actions[bot] commented on pull request #12841: [enhancement](Nereids) remove unnecessary ExchangeNode under AssertNumRowsNode

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12841: URL: https://github.com/apache/doris/pull/12841#issuecomment-1255812984 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #12841: [enhancement](Nereids) remove unnecessary ExchangeNode under AssertNumRowsNode

2022-09-22 Thread GitBox
github-actions[bot] commented on PR #12841: URL: https://github.com/apache/doris/pull/12841#issuecomment-1255813002 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] dataroaring commented on issue #10473: [Feature] About supporting sequenceCount function and retention function

2022-09-22 Thread GitBox
dataroaring commented on issue #10473: URL: https://github.com/apache/doris/issues/10473#issuecomment-1255832542 retention is picked by a guy. https://github.com/apache/doris/issues/12800. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [doris] Gabriel39 commented on a diff in pull request #12852: [Improvement](dict) optimize dictionary column

2022-09-22 Thread GitBox
Gabriel39 commented on code in PR #12852: URL: https://github.com/apache/doris/pull/12852#discussion_r978294410 ## be/src/vec/columns/column_dictionary.h: ## @@ -360,40 +356,50 @@ class ColumnDictionary final : public COWHelper> { if (code >= 0) { r

[GitHub] [doris] luozenglin commented on issue #12806: Invalid instance profile, sender is null: true, execNode is null: true

2022-09-22 Thread GitBox
luozenglin commented on issue #12806: URL: https://github.com/apache/doris/issues/12806#issuecomment-1255834756 FE will constantly accept instance profiles from BE and update the total profile in real time, in the process some unreported instance profiles are empty, which generates this war

[GitHub] [doris] morningman merged pull request #12902: [fix](test) fix a test failure problem after merging

2022-09-22 Thread GitBox
morningman merged PR #12902: URL: https://github.com/apache/doris/pull/12902 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

[GitHub] [doris] zenoyang commented on pull request #12852: [Improvement](dict) optimize dictionary column

2022-09-22 Thread GitBox
zenoyang commented on PR #12852: URL: https://github.com/apache/doris/pull/12852#issuecomment-1255845045 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[GitHub] [doris] morrySnow merged pull request #12841: [enhancement](Nereids) remove unnecessary ExchangeNode under AssertNumRowsNode

2022-09-22 Thread GitBox
morrySnow merged PR #12841: URL: https://github.com/apache/doris/pull/12841 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

[GitHub] [doris] dinggege1024 commented on issue #12895: [fix] fix sparkload comment

2022-09-22 Thread GitBox
dinggege1024 commented on issue #12895: URL: https://github.com/apache/doris/issues/12895#issuecomment-1255856946 sparkload already could load ORC PARQ format file. But this line of comments looks easy to misunderstand. -- This is an automated message from the Apache Git Service. To

[GitHub] [doris] BiteTheDDDDt opened a new issue, #12905: [Bug] tpcds q19 get wrong result on vectorized engine

2022-09-23 Thread GitBox
BiteThet opened a new issue, #12905: URL: https://github.com/apache/doris/issues/12905 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version master

[GitHub] [doris] morrySnow merged pull request #12891: [feature](Nereids) enable bucket shuffle join on fragment without scan node

2022-09-23 Thread GitBox
morrySnow merged PR #12891: URL: https://github.com/apache/doris/pull/12891 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

[GitHub] [doris-website] sahilm-10 opened a new pull request, #112: Best-Practices-Doris and Images Added

2022-09-23 Thread GitBox
sahilm-10 opened a new pull request, #112: URL: https://github.com/apache/doris-website/pull/112 Please Review Changes and Merge! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [doris] dinggege1024 commented on issue #12895: [fix] fix sparkload comment

2022-09-23 Thread GitBox
dinggege1024 commented on issue #12895: URL: https://github.com/apache/doris/issues/12895#issuecomment-1255881447 But this line of comments looks easy to misunderstand -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [doris] dinggege1024 closed issue #12895: [fix] fix sparkload comment

2022-09-23 Thread GitBox
dinggege1024 closed issue #12895: [fix] fix sparkload comment URL: https://github.com/apache/doris/issues/12895 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [doris] jackwener commented on a diff in pull request #12818: [refactor](fe-core src test catalog): refactor and replace use NIO

2022-09-23 Thread GitBox
jackwener commented on code in PR #12818: URL: https://github.com/apache/doris/pull/12818#discussion_r978341424 ## fe/fe-core/src/test/java/org/apache/doris/catalog/ColumnStatsTest.java: ## @@ -59,29 +57,29 @@ public void testSerialization() throws Exception { dos.close

[GitHub] [doris] BiteTheDDDDt opened a new pull request, #12906: [Bug](function) fix substr return null on row-based engine

2022-09-23 Thread GitBox
BiteThet opened a new pull request, #12906: URL: https://github.com/apache/doris/pull/12906 # Proposed changes Issue Number: close #12905 ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ]

[GitHub] [doris] wangshuo128 commented on a diff in pull request #12785: [Feature](Nereids) Set pre-aggregation status for OLAP table scan.

2022-09-23 Thread GitBox
wangshuo128 commented on code in PR #12785: URL: https://github.com/apache/doris/pull/12785#discussion_r978356245 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/mv/SelectRollupWithAggregate.java: ## @@ -172,23 +183,33 @@ public List buildRules() { /** * Se

[GitHub] [doris] wangshuo128 commented on a diff in pull request #12785: [Feature](Nereids) Set pre-aggregation status for OLAP table scan.

2022-09-23 Thread GitBox
wangshuo128 commented on code in PR #12785: URL: https://github.com/apache/doris/pull/12785#discussion_r978360611 ## fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/batch/NereidsRewriteJobExecutor.java: ## @@ -70,7 +71,8 @@ public NereidsRewriteJobExecutor(CascadesContext

[GitHub] [doris] levy5307 closed pull request #12257: [fix](memory): avoid coredump when list pointer is null

2022-09-23 Thread GitBox
levy5307 closed pull request #12257: [fix](memory): avoid coredump when list pointer is null URL: https://github.com/apache/doris/pull/12257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [doris] ChPi opened a new issue, #12907: [Enhancement] adding timeout for checking disk of be to avoid doris hang

2022-09-23 Thread GitBox
ChPi opened a new issue, #12907: URL: https://github.com/apache/doris/issues/12907 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description https://gith

[GitHub] [doris] wangshuo128 commented on a diff in pull request #12785: [Feature](Nereids) Set pre-aggregation status for OLAP table scan.

2022-09-23 Thread GitBox
wangshuo128 commented on code in PR #12785: URL: https://github.com/apache/doris/pull/12785#discussion_r978360611 ## fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/batch/NereidsRewriteJobExecutor.java: ## @@ -70,7 +71,8 @@ public NereidsRewriteJobExecutor(CascadesContext

[GitHub] [doris] Gabriel39 opened a new pull request, #12908: Optimize string read

2022-09-23 Thread GitBox
Gabriel39 opened a new pull request, #12908: URL: https://github.com/apache/doris/pull/12908 # Proposed changes ~0.2X performance boost for queries containing string predicates ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affec

[GitHub] [doris] Gabriel39 closed pull request #12908: Optimize string read

2022-09-23 Thread GitBox
Gabriel39 closed pull request #12908: Optimize string read URL: https://github.com/apache/doris/pull/12908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [doris] Gabriel39 opened a new pull request, #12909: [Improvement](string) Optimize scanning for string

2022-09-23 Thread GitBox
Gabriel39 opened a new pull request, #12909: URL: https://github.com/apache/doris/pull/12909 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] starocean999 opened a new pull request, #12910: [fix](like)prevent null pointer by unimplemented like_vec functions

2022-09-23 Thread GitBox
starocean999 opened a new pull request, #12910: URL: https://github.com/apache/doris/pull/12910 # Proposed changes Issue Number: close #xxx ## Problem summary currently only constant_substring_fn is fully vectorized, other functions should keep the old behavior by checki

[GitHub] [doris] Gabriel39 opened a new pull request, #12911: [Improvement](string) Optimize scanning for string

2022-09-23 Thread GitBox
Gabriel39 opened a new pull request, #12911: URL: https://github.com/apache/doris/pull/12911 # Proposed changes ~0.2X performance boost for queries containing string predicates ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affec

<    1   2   3   4   5   6   7   8   9   10   >