[GitHub] [incubator-doris] kangkaisen commented on pull request #4168: Fix large int literal analyze

2020-07-24 Thread GitBox
kangkaisen commented on pull request #4168: URL: https://github.com/apache/incubator-doris/pull/4168#issuecomment-663796296 Please add a UT to cover this bug. This is an automated message from the Apache Git Service. To respo

[incubator-doris] branch imay-patch-1 updated (9108a99 -> ed44a50)

2020-07-24 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch imay-patch-1 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 9108a99 Let linked-schema change work for BETA tablet add ed44a50 Update comment No new revisio

[GitHub] [incubator-doris] kangkaisen commented on pull request #4177: Reduce conflict of sql_parser.cup

2020-07-24 Thread GitBox
kangkaisen commented on pull request #4177: URL: https://github.com/apache/incubator-doris/pull/4177#issuecomment-663794124 @yangzhg @morningman Hi, The sql_parser.cup file seems has conflict issue frequently. could we put a readme file or some useful link under `fe/fe-core/src/main/cup/`

[GitHub] [incubator-doris] kangkaisen closed issue #4169: Database is recoverd not in "show databases"

2020-07-24 Thread GitBox
kangkaisen closed issue #4169: URL: https://github.com/apache/incubator-doris/issues/4169 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] kangkaisen merged pull request #4170: Fix recover database not in "show databases"

2020-07-24 Thread GitBox
kangkaisen merged pull request #4170: URL: https://github.com/apache/incubator-doris/pull/4170 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (b32500b -> 4d828d2)

2020-07-24 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from b32500b [Script] Restore build parallel config (#4166) add 4d828d2 Fix recover database not in "s

[GitHub] [incubator-doris] kangkaisen commented on pull request #4182: #4181 Let linked-schema change work for BETA tablet

2020-07-24 Thread GitBox
kangkaisen commented on pull request #4182: URL: https://github.com/apache/incubator-doris/pull/4182#issuecomment-663793293 We should cover the schema_version_convert in UT, which is error-prone. This is an automated message

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #4182: #4181 Let linked-schema change work for BETA tablet

2020-07-24 Thread GitBox
kangkaisen commented on a change in pull request #4182: URL: https://github.com/apache/incubator-doris/pull/4182#discussion_r460350162 ## File path: be/src/olap/schema_change.cpp ## @@ -2141,7 +2141,7 @@ OLAPStatus SchemaChangeHandler::_parse_request(TabletSharedPtr base_table

[GitHub] [incubator-doris] kangkaisen commented on issue #4162: Doris on es left join 谓词下推bug

2020-07-24 Thread GitBox
kangkaisen commented on issue #4162: URL: https://github.com/apache/incubator-doris/issues/4162#issuecomment-663791493 > @kangkaisen close? why? Sorry,which should be a misoperation. This is an automated message from

[GitHub] [incubator-doris] kangkaisen commented on pull request #4131: Use LongAdder or volatile long to replace AtomicLong in some scenarios

2020-07-24 Thread GitBox
kangkaisen commented on pull request #4131: URL: https://github.com/apache/incubator-doris/pull/4131#issuecomment-663791316 > > @caiconghui Hi,how many performance improvement this PR will get? > > @kangkaisen > > for single AtomicLong value and single LongAdder value, i test increment

[GitHub] [incubator-doris] yangzhg opened a new pull request #4183: Fix from/to_base64 may return incorrect value

2020-07-24 Thread GitBox
yangzhg opened a new pull request #4183: URL: https://github.com/apache/incubator-doris/pull/4183 ## Proposed changes from/to_base64 may return incorrect value when the value is null #4130 remove the duplicated base64 code fix the base64 encoded string length is wrong, and this

[GitHub] [incubator-doris] morningman commented on a change in pull request #4163: [Spark Load]Create spark load's repository in HDFS for dependencies

2020-07-24 Thread GitBox
morningman commented on a change in pull request #4163: URL: https://github.com/apache/incubator-doris/pull/4163#discussion_r460096973 ## File path: fe/fe-core/src/main/java/org/apache/doris/catalog/SparkResource.java ## @@ -144,6 +146,12 @@ public SparkResource getCopiedResour

[GitHub] [incubator-doris] imay opened a new pull request #4182: #4181 Let linked-schema change work for BETA tablet

2020-07-24 Thread GitBox
imay opened a new pull request #4182: URL: https://github.com/apache/incubator-doris/pull/4182 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] 01/01: Let linked-schema change work for BETA tablet

2020-07-24 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch imay-patch-1 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git commit 9108a999a045c00133a2361165db6dbe15719348 Author: Zhao Chun AuthorDate: Fri Jul 24 23:33:17 2020 +0800

[incubator-doris] branch imay-patch-1 created (now 9108a99)

2020-07-24 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch imay-patch-1 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. at 9108a99 Let linked-schema change work for BETA tablet This branch includes the following new commits:

[GitHub] [incubator-doris] imay opened a new issue #4181: Linked schema change not work

2020-07-24 Thread GitBox
imay opened a new issue #4181: URL: https://github.com/apache/incubator-doris/issues/4181 If a tablet rowset type is BETA, Linked Schema change will not be triggered. This is because, when the code see the new tablet's perfer rowset type is BETA, it will choose a directly way to do schem

[GitHub] [incubator-doris] amosbird opened a new pull request #4180: Masking glibc symbols for better portability

2020-07-24 Thread GitBox
amosbird opened a new pull request #4180: URL: https://github.com/apache/incubator-doris/pull/4180 ## Proposed changes In ClickHouse we have glibc symbols masked to backport down towards CentOS 5 (glibc 2.5). It's quite useful for creating portable executables. I'd love to have this

[GitHub] [incubator-doris] xy720 commented on a change in pull request #4163: [Spark Load]Create spark load's repository in HDFS for dependencies

2020-07-24 Thread GitBox
xy720 commented on a change in pull request #4163: URL: https://github.com/apache/incubator-doris/pull/4163#discussion_r460087064 ## File path: fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkRepository.java ## @@ -0,0 +1,379 @@ +// Licensed to the Apache Software F

[GitHub] [incubator-doris] xy720 commented on a change in pull request #4163: [Spark Load]Create spark load's repository in HDFS for dependencies

2020-07-24 Thread GitBox
xy720 commented on a change in pull request #4163: URL: https://github.com/apache/incubator-doris/pull/4163#discussion_r460087064 ## File path: fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkRepository.java ## @@ -0,0 +1,379 @@ +// Licensed to the Apache Software F

[GitHub] [incubator-doris] xy720 commented on a change in pull request #4163: [Spark Load]Create spark load's repository in HDFS for dependencies

2020-07-24 Thread GitBox
xy720 commented on a change in pull request #4163: URL: https://github.com/apache/incubator-doris/pull/4163#discussion_r460084182 ## File path: fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java ## @@ -114,7 +142,9 @@ public void submitEtlJob(long lo

[GitHub] [incubator-doris] xy720 commented on a change in pull request #4163: [Spark Load]Create spark load's repository in HDFS for dependencies

2020-07-24 Thread GitBox
xy720 commented on a change in pull request #4163: URL: https://github.com/apache/incubator-doris/pull/4163#discussion_r460083484 ## File path: fe/fe-core/src/main/java/org/apache/doris/common/FeConstants.java ## @@ -39,6 +39,9 @@ // dpp version public static String d

[GitHub] [incubator-doris] morningman commented on pull request #4177: Reduce conflict of sql_parser.cup

2020-07-24 Thread GitBox
morningman commented on pull request #4177: URL: https://github.com/apache/incubator-doris/pull/4177#issuecomment-663557077 If we resolve the reduce conflict, I suggest to modify the `expectedConflicts` in `fe/fe-core/pom.xml` too. -

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #4175: [Bug][UpdateDataQuota] Skip update used data quota for information_schema db and fix bug for wrong time interval for

2020-07-24 Thread GitBox
caiconghui commented on a change in pull request #4175: URL: https://github.com/apache/incubator-doris/pull/4175#discussion_r460065609 ## File path: fe/fe-core/src/main/java/org/apache/doris/transaction/UpdateDbUsedDataQuotaDaemon.java ## @@ -44,6 +44,10 @@ private void update

[GitHub] [incubator-doris] morningman merged pull request #4166: Restore build parallel config

2020-07-24 Thread GitBox
morningman merged pull request #4166: URL: https://github.com/apache/incubator-doris/pull/4166 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (4608f97 -> b32500b)

2020-07-24 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 4608f97 Support checking database used data quota when data load job begin a new txn (#3955) add

[GitHub] [incubator-doris] morningman commented on a change in pull request #4175: [Bug][UpdateDataQuota] Skip update used data quota for information_schema db and fix bug for wrong time interval for

2020-07-24 Thread GitBox
morningman commented on a change in pull request #4175: URL: https://github.com/apache/incubator-doris/pull/4175#discussion_r460052620 ## File path: fe/fe-core/src/main/java/org/apache/doris/transaction/UpdateDbUsedDataQuotaDaemon.java ## @@ -44,6 +44,10 @@ private void update

[GitHub] [incubator-doris] caiconghui opened a new issue #4179: [Bug] Should add db read lock when processing unfinished publish task

2020-07-24 Thread GitBox
caiconghui opened a new issue #4179: URL: https://github.com/apache/incubator-doris/issues/4179 **Describe the bug** This Bug was introduced by PR #4053, here should add db read lock when processing unfinished publish task. **To Reproduce** --

[GitHub] [incubator-doris] caiconghui opened a new pull request #4178: [Bug] Add db read lock when processing unfinished publish task

2020-07-24 Thread GitBox
caiconghui opened a new pull request #4178: URL: https://github.com/apache/incubator-doris/pull/4178 ## Proposed changes This Bug was introduced by PR #4053, here should add db read lock when processing unfinished publish task. ## Types of changes What types of changes

[GitHub] [incubator-doris] morningman commented on pull request #4053: Optimize the logic of processing unfinishedTask when transaction is publishTimeout

2020-07-24 Thread GitBox
morningman commented on pull request #4053: URL: https://github.com/apache/incubator-doris/pull/4053#issuecomment-663523056 Hi @caiconghui , I think you forget to hold the database's readlock? This is an automated message fro

[GitHub] [incubator-doris] yangzhg commented on issue #4130: [BUG] from_base64

2020-07-24 Thread GitBox
yangzhg commented on issue #4130: URL: https://github.com/apache/incubator-doris/issues/4130#issuecomment-663502497 It is a bug,and I will fix it, to_base64 function also has this problem, and to_base64 also has an bug may cause memory problem

[GitHub] [incubator-doris] yangzhg commented on issue #4155: Schema Change : errCode = 2, detailMessage = Can not change INT to TINYINT

2020-07-24 Thread GitBox
yangzhg commented on issue #4155: URL: https://github.com/apache/incubator-doris/issues/4155#issuecomment-663464893 For now we not support down cast, you can refer `org/apache/doris/catalog/ColumnType.java` for more detail

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #4165: [Spill To Disk][3/6] Add some function and variables in base class:BlockingJoinNode. Prepare for Derived class:Partiti

2020-07-24 Thread GitBox
HappenLee commented on a change in pull request #4165: URL: https://github.com/apache/incubator-doris/pull/4165#discussion_r459948700 ## File path: be/src/exec/blocking_join_node.cpp ## @@ -74,14 +76,23 @@ Status BlockingJoinNode::prepare(RuntimeState* state) { _probe_tupl

[GitHub] [incubator-doris] yangzhg opened a new pull request #4177: Reduce conflict of sql_parser.cup

2020-07-24 Thread GitBox
yangzhg opened a new pull request #4177: URL: https://github.com/apache/incubator-doris/pull/4177 ## Proposed changes Fix the Shift/Reduce conflict in cup file #4176 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #4165: [Spill To Disk][3/6] Add some function and variables in base class:BlockingJoinNode. Prepare for Derived class:Partiti

2020-07-24 Thread GitBox
HappenLee commented on a change in pull request #4165: URL: https://github.com/apache/incubator-doris/pull/4165#discussion_r459944251 ## File path: be/src/exec/blocking_join_node.h ## @@ -84,11 +88,20 @@ class BlockingJoinNode : public ExecNode { // This should be the same

[GitHub] [incubator-doris] yangzhg opened a new issue #4176: Reduce the conflict of grammar file

2020-07-24 Thread GitBox
yangzhg opened a new issue #4176: URL: https://github.com/apache/incubator-doris/issues/4176 For now our grammar file `fe/fe-core/src/main/cup/sql_parser.cup` has many reduce conflicts, we should remove those conflicts ``` [WARNING] /home/disk6/yang/workspace/baidu/bdg/doris/core/fe

[GitHub] [incubator-doris] caiconghui opened a new pull request #4175: [Bug][UpdateDataQuota] Skip update data used quota for information_schema db and fix bug for wrong time interval for UpdateDbUse

2020-07-24 Thread GitBox
caiconghui opened a new pull request #4175: URL: https://github.com/apache/incubator-doris/pull/4175 ## Proposed changes This PR is to skip update data used quota for information_schema db and fix bug for wrong time interval for UpdateDbUsedDataQuotaDaemon ## Types of changes

[GitHub] [incubator-doris] caiconghui opened a new issue #4174: [Bug]UpdateDbUsedDataQuotaDaemon has wrong time interval and not skip information_schema db

2020-07-24 Thread GitBox
caiconghui opened a new issue #4174: URL: https://github.com/apache/incubator-doris/issues/4174 **Describe the bug** UpdateDbUsedDataQuotaDaemon has wrong time interval and not skip information_schema db **To Reproduce** start fe, then see the following log : ``` 2020-07-

[GitHub] [incubator-doris] hexian55 commented on issue #4162: Doris on es left join 谓词下推bug

2020-07-24 Thread GitBox
hexian55 commented on issue #4162: URL: https://github.com/apache/incubator-doris/issues/4162#issuecomment-663388256 @kangkaisen close? why? This is an automated message from the Apache Git Service. To respond to the message