[GitHub] [incubator-doris] xinghuayu007 commented on a change in pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
xinghuayu007 commented on a change in pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#discussion_r586191151 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/FromUnixTimeRule.java ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Softwar

[GitHub] [incubator-doris] e0c9 opened a new issue #5448: [BUG] Forget to create new table when renaming table

2021-03-02 Thread GitBox
e0c9 opened a new issue #5448: URL: https://github.com/apache/incubator-doris/issues/5448 **Describe the bug** Master node forgets to create new table when renaming table **To Reproduce** Steps to reproduce the behavior: in master node: 1. create table xxx 2. rename tab

[GitHub] [incubator-doris] francisoliverlee opened a new issue #5447: [union all same field with different types make EXCEPTION] Unexpected exception: Failed analysis after expr substitution.

2021-03-02 Thread GitBox
francisoliverlee opened a new issue #5447: URL: https://github.com/apache/incubator-doris/issues/5447 **Describe the bug** ``` ERROR 5012 (HY000): errCode = 2, detailMessage = Unexpected exception: Failed analysis after expr substitution. ``` **To Reproduce** - prepare do

[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #5445: [Export] Expand function of export stmt

2021-03-02 Thread GitBox
EmmyMiao87 commented on pull request #5445: URL: https://github.com/apache/incubator-doris/pull/5445#issuecomment-789502734 I will update document later. This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] EmmyMiao87 opened a new issue #5446: Extended export function

2021-03-02 Thread GitBox
EmmyMiao87 opened a new issue #5446: URL: https://github.com/apache/incubator-doris/issues/5446 **Is your feature request related to a problem? Please describe.** 1. The smallest export unit supported by the existing export function is partition. But sometimes users only want to expor

[incubator-doris] branch master updated (6a00c68 -> 80d2375)

2021-03-02 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 6a00c68 Fix a typo ehco -> echo (#5433) add 80d2375 [Doc] Modify dead link of doc (#5411) No new

[GitHub] [incubator-doris] kangkaisen closed issue #5405: Lots of issues with page links

2021-03-02 Thread GitBox
kangkaisen closed issue #5405: URL: https://github.com/apache/incubator-doris/issues/5405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] kangkaisen merged pull request #5411: [Doc] Modify dead link of doc

2021-03-02 Thread GitBox
kangkaisen merged pull request #5411: URL: https://github.com/apache/incubator-doris/pull/5411 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #5445: [Export] Expand function of export stmt

2021-03-02 Thread GitBox
EmmyMiao87 opened a new pull request #5445: URL: https://github.com/apache/incubator-doris/pull/5445 ## Proposed changes 1. Support where clause in export stmt which only export selected rows. The syntax is following: Export table [table name] where [expr] To x

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #5436: [FEATURE]Check date type to avoid scan all partitions

2021-03-02 Thread GitBox
kangkaisen commented on a change in pull request #5436: URL: https://github.com/apache/incubator-doris/pull/5436#discussion_r586167698 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/BinaryPredicatesDateRule.java ## @@ -0,0 +1,50 @@ +// Licensed to the Apache S

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #5436: [FEATURE]Check date type to avoid scan all partitions

2021-03-02 Thread GitBox
kangkaisen commented on a change in pull request #5436: URL: https://github.com/apache/incubator-doris/pull/5436#discussion_r586167242 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/BinaryPredicatesDateRule.java ## @@ -0,0 +1,50 @@ +// Licensed to the Apache S

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #5436: [FEATURE]Check date type to avoid scan all partitions

2021-03-02 Thread GitBox
kangkaisen commented on a change in pull request #5436: URL: https://github.com/apache/incubator-doris/pull/5436#discussion_r586166167 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/BinaryPredicatesDateRule.java ## @@ -0,0 +1,50 @@ +// Licensed to the Apache S

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
kangkaisen commented on a change in pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#discussion_r586164964 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/FromUnixTimeRule.java ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] EmmyMiao87 commented on issue #5184: cocolate join在查询中带函数的情况下会失效

2021-03-02 Thread GitBox
EmmyMiao87 commented on issue #5184: URL: https://github.com/apache/incubator-doris/issues/5184#issuecomment-789486526 This is indeed a point that can be optimized. When the partitioning method of the upper plan node is the same as that of the lower layer, Doris can use colocate. I

[GitHub] [incubator-doris] kangkaisen commented on pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
kangkaisen commented on pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#issuecomment-789484553 > I'm not sure whether this change can guarantee the semantic correctness. > Are there other systems with similar modifications? > > Also, how much performanc

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
kangkaisen commented on a change in pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#discussion_r586159822 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/FromUnixTimeRule.java ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software

[incubator-doris] branch master updated (e93a6da -> 6a00c68)

2021-03-02 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from e93a6da [Doc] correct format errors in English doc (#5321) add 6a00c68 Fix a typo ehco -> echo (#

[GitHub] [incubator-doris] kangkaisen merged pull request #5433: Fix a typo ehco -> echo

2021-03-02 Thread GitBox
kangkaisen merged pull request #5433: URL: https://github.com/apache/incubator-doris/pull/5433 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #5325: [Doris On ES][WIP] Support external ES table with `SSL` secured and configurable node sniffing

2021-03-02 Thread GitBox
wuyunfeng commented on a change in pull request #5325: URL: https://github.com/apache/incubator-doris/pull/5325#discussion_r586145816 ## File path: fe/fe-core/src/main/java/org/apache/doris/external/elasticsearch/EsUtil.java ## @@ -82,4 +85,13 @@ public static JSONObject getJs

[GitHub] [incubator-doris] caiconghui commented on issue #5437: undefined reference to `malloc_stats_print'

2021-03-02 Thread GitBox
caiconghui commented on issue #5437: URL: https://github.com/apache/incubator-doris/issues/5437#issuecomment-789375587 > @caiconghui It's failure again, it's a similar error. But thanks a lot, I will read the source code and try to fix it. or you can add my wechat caiconghui001. I d

[GitHub] [incubator-doris] carlziess commented on issue #5437: undefined reference to `malloc_stats_print'

2021-03-02 Thread GitBox
carlziess commented on issue #5437: URL: https://github.com/apache/incubator-doris/issues/5437#issuecomment-789362005 @caiconghui It's failure again, it's a similar error. But thanks a lot, I will read the source code and try to fix it. ---

[GitHub] [incubator-doris] morningman commented on pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
morningman commented on pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#issuecomment-788994930 I'm not sure whether this change can guarantee the semantic correctness. Are there other systems with similar modifications? Also, how much performance improv

[GitHub] [incubator-doris] morningman commented on a change in pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
morningman commented on a change in pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444#discussion_r585663601 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/FromUnixTimeRule.java ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] hf200012 commented on issue #5334: Stream load error

2021-03-02 Thread GitBox
hf200012 commented on issue #5334: URL: https://github.com/apache/incubator-doris/issues/5334#issuecomment-788992074 I also encountered this problem, json data format W0201 16:20:45.516393 164407 thrift_rpc_helper.cpp:84] call frontend service failed, address=TNetworkAddress(hostnam

[GitHub] [incubator-doris] liutang123 edited a comment on pull request #5431: Fix #5430 set dest tuple to null when src_tuple is NULL

2021-03-02 Thread GitBox
liutang123 edited a comment on pull request #5431: URL: https://github.com/apache/incubator-doris/pull/5431#issuecomment-787459739 I test this PR in our cluster and it is ready for review. This is an automated message from th

[GitHub] [incubator-doris] 924060929 commented on pull request #5336: [Spark-Doris-Connector][Bug-Fix] Resolve deserialize exception when Spark Doris Connector in aync deserialize mode

2021-03-02 Thread GitBox
924060929 commented on pull request #5336: URL: https://github.com/apache/incubator-doris/pull/5336#issuecomment-76776 @Youngwb already fix bug which use deserializeArrowToRowBatchAsync before initialize This is an autom

[GitHub] [incubator-doris] 924060929 commented on a change in pull request #5336: [Spark-Doris-Connector][Bug-Fix] Resolve deserialize exception when Spark Doris Connector in aync deserialize mode

2021-03-02 Thread GitBox
924060929 commented on a change in pull request #5336: URL: https://github.com/apache/incubator-doris/pull/5336#discussion_r585534948 ## File path: extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/rdd/ScalaValueReader.scala ## @@ -46,6 +47,9 @@ class Scala

[GitHub] [incubator-doris] 924060929 commented on a change in pull request #5336: [Spark-Doris-Connector][Bug-Fix] Resolve deserialize exception when Spark Doris Connector in aync deserialize mode

2021-03-02 Thread GitBox
924060929 commented on a change in pull request #5336: URL: https://github.com/apache/incubator-doris/pull/5336#discussion_r585529036 ## File path: extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/rdd/ScalaValueReader.scala ## @@ -46,6 +47,9 @@ class Scala

[GitHub] [incubator-doris] wangbo closed issue #3319: Support Java Verision HyperLogLog

2021-03-02 Thread GitBox
wangbo closed issue #3319: URL: https://github.com/apache/incubator-doris/issues/3319 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [incubator-doris] Youngwb commented on a change in pull request #5336: [Spark-Doris-Connector][Bug-Fix] Resolve deserialize exception when Spark Doris Connector in aync deserialize mode

2021-03-02 Thread GitBox
Youngwb commented on a change in pull request #5336: URL: https://github.com/apache/incubator-doris/pull/5336#discussion_r585515502 ## File path: extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/rdd/ScalaValueReader.scala ## @@ -46,6 +47,9 @@ class ScalaVa

[GitHub] [incubator-doris] 924060929 edited a comment on issue #3319: Support Java Verision HyperLogLog

2021-03-02 Thread GitBox
924060929 edited a comment on issue #3319: URL: https://github.com/apache/incubator-doris/issues/3319#issuecomment-788863320 @wangbo I already implement hll/bitmap scala version and do many unit test in our company, see data/spark-on-doris/common/src/main/scala/org/apache/doris/spark/sql/

[GitHub] [incubator-doris] 924060929 commented on issue #3319: Support Java Verision HyperLogLog

2021-03-02 Thread GitBox
924060929 commented on issue #3319: URL: https://github.com/apache/incubator-doris/issues/3319#issuecomment-788863320 @wangbo I already implement hll/bitmap scala version add do many unit test in our company, see data/spark-on-doris/common/src/main/scala/org/apache/doris/spark/sql/functio

[GitHub] [incubator-doris] xinghuayu007 opened a new issue #5443: [Rewrite] Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
xinghuayu007 opened a new issue #5443: URL: https://github.com/apache/incubator-doris/issues/5443 **Is your feature request related to a problem? Please describe.** from_unxitime is a cpu-exhausted function. SQL: `select filed from table where from_unixtime(field) > '2021-03-02'`, if

[GitHub] [incubator-doris] demon-gu commented on issue #5442: Doris内存会不停增长

2021-03-02 Thread GitBox
demon-gu commented on issue #5442: URL: https://github.com/apache/incubator-doris/issues/5442#issuecomment-788763850 > which version are you using now. Server version: 5.1.0 Baidu Doris(Palo) version 0.13.15-Unknown T

[GitHub] [incubator-doris] xinghuayu007 opened a new pull request #5444: [Rewrite]Rewrite from_unixtime to reduce calling this function

2021-03-02 Thread GitBox
xinghuayu007 opened a new pull request #5444: URL: https://github.com/apache/incubator-doris/pull/5444 ## Proposed changes from_unxitime is a cpu-exhausted function. SQL: `select filed from table where from_unixtime(field) > '2021-03-02'`, if there are one million rows of data. Func

[GitHub] [incubator-doris] 924060929 commented on pull request #5441: [Bug-Fix][Bitmap][Be] Resolve bitmap_not calculate wrong result(#5440)

2021-03-02 Thread GitBox
924060929 commented on pull request #5441: URL: https://github.com/apache/incubator-doris/pull/5441#issuecomment-788740896 > @924060929 Thanks Fix the bug of doris, could you please add a UT to avoid the some problem. done ---

[GitHub] [incubator-doris] HappenLee commented on issue #5442: Doris内存会不停增长

2021-03-02 Thread GitBox
HappenLee commented on issue #5442: URL: https://github.com/apache/incubator-doris/issues/5442#issuecomment-788742381 which version are you using now. This is an automated message from the Apache Git Service. To respond to t

[GitHub] [incubator-doris] demon-gu opened a new issue #5442: Doris内存会不停增长

2021-03-02 Thread GitBox
demon-gu opened a new issue #5442: URL: https://github.com/apache/incubator-doris/issues/5442 使用Doris时在be.conf中设置mem_limit,但是并不起作用,Doris使用的内存远远超过设置的百分比,直到被系统杀死be进程 This is an automated message from the Apache Git Service.

[GitHub] [incubator-doris] 924060929 opened a new pull request #5441: [Bug-Fix][Bitmap][Be] Resolve bitmap_not calculate wrong result(#5440)

2021-03-02 Thread GitBox
924060929 opened a new pull request #5441: URL: https://github.com/apache/incubator-doris/pull/5441 ## Proposed changes fix #5440 ## Types of changes - [x] Bugfix (non-breaking change which fixes an issue) - [] New feature (non-breaking change which adds functionality) -

[GitHub] [incubator-doris] 924060929 opened a new issue #5440: [Bug][Bitmap][Be] bitmap_not calculate wrong result

2021-03-02 Thread GitBox
924060929 opened a new issue #5440: URL: https://github.com/apache/incubator-doris/issues/5440 **Describe the bug** Execute follow sql, and expect response '', but response others ```sql select bitmap_to_string(bitmap_not(bitmap_from_string('1'), bitmap_from_string('1,2'))); ``