[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1745: add delete predicate filter(#1636)

2019-09-10 Thread GitBox
kangpinghuang commented on a change in pull request #1745: add delete predicate filter(#1636) URL: https://github.com/apache/incubator-doris/pull/1745#discussion_r322700637 ## File path: be/src/olap/delete_handler.cpp ## @@ -343,5 +343,17 @@ void DeleteHandler::finalize()

[GitHub] [incubator-doris] imay opened a new issue #1776: create chunk allocator for memory pool

2019-09-10 Thread GitBox
imay opened a new issue #1776: create chunk allocator for memory pool URL: https://github.com/apache/incubator-doris/issues/1776 ## Motivation In the case of high concurrency testing, many threads are waiting to be applied and released in memory, and a large part of them are released

[GitHub] [incubator-doris] morningman opened a new issue #1777: Limit the mem usage when loading with HLL column

2019-09-10 Thread GitBox
morningman opened a new issue #1777: Limit the mem usage when loading with HLL column URL: https://github.com/apache/incubator-doris/issues/1777 When loading tables containing HLL columns, the aggregation function of HLL columns should have arena for memory allocation. Otherwise, the size

[GitHub] [incubator-doris] morningman opened a new pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
morningman opened a new pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778 Should use arena to allocate mem for HyperLogLog column. ISSUE: #1777 -

[GitHub] [incubator-doris] kangkaisen opened a new pull request #1779: Minor: Update .gitignore

2019-09-10 Thread GitBox
kangkaisen opened a new pull request #1779: Minor: Update .gitignore URL: https://github.com/apache/incubator-doris/pull/1779 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] kangkaisen commented on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
kangkaisen commented on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529926734 finalize method need also update. This

[GitHub] [incubator-doris] kangkaisen edited a comment on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
kangkaisen edited a comment on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529926734 update method need also update.

[GitHub] [incubator-doris] kangkaisen opened a new pull request #1780: Fix compile error

2019-09-10 Thread GitBox
kangkaisen opened a new pull request #1780: Fix compile error URL: https://github.com/apache/incubator-doris/pull/1780 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-doris] imay merged pull request #1779: Minor: Update .gitignore

2019-09-10 Thread GitBox
imay merged pull request #1779: Minor: Update .gitignore URL: https://github.com/apache/incubator-doris/pull/1779 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [incubator-doris] imay commented on a change in pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
imay commented on a change in pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778#discussion_r322753911 ## File path: be/src/olap/aggregate_func.h ## @@ -435,7 +436,7 @@ struct

[GitHub] [incubator-doris] morningman commented on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
morningman commented on issue #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529987141 > update method need also update. Changed --

[GitHub] [incubator-doris] imay merged pull request #1780: Fix compile error

2019-09-10 Thread GitBox
imay merged pull request #1780: Fix compile error URL: https://github.com/apache/incubator-doris/pull/1780 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [incubator-doris] nick-yangg opened a new issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg opened a new issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781 我在使用sh build.sh 编译的时候报错,致使编译失败。 ![image](https://user-images.githubusercontent.com/55170104/64662776-31ea9080-d47c-11e9-8716-c8019b0

[GitHub] [incubator-doris] yiguolei closed issue #1751: Active rowset is garbage collected

2019-09-10 Thread GitBox
yiguolei closed issue #1751: Active rowset is garbage collected URL: https://github.com/apache/incubator-doris/issues/1751 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-doris] yiguolei closed issue #1765: Should create init version in alter request v2

2019-09-10 Thread GitBox
yiguolei closed issue #1765: Should create init version in alter request v2 URL: https://github.com/apache/incubator-doris/issues/1765 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [incubator-doris] imay merged pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading

2019-09-10 Thread GitBox
imay merged pull request #1778: Fix bug that failed to limit the mem usage of HLL column when loading URL: https://github.com/apache/incubator-doris/pull/1778 This is an automated message from the Apache Git Service. To resp

[GitHub] [incubator-doris] yiguolei opened a new issue #1782: New stateless BE design or share storage architecture

2019-09-10 Thread GitBox
yiguolei opened a new issue #1782: New stateless BE design or share storage architecture URL: https://github.com/apache/incubator-doris/issues/1782 1. In the cloud, VM's local disk is not very stable, for example the VM may crashed and the cloud provider will replace the VM using another

[GitHub] [incubator-doris] imay commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
imay commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530193961 centos的版本是?gcc的版本是?你这个应该是在编译三方库RocksDB出的问题? 如果想快速尝试Doris,建议可以直接使用Doris的docker镜像进行编译 --

[GitHub] [incubator-doris] yiguolei opened a new pull request #1783: Add meta store service thrift definition

2019-09-10 Thread GitBox
yiguolei opened a new pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783 #1782 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530194519 CentOS的的版本是7 ,gcc 8 的版本,如果是RocksDB出的问题需要怎么去解决它

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530195164 @imay This is an automated message from the A

[GitHub] [incubator-doris] imay commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
imay commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530195846 你可以尝试export CXXFLAGS="-Wno-error=stringop-truncation"之后在编译试试

[GitHub] [incubator-doris] morningman commented on a change in pull request #1783: Add meta store service thrift definition

2019-09-10 Thread GitBox
morningman commented on a change in pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783#discussion_r323044760 ## File path: gensrc/thrift/MetaStoreService.thrift ## @@ -0,0 +1,157 @@ +// Licensed to the Apac

[GitHub] [incubator-doris] morningman commented on a change in pull request #1783: Add meta store service thrift definition

2019-09-10 Thread GitBox
morningman commented on a change in pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783#discussion_r323044643 ## File path: gensrc/thrift/MetaStoreService.thrift ## @@ -0,0 +1,157 @@ +// Licensed to the Apac

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530204022 @imay 我在编译的过程中出现了这些,应该没什么问题吧? ![image](https://user-images.githubusercontent.com/55170104/64665946-15a02100-

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530204564 @imay 这个必须要编译吗,有编译好的版本(直接用的版本)吗? This is an au

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-10 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530205532 好的我在尝试编译中,这个必须要编译吗,有编译好的可以直接使用的吗? ZHAO Chun 于2019年9月11日周三 上午10:43写道: > 你可以尝试export CXXFLAGS="-Wno

[GitHub] [incubator-doris] nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’

2019-09-11 Thread GitBox
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const char*, size_t)’ URL: https://github.com/apache/incubator-doris/issues/1781#issuecomment-530269292 感谢你的帮助,我已经搭建完成了 yang nick 于2019年9月11日周三 上午11:35写道: > 好的我在尝试编译中,这个必须要编译吗,有编译好的可以直接使用的吗? > >

[GitHub] [incubator-doris] kangkaisen opened a new issue #1784: FE warn log don't have useful info

2019-09-11 Thread GitBox
kangkaisen opened a new issue #1784: FE warn log don't have useful info URL: https://github.com/apache/incubator-doris/issues/1784 **Describe the bug** ``` 2019-09-11 15:42:34,079 WARN 35 [GlobalTransactionMgr.finishTransaction():679] transaction state {} has error, the replica [{}]

[GitHub] [incubator-doris] kangkaisen opened a new pull request #1785: Fix FE log error

2019-09-11 Thread GitBox
kangkaisen opened a new pull request #1785: Fix FE log error URL: https://github.com/apache/incubator-doris/pull/1785 Fix https://github.com/apache/incubator-doris/issues/1784 This is an automated message from the Apache Git S

[GitHub] [incubator-doris] morningman closed pull request #1783: Add meta store service thrift definition

2019-09-11 Thread GitBox
morningman closed pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [incubator-doris] morningman closed issue #1784: FE warn log don't have useful info

2019-09-11 Thread GitBox
morningman closed issue #1784: FE warn log don't have useful info URL: https://github.com/apache/incubator-doris/issues/1784 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [incubator-doris] morningman merged pull request #1785: Fix FE log error

2019-09-11 Thread GitBox
morningman merged pull request #1785: Fix FE log error URL: https://github.com/apache/incubator-doris/pull/1785 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [incubator-doris] yiguolei opened a new pull request #1783: Add meta store service thrift definition

2019-09-11 Thread GitBox
yiguolei opened a new pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783 #1782 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] wubiaoi opened a new issue #1786: Support estimate size for v2 SegmentWriter

2019-09-11 Thread GitBox
wubiaoi opened a new issue #1786: Support estimate size for v2 SegmentWriter URL: https://github.com/apache/incubator-doris/issues/1786 RowsetWriter needs to control memory usage by controlling the size of each Segment file not too large, so SegmentWriter needs to implement the estimate me

[GitHub] [incubator-doris] wubiaoi opened a new pull request #1787: #1786 support estimate size for v2 segment writer

2019-09-11 Thread GitBox
wubiaoi opened a new pull request #1787: #1786 support estimate size for v2 segment writer URL: https://github.com/apache/incubator-doris/pull/1787 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] wubiaoi opened a new pull request #1787: support estimate size for v2 segment writer #1786

2019-09-11 Thread GitBox
wubiaoi opened a new pull request #1787: support estimate size for v2 segment writer #1786 URL: https://github.com/apache/incubator-doris/pull/1787 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-doris] wubiaoi closed pull request #1787: support estimate size for v2 segment writer #1786

2019-09-11 Thread GitBox
wubiaoi closed pull request #1787: support estimate size for v2 segment writer #1786 URL: https://github.com/apache/incubator-doris/pull/1787 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [incubator-doris] xionglei0 opened a new pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
xionglei0 opened a new pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788 doris_exchange_instances speed up the query especially useful when: 1. data size decrease on a massive scale after ex

[GitHub] [incubator-doris] jaynblue opened a new issue #1789: provide RPM package

2019-09-11 Thread GitBox
jaynblue opened a new issue #1789: provide RPM package URL: https://github.com/apache/incubator-doris/issues/1789 When will be provide RPM package? This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-doris] yan-yunfeng opened a new issue #1790: doris对于实时流处理的支持

2019-09-11 Thread GitBox
yan-yunfeng opened a new issue #1790: doris对于实时流处理的支持 URL: https://github.com/apache/incubator-doris/issues/1790 我在尝试用flink接入doris进行实时数据的存储,发现单条数据的存入非常慢。 doris是否不太支持这种实时数据的逐条插入呢?如果不太支持,后续是否会实现实时数据快速逐条插入? This is an auto

[GitHub] [incubator-doris] chaoyli commented on issue #1790: doris对于实时流处理的支持

2019-09-11 Thread GitBox
chaoyli commented on issue #1790: doris对于实时流处理的支持 URL: https://github.com/apache/incubator-doris/issues/1790#issuecomment-530634330 doris的导入支持的micro-batch,每秒支持的导入在100次左右,对于这种单条导入,目前框架有限制。 我理解micro-batch对于分析场景,能够覆盖大部分的场景。 你这边是什么场景需要单条实时导入呢?

[GitHub] [incubator-doris] morningman merged pull request #1783: Add meta store service thrift definition

2019-09-11 Thread GitBox
morningman merged pull request #1783: Add meta store service thrift definition URL: https://github.com/apache/incubator-doris/pull/1783 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [incubator-doris] morningman commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
morningman commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r319505833 ## File path: fe/src/main/java/org/apache/doris/task/StreamLoadTask.java ## @@ -83,8 +84,15 @@ public TFileFormatType ge

[GitHub] [incubator-doris] imay commented on issue #1789: provide RPM package

2019-09-11 Thread GitBox
imay commented on issue #1789: provide RPM package URL: https://github.com/apache/incubator-doris/issues/1789#issuecomment-530640400 This may take a while, maybe 1-2 months? You can try to compile with docker first. This is

[GitHub] [incubator-doris] xionglei0 commented on issue #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
xionglei0 commented on issue #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#issuecomment-530640543 ![image](https://user-images.githubusercontent.com/55084968/64749857-b0613400-d549-11e9-939d-48bf14901d29.p

[GitHub] [incubator-doris] morningman opened a new pull request #1791: Fix bug that the calculation of disk usage percent is wrong

2019-09-11 Thread GitBox
morningman opened a new pull request #1791: Fix bug that the calculation of disk usage percent is wrong URL: https://github.com/apache/incubator-doris/pull/1791 This bug may cause unable to load data This is an automated mess

[GitHub] [incubator-doris] imay opened a new pull request #1792: Add ChunkAllocator to accelerate chunk allocation

2019-09-11 Thread GitBox
imay opened a new pull request #1792: Add ChunkAllocator to accelerate chunk allocation URL: https://github.com/apache/incubator-doris/pull/1792 I add ChunkAllocator in this CL to put unused memory chunk to a chunk pool other than return it to system allocator. Now we only change MemP

[GitHub] [incubator-doris] imay commented on issue #1792: Add ChunkAllocator to accelerate chunk allocation

2019-09-11 Thread GitBox
imay commented on issue #1792: Add ChunkAllocator to accelerate chunk allocation URL: https://github.com/apache/incubator-doris/pull/1792#issuecomment-530643709 for #1776 This is an automated message from the Apache Git Servi

[GitHub] [incubator-doris] nick-yangg opened a new issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240

2019-09-11 Thread GitBox
nick-yangg opened a new issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240 URL: https://github.com/apache/incubator-doris/issues/1793 ``` "TxnId": -1, "Label": "2", "Status": "Fail", "Message": "body exceed max size, max_body_b

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323539143 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323536718 ## File path: fe/src/main/java/org/apache/doris/common/FeMetaVersion.java ##

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323539013 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323537163 ## File path: fe/src/main/java/org/apache/doris/qe/SessionVariable.java ## @@

[GitHub] [incubator-doris] nick-yangg opened a new issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误

2019-09-11 Thread GitBox
nick-yangg opened a new issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误 URL: https://github.com/apache/incubator-doris/issues/1794 ``` failed to initialize storage reader. tablet=12301.1548401152, res=-105, backend=xx.xxx.xx.xx ``` 这个问题是bug还是那里操作配置的有问题? --

[GitHub] [incubator-doris] xionglei0 commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
xionglei0 commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323541404 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @

[GitHub] [incubator-doris] yiguolei opened a new pull request #1795: Initialize tablet uid not using default constructor for performance r…

2019-09-11 Thread GitBox
yiguolei opened a new pull request #1795: Initialize tablet uid not using default constructor for performance r… URL: https://github.com/apache/incubator-doris/pull/1795 Init tablet uid at parameter initialize list not using default constructor because boost uuid method is too slow. -

[GitHub] [incubator-doris] chaoyli merged pull request #1795: Initialize tablet uid not using default constructor for performance r…

2019-09-11 Thread GitBox
chaoyli merged pull request #1795: Initialize tablet uid not using default constructor for performance r… URL: https://github.com/apache/incubator-doris/pull/1795 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #1796: Fix mistake in docs

2019-09-11 Thread GitBox
EmmyMiao87 opened a new pull request #1796: Fix mistake in docs URL: https://github.com/apache/incubator-doris/pull/1796 This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [incubator-doris] morningman merged pull request #1796: Fix mistake in docs

2019-09-11 Thread GitBox
morningman merged pull request #1796: Fix mistake in docs URL: https://github.com/apache/incubator-doris/pull/1796 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [incubator-doris] imay commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
imay commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323542395 ## File path: fe/src/main/java/org/apache/doris/planner/StreamLoadScanNode.java ## @@ -120,72 +119,9 @@ public void init(Analy

[GitHub] [incubator-doris] imay commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
imay commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323563026 ## File path: fe/src/main/java/org/apache/doris/load/Load.java ## @@ -807,6 +860,327 @@ public static void checkAndCreateSourc

[GitHub] [incubator-doris] imay commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
imay commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323564806 ## File path: fe/src/main/java/org/apache/doris/alter/AlterJobV2.java ## @@ -0,0 +1,217 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] morningman commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
morningman commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323574464 ## File path: fe/src/main/java/org/apache/doris/alter/AlterJobV2.java ## @@ -0,0 +1,217 @@ +// Licensed to the Apache So

[GitHub] [incubator-doris] morningman commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
morningman commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323574846 ## File path: fe/src/main/java/org/apache/doris/load/Load.java ## @@ -807,6 +860,327 @@ public static void checkAndCreat

[GitHub] [incubator-doris] morningman commented on a change in pull request #1695: Refactor alter job

2019-09-11 Thread GitBox
morningman commented on a change in pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323575599 ## File path: fe/src/main/java/org/apache/doris/planner/StreamLoadScanNode.java ## @@ -120,72 +119,9 @@ public void init

[GitHub] [incubator-doris] morningman merged pull request #1791: Fix bug that the calculation of disk usage percent is wrong

2019-09-11 Thread GitBox
morningman merged pull request #1791: Fix bug that the calculation of disk usage percent is wrong URL: https://github.com/apache/incubator-doris/pull/1791 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-doris] imay commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误

2019-09-11 Thread GitBox
imay commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误 URL: https://github.com/apache/incubator-doris/issues/1794#issuecomment-530690420 可以把内存适当调整大一些,`set exec_mem_limit = ` This is an automated message from the Apach

[GitHub] [incubator-doris] morningman commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误

2019-09-11 Thread GitBox
morningman commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误 URL: https://github.com/apache/incubator-doris/issues/1794#issuecomment-530690812 You can search `exec_mem_limit` here: `http://doris.incubator.apache.org/documentation/cn/getting-started/advance-usage.html?highlig

[GitHub] [incubator-doris] imay commented on issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240

2019-09-11 Thread GitBox
imay commented on issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240 URL: https://github.com/apache/incubator-doris/issues/1793#issuecomment-530690719 修改be的配置streaming_load_max_mb,适当调整的大一些

[GitHub] [incubator-doris] morningman commented on issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240

2019-09-11 Thread GitBox
morningman commented on issue #1793: stream load import 的时候出现 body exceed max size, max_body_bytes=10737418240 URL: https://github.com/apache/incubator-doris/issues/1793#issuecomment-530691196 You can search `streaming_load_max_mb` here: `http://doris.incubator.apache.org/documentation

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-11 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323580189 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] morningman commented on issue #1790: doris对于实时流处理的支持

2019-09-11 Thread GitBox
morningman commented on issue #1790: doris对于实时流处理的支持 URL: https://github.com/apache/incubator-doris/issues/1790#issuecomment-530692171 Do not use `INSERT INTO VALUES` stmt in product environment. It's throughput is very low. You can use `stream load` via http to meet load latency within

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323582503 ## File path: be/src/olap/types.h ## @@ -74,6 +74,7 @@ class TypeInfo { inline void set_to_min(void* buf) c

[GitHub] [incubator-doris] imay merged pull request #1787: support estimate size for v2 segment writer #1786

2019-09-12 Thread GitBox
imay merged pull request #1787: support estimate size for v2 segment writer #1786 URL: https://github.com/apache/incubator-doris/pull/1787 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323588812 ## File path: be/src/olap/bloom_filter.hpp ## @@ -71,6 +70,16 @@ class BitSet { return true; } +

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r321569645 ## File path: be/src/olap/rowset/segment_v2/bloom_filter_page.cpp ## @@ -0,0 +1,114 @@ +// Licensed to the Apach

[GitHub] [incubator-doris] kangpinghuang commented on issue #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on issue #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#issuecomment-530704672 > Besides implementation, I have several questions about the design > > 1. Why do we choose to store one BF per column per row block (1024 row

[GitHub] [incubator-doris] morningman opened a new issue #1797: Improve the load performance of large file

2019-09-12 Thread GitBox
morningman opened a new issue #1797: Improve the load performance of large file URL: https://github.com/apache/incubator-doris/issues/1797 The current load process is: `Tablet Sink -> Tablet Channel Mgr -> Tablets Channel -> Delta Writer -> MemTable -> Flush to disk` In the pa

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323600981 ## File path: be/src/olap/rowset/segment_v2/bloom_filter_page.cpp ## @@ -0,0 +1,114 @@ +// Licensed to the Apach

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323601322 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -152,7 +153,12 @@ class BinaryPlainPageDec

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602117 ## File path: be/src/olap/rowset/segment_v2/column_writer.h ## @@ -42,7 +44,13 @@ struct ColumnWriterOptions {

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602207 ## File path: be/src/olap/rowset/segment_v2/segment_writer.cpp ## @@ -137,6 +139,13 @@ Status SegmentWriter::_wr

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1738: add bloom filter index

2019-09-12 Thread GitBox
kangpinghuang commented on a change in pull request #1738: add bloom filter index URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602143 ## File path: be/src/olap/rowset/segment_v2/column_writer.h ## @@ -42,7 +44,13 @@ struct ColumnWriterOptions {

[GitHub] [incubator-doris] wubiaoi closed issue #1786: Support estimate size for v2 SegmentWriter

2019-09-12 Thread GitBox
wubiaoi closed issue #1786: Support estimate size for v2 SegmentWriter URL: https://github.com/apache/incubator-doris/issues/1786 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-doris] imay merged pull request #1695: Refactor alter job

2019-09-12 Thread GitBox
imay merged pull request #1695: Refactor alter job URL: https://github.com/apache/incubator-doris/pull/1695 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-doris] morningman opened a new pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
morningman opened a new pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798 ISSUE: #1797 This is an automated message from the Apache Git Service. To resp

[GitHub] [incubator-doris] morningman commented on issue #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
morningman commented on issue #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#issuecomment-530726511 Separate TabletsChannel from TabletWriterMgr to avoid conflict define between gutil and brpc --

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323628862 ## File path: be/src/olap/delta_writer.h ## @@ -75,10 +90,16 @@ class DeltaWriter { Rows

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323638178 ## File path: be/src/runtime/tablets_channel.h ## @@ -0,0 +1,129 @@ +// Licensed to the Apach

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323631389 ## File path: be/src/runtime/tablets_channel.h ## @@ -0,0 +1,129 @@ +// Licensed to the Apach

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
kangkaisen commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323626737 ## File path: be/src/common/config.h ## @@ -452,6 +452,10 @@ namespace config { CONF_Int

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-12 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323639985 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-12 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323640876 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-12 Thread GitBox
imay commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323640516 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @@ -84

[GitHub] [incubator-doris] xionglei0 commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange

2019-09-12 Thread GitBox
xionglei0 commented on a change in pull request #1788: add param: doris_exchange_instances to set parallel after exchange URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323647063 ## File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java ## @

[GitHub] [incubator-doris] morningman opened a new pull request #1799: Support table comment and column comment for view

2019-09-12 Thread GitBox
morningman opened a new pull request #1799: Support table comment and column comment for view URL: https://github.com/apache/incubator-doris/pull/1799 1. Support table comment when creating table or view 2. Support column comment when creating view. See `help create table` and `he

[GitHub] [incubator-doris] morningman commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
morningman commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678171 ## File path: be/src/common/config.h ## @@ -452,6 +452,10 @@ namespace config { CONF_Int

[GitHub] [incubator-doris] morningman commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
morningman commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678360 ## File path: be/src/olap/delta_writer.h ## @@ -75,10 +90,16 @@ class DeltaWriter { Rows

[GitHub] [incubator-doris] morningman commented on a change in pull request #1798: Optimize the load performance for large file

2019-09-12 Thread GitBox
morningman commented on a change in pull request #1798: Optimize the load performance for large file URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678984 ## File path: be/src/runtime/tablets_channel.h ## @@ -0,0 +1,129 @@ +// Licensed to the Apach

<    30   31   32   33   34   35   36   37   38   39   >