kangpinghuang commented on a change in pull request #1745: add delete predicate
filter(#1636)
URL: https://github.com/apache/incubator-doris/pull/1745#discussion_r322700637
##
File path: be/src/olap/delete_handler.cpp
##
@@ -343,5 +343,17 @@ void DeleteHandler::finalize()
imay opened a new issue #1776: create chunk allocator for memory pool
URL: https://github.com/apache/incubator-doris/issues/1776
## Motivation
In the case of high concurrency testing, many threads are waiting to be
applied and released in memory, and a large part of them are released
morningman opened a new issue #1777: Limit the mem usage when loading with HLL
column
URL: https://github.com/apache/incubator-doris/issues/1777
When loading tables containing HLL columns, the aggregation function of HLL
columns should have arena for memory allocation. Otherwise, the size
morningman opened a new pull request #1778: Fix bug that failed to limit the
mem usage of HLL column when loading
URL: https://github.com/apache/incubator-doris/pull/1778
Should use arena to allocate mem for HyperLogLog column.
ISSUE: #1777
-
kangkaisen opened a new pull request #1779: Minor: Update .gitignore
URL: https://github.com/apache/incubator-doris/pull/1779
This is an automated message from the Apache Git Service.
To respond to the message, please log on
kangkaisen commented on issue #1778: Fix bug that failed to limit the mem usage
of HLL column when loading
URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529926734
finalize method need also update.
This
kangkaisen edited a comment on issue #1778: Fix bug that failed to limit the
mem usage of HLL column when loading
URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529926734
update method need also update.
kangkaisen opened a new pull request #1780: Fix compile error
URL: https://github.com/apache/incubator-doris/pull/1780
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
imay merged pull request #1779: Minor: Update .gitignore
URL: https://github.com/apache/incubator-doris/pull/1779
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub an
imay commented on a change in pull request #1778: Fix bug that failed to limit
the mem usage of HLL column when loading
URL: https://github.com/apache/incubator-doris/pull/1778#discussion_r322753911
##
File path: be/src/olap/aggregate_func.h
##
@@ -435,7 +436,7 @@ struct
morningman commented on issue #1778: Fix bug that failed to limit the mem usage
of HLL column when loading
URL: https://github.com/apache/incubator-doris/pull/1778#issuecomment-529987141
> update method need also update.
Changed
--
imay merged pull request #1780: Fix compile error
URL: https://github.com/apache/incubator-doris/pull/1780
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use t
nick-yangg opened a new issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL: https://github.com/apache/incubator-doris/issues/1781
我在使用sh build.sh 编译的时候报错,致使编译失败。
’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530193961
centos的版本是?gcc的版本是?你这个应该是在编译三方库RocksDB出的问题?
如果想快速尝试Doris,建议可以直接使用Doris的docker镜像进行编译
--
yiguolei opened a new pull request #1783: Add meta store service thrift
definition
URL: https://github.com/apache/incubator-doris/pull/1783
#1782
This is an automated message from the Apache Git Service.
To respond to the
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530194519
CentOS的的版本是7 ,gcc 8 的版本,如果是RocksDB出的问题需要怎么去解决它
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530195164
@imay
This is an automated message from the A
imay commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530195846
你可以尝试export CXXFLAGS="-Wno-error=stringop-truncation"之后在编译试试
morningman commented on a change in pull request #1783: Add meta store service
thrift definition
URL: https://github.com/apache/incubator-doris/pull/1783#discussion_r323044760
##
File path: gensrc/thrift/MetaStoreService.thrift
##
@@ -0,0 +1,157 @@
+// Licensed to the Apac
morningman commented on a change in pull request #1783: Add meta store service
thrift definition
URL: https://github.com/apache/incubator-doris/pull/1783#discussion_r323044643
##
File path: gensrc/thrift/MetaStoreService.thrift
##
@@ -0,0 +1,157 @@
+// Licensed to the Apac
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530204022
@imay 我在编译的过程中出现了这些,应该没什么问题吧?
’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530204564
@imay 这个必须要编译吗,有编译好的版本(直接用的版本)吗?
This is an au
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530205532
好的我在尝试编译中,这个必须要编译吗,有编译好的可以直接使用的吗?
ZHAO Chun 于2019年9月11日周三 上午10:43写道:
> 你可以尝试export CXXFLAGS="-Wno
nick-yangg commented on issue #1781: 在CentOS上直接编译报错:‘char* strncpy(char*, const
char*, size_t)’
URL:
https://github.com/apache/incubator-doris/issues/1781#issuecomment-530269292
感谢你的帮助,我已经搭建完成了
yang nick 于2019年9月11日周三 上午11:35写道:
> 好的我在尝试编译中,这个必须要编译吗,有编译好的可以直接使用的吗?
>
>
kangkaisen opened a new issue #1784: FE warn log don't have useful info
URL: https://github.com/apache/incubator-doris/issues/1784
**Describe the bug**
```
2019-09-11 15:42:34,079 WARN 35
[GlobalTransactionMgr.finishTransaction():679] transaction state {} has error,
the replica [{}]
kangkaisen opened a new pull request #1785: Fix FE log error
URL: https://github.com/apache/incubator-doris/pull/1785
Fix https://github.com/apache/incubator-doris/issues/1784
This is an automated message from the Apache Git S
morningman closed pull request #1783: Add meta store service thrift definition
URL: https://github.com/apache/incubator-doris/pull/1783
This is an automated message from the Apache Git Service.
To respond to the message, plea
morningman closed issue #1784: FE warn log don't have useful info
URL: https://github.com/apache/incubator-doris/issues/1784
This is an automated message from the Apache Git Service.
To respond to the message, please log on t
morningman merged pull request #1785: Fix FE log error
URL: https://github.com/apache/incubator-doris/pull/1785
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
yiguolei opened a new pull request #1783: Add meta store service thrift
definition
URL: https://github.com/apache/incubator-doris/pull/1783
#1782
This is an automated message from the Apache Git Service.
To respond to the
wubiaoi opened a new issue #1786: Support estimate size for v2 SegmentWriter
URL: https://github.com/apache/incubator-doris/issues/1786
RowsetWriter needs to control memory usage by controlling the size of each
Segment file not too large, so SegmentWriter needs to implement the estimate
me
wubiaoi opened a new pull request #1787: #1786 support estimate size for v2
segment writer
URL: https://github.com/apache/incubator-doris/pull/1787
This is an automated message from the Apache Git Service.
To respond to the
wubiaoi opened a new pull request #1787: support estimate size for v2 segment
writer #1786
URL: https://github.com/apache/incubator-doris/pull/1787
This is an automated message from the Apache Git Service.
To respond to the
wubiaoi closed pull request #1787: support estimate size for v2 segment writer
#1786
URL: https://github.com/apache/incubator-doris/pull/1787
This is an automated message from the Apache Git Service.
To respond to the messag
xionglei0 opened a new pull request #1788: add param: doris_exchange_instances
to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788
doris_exchange_instances speed up the query especially useful when:
1. data size decrease on a massive scale after ex
jaynblue opened a new issue #1789: provide RPM package
URL: https://github.com/apache/incubator-doris/issues/1789
When will be provide RPM package?
This is an automated message from the Apache Git Service.
To respond to the me
yan-yunfeng opened a new issue #1790: doris对于实时流处理的支持
URL: https://github.com/apache/incubator-doris/issues/1790
我在尝试用flink接入doris进行实时数据的存储,发现单条数据的存入非常慢。
doris是否不太支持这种实时数据的逐条插入呢?如果不太支持,后续是否会实现实时数据快速逐条插入?
This is an auto
chaoyli commented on issue #1790: doris对于实时流处理的支持
URL:
https://github.com/apache/incubator-doris/issues/1790#issuecomment-530634330
doris的导入支持的micro-batch,每秒支持的导入在100次左右,对于这种单条导入,目前框架有限制。
我理解micro-batch对于分析场景,能够覆盖大部分的场景。
你这边是什么场景需要单条实时导入呢?
morningman merged pull request #1783: Add meta store service thrift definition
URL: https://github.com/apache/incubator-doris/pull/1783
This is an automated message from the Apache Git Service.
To respond to the message, plea
morningman commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r319505833
##
File path: fe/src/main/java/org/apache/doris/task/StreamLoadTask.java
##
@@ -83,8 +84,15 @@ public TFileFormatType ge
imay commented on issue #1789: provide RPM package
URL:
https://github.com/apache/incubator-doris/issues/1789#issuecomment-530640400
This may take a while, maybe 1-2 months? You can try to compile with docker
first.
This is
xionglei0 commented on issue #1788: add param: doris_exchange_instances to set
parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#issuecomment-530640543
 操作是有时候会出现下面的错误
URL: https://github.com/apache/incubator-doris/issues/1794
```
failed to initialize storage reader. tablet=12301.1548401152, res=-105,
backend=xx.xxx.xx.xx
```
这个问题是bug还是那里操作配置的有问题?
--
xionglei0 commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323541404
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@
yiguolei opened a new pull request #1795: Initialize tablet uid not using
default constructor for performance r…
URL: https://github.com/apache/incubator-doris/pull/1795
Init tablet uid at parameter initialize list not using default constructor
because boost uuid method is too slow.
-
chaoyli merged pull request #1795: Initialize tablet uid not using default
constructor for performance r…
URL: https://github.com/apache/incubator-doris/pull/1795
This is an automated message from the Apache Git Service.
To
EmmyMiao87 opened a new pull request #1796: Fix mistake in docs
URL: https://github.com/apache/incubator-doris/pull/1796
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
morningman merged pull request #1796: Fix mistake in docs
URL: https://github.com/apache/incubator-doris/pull/1796
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub a
imay commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323542395
##
File path: fe/src/main/java/org/apache/doris/planner/StreamLoadScanNode.java
##
@@ -120,72 +119,9 @@ public void init(Analy
imay commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323563026
##
File path: fe/src/main/java/org/apache/doris/load/Load.java
##
@@ -807,6 +860,327 @@ public static void checkAndCreateSourc
imay commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323564806
##
File path: fe/src/main/java/org/apache/doris/alter/AlterJobV2.java
##
@@ -0,0 +1,217 @@
+// Licensed to the Apache Software
morningman commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323574464
##
File path: fe/src/main/java/org/apache/doris/alter/AlterJobV2.java
##
@@ -0,0 +1,217 @@
+// Licensed to the Apache So
morningman commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323574846
##
File path: fe/src/main/java/org/apache/doris/load/Load.java
##
@@ -807,6 +860,327 @@ public static void checkAndCreat
morningman commented on a change in pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695#discussion_r323575599
##
File path: fe/src/main/java/org/apache/doris/planner/StreamLoadScanNode.java
##
@@ -120,72 +119,9 @@ public void init
morningman merged pull request #1791: Fix bug that the calculation of disk
usage percent is wrong
URL: https://github.com/apache/incubator-doris/pull/1791
This is an automated message from the Apache Git Service.
To respond
imay commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误
URL:
https://github.com/apache/incubator-doris/issues/1794#issuecomment-530690420
可以把内存适当调整大一些,`set exec_mem_limit = `
This is an automated message from the Apach
morningman commented on issue #1794: doris 进行count(*) 操作是有时候会出现下面的错误
URL:
https://github.com/apache/incubator-doris/issues/1794#issuecomment-530690812
You can search `exec_mem_limit` here:
`http://doris.incubator.apache.org/documentation/cn/getting-started/advance-usage.html?highlig
imay commented on issue #1793: stream load import 的时候出现 body exceed max size,
max_body_bytes=10737418240
URL:
https://github.com/apache/incubator-doris/issues/1793#issuecomment-530690719
修改be的配置streaming_load_max_mb,适当调整的大一些
morningman commented on issue #1793: stream load import 的时候出现 body exceed max
size, max_body_bytes=10737418240
URL:
https://github.com/apache/incubator-doris/issues/1793#issuecomment-530691196
You can search `streaming_load_max_mb` here:
`http://doris.incubator.apache.org/documentation
imay commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323580189
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@@ -84
morningman commented on issue #1790: doris对于实时流处理的支持
URL:
https://github.com/apache/incubator-doris/issues/1790#issuecomment-530692171
Do not use `INSERT INTO VALUES` stmt in product environment. It's throughput
is very low.
You can use `stream load` via http to meet load latency within
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323582503
##
File path: be/src/olap/types.h
##
@@ -74,6 +74,7 @@ class TypeInfo {
inline void set_to_min(void* buf) c
imay merged pull request #1787: support estimate size for v2 segment writer
#1786
URL: https://github.com/apache/incubator-doris/pull/1787
This is an automated message from the Apache Git Service.
To respond to the message,
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323588812
##
File path: be/src/olap/bloom_filter.hpp
##
@@ -71,6 +70,16 @@ class BitSet {
return true;
}
+
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r321569645
##
File path: be/src/olap/rowset/segment_v2/bloom_filter_page.cpp
##
@@ -0,0 +1,114 @@
+// Licensed to the Apach
kangpinghuang commented on issue #1738: add bloom filter index
URL: https://github.com/apache/incubator-doris/pull/1738#issuecomment-530704672
> Besides implementation, I have several questions about the design
>
> 1. Why do we choose to store one BF per column per row block (1024 row
morningman opened a new issue #1797: Improve the load performance of large file
URL: https://github.com/apache/incubator-doris/issues/1797
The current load process is:
`Tablet Sink -> Tablet Channel Mgr -> Tablets Channel -> Delta Writer ->
MemTable -> Flush to disk`
In the pa
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323600981
##
File path: be/src/olap/rowset/segment_v2/bloom_filter_page.cpp
##
@@ -0,0 +1,114 @@
+// Licensed to the Apach
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323601322
##
File path: be/src/olap/rowset/segment_v2/binary_plain_page.h
##
@@ -152,7 +153,12 @@ class BinaryPlainPageDec
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602117
##
File path: be/src/olap/rowset/segment_v2/column_writer.h
##
@@ -42,7 +44,13 @@ struct ColumnWriterOptions {
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602207
##
File path: be/src/olap/rowset/segment_v2/segment_writer.cpp
##
@@ -137,6 +139,13 @@ Status SegmentWriter::_wr
kangpinghuang commented on a change in pull request #1738: add bloom filter
index
URL: https://github.com/apache/incubator-doris/pull/1738#discussion_r323602143
##
File path: be/src/olap/rowset/segment_v2/column_writer.h
##
@@ -42,7 +44,13 @@ struct ColumnWriterOptions {
wubiaoi closed issue #1786: Support estimate size for v2 SegmentWriter
URL: https://github.com/apache/incubator-doris/issues/1786
This is an automated message from the Apache Git Service.
To respond to the message, please log
imay merged pull request #1695: Refactor alter job
URL: https://github.com/apache/incubator-doris/pull/1695
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
morningman opened a new pull request #1798: Optimize the load performance for
large file
URL: https://github.com/apache/incubator-doris/pull/1798
ISSUE: #1797
This is an automated message from the Apache Git Service.
To resp
morningman commented on issue #1798: Optimize the load performance for large
file
URL: https://github.com/apache/incubator-doris/pull/1798#issuecomment-530726511
Separate TabletsChannel from TabletWriterMgr to avoid conflict define
between gutil and brpc
--
kangkaisen commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323628862
##
File path: be/src/olap/delta_writer.h
##
@@ -75,10 +90,16 @@ class DeltaWriter {
Rows
kangkaisen commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323638178
##
File path: be/src/runtime/tablets_channel.h
##
@@ -0,0 +1,129 @@
+// Licensed to the Apach
kangkaisen commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323631389
##
File path: be/src/runtime/tablets_channel.h
##
@@ -0,0 +1,129 @@
+// Licensed to the Apach
kangkaisen commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323626737
##
File path: be/src/common/config.h
##
@@ -452,6 +452,10 @@ namespace config {
CONF_Int
imay commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323639985
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@@ -84
imay commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323640876
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@@ -84
imay commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323640516
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@@ -84
xionglei0 commented on a change in pull request #1788: add param:
doris_exchange_instances to set parallel after exchange
URL: https://github.com/apache/incubator-doris/pull/1788#discussion_r323647063
##
File path: fe/src/main/java/org/apache/doris/qe/Coordinator.java
##
@
morningman opened a new pull request #1799: Support table comment and column
comment for view
URL: https://github.com/apache/incubator-doris/pull/1799
1. Support table comment when creating table or view
2. Support column comment when creating view.
See `help create table` and `he
morningman commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678171
##
File path: be/src/common/config.h
##
@@ -452,6 +452,10 @@ namespace config {
CONF_Int
morningman commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678360
##
File path: be/src/olap/delta_writer.h
##
@@ -75,10 +90,16 @@ class DeltaWriter {
Rows
morningman commented on a change in pull request #1798: Optimize the load
performance for large file
URL: https://github.com/apache/incubator-doris/pull/1798#discussion_r323678984
##
File path: be/src/runtime/tablets_channel.h
##
@@ -0,0 +1,129 @@
+// Licensed to the Apach
3401 - 3500 of 7706 matches
Mail list logo