kangpinghuang commented on a change in pull request #1417: Check if there exist
a rowset contains the added rowset
URL: https://github.com/apache/incubator-doris/pull/1417#discussion_r299324034
##
File path: be/src/olap/task/engine_publish_version_task.cpp
##
@@ -104,7 +10
yiguolei opened a new pull request #1417: Check if there exist a rowset
contains the added rowset
URL: https://github.com/apache/incubator-doris/pull/1417
This is an automated message from the Apache Git Service.
To respond
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299288208
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299024099
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299289567
##
File path: be/src/olap/rowset/segment_v2/encoding_info.h
##
@@ -31,8 +34,6 @@ namespace segment_v2 {
class PageBuilder;
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299287913
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299287706
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299038874
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299284866
##
File path: be/src/olap/rowset/segment_v2/options.h
##
@@ -17,20 +17,19 @@
#pragma once
-#include "gen_cpp/segment_v2.pb
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299286552
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299027679
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299028699
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299026166
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299028050
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.cpp
##
@@ -0,0 +1,213 @@
+// Licensed to the Apache Software Found
gaodayue commented on a change in pull request #1409: Add dict page
URL: https://github.com/apache/incubator-doris/pull/1409#discussion_r299284414
##
File path: be/src/olap/rowset/segment_v2/binary_dict_page.h
##
@@ -0,0 +1,116 @@
+// Licensed to the Apache Software Foundat
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507499007
磁盘是HDD
This is an automated message from the Apache Git Service.
To respond to t
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507497496
测试过程我我发现Load的性能不高，我在hdfs的一个目录下放了20G数据，22个文件，表字段150个，入库使用了1小时17分钟，这个性能对于一个MPP入库来说，感觉性能不太好。硬件配置上，doris使用万兆网，hadoop使用千兆网，SSD磁盘。性能有调优的空间吗？
-
Hi All,
We are pleased to announce the release of Apache Doris 0.10.0-incubating.
Apache Doris (incubating) is an MPP-based interactive SQL data warehousing for
reporting and analysis.
Thanks to everyone who has contributed to this release.
The release and its note can be found here:
https://git
kangpinghuang commented on issue #1408: Add dict encoding page
URL:
https://github.com/apache/incubator-doris/issues/1408#issuecomment-507220068
pls refer to PR #1409
This is an automated message from the Apache Git Service.
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298984233
##
File path: be/src/olap/olap_index.h
##
@@ -87,13 +83,11 @@ struct OLAPIndexOffset {
//
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507212748
ok，3q
This is an automated message from the Apache Git Service.
To respond to th
imay merged pull request #1173: load data from Parquet file (Issues #911)
URL: https://github.com/apache/incubator-doris/pull/1173
This is an automated message from the Apache Git Service.
To respond to the message, please lo
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298980096
##
File path: be/src/olap/olap_index.cpp
##
@@ -50,41 +53,64 @@ MemIndex::~MemIndex() {
for
imay commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507208871
> 我用的是0.10.0-rc04版本，该版本支持“不需要全部加载到内存中”特性么？
This is supported in current master branch. not in 0.10.0
-
zhaomingzhu commented on issue #1399: llvm 无法编译
URL:
https://github.com/apache/incubator-doris/issues/1399#issuecomment-507206582
Thanks ，this problem has been solved by adding proxies for mvn config。 but
compile BE code is error。
Question 3：
../olap/libOlap.a(utils.cpp.o)：在函数‘boost
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507193035
我用的是0.10.0-rc04版本，该版本支持“不需要全部加载到内存中”特性么？
This is an automated message from the A
zhaomingzhu commented on issue #1399: llvm 无法编译
URL:
https://github.com/apache/incubator-doris/issues/1399#issuecomment-507187131
sorry 依然报错。 使用你们docker 环境编译fe和自己设置环境编译FE，出现同样错误。
网络可以通，但是maven依赖包无法下载。
[ERROR] Plugin net.sourceforge.czt.dev:cup-maven-plugin:1.6-cdh or one of
its d
imay commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507178496
set exec_mem_limit = xxx
xxx's unit is in bytes whose default value is 2GB
This is a
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298942828
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache Softw
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298942713
##
File path: be/src/olap/olap_index.h
##
@@ -87,13 +83,11 @@ struct OLAPIndexOffset {
// 唯一标识
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298942725
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache Softw
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298941806
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache Softw
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298941841
##
File path: be/src/olap/olap_index.h
##
@@ -133,37 +127,35 @@ struct RowBlockPosition {
imay commented on a change in pull request #1413: Add short key index builder,
decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298940249
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache Softw
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507174285
改完后不再报上面那个错误了，但报了Broker etl failed：Memory limit exceeded的错误。
This is an automate
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298908687
##
File path: be/src/olap/olap_index.h
##
@@ -133,37 +127,35 @@ struct RowBlockPosition {
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298922286
##
File path: be/src/olap/olap_index.h
##
@@ -87,13 +83,11 @@ struct OLAPIndexOffset {
//
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298932675
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache S
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298914147
##
File path: be/src/olap/olap_index.cpp
##
@@ -50,41 +53,64 @@ MemIndex::~MemIndex() {
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298902873
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache S
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298863266
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache S
gaodayue commented on a change in pull request #1413: Add short key index
builder, decoder, iterator
URL: https://github.com/apache/incubator-doris/pull/1413#discussion_r298932728
##
File path: be/src/olap/short_key_index.h
##
@@ -0,0 +1,183 @@
+// Licensed to the Apache S
imay commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507168539
> 是在fe或be的配置文件中改么？我用mysql set 命令提示没有这个变量
fe.conf
max_bytes_per_broker_scanner = x
zttaotao2013 commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507166559
是在fe或be的配置文件中改么？我用mysql set 命令提示没有这个变量
This is an automated message from the Apa
imay merged pull request #1415: Change error msg of mini load when
PUBLISH_TIMEOUT
URL: https://github.com/apache/incubator-doris/pull/1415
This is an automated message from the Apache Git Service.
To respond to the message,
imay commented on issue #1416: ETL_SUBMIT_FAIL problem
URL:
https://github.com/apache/incubator-doris/issues/1416#issuecomment-507160933
当前broker导入需要把数据都加载到内存中，然后完成排序操作再写入到磁盘中。
我们新版本的导入已经可以不需要全部加载到内存中了，这个值是可以改大的。你可以修改max_bytes_per_broker_scanner的值
---
zttaotao2013 opened a new issue #1416: ETL_SUBMIT_FAIL problem
URL: https://github.com/apache/incubator-doris/issues/1416
我搭建了3fe + 3be + 3broker的doris测试环境，计划对存储于hdfs目录中的数据使用Broker进行批量入库，我定义了一个任务：
load label data_load_1
data infile
(
"hdfs://192.168.0.2:8020/doris/data/*.nb"
imay edited a comment on issue #1399: llvm 无法编译
URL:
https://github.com/apache/incubator-doris/issues/1399#issuecomment-507142582
You can install libbfd with `yum install binutils-devel zlib-devel
libcurl-devel elfutils-devel`
--
imay commented on issue #1399: llvm 无法编译
URL:
https://github.com/apache/incubator-doris/issues/1399#issuecomment-507142582
You can install libbfd with `yum install elfutils-devel`
This is an automated message from the Apache
49 matches
Mail list logo
