Re:Re: [DISCUSS] Unify the load framework in Doris

2019-06-21 Thread 陈明雨
idu.com>> >日期: 2019年4月9日 星期二 下午4:39 >至: "dev@doris.apache.org<mailto:dev@doris.apache.org>" >mailto:dev@doris.apache.org>> >抄送: palo-rd mailto:palo...@baidu.com>>, Ling Miao >mailto:miaolin...@baidu.com>> >主题: [DISCUSS] Unify the load frame

Re: [DISCUSS] Unify the load framework in Doris

2019-06-21 Thread Miao,Ling
pache.org>" mailto:dev@doris.apache.org>> 抄送: palo-rd mailto:palo...@baidu.com>>, Ling Miao mailto:miaolin...@baidu.com>> 主题: [DISCUSS] Unify the load framework in Doris Hi all, I prepare to unify the load framework in Doris. The background is following: There are diffe

Re: [DISCUSS] Unify the load framework in Doris

2019-04-10 Thread Zhao Chun
It will be a good job for Doris. Here are some code to do same thing, for example, the CSVScanNode can be replaced by BrokerScanNode. And BrokerScanNode seems to be changed another name, because that it not only can scan from broker, but also from local file or memory sink. Can you change it to an

[DISCUSS] Unify the load framework in Doris

2019-04-09 Thread Miao,Ling
Hi all, I prepare to unify the load framework in Doris. The background is following: There are different load frameworks belong to different load methods in Doris. On the one hand, the performance of broker and mini load which use the old framework is lower than stream load. On the other hand,