Re:Re:Re: Refactor Doris's IO Stack

2022-04-27 Thread 陈明雨
Add write priv for plat1ko [1] https://cwiki.apache.org/confluence/display/DORIS/DSIP-006%3A+Refactor+IO+stack -- 此致!Best Regards 陈明雨 Mingyu Chen Email: chenmin...@apache.org 在 2022-03-31 14:41:35,"陈明雨" 写道: >Hi Guolei, >I have created DSIP-006 for this proposal >https://cwiki.apache.o

Re:Re: Refactor Doris's IO Stack

2022-03-30 Thread 陈明雨
Hi Guolei, I have created DSIP-006 for this proposal https://cwiki.apache.org/confluence/display/DORIS/DSIP-006%3A+Refactor+IO+stack -- 此致!Best Regards 陈明雨 Mingyu Chen Email: chenmin...@apache.org 在 2022-03-30 12:35:44,"王博" 写道: >+1 >Looking forward Teacher Guolei's dsip. > >GuoLei Yi 于

Re: Refactor Doris's IO Stack

2022-03-29 Thread 王博
+1 Looking forward Teacher Guolei's dsip. GuoLei Yi 于2022年3月29日周二 14:17写道: > Currently, there are various interfaces for file IO operations in Doris: > >- There are FileReader and FileWriter in the query layer. There are >corresponding implementations for HDFS, S3, Broker, and Local. >

Re: Refactor Doris's IO Stack

2022-03-29 Thread GuoLei Yi
Thanks for your advice. I will follow your instructions, and replace the usage step by step. 陈明雨 于2022年3月29日周二 22:55写道: > Indeed, we need to refactor the IO layer to make it more clear and > extensible. > The basic purpose is that when a new kind of file system is introduced, we > only need to i

Refactor Doris's IO Stack

2022-03-28 Thread GuoLei Yi
Currently, there are various interfaces for file IO operations in Doris: - There are FileReader and FileWriter in the query layer. There are corresponding implementations for HDFS, S3, Broker, and Local. - In the storage layer, there is a BlockManager that abstracts Block, there are Wr