Hi, > Or is it just not developed to this point? It isn't developed & I don't think there is any effort going on in that direction
> I learned that continuous layout can ensure the locality of file blocks How? Erasure Coding will have BlockGroups not just one Block, whether you write in a striped manner or in a Contiguous manner, it will spread over equal number of Datanodes based on the BPP, I am not sure if anything changes with locality, just by the way how EC Blocks are written. > , I have large files and write them once and read them many times. Erasure Coding in general was developed for storing Archival data, so you need to figure out how "many" is ok. -Ayush On Mon, 22 Apr 2024 at 15:56, zhangzhengli <[email protected]> wrote: > Hi all, Since HDFS-8030, hdfs ec continuous layout has not developed much. > Are there any difficulties? Or is it just not developed to this point? > > > > I learned that continuous layout can ensure the locality of file blocks, > and I want to use this feature in near-data scenarios. For example, I have > large files and write them once and read them many times. > > > > Any suggestions are appreciated > > > > 从 Windows 版邮件 <https://go.microsoft.com/fwlink/?LinkId=550986>发送 > > >
