HDFS reads blocks sequentially. We can implement a multi-threaded block reader in theory.
> On Jun 26, 2019, at 5:05 AM, Daegyu Han <[email protected]> wrote: > > Hi all, > > Assuming HDFS has a 1GB file input.dat and a block size of 128MB. > > Can the user read multithreaded when reading the input.dat file? > > In other words, is not the block being read sequentially, but reading > multiple blocks at the same time? > > If not, is it difficult to implement a multi-threaded block read? > > Best Regards, > Daegyu > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
