On 2017-02-13 09:36, Benson Muite wrote: > Hi, > > Do you have any performance requirements? > > Benson > > On 02/13/2017 09:55 AM, Tony Brian Albers wrote: >> Hi guys, >> >> So, we're running a small(as in a small number of nodes(10), not >> storage(170TB)) hadoop cluster here. Right now we're on IBM Spectrum >> Scale(GPFS) which works fine and has POSIX support. On top of GPFS we >> have a GPFS transparency connector so that HDFS uses GPFS. >> >> Now, if I'd like to replace GPFS with something else, what should I use? >> It needs to be a fault-tolerant DFS, with POSIX support(so that users >> can move data to and from it with standard tools). >> >> I've looked at MooseFS which seems to be able to do the trick, but are >> there any others that might do? >> >> TIA >> >
Well, we're not going to be doing a huge amount of I/O. So performance requirements are not high. But ingest needs to be really fast, we're talking tens of terabytes here. /tony -- Best regards, Tony Albers Systems administrator, IT-development Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark. Tel: +45 2566 2383 / +45 8946 2316 _______________________________________________ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
