Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Michael Huntingdon
I just sat in on a presentation where both streaming and meta-data were discussed. Meta-data is the silver bullet in a Luster environment. The conversation turned to setting up NFS for home/user, with the nearly all other data on SFS with enough OSS and MDS servers to provide both the throughpu

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Craig Tierney
Brian D. Ropers-Huilman wrote: On 12/11/06, Craig Tierney <[EMAIL PROTECTED]> wrote: Lustre supports redundant meta-data servers (MDS) and failover for the object-storage servers (OSS). However, "high-performing" is relative. Great at streaming data, not at meta-data. Which is really the bane

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Brian D. Ropers-Huilman
On 12/11/06, Craig Tierney <[EMAIL PROTECTED]> wrote: Lustre supports redundant meta-data servers (MDS) and failover for the object-storage servers (OSS). However, "high-performing" is relative. Great at streaming data, not at meta-data. Which is really the bane of all cluster file systems, is

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Craig Tierney
Mark Hahn wrote: You can look into OpenAFS but be warned that you have to know infrastructure software quite well (LDAP+kerberos). It's cross-platform, can be distributed but don't think it's up to multiple writes on different mirrors though. and Lustre is parallel, high-performing and somewh

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Bill Broadley
Eric Thibodeau wrote: You can look into OpenAFS but be warned that you have to know infrastructure software quite well (LDAP+kerberos). It's cross-platform, can be distributed but don't think it's up to multiple writes on different mirrors though. Indeed. There are many tough compromises in

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Michael Will
Look at dcache -Original Message- From: Mark Hahn [mailto:[EMAIL PROTECTED] Sent: Mon Dec 11 17:01:15 2006 To: beowulf@beowulf.org Subject:Re: [Beowulf] distributed file storage solution? > You can look into OpenAFS but be warned that you have to know >infrastructure soft

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Mark Hahn
i am looking for a application (most preferably, but not necessarily OSS or free software) and that can create distributed, reliable, fault tolerant, decentralized, high preformance file server. how reliable/fault-tolerant? how distributed/decentralized (no servers)? how high-performing? I've

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Mark Hahn
You can look into OpenAFS but be warned that you have to know infrastructure software quite well (LDAP+kerberos). It's cross-platform, can be distributed but don't think it's up to multiple writes on different mirrors though. and Lustre is parallel, high-performing and somewhat reliable/FT, but

Re: [Beowulf] distributed file storage solution?

2006-12-11 Thread Eric Thibodeau
You can look into OpenAFS but be warned that you have to know infrastructure software quite well (LDAP+kerberos). It's cross-platform, can be distributed but don't think it's up to multiple writes on different mirrors though. Le vendredi 8 décembre 2006 21:36, samit a écrit : > hello list, > >

RE: [Beowulf] SATA II - PXE+NFS - diskless compute nodes

2006-12-11 Thread Michael Will
Scyld CW4 is based on RHEL4 and also supported on Centos 4. That does not give you different operating systems though, just flexible deployment of RHEL4 based HPC compute nodes. Note that we had to reimplement the PXE boot part to allow reasonable scaling. Michael -Original Message- Fr

[Beowulf] distributed file storage solution?

2006-12-11 Thread samit
hello list, i am looking for a application (most preferably, but not necessarily OSS or free software) and that can create distributed, reliable, fault tolerant, decentralized, high preformance file server. I've looked at few P2P file storing solutions that store multiple copies of file in differ