Re: [Beowulf] copying big files

2008-08-10 Thread Nifty niftyompi Mitch
On Fri, Aug 08, 2008 at 05:52:40PM +0200, Jan Heichler wrote: >Hallo Henning, >HF> Hi everybody, > >HF> One needs basically a daemon which handles copying requests and >establishes > >HF> the connection to next node in the chain. > >Why a daemon? Just MPI that starts up t

Re: [Beowulf] Building new cluster - estimate

2008-08-10 Thread Scott Atchley
On Aug 5, 2008, at 10:43 PM, Joe Landman wrote: As a note: I was pointed to a recent lockup (double lock acquisition) in XFS with NFS. I don't think I have seen this one in the wild myself. Right now I am fighting an NFS over RDMA crash in 2.6.26 which seems to have been cured in 2.6.26.

Re: [Beowulf] copying big files (Henning Fehrmann)

2008-08-10 Thread Scott Atchley
On Aug 10, 2008, at 7:57 AM, Scott Atchley wrote: You may want to look at http://loci.cs.utk.edu. If you need to distribute large files within a cluster or across the WAN, you can use the LoRS tools to stripe the file over multiple servers and the clients then try pulling blocks off of each

Re: [Beowulf] copying big files (Henning Fehrmann)

2008-08-10 Thread Scott Atchley
On Aug 9, 2008, at 5:03 PM, Reuti wrote: Hi, Am 09.08.2008 um 20:53 schrieb jitesh dundas: We could try and implement this functionality of resuming broken downloads like in some softwares like Download Accelerator and bit-torrent. I hope my views can help, so here goes:- When a file is bei