On Mar 5, 2010, at 11:32 AM, Michael Di Domenico wrote:
I was hoping someone would pop up say, hey use this magical piece of software. (of which im unable to locate)..
You might want to take a look at GridFTP from Globus (http:// globus.org). Among other things, it has support for parallel data streams and is specifically designed for transferring lots of data between clusters. It's distributed as part of the Toolkit, and it's not too hard to build /just/ GridFTP.
As with any recommended software, YMMV. ---------------- Andrew Fitz Gibbon f...@cs.earlham.edu _______________________________________________ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf