Re: [Beowulf] Hadoop

2008-12-27 Thread Jeff Layton
I hate to tangent (hijack?) this subject, but I'm curious about your class poll. Did the people who were interested in Matlab consider Octave? Thanks! Jeff From: Joe Landman To: Jeff Layton Cc: Gerry Creager ; Beowulf Mailing List Sent: Saturday, Decembe

Re: [Beowulf] Hadoop

2008-12-27 Thread Joe Landman
Jeff Layton wrote: BTW - I saw Karen's post about using Java with HadoopFS. Be sure to pay attention to that since getting a good 64-bit Java implementation for Linux is not always easy. There are a few out there (Sun has an early access program to a 64-bit Java) but the reports I've heard are

Re: [Beowulf] Hadoop

2008-12-27 Thread Gerry Creager
Jeff, I'm an old, guy and don't mind top-posts! Thanks for the insight! gerry Jeff Layton wrote: Sorry for top-posting (I hate these on-line email tools...) Did the person requesting Hadoop ever say why they wanted it? For example, do they have code written in MapReduce or do they think that

Re: [Beowulf] Hadoop

2008-12-27 Thread Gerry Creager
Karen, Thanks for the clarifications. I'm concerned about the software, but it looks like we'll install Hadoop On Demand, as someone has already promised a user we'd do it... If there were serious pitfalls, I might be able to slow it down some, but simply inefficient isn't sufficient... we h

[Beowulf] Tales of Desperaux

2008-12-27 Thread John Hearns
http://www.theregister.co.uk/2008/12/26/soho_rendering_supercomputer/ Excellent article on the 4000 core render farm for Tales of Desperaux, and the Lustre file system behind it. My only connection with the project being that I used to work for Steve Prescott yea long ago... back when the dinosaur

Re: [Beowulf] Hadoop

2008-12-27 Thread Jeff Layton
Sorry for top-posting (I hate these on-line email tools...) Did the person requesting Hadoop ever say why they wanted it? For example, do they have code written in MapReduce or do they think that Hadoop will give them faster throughput than something else? Hadoop is a project that really has 2

Re: [Beowulf] Hadoop

2008-12-27 Thread Chris Samuel
Hi Gerry, - "Gerry Creager" wrote: > I'm a bit concerned that it's not gonna be real compatible > with, say, Torque/Maui and Gluster There is the Hadoop on Demand (HOD) project to integrate Hadoop with Torque: http://hadoop.apache.org/core/docs/current/hod.html No idea how well it works t