On 05/19/2014 11:26 PM, Lockwood, Glenn wrote:
I appreciate your commentary, Ellis. I agree and disagree with you
on your various points, and a lot of comes from what (I suspect) is
the difference in our perspectives:
Hi Glenn -- sorry to come off uncouth in certain instances. Was writing
st
I think looking at technology such as MapR is using could address the
suboptimal HDFS, there are opportunities to be had with this framework. As for
Java, I could pontificate, but to this group I sense this would be pointless...
The right tool for the job will trump in the end.
James Lowey
I appreciate your commentary, Ellis. I agree and disagree with you on your
various points, and a lot of comes from what (I suspect) is the difference in
our perspectives:
On May 19, 2014, at 5:48 PM, Ellis H. Wilson III wrote:
> 1. I wish "Hadoop" would die. The term that is. Hadoop exists l
On 05/19/2014 03:26 PM, Douglas Eadline wrote:
Great write-up by Glenn Lockwood about the state of Hadoop in HPC. It
pretty much nails it, and offers an nice overview of the current
ongoing efforts to make it relevant in that field.
http://glennklockwood.blogspot.com/2014/05/hadoops-uncomfortab
On May 19, 2014, at 4:24 PM, Christopher Samuel wrote:
> Other than that we've had no interest expressed in it to us, and I
> wasn't aware of a way for us to support it now we've completely
> migrated to Slurm (had no reason to look).
FYI, we have a simpler alternative to Hadoop on Demand that i
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On 20/05/14 07:36, Andrew Holway wrote:
> There is also support for SLURM as a scheduler however I don't have
> a nice link. These bits should mean that Hadoop can play nicely as
> a "normal" HPC application.
Interesting, we had a small bit of intere
Important paragraph:
"Some larger players in the HPC arena have begun to provide rich support
for high-performance parallel file systems as a complete alternative to
HDFS. IBM's GPFS file system has a file placement optimization (FPO)
capability that allows GPFS to act as a drop-in replacement fo
> Great write-up by Glenn Lockwood about the state of Hadoop in HPC. It
> pretty much nails it, and offers an nice overview of the current
> ongoing efforts to make it relevant in that field.
>
> http://glennklockwood.blogspot.com/2014/05/hadoops-uncomfortable-fit-in-hpc.html
>
> Most spot on thi
