[Beowulf] SC10 Beowulf Bash

2010-10-29 Thread Douglas Eadline
It is that time of the year. If you are attending SC10, here is what you have been waiting for: The Big Wheels Keep On Turning Beowulf Bash http://www.xandmarketing.com/beobash10/ -- Doug -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to

RE: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Lux, Jim (337C)
> -Original Message- > From: beowulf-boun...@beowulf.org [mailto:beowulf-boun...@beowulf.org] On > Behalf Of Joe Landman > Sent: Friday, October 29, 2010 1:10 PM > To: beowulf@beowulf.org > Subject: Re: [Beowulf] Storage - the end of RAID? > > RAID IS NOT A BACKUP (can't say how many tim

Re: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Ellis H. Wilson III
On 10/29/10 15:48, Greg Lindahl wrote: On Fri, Oct 29, 2010 at 03:02:45PM -0400, Ellis H. Wilson III wrote: I think it's making a pretty wild assumption to say search engines and HPC have the same I/O needs (and thus can use the same I/O setups). Well, I'm an HPC guy doing infrastructure for

Re: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Joe Landman
On 10/29/2010 03:02 PM, Ellis H. Wilson III wrote: On 10/29/10 13:18, Greg Lindahl wrote: On Fri, Oct 29, 2010 at 05:42:39PM +0100, Hearns, John wrote: Quite a perceptive article on ZDnet http://www.zdnet.com/blog/storage/the-end-of-raid/1154?tag=nl.e539 This has been going on for a long ti

Re: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Greg Lindahl
On Fri, Oct 29, 2010 at 03:02:45PM -0400, Ellis H. Wilson III wrote: > I think it's making a pretty wild assumption to say search engines and > HPC have the same I/O needs (and thus can use the same I/O setups). Well, I'm an HPC guy doing infrastructure for a search engine, so I'm not assuming

Re: [Beowulf] RE: Storage - the end of RAID?

2010-10-29 Thread Andrew Piskorski
On Fri, Oct 29, 2010 at 02:46:35PM -0400, Ellis H. Wilson III wrote: >>> http://www.zdnet.com/blog/storage/the-end-of-raid/1154?tag=nl.e539 > The major issue I see with the article is that the author refers to RAID > being "dead" when really he should be saying RAID 2-6 is less preferable > to R

Re: [Beowulf] RE: Storage - the end of RAID?

2010-10-29 Thread Greg Lindahl
On Fri, Oct 29, 2010 at 02:46:35PM -0400, Ellis H. Wilson III wrote: > Drives (of the commodity variety) are pretty darn cheap already. I'd be > surprised if this (RAID 1) isn't the better solution today (rather than > RAID2-6), rather than some point in the future. Um, it's not really RAID

Re: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Ellis H. Wilson III
On 10/29/10 13:18, Greg Lindahl wrote: On Fri, Oct 29, 2010 at 05:42:39PM +0100, Hearns, John wrote: Quite a perceptive article on ZDnet http://www.zdnet.com/blog/storage/the-end-of-raid/1154?tag=nl.e539 This has been going on for a long time. Blekko has 5 petabytes of disk, and no RAID any

Re: [Beowulf] RE: Storage - the end of RAID?

2010-10-29 Thread Ellis H. Wilson III
On 10/29/10 14:06, Lux, Jim (337C) wrote: -Original Message- From: beowulf-boun...@beowulf.org [mailto:beowulf-boun...@beowulf.org] On Behalf Of Hearns, John Sent: Friday, October 29, 2010 9:43 AM To: beowulf@beowulf.org Subject: [Beowulf] Storage - the end of RAID? Quite a perceptive a

[Beowulf] RE: Storage - the end of RAID?

2010-10-29 Thread Lux, Jim (337C)
> -Original Message- > From: beowulf-boun...@beowulf.org [mailto:beowulf-boun...@beowulf.org] On > Behalf Of Hearns, John > Sent: Friday, October 29, 2010 9:43 AM > To: beowulf@beowulf.org > Subject: [Beowulf] Storage - the end of RAID? > > Quite a perceptive article on ZDnet > > http://

RE: [Beowulf] Re: Interesting

2010-10-29 Thread Lux, Jim (337C)
Jim Lux +1(818)354-2075 > -Original Message- > From: Robert G. Brown [mailto:r...@phy.duke.edu] > Sent: Friday, October 29, 2010 10:37 AM > To: Lux, Jim (337C) > Cc: Ellis H. Wilson III; beowulf@beowulf.org > Subject: Re: [Beowulf] Re: Interesting > > On Fri, 29 Oct 2010, Lux, Jim (337C

Re: [Beowulf] Re: Interesting

2010-10-29 Thread Robert G. Brown
On Fri, 29 Oct 2010, Lux, Jim (337C) wrote: Or, how about something like the UNICON aka "terabit memory" (TBM) from Illiac IV days. It's a stable polyester base with a thin film of rhodium that was ablated by a laser making 3 micron holes to write the bits. $3.5M to store a terabit in 1975. B

Re: [Beowulf] Storage - the end of RAID?

2010-10-29 Thread Greg Lindahl
On Fri, Oct 29, 2010 at 05:42:39PM +0100, Hearns, John wrote: > Quite a perceptive article on ZDnet > > http://www.zdnet.com/blog/storage/the-end-of-raid/1154?tag=nl.e539 This has been going on for a long time. Blekko has 5 petabytes of disk, and no RAID anywhere. RAID went out with SQL. Kinda

Re: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Alan Louis Scheinine
With regard to the comment: > Do you really think you're going to program these machines > with something other than MPI? Exactly, that is another facet of the same debate about the future: the need for a shift that encompasses both programming language, execution model and interconnect hardware.

RE: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Bill Rankin
> Define "real" applications, Something that produces tangible, scientifically useful results that would not have otherwise been realized without the availability and capability of that machine. > but to give my guess at your question "But they didn't. Why?" > > One word - cost Well, that's

[Beowulf] Storage - the end of RAID?

2010-10-29 Thread Hearns, John
Quite a perceptive article on ZDnet http://www.zdnet.com/blog/storage/the-end-of-raid/1154?tag=nl.e539 Class, discuss. John Hearns | CFD Hardware Specialist | McLaren Racing Limited McLaren Technology Centre, Chertsey Road, Woking, Surrey GU21 4YH, UK T: +44 (0) 1483 261000 D: +44 (0) 1483 26

Re: [Beowulf] Re: Interesting

2010-10-29 Thread Robert G. Brown
On Fri, 29 Oct 2010, Ellis H. Wilson III wrote: Interestingly, I found "Keeping Bits Safe: How Hard Can It Be?" by David Rosenthal in the November Communications of the ACM just released. It does discuss data retention at the centuries level, but unfortunately does not consider the moon-based

Re: [Beowulf] Anybody using Redhat HPC Solution in their Beowulf

2010-10-29 Thread Stuart Barkley
On Sat, 23 Oct 2010 at 00:11 -, Richard Chang wrote: > On 10/22/2010 11:26 PM, Alex Chekholko wrote: > > The RH HPC mailing list suggests this project is inactive: > > https://www.redhat.com/archives/rhel-hpc-list/ > > I didn't check that. I never knew that an inactive mailing list > means an

Re: [Beowulf] Re: Interesting

2010-10-29 Thread Ashley Pittman
On 29 Oct 2010, at 15:49, Lux, Jim (337C) wrote: > So, if you want your flash to hold forever, you'll have to periodically > rewrite it. Say you rewrote every year, you'd get 10,000-100,000 years > before you "wore out" the flash. > > There are other aging effects: diffusion of metal ions, etc.

RE: [Beowulf] how Google warps your brain

2010-10-29 Thread Stuart Barkley
On Mon, 25 Oct 2010 at 11:26 -, Hearns, John wrote: > > might well last to the end of civilization. Replicate them a few > > million times, PERPETUATE them from generation to generation by > > renewing the copies, and backing them up, and recopying them in > > formats where they are still use

RE: [Beowulf] Anybody using Redhat HPC Solution in their Beowulf

2010-10-29 Thread Purvis, Cameron
> You're asking the CS department (full of researchers wanting > to do novel research for their dissertation or to move them > towards tenure) to be sysadmins. Being an SA is fun, once. An IT guy here: A challenge at my institution is that these systems are usually by faculty or by un

RE: [Beowulf] MPI-IO + nfs - alternatives?

2010-10-29 Thread Shai Fultheim (s...@scalemp.com)
Robert, I would go for virtualizing the cluster as single system (virtual SMP) and then using local I/O - just as we all run MPI apps on large SMPs years ago. Specifically, vSMP Foundation (www.scalemp.com) provides great scratch performance with local drives (use Linux raid utilities to make RA

[Beowulf] PCGrid 2011 CFP - Deadline Extended

2010-10-29 Thread Eric Heien
Due to requests from some contributors, we've extended the manuscript submission deadline to November 15. The abstract submission deadline is November 1. ## CALL FOR PAPERS Fifth Workshop on Desktop Grids and Volunteer Comp

Re: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Douglas J. Trainor
a Dongarra interview [with a nice photo on Dongarra] only stated, "The Chinese designed their own interconnect. It's not commodity. It's based on chips, based on a router, based on a switch that they produce." http://news.cnet.com/8301-13924_3-20021122-64.html On Oct 28, 2010, at 5:

Re: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Morton, Scott
Yes, the petroleum industry is using GPUs in production. At Hess Corporation, we have our main seismic imaging codes running in production on nvidia GPUs. I have several presentations you can find on the internet, if you want details. There are several other companies with some similar success

Re: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Douglas J. Trainor
On Oct 28, 2010, at 11:26 AM, Bill Rankin wrote: > [...] > What this machine does do is validate to some extent the continued use and > development of GPUs in an HPC/cluster setting. > [...] Nvidia claims Tianhe-1A's 4.04 megawatts of CUDA GPUs and Xeon CPUs is three times more power efficien

Re: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread C. Bergström
Bill Rankin wrote: Douglas: [...] What this machine does do is validate to some extent the continued use and development of GPUs in an HPC/cluster setting. [...] Nvidia claims Tianhe-1A's 4.04 megawatts of CUDA GPUs and Xeon CPUs is three times more power efficient than

Re: [Beowulf] Re: Interesting

2010-10-29 Thread Lux, Jim (337C)
On 10/29/10 6:50 AM, "Ellis H. Wilson III" wrote: > Interestingly, I found "Keeping Bits Safe: How Hard Can It Be?" by David > Rosenthal in the November Communications of the ACM just released. > > It does discuss data retention at the centuries level, but unfortunately > does not consider th

RE: [Beowulf] Re: Interesting

2010-10-29 Thread Hearns, John
> -Original Message- > > I guess that we don't think too much these days about the archival > properties of paper and pen, simply because it's seemingly so much more > stable than the various computer formats. I wonder how resistant to > aging modern printer/copier paper is versus its o

RE: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Bill Rankin
Douglas: > > [...] > > What this machine does do is validate to some extent the continued > use and development of GPUs in an HPC/cluster setting. > > [...] > > Nvidia claims Tianhe-1A's 4.04 megawatts of CUDA GPUs and Xeon CPUs is > three times more power efficient than CPUs alone. The Nvidia p

RE: [Beowulf] Re: Interesting

2010-10-29 Thread Bill Rankin
> "Robert G. Brown" wrote: > > > I've lost stories I've > > written on paper, and a really cool poem that I wrote with a pen popular > > in the 70's that turned out to have ink that faded to clear over 20 > > year, with or without the help of ambient UV. I have spiral notebooks > > from graduate

RE: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Gilad Shainer
Its their own new proprietary interconnect, runs at 80Gb/s (similar speed to IB 8x), switches are low port count. What the article missed is that they are also using their own CPUs and host chipset (along with Intel) in that system as well. Gilad -Original Message- From: beowulf-boun...@

Re: [Beowulf] Re: Interesting

2010-10-29 Thread Ellis H. Wilson III
Interestingly, I found "Keeping Bits Safe: How Hard Can It Be?" by David Rosenthal in the November Communications of the ACM just released. It does discuss data retention at the centuries level, but unfortunately does not consider the moon-based strategy proposed by Rob. Nonetheless is a good

RE: [Beowulf] China Wrests Supercomputer Title From U.S.

2010-10-29 Thread Bill Rankin
> [...]and if its users are ordinary or not. > > -- greg In my experience very few people in this business would ever be called "ordinary". :-) -b ___ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscripti