Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Gerald Creager
+1: Reality. Joe Landman wrote: Rahul Nabar wrote: On Sun, Jan 17, 2010 at 9:36 PM, Joe Landman wrote: Ohhh ... it depends. Some of the "vendors" hardware raid ... heck ... most of it ... is rebadged LSI gear. Usually their lower end stuff which is sometimes fake-raid. Use fake-raid only

Re: [Beowulf] running the Linpak -HPL benchmark.

2010-01-17 Thread Rahul Nabar
On Sun, Jan 17, 2010 at 8:03 PM, Gustavo Correa wrote: > I've got Rmax/Rpeak around 84% on the cluster (AMD Opteron Shanghai, IB on a > single switch). > I didn't have the cluster available to play with HPL for too long, not too > much tuning, > I had to move to production mode. > Some folks on

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Gerald Creager
Hardware RAID, in my experience, works well with most LSI controllers (that haven't been modified to become Dell PERC controllers) and 3Ware controllers. I've had pretty grim results with most others. A colleague and I had great initial results with several ARECA controllers, but then they lo

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Rahul Nabar
On Sun, Jan 17, 2010 at 9:58 PM, Joe Landman wrote: > Its a software RAID implementation pretending to be a hardware RAID > implementation.  They are rarely if ever as good as MD.  Many of them in > Linux will invoke dm (the "other" RAID engine) as dm has "support" for > fake-raid.  Note that we

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Joe Landman
Rahul Nabar wrote: On Sun, Jan 17, 2010 at 9:36 PM, Joe Landman wrote: Ohhh ... it depends. Some of the "vendors" hardware raid ... heck ... most of it ... is rebadged LSI gear. Usually their lower end stuff which is sometimes fake-raid. Use fake-raid only if no other options exist. Thanks

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Rahul Nabar
Thanks Tony for the helpful tips! On Sun, Jan 17, 2010 at 5:08 PM, Tony Travis wrote: > > However, I would avoid relying on LVM mirroring for data protection. It is > much safer to stripe a set of RAID1's using LVM. I don't think LVM is useful > unless you are managing a disk farm. The commonest

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Rahul Nabar
On Sun, Jan 17, 2010 at 9:36 PM, Joe Landman wrote: > > Ohhh ... it depends.  Some of the "vendors" hardware raid ... heck ... most > of it ... is rebadged LSI gear.  Usually their lower end stuff which is > sometimes fake-raid.  Use fake-raid only if no other options exist. Thanks Joe! What's "f

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Joe Landman
Rahul Nabar wrote: If I have a option between doing Hardware RAID versus having software raid via mdadm is there a clear winner in terms of performance? Or is Depends upon workload, writes vs reads, streaming vs random IO, number of simultaneous readers/writers. There is no real clear answer.

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Alan Louis Scheinine
I had a nightmare problem with a newly compiled kernel not booting. The problem may have been with the command mkblkdevs of nash but in any case I did extensive web search on the AHCI controller that I had in both a notebook and a desktop computer, both of which had the booting problem. One examp

Re: [Beowulf] running the Linpak -HPL benchmark.

2010-01-17 Thread Gustavo Correa
Hi Rahul I've got Rmax/Rpeak around 84% on the cluster (AMD Opteron Shanghai, IB on a single switch). I didn't have the cluster available to play with HPL for too long, not too much tuning, I had to move to production mode. Some folks on mailing lists said they'd get 90%, but the topmost group i

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Tony Travis
Rahul Nabar wrote: If I have a option between doing Hardware RAID versus having software raid via mdadm is there a clear winner in terms of performance? Or is the answer only resolvable by actual testing? I have a fairly fast machine (Nehalem 2.26 GHz 8 cores) and 48 gigs of RAM. Hello, Rahul.

Re: [Beowulf] HPC/mpi courses

2010-01-17 Thread Jonathan Dursi
On 2010-01-17, at 6:24AM, Rob Horton wrote: > On Sat, Jan 16, 2010 at 11:50:48AM +0300, Walid wrote: >> >> do you know of any official courses run in Europe, or Asia covering >> HPC system, or development. mpi or new distributed memory paradigms >> are welcome. > > NAG run various courses on beha

Re: [Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Bill Broadley
Rahul Nabar wrote: > If I have a option between doing Hardware RAID versus having software > raid via mdadm is there a clear winner in terms of performance? No. > Or is > the answer only resolvable by actual testing? I have a fairly fast > machine (Nehalem 2.26 GHz 8 cores) and 48 gigs of RAM. >

[Beowulf] hardware RAID versus mdadm versus LVM-striping

2010-01-17 Thread Rahul Nabar
If I have a option between doing Hardware RAID versus having software raid via mdadm is there a clear winner in terms of performance? Or is the answer only resolvable by actual testing? I have a fairly fast machine (Nehalem 2.26 GHz 8 cores) and 48 gigs of RAM. Should I be using the vendor's hardw

Re: [Beowulf] HPC/mpi courses

2010-01-17 Thread Rob Horton
On Sat, Jan 16, 2010 at 11:50:48AM +0300, Walid wrote: > Dear All, > > do you know of any official courses run in Europe, or Asia covering > HPC system, or development. mpi or new distributed memory paradigms > are welcome. NAG run various courses on behalf of HECToR in the UK: http://www.hector

[Beowulf] Jobs in the UK

2010-01-17 Thread John Hearns
If anyone is looking for a job in the UK, there are a few on offer: http://www.jobserve.com/Systems-Specialist-Abingdon-Abingdon-Oxfordshire-Permanent-W6BA2DC924C566BD1.jsjob (I think you can work out who this is if not I can tell you off list!) http://www.jobserve.com/High-Performance-Comput