Re: [Beowulf] Big storage

2008-04-15 Thread Chris Samuel
- "Greg Lindahl" <[EMAIL PROTECTED]> wrote: > And, finally, this one makes you wonder how Linux storage works at > all: > > http://www.usenix.org/event/fast08/tech/full_papers/gunawi/gunawi.pdf Wow! It'd be interesting to see a recent follow up analysing how many issues have been fixed in

Re: [Beowulf] Big storage

2008-04-15 Thread Chris Samuel
- "Bruce Allen" <[EMAIL PROTECTED]> wrote: > Here is an LKML thread about silent data corruption: > http://kerneltrap.org/mailarchive/linux-kernel/2007/9/10/191697 There's a really interesting Linux filesystem in development at the moment called btrfs by Chris Mason at Oracle. It includes

Re: [Beowulf] Big storage

2008-04-15 Thread Greg Lindahl
On Tue, Apr 15, 2008 at 06:02:51PM -0500, Bruce Allen wrote: > So far we have not seen any signs of data corruption on Linux+Areca > systems (and our data files carry both internal and external checksums, so > we would be sensitive to this). Check out these papers from Fast08, they're based on

Re: [Beowulf] Big storage

2008-04-15 Thread Bruce Allen
Hi Xavier, PPS: We've also been doing some experiments with putting OpenSolaris+ZFS on some of our generic (Supermicro + Areca) 16-disk RAID systems, which were originally intended to run Linux. I think that DESY proved some data corruption with such configuration, so they switched to OpenS

Re: [Beowulf] Big storage

2008-04-15 Thread Xavier Canehan
On Mon, Apr 14, 2008 at 7:36 PM, Bruce Allen <[EMAIL PROTECTED]> wrote: > > Have you ever lost data on the X4500 systems? > Never. Considering only solaris boxes in production, 10 for HPSS are based on a SVM disk configuration when 131 use ZFS (101 dCache, 19 Xrootd, 11 SRB). We never had a big

Re: [Beowulf] Big storage

2008-04-15 Thread Bruce Allen
Hi Xavier, Would it be possible to get a (private) copy of your Jumpstart config file and the custom install scripts? Reading these and modifying them will probably be quite a bit quicker than developing our own from scratch. Sure. I'll send them in private after review. Thanks very much.