Re: [Beowulf] ZFS for HPC

2013-12-22 Thread Skylar Thompson
On 12/22/2013 6:51 PM, Christopher Samuel wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/12/13 13:30, Skylar Thompson wrote: The one time we actually had corruption on-disk, ZFS was nice enough to tell us exactly which files were corrupted. This made it really easy to recover files

Re: [Beowulf] ZFS for HPC

2013-12-22 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 23/12/13 13:30, Skylar Thompson wrote: > The one time we actually had corruption on-disk, ZFS was nice > enough to tell us exactly which files were corrupted. This made it > really easy to recover files from backups from before the > corruption too

Re: [Beowulf] ZFS for HPC

2013-12-22 Thread Skylar Thompson
On 12/22/2013 4:14 PM, Christopher Samuel wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Andrew, On 26/11/13 23:10, Andrew Holway wrote: Does checksumming save our data? Well that will depend on whether your setup is to just detect corruption, or be able to correct it too. The on

Re: [Beowulf] ZFS for HPC

2013-12-22 Thread Christopher Samuel
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Andrew, On 26/11/13 23:10, Andrew Holway wrote: > I am looking at Lustre 2.4 currently and have it working in a test > environment (actually with minimal shouting and grinding of > teeth). Congratulations! > Taking a holistic approach: What doe