Re: [Beowulf] OT: recoverable optical media archive format?

2010-06-08 Thread Jesse Becker
I came across this page a few years back that discusses this very problem: http://users.softlab.ntua.gr/~ttsiod/rsbep.html On Tue, Jun 08, 2010 at 01:44:55PM -0400, David Mathog wrote: This is off topic so I will try to keep it short: is there an "archival" format for large binary files w

Re: [Beowulf] OT: recoverable optical media archive format?

2010-06-08 Thread Reuti
Hi, Am 08.06.2010 um 19:44 schrieb David Mathog: This is off topic so I will try to keep it short: is there an "archival" format for large binary files which contains enough error correction to that all original data may be recovered even if there is a little data loss in the storage media?

Re: [Beowulf] OT: recoverable optical media archive format?

2010-06-08 Thread Michael Di Domenico
What's the ramification of losing a block? (ie file-system won't mount, data has a hole) Not that it's elegant, the first thing that pops to mind is using 'split' to chunk the file into many little bits and then md5 each bit On Tue, Jun 8, 2010 at 1:44 PM, David Mathog wrote: > This is off top

[Beowulf] OT: recoverable optical media archive format?

2010-06-08 Thread David Mathog
This is off topic so I will try to keep it short: is there an "archival" format for large binary files which contains enough error correction to that all original data may be recovered even if there is a little data loss in the storage media? For my purposes these are disk images, sometimes .ta