On 2012-06-07 03:20:37 +0200, Vincent Lefevre wrote:
> Now, the way bunzip2 does integrity checking when decompressing is
> poorly documented: does bunzip2 guarantee that every byte from the
> stream is correct (e.g. integrity checking is done chunk by chunk,
> and a chunk is output only once CRC checking has been done on it)
> or does one need to wait for the decompression of the full file to
> detect a possible integrity error?
> 
> If this is the latter, then the problem could come from the file
> server, because my own MD5 checking has detected the problem before
> the file has entirely been decompressed. In such a case, I would
> need to modify my script for better information on the failure.

I think I have the answer. My test in loop has just given:

This is ckdump 50073 2012-03-01 14:12:19
Reading the md5 file...
Starting bunzip2 on mpfr-0-8207.bz2 ...
Checking the dump file...
Revision 6952
bunzip2: Data integrity error when decompressing.
        Input file = mpfr-0-8207.bz2, output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

ckdump: bunzip2 died (exit value: 2)

i.e. I got the integrity error in the middle of the stream.

Other failing tests:

This is ckdump 50073 2012-03-01 14:12:19
Reading the md5 file...
Starting bunzip2 on mpfr-0-8207.bz2 ...
Checking the dump file...
ckdump: bad MD5 for revision 7899 (output to ckdump.r7899)

This is ckdump 50073 2012-03-01 14:12:19
Reading the md5 file...
Starting bunzip2 on mpfr-0-8207.bz2 ...
Checking the dump file...
Revision 5654
bunzip2: Data integrity error when decompressing.
        Input file = mpfr-0-8207.bz2, output file = (stdout)
[...]

This is ckdump 50073 2012-03-01 14:12:19
Reading the md5 file...
Starting bunzip2 on mpfr-0-8207.bz2 ...
Checking the dump file...
Revision 7875
bunzip2: Data integrity error when decompressing.
        Input file = mpfr-0-8207.bz2, output file = (stdout)
[...]

This is ckdump 50073 2012-03-01 14:12:19
Reading the md5 file...
Starting bunzip2 on mpfr-0-8207.bz2 ...
Checking the dump file...
ckdump: bad MD5 for revision 7588 (output to ckdump.r7588)

The fact I do not always get an integrity error probably means
that the problem doesn't come from the file server.

This was still on the same machine (the other two are fine).
Possibly a hardware problem, unless there's something else
special with this machine.

-- 
Vincent Lefèvre <vinc...@vinc17.net> - Web: <http://www.vinc17.net/>
100% accessible validated (X)HTML - Blog: <http://www.vinc17.net/blog/>
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)



--
To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org

Reply via email to