mikemccand commented on pull request #128:
URL: https://github.com/apache/lucene/pull/128#issuecomment-849681533
Phew, aha! I caught my mistake! When I ran `CheckIndex`, I failed to pass
the `.broken` index -- I was just checking the original (presumably NOT
corrupt) index. I reran with the right argument (`.broken` version), and good
news!:
```
beast3:core[main]$ java -cp
../core/build/libs/lucene-core-9.0.0-SNAPSHOT.jar
org.apache.lucene.index.CheckIndex
/l/indices/trunk.nightly.index.prev.broken/index -segment _gm
NOTE: testing will be more thorough if you run java with
'-ea:org.apache.lucene...', so assertions are enabled
Opening index @ /l/indices/trunk.nightly.index.prev.broken/index
Checking index with async threadCount: 4
0.00% total deletions; 27625038 documents; 0 deletions
Segments file=segments_2 numSegments=15 version=9.0.0
id=4tts2a3tdztvmyrx4eavuuvca userData={userData=multi}
Checking only these segments: _gm:
9 of 15: name=_gm maxDoc=497803
version=9.0.0
id=4tts2a3tdztvmyrx4eavuuvau
codec=Lucene90
compound=false
numFiles=20
size (MB)=402.17
diagnostics = {os.arch=amd64, mergeFactor=10,
java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1622011837396,
lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.\
1, mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle
Corporation, source=merge}
no deletions
test: open reader.........OK [took 0.054 sec]
test: check integrity.....FAILED
WARNING: exorciseIndex() would remove reference to this segment; full
exception:
org.apache.lucene.index.CorruptIndexException: checksum failed (hardware
problem?) : expected=681c742f actual=5f6ae61b
(resource=BufferedChecksumIndexInput(MMapIndexInput(path="/l/indices/\
trunk.nightly.index.prev.broken/index/_gm.kdi")))
at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:440)
at
org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:614)
at
org.apache.lucene.codecs.lucene90.Lucene90PointsReader.checkIntegrity(Lucene90PointsReader.java:143)
at
org.apache.lucene.index.CodecReader.checkIntegrity(CodecReader.java:267)
at
org.apache.lucene.index.SegmentReader.checkIntegrity(SegmentReader.java:391)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:745)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:527)
at org.apache.lucene.index.CheckIndex.doCheck(CheckIndex.java:4046)
at org.apache.lucene.index.CheckIndex.doMain(CheckIndex.java:3919)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:3851)
WARNING: 1 broken segments (containing 497803 documents) detected
Took 0.176 sec total.
WARNING: would write new segments file, and 497803 documents would be lost,
if -exorcise were specified
```
OK all is good! It looks like corruption is indeed still detected with this
PR, wonderful!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
