mikemccand commented on pull request #128: URL: https://github.com/apache/lucene/pull/128#issuecomment-849681533
Phew, aha! I caught my mistake! When I ran `CheckIndex`, I failed to pass the `.broken` index -- I was just checking the original (presumably NOT corrupt) index. I reran with the right argument (`.broken` version), and good news!: ``` beast3:core[main]$ java -cp ../core/build/libs/lucene-core-9.0.0-SNAPSHOT.jar org.apache.lucene.index.CheckIndex /l/indices/trunk.nightly.index.prev.broken/index -segment _gm NOTE: testing will be more thorough if you run java with '-ea:org.apache.lucene...', so assertions are enabled Opening index @ /l/indices/trunk.nightly.index.prev.broken/index Checking index with async threadCount: 4 0.00% total deletions; 27625038 documents; 0 deletions Segments file=segments_2 numSegments=15 version=9.0.0 id=4tts2a3tdztvmyrx4eavuuvca userData={userData=multi} Checking only these segments: _gm: 9 of 15: name=_gm maxDoc=497803 version=9.0.0 id=4tts2a3tdztvmyrx4eavuuvau codec=Lucene90 compound=false numFiles=20 size (MB)=402.17 diagnostics = {os.arch=amd64, mergeFactor=10, java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1622011837396, lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.\ 1, mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle Corporation, source=merge} no deletions test: open reader.........OK [took 0.054 sec] test: check integrity.....FAILED WARNING: exorciseIndex() would remove reference to this segment; full exception: org.apache.lucene.index.CorruptIndexException: checksum failed (hardware problem?) : expected=681c742f actual=5f6ae61b (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/l/indices/\ trunk.nightly.index.prev.broken/index/_gm.kdi"))) at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:440) at org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:614) at org.apache.lucene.codecs.lucene90.Lucene90PointsReader.checkIntegrity(Lucene90PointsReader.java:143) at org.apache.lucene.index.CodecReader.checkIntegrity(CodecReader.java:267) at org.apache.lucene.index.SegmentReader.checkIntegrity(SegmentReader.java:391) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:745) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:527) at org.apache.lucene.index.CheckIndex.doCheck(CheckIndex.java:4046) at org.apache.lucene.index.CheckIndex.doMain(CheckIndex.java:3919) at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:3851) WARNING: 1 broken segments (containing 497803 documents) detected Took 0.176 sec total. WARNING: would write new segments file, and 497803 documents would be lost, if -exorcise were specified ``` OK all is good! It looks like corruption is indeed still detected with this PR, wonderful! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org