mikemccand commented on pull request #128:
URL: https://github.com/apache/lucene/pull/128#issuecomment-849681533


   Phew, aha!  I caught my mistake!  When I ran `CheckIndex`, I failed to pass 
the `.broken` index -- I was just checking the original (presumably NOT 
corrupt) index.  I reran with the right argument (`.broken` version), and good 
news!:
   
   ```
   beast3:core[main]$ java -cp 
../core/build/libs/lucene-core-9.0.0-SNAPSHOT.jar 
org.apache.lucene.index.CheckIndex 
/l/indices/trunk.nightly.index.prev.broken/index -segment _gm
   
   NOTE: testing will be more thorough if you run java with 
'-ea:org.apache.lucene...', so assertions are enabled
   
   Opening index @ /l/indices/trunk.nightly.index.prev.broken/index
   
   Checking index with async threadCount: 4
   0.00% total deletions; 27625038 documents; 0 deletions
   Segments file=segments_2 numSegments=15 version=9.0.0 
id=4tts2a3tdztvmyrx4eavuuvca userData={userData=multi}
   
   Checking only these segments: _gm:
   9 of 15: name=_gm maxDoc=497803
       version=9.0.0
       id=4tts2a3tdztvmyrx4eavuuvau
       codec=Lucene90
       compound=false
       numFiles=20
       size (MB)=402.17
       diagnostics = {os.arch=amd64, mergeFactor=10, 
java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1622011837396, 
lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.\
   1, mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle 
Corporation, source=merge}
       no deletions
       test: open reader.........OK [took 0.054 sec]
       test: check integrity.....FAILED
       WARNING: exorciseIndex() would remove reference to this segment; full 
exception:
   org.apache.lucene.index.CorruptIndexException: checksum failed (hardware 
problem?) : expected=681c742f actual=5f6ae61b 
(resource=BufferedChecksumIndexInput(MMapIndexInput(path="/l/indices/\
   trunk.nightly.index.prev.broken/index/_gm.kdi")))
           at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:440)
           at 
org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:614)
           at 
org.apache.lucene.codecs.lucene90.Lucene90PointsReader.checkIntegrity(Lucene90PointsReader.java:143)
           at 
org.apache.lucene.index.CodecReader.checkIntegrity(CodecReader.java:267)
           at 
org.apache.lucene.index.SegmentReader.checkIntegrity(SegmentReader.java:391)
           at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:745)
           at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:527)
           at org.apache.lucene.index.CheckIndex.doCheck(CheckIndex.java:4046)
           at org.apache.lucene.index.CheckIndex.doMain(CheckIndex.java:3919)
           at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:3851)
   
   WARNING: 1 broken segments (containing 497803 documents) detected
   Took 0.176 sec total.
   WARNING: would write new segments file, and 497803 documents would be lost, 
if -exorcise were specified
   ```
   
   OK all is good!  It looks like corruption is indeed still detected with this 
PR, wonderful!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to