On Sat, Aug 16, 2008 at 4:33 AM, Grant Ingersoll <[EMAIL PROTECTED]> wrote:
> Can you try Lucene's CheckIndex tool on it and report what it says?
>
> On Aug 15, 2008, at 1:35 PM, Chris Harris wrote:
>
>> I have an index (different from the ones mentioned yesterday) that was
>> working fine with 3M docs or so, but when I added a bunch more docs,
>> bringing it closer to 4M docs, the index seemed to get corrupted. In
>> particular, now when I start Solr up, or when when my indexing process
>> tries add a document, I get a complaint about missing index files.
>>
>> The error on startup looks like this:
>>
>> [...]
So I've run the Lucene CheckIndex tool twice.
First I ran it on my Windows machine, on the original compound format
index, which I then moved over to Linux and added to. It checked out
ok:
NOTE: testing will be more thorough if you run java with
'-ea:org.apache.lucene', so assertions are enabled
Opening index @ E:\solr-9999\solr\exhibitcore\data\index
Segments file=segments_2 numSegments=1
version=FORMAT_SHARED_DOC_STORE [Lucene 2.3]
1 of 1: name=_0 docCount=2829254
compound=true
numFiles=1
size (MB)=30,423.298
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [20208545 terms; 1092415125
terms/docs pairs; 6041972577 tokens]
test: stored fields.......OK [82628579 total field count; avg
29.205 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
No problems were detected with this index.
Then I ran it on Linux, against the index in its problematic state.
(Note: This is the end of my message. Everything that follows is
output from the tool):
Opening index @
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/
Segments file=segments_10tu numSegments=48
version=FORMAT_SHARED_DOC_STORE [Lucene 2.3]
1 of 48: name=_0 docCount=2829254
compound=true
numFiles=1
size (MB)=30,423.298
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [20208545 terms; 1092415125
terms/docs pairs; 6041972577 tokens]
test: stored fields.......OK [82628579 total field count; avg
29.205 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
2 of 48: name=_uz docCount=1567952
compound=false
numFiles=8
size (MB)=17,238.136
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [11529959 terms; 613302128
terms/docs pairs; 3503689207 tokens]
test: stored fields.......OK [45879263 total field count; avg
29.261 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
3 of 48: name=_v7 docCount=24507
compound=false
numFiles=0
size (MB)=0
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v7.fnm
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:473)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:57)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:300)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
4 of 48: name=_v6 docCount=1
compound=false
numFiles=0
size (MB)=0
docStoreOffset=6095
docStoreSegment=_v4
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v6.fnm
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:473)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:57)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:300)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
5 of 48: name=_v8 docCount=1714
compound=false
numFiles=0
size (MB)=0
docStoreOffset=0
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fnm
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:473)
at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:57)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:300)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
6 of 48: name=_v9 docCount=2807
compound=false
numFiles=6
size (MB)=7.41
docStoreOffset=1714
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
7 of 48: name=_va docCount=2871
compound=false
numFiles=6
size (MB)=8.107
docStoreOffset=4521
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
8 of 48: name=_vb docCount=2428
compound=false
numFiles=6
size (MB)=8.196
docStoreOffset=7392
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
9 of 48: name=_vc docCount=2606
compound=false
numFiles=6
size (MB)=8.157
docStoreOffset=9820
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
10 of 48: name=_vd docCount=3595
compound=false
numFiles=6
size (MB)=9.058
docStoreOffset=12426
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
11 of 48: name=_ve docCount=2467
compound=false
numFiles=6
size (MB)=7.643
docStoreOffset=16021
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
12 of 48: name=_vf docCount=2951
compound=false
numFiles=6
size (MB)=7.808
docStoreOffset=18488
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
13 of 48: name=_vg docCount=2661
compound=false
numFiles=6
size (MB)=7.593
docStoreOffset=21439
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
14 of 48: name=_vh docCount=1
compound=false
numFiles=6
size (MB)=0.024
docStoreOffset=24100
docStoreSegment=_v8
docStoreIsCompoundFile=false
no deletions
test: open reader.........FAILED
WARNING: would remove reference to this segment (-fix was not
specified); full exception:
java.io.FileNotFoundException:
/home/guy/corrupt-solr-9999-from-ssd/solr/exhibitcore/data/index/_v8.fdt
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.<init>(FSDirectory.java:539)
at
org.apache.lucene.store.FSDirectory$FSIndexInput.<init>(FSDirectory.java:569)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
at org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:77)
at
org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:310)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
at org.apache.lucene.index.CheckIndex.check(CheckIndex.java:178)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:433)
15 of 48: name=_vi docCount=2696
compound=false
numFiles=8
size (MB)=7.785
docStoreOffset=0
docStoreSegment=_vi
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [66355 terms; 872287 terms/docs
pairs; 4178224 tokens]
test: stored fields.......OK [79220 total field count; avg
29.384 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
16 of 48: name=_vk docCount=2685
compound=false
numFiles=8
size (MB)=7.964
docStoreOffset=2696
docStoreSegment=_vi
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [67023 terms; 854607 terms/docs
pairs; 4339410 tokens]
test: stored fields.......OK [78870 total field count; avg
29.374 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
17 of 48: name=_vm docCount=3005
compound=false
numFiles=8
size (MB)=7.508
docStoreOffset=5381
docStoreSegment=_vi
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [68014 terms; 884783 terms/docs
pairs; 3929139 tokens]
test: stored fields.......OK [88490 total field count; avg
29.448 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
18 of 48: name=_vp docCount=324
compound=false
numFiles=8
size (MB)=0.821
docStoreOffset=8386
docStoreSegment=_vi
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [13653 terms; 98060 terms/docs
pairs; 387483 tokens]
test: stored fields.......OK [9550 total field count; avg 29.475
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
19 of 48: name=_vr docCount=2876
compound=false
numFiles=8
size (MB)=8.516
docStoreOffset=0
docStoreSegment=_vr
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [56320 terms; 936109 terms/docs
pairs; 4728980 tokens]
test: stored fields.......OK [83949 total field count; avg
29.189 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
20 of 48: name=_vt docCount=3000
compound=false
numFiles=8
size (MB)=8.143
docStoreOffset=2876
docStoreSegment=_vr
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [61395 terms; 930671 terms/docs
pairs; 4404432 tokens]
test: stored fields.......OK [88119 total field count; avg
29.373 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
21 of 48: name=_vu docCount=3247
compound=false
numFiles=8
size (MB)=8.575
docStoreOffset=5876
docStoreSegment=_vr
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [57072 terms; 964581 terms/docs
pairs; 4736917 tokens]
test: stored fields.......OK [94657 total field count; avg
29.152 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
22 of 48: name=_vw docCount=2230
compound=false
numFiles=8
size (MB)=7.997
docStoreOffset=9123
docStoreSegment=_vr
docStoreIsCompoundFile=false
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [68542 terms; 806178 terms/docs
pairs; 4442386 tokens]
test: stored fields.......OK [63686 total field count; avg
28.559 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
23 of 48: name=_wt docCount=22775
compound=false
numFiles=8
size (MB)=224.064
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [318080 terms; 8361527 terms/docs
pairs; 45373494 tokens]
test: stored fields.......OK [668758 total field count; avg
29.364 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
24 of 48: name=_xn docCount=21970
compound=false
numFiles=8
size (MB)=241.717
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [288434 terms; 8483464 terms/docs
pairs; 48366212 tokens]
test: stored fields.......OK [645574 total field count; avg
29.384 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
25 of 48: name=_2d3 docCount=5727
compound=false
numFiles=8
size (MB)=86.694
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [148383 terms; 2524225 terms/docs
pairs; 14728469 tokens]
test: stored fields.......OK [167705 total field count; avg
29.283 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
26 of 48: name=_qwt docCount=13298
compound=false
numFiles=8
size (MB)=174.405
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [359873 terms; 5494882 terms/docs
pairs; 29333679 tokens]
test: stored fields.......OK [390190 total field count; avg
29.342 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
27 of 48: name=_1mjk docCount=17236
compound=false
numFiles=8
size (MB)=163.647
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [275241 terms; 6155383 terms/docs
pairs; 32749996 tokens]
test: stored fields.......OK [506146 total field count; avg
29.366 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
28 of 48: name=_27ii docCount=11352
compound=false
numFiles=8
size (MB)=111.841
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [215039 terms; 3714225 terms/docs
pairs; 18970802 tokens]
test: stored fields.......OK [331068 total field count; avg
29.164 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
29 of 48: name=_2tci docCount=12268
compound=false
numFiles=8
size (MB)=158.258
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [253071 terms; 4618740 terms/docs
pairs; 25703772 tokens]
test: stored fields.......OK [357769 total field count; avg
29.163 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
30 of 48: name=_2vze docCount=1460
compound=false
numFiles=8
size (MB)=16.176
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [31654 terms; 555485 terms/docs
pairs; 3100621 tokens]
test: stored fields.......OK [43475 total field count; avg
29.777 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
31 of 48: name=_2xz1 docCount=1150
compound=false
numFiles=8
size (MB)=16.585
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [29656 terms; 502097 terms/docs
pairs; 3078184 tokens]
test: stored fields.......OK [34161 total field count; avg
29.705 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
32 of 48: name=_2zq4 docCount=1247
compound=false
numFiles=8
size (MB)=17.576
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [22605 terms; 491640 terms/docs
pairs; 3295324 tokens]
test: stored fields.......OK [34370 total field count; avg
27.562 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
33 of 48: name=_31a7 docCount=919
compound=false
numFiles=8
size (MB)=17.645
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [4965 terms; 444500 terms/docs
pairs; 3376221 tokens]
test: stored fields.......OK [24826 total field count; avg
27.014 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
34 of 48: name=_331a docCount=1027
compound=false
numFiles=8
size (MB)=16.918
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [26041 terms; 462180 terms/docs
pairs; 3234913 tokens]
test: stored fields.......OK [28927 total field count; avg
28.167 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
35 of 48: name=_35uh docCount=1637
compound=false
numFiles=8
size (MB)=16.68
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [40298 terms; 588796 terms/docs
pairs; 3377855 tokens]
test: stored fields.......OK [48441 total field count; avg
29.591 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
36 of 48: name=_3631 docCount=135
compound=false
numFiles=8
size (MB)=1.61
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [9284 terms; 61663 terms/docs
pairs; 367236 tokens]
test: stored fields.......OK [4032 total field count; avg 29.867
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
37 of 48: name=_36d8 docCount=166
compound=false
numFiles=8
size (MB)=1.692
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [4135 terms; 69940 terms/docs
pairs; 439983 tokens]
test: stored fields.......OK [4843 total field count; avg 29.175
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
38 of 48: name=_36pr docCount=200
compound=false
numFiles=8
size (MB)=1.743
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [6782 terms; 60864 terms/docs
pairs; 313091 tokens]
test: stored fields.......OK [5918 total field count; avg 29.59
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
39 of 48: name=_3732 docCount=195
compound=false
numFiles=8
size (MB)=1.695
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [13797 terms; 64908 terms/docs
pairs; 307017 tokens]
test: stored fields.......OK [5829 total field count; avg 29.892
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
40 of 48: name=_37a5 docCount=117
compound=false
numFiles=8
size (MB)=1.687
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [7502 terms; 50207 terms/docs
pairs; 325345 tokens]
test: stored fields.......OK [3483 total field count; avg 29.769
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
41 of 48: name=_37dc docCount=54
compound=false
numFiles=8
size (MB)=0.776
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [3529 terms; 28935 terms/docs
pairs; 187790 tokens]
test: stored fields.......OK [1595 total field count; avg 29.537
fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
42 of 48: name=_37dd docCount=1
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [202 terms; 202 terms/docs pairs; 425 tokens]
test: stored fields.......OK [29 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
43 of 48: name=_37dg docCount=1
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [204 terms; 204 terms/docs pairs; 427 tokens]
test: stored fields.......OK [29 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
44 of 48: name=_37dj docCount=1
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [202 terms; 202 terms/docs pairs; 425 tokens]
test: stored fields.......OK [29 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
45 of 48: name=_37dm docCount=1
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [21 fields]
test: terms, freq, prox...OK [203 terms; 203 terms/docs pairs; 426 tokens]
test: stored fields.......OK [30 total field count; avg 30 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
46 of 48: name=_37dp docCount=1
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [202 terms; 202 terms/docs pairs; 425 tokens]
test: stored fields.......OK [29 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
47 of 48: name=_37ds docCount=2
compound=false
numFiles=8
size (MB)=0.008
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [297 terms; 338 terms/docs pairs; 680 tokens]
test: stored fields.......OK [58 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
48 of 48: name=_37dv docCount=2
compound=false
numFiles=8
size (MB)=0.005
no deletions
test: open reader.........OK
test: fields, norms.......OK [20 fields]
test: terms, freq, prox...OK [151 terms; 276 terms/docs pairs; 510 tokens]
test: stored fields.......OK [58 total field count; avg 29 fields per doc]
test: term vectors........OK [0 total vector count; avg 0
term/freq vector fields per doc]
WARNING: 12 broken segments detected
WARNING: 48609 documents would be lost if -fix were specified
NOTE: would write new segments file [-fix was not specified]
