mikemccand commented on pull request #128:
URL: https://github.com/apache/lucene/pull/128#issuecomment-847906215
Finally I ran `CheckIndex -threadCount 128`:
```
beast3:core[main]$ java -cp
../core/build/libs/lucene-core-9.0.0-SNAPSHOT.jar
org.apache.lucene.index.CheckIndex /l/indices/trunk.nightly.index.prev/index
-threadCount 128
NOTE: testing will be more thorough if you run java with
'-ea:org.apache.lucene...', so assertions are enabled
Opening index @ /l/indices/trunk.nightly.index.prev/index
0.00% total deletions; 27625038 documents; 0 deleteions
Segments file=segments_2 numSegments=15 version=9.0.0
id=5kpcv7rf0icb64q1ern1xs4bp userData={userData=multi}
[Segment 110] 1 of 15: name=_32 maxDoc=4978031
[Segment 110] version=9.0.0
[Segment 110] id=5kpcv7rf0icb64q1ern1xs35l
[Segment 110] codec=Lucene90
[Segment 110] compound=false
[Segment 110] numFiles=20
[Segment 110] size (MB)=3,890.496
[Segment 110] diagnostics = {os.arch=amd64, mergeFactor=10,
java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1621919422678,
lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.1,
mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle
Corporation, source=merge}
[Segment 110] no deletions
[Segment 110] test: open reader.........[Segment 110] OK [took 0.161 sec]
[Segment 110] test: check integrity.....[Segment 110] OK [took 0.617 sec]
[Segment 110][LiveDocs] test: check live docs.....[Segment 110][LiveDocs]
OK [took 0.001 sec]
[Segment 110][FieldInfos] test: field infos.........[Segment
110][FieldNorms] test: field norms.........[Segment 110][FieldInfos] OK [23
fields] [took 0.001 sec]
[Segment 110][Postings] test: terms, freq, prox...[Segment
110][StoredFields] test: stored fields.......[Segment 110][TermVectors]
test: term vectors........[Segment 110][DocValues] test:
docvalues...........[Segment 110][TermVectors] OK [0 total term vector count;
avg 0.0 term/freq vector fields per doc] [took 0.001 sec]
[Segment 110][Points] test: points..............[Segment 110][Vectors]
test: vectors..............[Segment 110][FieldNorms] OK [2 fields] [took 0.032
sec]
[Segment 110][Vectors] OK [1 fields, 4978031 vectors] [took 0.190 sec]
[Segment 110][Points] OK [4 fields, 19912124 points] [took 0.675 sec]
[Segment 110][StoredFields] OK [14934093 total field count; avg 3.0 fields
per doc] [took 1.229 sec]
[Segment 110][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7
SORTED; 0 SORTED_NUMERIC; 2 SORTED_SET] [took 3.357 sec]
OK [16412141 terms; 525829996 terms/docs pairs; 765284459 tokens] [took
33.251 sec]
[Segment 110]
[Segment 221] 2 of 15: name=_65 maxDoc=4978032
[Segment 221] version=9.0.0
[Segment 221] id=5kpcv7rf0icb64q1ern1xs3eu
[Segment 221] codec=Lucene90
[Segment 221] compound=false
[Segment 221] numFiles=20
[Segment 221] size (MB)=3,873.589
[Segment 221] diagnostics = {os.arch=amd64, mergeFactor=10,
java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1621920782361,
lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.1,
mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle
Corporation, source=merge}
[Segment 221] no deletions
[Segment 221] test: open reader.........[Segment 221] OK [took 0.166 sec]
[Segment 221] test: check integrity.....[Segment 221] OK [took 0.533 sec]
[Segment 221][LiveDocs] test: check live docs.....[Segment
221][FieldInfos] test: field infos.........[Segment 221][LiveDocs] OK [took
0.000 sec]
[Segment 221][FieldNorms] test: field norms.........[Segment
221][Postings] test: terms, freq, prox...[Segment 221][FieldInfos] OK [23
fields] [took 0.000 sec]
[Segment 221][StoredFields] test: stored fields.......[Segment
221][TermVectors] test: term vectors........[Segment 221][DocValues]
test: docvalues...........[Segment 221][Points] test:
points..............[Segment 221][Vectors] test:
vectors..............[Segment 221][TermVectors] OK [0 total term vector count;
avg 0.0 term/freq vector fields per doc] [t\
ook 0.000 sec]
[Segment 221][FieldNorms] OK [2 fields] [took 0.012 sec]
[Segment 221][Vectors] OK [1 fields, 4978032 vectors] [took 0.163 sec]
[Segment 221][Points] OK [4 fields, 19912128 points] [took 0.646 sec]
[Segment 221][StoredFields] OK [14934096 total field count; avg 3.0 fields
per doc] [took 1.029 sec]
[Segment 221][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7
SORTED; 0 SORTED_NUMERIC; 2 SORTED_SET] [took 3.073 sec]
OK [15879702 terms; 497899770 terms/docs pairs; 726182953 tokens] [took
31.948 sec]
[Segment 221]
[Segment 332] 3 of 15: name=_98 maxDoc=4978032
[Segment 332] version=9.0.0
[Segment 332] id=5kpcv7rf0icb64q1ern1xs3o3
[Segment 332] codec=Lucene90
[Segment 332] compound=false
[Segment 332] numFiles=20
[Segment 332] size (MB)=3,837.561
[Segment 332] diagnostics = {os.arch=amd64, mergeFactor=10,
java.runtime.version=15.0.1+9-18, os=Linux, timestamp=1621922132326,
lucene.version=9.0.0, java.vm.version=15.0.1+9-18, java.version=15.0.1,
mergeMaxNumSegments=-1, os.version=5.11.2-arch1-1, java.vendor=Oracle
Corporation, source=merge}
[Segment 332] no deletions
[Segment 332] test: open reader.........[Segment 332] OK [took 0.136 sec]
[Segment 332] test: check integrity.....[Segment 332] OK [took 0.554 sec]
[Segment 332][LiveDocs] test: check live docs.....[Segment
332][FieldInfos] test: field infos.........[Segment 332][LiveDocs] OK [took
0.000 sec]
[Segment 332][FieldNorms] test: field norms.........[Segment
332][Postings] test: terms, freq, prox...[Segment 332][FieldInfos] OK [23
fields] [took 0.000 sec]
[Segment 332][StoredFields] test: stored fields.......[Segment
332][TermVectors] test: term vectors........[Segment 332][DocValues]
test: docvalues...........[Segment 332][Points] test:
points..............[Segment 332][TermVectors] OK [0 total term vector count;
avg 0.0 term/freq vector fields per doc] [took 0.000 sec]
[Segment 332][Vectors] test: vectors..............[Segment
332][FieldNorms] OK [2 fields] [took 0.014 sec]
[Segment 332][Vectors] OK [1 fields, 4978032 vectors] [took 0.157 sec]
[Segment 332][Points] OK [4 fields, 19912128 points] [took 0.639 sec]
[Segment 332][StoredFields] OK [14934096 total field count; avg 3.0 fields
per doc] [took 1.032 sec]
[Segment 332][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7
SORTED; 0 SORTED_NUMERIC; 2 SORTED_SET] [took 3.124 sec]
OK [16460318 terms; 475335907 terms/docs pairs; 694693997 tokens] [took
30.290 sec]
[Segment 332]
...
[Segment 614] 15 of 15: name=_h2 maxDoc=46742
[Segment 614] version=9.0.0
[Segment 614] id=5kpcv7rf0icb64q1ern1xs4bl
[Segment 614] codec=Lucene90
[Segment 614] compound=false
[Segment 614] numFiles=20
[Segment 614] size (MB)=39.37
[Segment 614] diagnostics = {java.vm.version=15.0.1+9-18,
java.version=15.0.1, timestamp=1621925578914, os=Linux, java.vendor=Oracle
Corporation, os.version=5.11.2-arch1-1, java.runtime.version=15.0.1+9-18,
os.arch=amd64, source=flush, lucene.version=9.0.0}
[Segment 614] no deletions
[Segment 614] test: open reader.........[Segment 614] OK [took 0.004 sec]
[Segment 614] test: check integrity.....[Segment 614] OK [took 0.011 sec]
[Segment 614][LiveDocs] test: check live docs.....[Segment
614][FieldInfos] test: field infos.........[Segment 614][FieldNorms]
test: field norms.........[Segment 614][Postings] test: terms, freq,
prox...[Segment 614][LiveDocs] OK [took 0.000 sec]
[Segment 614][StoredFields] test: stored fields.......[Segment
614][TermVectors] test: term vectors........[Segment 614][DocValues]
test: docvalues...........[Segment 614][Points] test:
points..............[Segment 614][Vectors] test:
vectors..............[Segment 614][FieldInfos] OK [23 fields] [took 0.000 sec]
[Segment 614][TermVectors] OK [0 total term vector count; avg 0.0 term/freq
vector fields per doc] [took 0.000 sec]
[Segment 614][FieldNorms] OK [2 fields] [took 0.002 sec]
[Segment 614][Vectors] OK [1 fields, 46742 vectors] [took 0.002 sec]
[Segment 614][Points] OK [4 fields, 186968 points] [took 0.006 sec]
[Segment 614][StoredFields] OK [140226 total field count; avg 3.0 fields per
doc] [took 0.012 sec]
[Segment 614][DocValues] OK [15 docvalues fields; 4 BINARY; 2 NUMERIC; 7
SORTED; 0 SORTED_NUMERIC; 2 SORTED_SET] [took 0.079 sec]
OK [344318 terms; 3965374 terms/docs pairs; 6341319 tokens] [took 0.331 sec]
[Segment 614]
No problems were detected with this index.
Took 176.318 sec total.
```
It went a bit faster! (203 down to 176 seconds).
But the output is jumbled, I think because we are missing newlines
somewhere, or maybe necessary locking?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
