Michael McCandless created LUCENE-9662:
------------------------------------------

             Summary: CheckIndex should be concurrent
                 Key: LUCENE-9662
                 URL: https://issues.apache.org/jira/browse/LUCENE-9662
             Project: Lucene - Core
          Issue Type: Bug
            Reporter: Michael McCandless


I am watching a nightly benchmark run slowly run its {{CheckIndex}} step, using 
a single core out of the 128 cores the box has.

It seems like this is an embarrassingly parallel problem, if the index has 
multiple segments, and would finish much more quickly on concurrent hardware if 
we did "thread per segment".

If wanted to get even further concurrency, each part of the Lucene index that 
is checked is also independent, so it could be "thread per segment per part".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to