On 7/26/2018 1:32 PM, cyndefromva wrote:
At the point it starts failing I see a java exception: "java.io-IOException:
Too many open files" in the solr log file and a SolrException (Error open
new searcher) is returned to the user.
The operating system where Solr is running needs its open file limit
increased. Exactly how to do this will depend on what OS it is. Most
Linux systems need to have /etc/security/limits.conf edited.
But it appears to be calling commit more frequently. In the solr log I see
the following commit written miliseconds from each other:
UpdateHandler start
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
I also see the following written right below it:
PERFORMANCE WARNING: Overlapping onDeckSearchers=2
You have autoCommit with openSearcher set to false. The commit log
entry you've pasted is openSearcher=true ... it is not coming from
autoCommit.
The overlapping onDeckSearchers is also not being caused by autoCommit
-- that will not open a new searcher. The commit log also has
softCommit=false, which means that it is an explicit hard commit, most
likely coming from your indexing application. If autoSoftCommit or
commitWithin were happening, it would be a soft commit.
Thanks,
Shawn
