Hello,
Is your maximum number of open files 1024? If so, increase it to a more regular
65536. Some operating systems ship with 1024 for reasons i don't understand.
Whenever installing Solr anywhere for the past ten years, we have had to check
this each and every time, and still have to!
Regards,
Markus
-----Original message-----
> From:cyndefromva <cyndefro...@gmail.com>
> Sent: Thursday 26th July 2018 22:18
> To: solr-user@lucene.apache.org
> Subject: Recent configuration change to our site causes frequent index
> corruption
>
> I have Rails 5 application that uses solr to index and search our site. The
> sunspot gem is used to integrate ruby and sunspot. It's a relatively small
> site (no more 100,000 records) and has moderate usage (except for the
> googlebot).
>
> Until recently we regularly received 503 errors; reloading the page
> generally cleared it up, but that was not exactly the user experience we
> wantedso we added the following initializer to force the retry on failures:
>
> Sunspot.session =
> Sunspot::SessionProxy::Retry5xxSessionProxy.new(Sunspot.session)
>
> As a result, about every third day the site locks up until we rebuild the
> data directory (stop solr, move data directory to another location, start
> solr, reindex).
>
> At the point it starts failing I see a java exception: "java.io-IOException:
> Too many open files" in the solr log file and a SolrException (Error open
> new searcher) is returned to the user.
>
> In the solrconfig.xml file we have autoCommit and autoSoftCommit set as
> follows:
>
> <autoCommit>
> <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
> <openSearcher>false</openSearcher>
> </autoCommit>
>
> <autoSoftCommit>
> <maxTime>${solr.autoSoftCommit.maxTime:-1}</maxTime>
> </autoSoftCommit>
>
> Which I believe means there should be a hard commit every 15 seconds.
>
> But it appears to be calling commit more frequently. In the solr log I see
> the following commit written miliseconds from each other:
>
> UpdateHandler start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>
> I also see the following written right below it:
>
> PERFORMANCE WARNING: Overlapping onDeckSearchers=2
>
> Note: maxWarmingSearchers is set to 2.
>
>
> I would really appreciate any help I can get to resolve this issue.
>
> Thank you!
>
>
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
>
