Yep. Sounds bad. First of all, your filterCache will potentially occupy (maxDoc / 8) * 32,768 bytes, plus some slop.
Additionally you're replaying the last 256 filter queries every time you open a new searcher (i.e. do a soft commit or hard commit with openSearcher=true. Actually. probably whenever you commit from the client). This is most likely a huge waste. Your queryResultCache is replaying the most recent 256 queries every time it opens a searcher too. This is also most likely a huge waste of time/cycles. Your documentCache doesn't autowarm so it's not a factor. These cache settings are quite outside the norm, suggest you pare them waaaaaay down, implement some kind of load tester and gradually increase them until you see diminishing returns. That's usually at much smaller numbers than you might expect, although YMMV. Beware filter queries with NOW, see: http://lucidworks.com/blog/date-math-now-and-filter-queries/ Best, Erick On Tue, Sep 22, 2015 at 10:54 AM, vsilgalis <vsilga...@gmail.com> wrote: > Erick Erickson wrote >> Things shouldn't be going into recovery that often. >> >> Exceeding the maxwarming searchers indicates that you're committing >> very often, and that your autowarming interval exceeds the interval >> between >> commits (either hard commit with openSearcher set to true or soft >> commits). >> >> I'd focus on that bit first. How are you committing, what are your >> autowarm >> settings etc? >> >> Are you committing from the client? Do you have very high (> 32 IMO) >> autowarm counts for your caches in solrconfig.xml? etc. >> >> Here's a long writeup of commits -n- stuff: >> https://lucidworks.com/blog/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ >> >> Best, >> Erick > > I've actually read that article a few times. > > Yeah I know we aren't perfect in opening searchers. Yes we are committing > from the client, this is something that is changing in our next code > release, AND we are auto soft committing every second. > > <filterCache class="solr.FastLRUCache" size="32768" initialSize="32768" > autowarmCount="256"/> > <queryResultCache class="solr.LRUCache" size="32768" initialSize="32768" > autowarmCount="256"/> > <documentCache class="solr.LRUCache" size="32768" initialSize="32768" > autowarmCount="256"/> > > Sounds like this might bad? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-4-10-2-Cores-in-Recovery-tp4230598p4230616.html > Sent from the Solr - User mailing list archive at Nabble.com.
