Re: Solr 4.10.2 Cores in Recovery

2015-09-23 Thread Shawn Heisey
On 9/23/2015 10:10 AM, vsilgalis wrote: > Thanks guys, this is exactly what I needed, something to dig into and follow > up on. > > I do have question in regards to searcher warmup, when looking here: > http://0.0.0.0.43:8080/solr/#/collections/plugins/core?entry=searcher > > is the warmuptime spec

Re: Solr 4.10.2 Cores in Recovery

2015-09-23 Thread vsilgalis
Shawn Heisey-2 wrote > On 9/22/2015 11:54 AM, vsilgalis wrote: >> I've actually read that article a few times. >> >> Yeah I know we aren't perfect in opening searchers. Yes we are committing >> from the client, this is something that is changing in our next code >> release, AND we are auto soft com

Re: Solr 4.10.2 Cores in Recovery

2015-09-22 Thread Shawn Heisey
On 9/22/2015 11:54 AM, vsilgalis wrote: > I've actually read that article a few times. > > Yeah I know we aren't perfect in opening searchers. Yes we are committing > from the client, this is something that is changing in our next code > release, AND we are auto soft committing every second. > >

Re: Solr 4.10.2 Cores in Recovery

2015-09-22 Thread Erick Erickson
Yep. Sounds bad. First of all, your filterCache will potentially occupy (maxDoc / 8) * 32,768 bytes, plus some slop. Additionally you're replaying the last 256 filter queries every time you open a new searcher (i.e. do a soft commit or hard commit with openSearcher=true. Actually. probably whenev

Re: Solr 4.10.2 Cores in Recovery

2015-09-22 Thread vsilgalis
Erick Erickson wrote > Things shouldn't be going into recovery that often. > > Exceeding the maxwarming searchers indicates that you're committing > very often, and that your autowarming interval exceeds the interval > between > commits (either hard commit with openSearcher set to true or soft > c

Re: Solr 4.10.2 Cores in Recovery

2015-09-22 Thread Erick Erickson
Things shouldn't be going into recovery that often. Exceeding the maxwarming searchers indicates that you're committing very often, and that your autowarming interval exceeds the interval between commits (either hard commit with openSearcher set to true or soft commits). I'd focus on that bit fir

Solr 4.10.2 Cores in Recovery

2015-09-22 Thread vsilgalis
We have a collection with 2 shards, 3 nodes per shard running solr 4.10.2 Our issue is that cores that get in recovery never recover, they are in a constant state of recovery unless we restart the node and then reload the core on the leader. Updates seem to get to the server fine as the transacti