Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
On Mar 11, 2013, at 7:47 PM, Shawn Heisey wrote: >> > > I've just locate a previous message on this list from Mark Miller saying that > in Solr 4, commitWithin is a soft commit. Yes, that's true. > > You should definitely wait for Mark or another committer to verify what I'm > saying in t

Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
On Mar 11, 2013, at 5:52 PM, jimtronic wrote: > Should I omit commitWithin and set DIH to commit=false and just let soft and > autocommit do their jobs? Yeah, that's one valid option. You def are not able to keep up with the current commit / open searcher level. It looks like DIH will do a har

Re: Some nodes have all the load

2013-03-11 Thread Shawn Heisey
On 3/11/2013 3:52 PM, jimtronic wrote: The load test was fairly heavy (ie lots of users) and designed to mimic a fully operational system with lots of users doing normal things. There were two things I gleaned from the logs: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 appeared for severa

Re: Some nodes have all the load

2013-03-11 Thread jimtronic
The load test was fairly heavy (ie lots of users) and designed to mimic a fully operational system with lots of users doing normal things. There were two things I gleaned from the logs: PERFORMANCE WARNING: Overlapping onDeckSearchers=2 appeared for several of my more active cores and The non-l

Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
There is an open JIRA issue about trying to "spread the leader load" during elections. Was waiting to get reports that it was really a problem for someone though. How much load were you putting on? How long were the nodes unresponsive? Unresponsive to everything? Just updates? Searches? What ve