high CPU usage and SelectCannelConnector threads used a lot

2010-12-06 Thread John Russell
Hi, I'm using solr and have been load testing it for around 4 days. We use the solrj client to communicate with a separate jetty based solr process on the same box. After a few days solr's CPU% is now consistently at or above 100% (multiple processors available) and the application using it is mo

OutOfMemory GC: GC overhead limit exceeded - Why isn't WeakHashMap getting collected?

2010-12-10 Thread John Russell
I have been load testing solr 1.4.1 and have been running into OOM errors. Not out of heap but with the GC overhead limit exceeded message meaning that it didn't actually run out of heap space but just spent too much CPU time trying to make room and gave up. I got a heap dump and sent it through t

Re: OutOfMemory GC: GC overhead limit exceeded - Why isn't WeakHashMap getting collected?

2010-12-10 Thread John Russell
> many distinct values? If so, can you reduce the number or unique > terms? You might check your faceting algorithms, and see if you could > use enum, instead of fc for some of them. > > Check your statistics page, what's your insanity count? > > Tom > > > > On

Re: OutOfMemory GC: GC overhead limit exceeded - Why isn't WeakHashMap getting collected?

2010-12-13 Thread John Russell
document, perhaps you can print out some characteristics of the doc > before you add it? Is it always the same doc? Are you indexing and > searching on the same machine? Is the doc really huge? > > Best > Erick > > > On Fri, Dec 10, 2010 at 4:33 PM, John Russell wrote: >

Re: OutOfMemory GC: GC overhead limit exceeded - Why isn't WeakHashMap getting collected?

2010-12-13 Thread John Russell
; > Will make GC happen in a different thread, instead of the same thread as > solr operations. > > I think that is also something that many many Solr installations probably > need, but don't realize they need. > > > On 12/13/2010 3:42 PM, John Russell wro