Re: Diagnosing solr timeout

2010-06-09 Thread Lance Norskog
Every time you reload the index it is to rebuild the facet cached data. Could that be it? Also, how big are the fields being highlighted? And are they indexed with term vectors? (If not, the text is re-analyzed in flight with term vectors.) How big are the caches? Are they growing & growing? On

Re: Diagnosing solr timeout

2010-06-09 Thread Jean-Sebastien Vachon
I use the following article as a reference when dealing with GC related issues http://www.petefreitag.com/articles/gctuning/ I suggest you activate the verbose option and send GC stats to a file. I don't remember exactly what was the option but you should find the information easily Good luck

Re: Diagnosing solr timeout

2010-06-09 Thread Paul
>Have you looked at the garbage collector statistics? I've experienced this >kind of issues in the past and I was getting huge spikes when the GC was doing its job. I haven't, and I'm not sure what a good way to monitor this is. The problem occurs maybe once a week on a server. Should I run jstat

Re: Diagnosing solr timeout

2010-06-09 Thread Jean-Sebastien Vachon
Have you looked at the garbage collector statistics? I've experienced this kind of issues in the past and I was getting huge spikes when the GC was doing its job. On 2010-06-09, at 10:52 AM, Paul wrote: > Hi all, > > In my app, it seems like solr has become slower over time. The index > has gro

Diagnosing solr timeout

2010-06-09 Thread Paul
Hi all, In my app, it seems like solr has become slower over time. The index has grown a bit, and there are probably a few more people using the site, but the changes are not drastic. I notice that when a solr search is made, the amount of cpu and ram spike precipitously. I notice in the solr lo