Sorry, my bad. Didn't read the entire thread. Look at your filter cache first. You are autowarming 1000, and there is exactly 1000 in there. Yet it looks like there may be tens of thousands of filter queries in your system. I would try autowarming more. Try 10,000 or 20,000 and see if it helps.
Second look at your document cache. Document caches don't use autowarm. But you can add queries to your firstSeacher and newSearcher entries in your solrconfig to pre-populate the document cache during warming. -Todd Feak -----Original Message----- From: oleg_gnatovskiy [mailto:oleg_gnatovs...@citysearch.com] Sent: Friday, December 12, 2008 11:19 AM To: solr-user@lucene.apache.org Subject: RE: Query Performance while updating teh index The auto warm time is not an issue. We take the server off the load balancer while it is autowarming. It seems that the slowness occurs after autowarm is done. Feak, Todd wrote: > > It's spending 4-5 seconds warming up your query cache. If 4-5 seconds is > too much, you could reduce the number of queries to auto-warm with on > that cache. > > Notice that the 4-5 seconds is spent only putting about 420 queries into > the query cache. Your autowarm of 50000 for the query cache seems a bit > high. If you need to reduce that autowarm time below 5 seconds, you may > have to set that value in the hundreds, as opposed to tens of thousands. > > -Todd Feak > > -----Original Message----- > From: oleg_gnatovskiy [mailto:oleg_gnatovs...@citysearch.com] > Sent: Friday, December 12, 2008 10:08 AM > To: solr-user@lucene.apache.org > Subject: Re: Query Performance while updating teh index > > > Here's what we have on one of the data slaves for the autowarming. > > > > -- > > Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main > > > filterCache{lookups=351993,hits=347055,hitratio=0.98,inserts=8332,evicti > ons=0,size=8245,warmupTime=215,cumulative_lookups=2837676,cumulative_hit > s=2766551,cumulative_hitratio=0.97,cumulative_inserts=72050,cumulative_e > victions=0} > > Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming result for searc...@3f32ca2b main > > > filterCache{lookups=0,hits=0,hitratio=0.00,inserts=1000,evictions=0,size > =1000,warmupTime=317,cumulative_lookups=2837676,cumulative_hits=2766551, > cumulative_hitratio=0.97,cumulative_inserts=72050,cumulative_evictions=0 > } > > Dec 12, 2008 8:46:02 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main > > > queryResultCache{lookups=5309,hits=5223,hitratio=0.98,inserts=422,evicti > ons=0,size=421,warmupTime=4628,cumulative_lookups=77802,cumulative_hits= > 77216,cumulative_hitratio=0.99,cumulative_inserts=424,cumulative_evictio > ns=0} > > -- > > Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming result for searc...@3f32ca2b main > > > queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=421,evictions=0, > size=421,warmupTime=5536,cumulative_lookups=77804,cumulative_hits=77218, > cumulative_hitratio=0.99,cumulative_inserts=424,cumulative_evictions=0} > > Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming searc...@3f32ca2b main from searc...@443ad545 main > > > documentCache{lookups=87216,hits=86686,hitratio=0.99,inserts=570,evictio > ns=0,size=570,warmupTime=0,cumulative_lookups=1270773,cumulative_hits=12 > 68318,cumulative_hitratio=0.99,cumulative_inserts=2455,cumulative_evicti > ons=0} > > Dec 12, 2008 8:46:07 AM org.apache.solr.search.SolrIndexSearcher warm > > INFO: autowarming result for searc...@3f32ca2b main > > > documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size= > 0,warmupTime=0,cumulative_lookups=1270773,cumulative_hits=1268318,cumula > tive_hitratio=0.99,cumulative_inserts=2455,cumulative_evictions=0} > > -- > > > > This is our current values after I've messed with them a few times > trying to > get better performance. > > > > <filterCache > > class="solr.LRUCache" > > size="30000" > > initialSize="15000" > > autowarmCount="1000"/> > > <queryResultCache > > class="solr.LRUCache" > > size="60000" > > initialSize="30000" > > autowarmCount="50000"/> > > <documentCache > > class="solr.LRUCache" > > size="200000" > > initialSize="125000" > > autowarmCount="0"/> > > > -- > View this message in context: > http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452 > 835p20980669.html > Sent from the Solr - User mailing list archive at Nabble.com. > > > > -- View this message in context: http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452 835p20981862.html Sent from the Solr - User mailing list archive at Nabble.com.
