Every time a commit is done a new searcher is opened. In the solr config file caches are defined with a parameter called autowarm. Autowarm basically tries to copy the cache values from previous searcher into the current one. If you are doing a bulk update and do not care for searching till your indexing is over then you can specify openSearcher=false while doing a commit. That should speed up your indexing a lot.
-- Shreejay Nair Sent from my mobile device. Please excuse brevity and typos. On Monday, May 20, 2013 at 7:16, geeky2 wrote: > hello, > > we are tracking down some performance issues with our DIH process. > > not sure if this is related - but i am seeing tons of the messages below in > the logs during re-indexing of the core. > > what do these messages mean? > > > 2013-05-18 19:37:30,623 INFO [org.apache.solr.update.UpdateHandler] > (pool-11-thread-1) end_commit_flush > 2013-05-18 19:37:30,623 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming Searcher@5b8d745 main from Searcher@1fb355af > main > fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,624 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming result for Searcher@5b8d745 main > fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,624 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming Searcher@5b8d745 main from Searcher@1fb355af > main > filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,625 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming result for Searcher@5b8d745 main > filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,625 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming Searcher@5b8d745 main from Searcher@1fb355af > main > queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=3,evictions=0,size=3,warmupTime=1,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,628 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming result for Searcher@5b8d745 main > queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=3,evictions=0,size=3,warmupTime=3,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,628 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming Searcher@5b8d745 main from Searcher@1fb355af > main > documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > 2013-05-18 19:37:30,628 INFO [org.apache.solr.search.SolrIndexSearcher] > (pool-10-thread-1) autowarming result for Searcher@5b8d745 main > documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} > > thx > mark > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/seeing-lots-of-autowarming-messages-in-log-during-DIH-indexing-tp4064649.html > Sent from the Solr - User mailing list archive at Nabble.com. > >