Would it make sense if we open a newSearcher with the last 15 days documents?
since these is the documents which are mostly used by the users. Also, how
could i do this if this is possible?
> Date: Wed, 31 Jul 2013 08:54:47 -0600
> From: s...@elyograg.org
> To: solr-user@lucene.apache.org
> Subject: Re: Autowarming last 15 days data
>
> On 7/31/2013 7:30 AM, Cool Techi wrote:
> > We have a solr master slave set up with close to 30 million records. Our
> > index changes/updates very frequently and replication is set up at 60
> > seconds delay.
> >
> > Now every time replication completes, the new searches take a time. How can
> > this be improved? I have come across that warming would help this scenario,
> > I our case we cannot warm some queries, but most of the users use the last
> > 15 days data only.
> >
> > So would it be possible to auto warm only last 15 days data?
>
> Autowarming is generally done automatically when a new searcher is
> opened, according to the cache config. It will take the most recent N
> queries in the cache (according to the autowarmCount) and re-execute
> those queries against the index to populate the cache. The document
> cache cannot be warmed directly, but when the query result cache is
> warmed, that will also populate the document cache.
>
> Because you have a potentially very frequent interval for opening new
> searchers (possibly replicating every 60 seconds), you will want to
> avoid large autowarmCount values. If your autowarming ends up taking
> too long, the system will try to open a new searcher while the previous
> one is being warmed, which can lead to problems. I have found that the
> filterCache is particularly slow to warm.
>
> Thanks,
> Shawn
>
