One solution is to add the persistent cache with memcache at the
application layer.
--
Tommy Chheng
Programmer and UC Irvine Graduate Student
Twitter @tommychheng
http://tommy.chheng.com
On 2/12/10 5:19 AM, Tim Terlegård wrote:
2010/2/12 Shalin Shekhar Mangar<shalinman...@gmail.com>:
2010/2/12 Tim Terlegård<tim.terleg...@gmail.com>
Does Solr use some sort of a persistent cache?
Solr does not have a persistent cache. That is the operating system's file
cache at work.
Aha, that's very interesting and seems to make sense.
So is the primary goal of warmup queries to allow the operating system
to cache all the files in the data/index directory? Because I think
the difference (768ms vs 52ms) is pretty big. I just do one warmup
query and get 52 ms response on a 40 million documents index. I think
that's pretty nice performance without tinkering with the caches at
all. The only tinkering that seems to be needed is this operating
system file caching. What's the best way to make sure that my warmup
queries have cached all the files? And does a file cache have the
complete file in memory? I guess it can get tough to get my 100GB
index into the 16GB memory.
/Tim
--
Tommy Chheng
Programmer and UC Irvine Graduate Student
Twitter @tommychheng
http://tommy.chheng.com