On 11/26/2012 2:41 PM, richardg wrote:
We started having high load again today a few times today, each time looking at SPM monitor our filter cache starts having high lookups and low hit rate, this is our filtercache setting:<filterCache class="solr.FastLRUCache" size="1024" initialSize="512" autowarmCount="512"/> would it be possibly too slow? here is the graph when it happens: <http://lucene.472066.n3.nabble.com/file/n4022464/filter_cache.png>
Based on my own experiences, I would bet that you have some very very complex or large filter queries, and when they are executed against your brand new index searcher by your autowarmCount of 512, they go very slowly.
I started out with an autowarm count of 32 against a 256-entry filtercache. I ultimately had to drop my autowarm count to FOUR in order to make sure that it took less than 30 seconds for autowarm to complete. I was initially seeing autowarm times measured in minutes.
If this is what is happening to you, the advice is simple: Either drastically lower your filterCache autowarmCount, or fix your app so that your filter queries are smaller and less complex.
Thanks, Shawn
