On 12/8/06, Andrew Nagy <[EMAIL PROTECTED]> wrote:
I changed the filterCache to the following: <filterCache class="solr.LRUCache" size="25600" initialSize="5120" autowarmCount="1024"/>However a search that normally takes .04s is taking 74 seconds once I use the facets since I am faceting on 4 fields.
The first time or subsequent times? Is your filterCache big enough yet? What do you see for evictions and hit ratio?
Can you suggest a better configuration that would solve this performance issue, or should I not use faceting?
Faceting isn't something that will always be fast... one often needs to design things in a way that it can be fast. Can you give some examples of your faceted queries? Can you show the field and fieldtype definitions for the fields you are faceting on? For each field that you are faceting on, how many different terms are in it?
I figure I could run the query twice, once limited to 20 records and then again with the limit set to the total number of records and develop my own facets. I have infact done this before with a different back-end and my code is processed in under .01 seconds. Why is faceting so slow?
It's computationally expensive to get exact facet counts for a large number of hits, and that is what the current faceting code is designed to do. No single method will be appropriate *and* fast for all scenarios. Another method that hasn't been implemented is some statistical faceting based on the top hits, using stored fields or stored term vectors. -Yonik
