Re: Need help with field collapsing and out of memory error

2010-09-02 Thread Moazzam Khan
Oh, I don't know if this matters but I store text fields in Solr but I never get them from the index (I only get the ID field from the index and everything else is pulled from DB cache). I store all the fields just in case I need to debug search queries, etc and want to see the data. Regards, Moa

Re: Need help with field collapsing and out of memory error

2010-09-01 Thread Moazzam Khan
Hi, If this is how you configure the field collapsing cache, then I don't have it setup: I didnt add that part to solrconfig.xml. The way I setup field collapsing is I added this tag: Then I modified the default request handler (for standard queries) with this:

Re: Need help with field collapsing and out of memory error

2010-09-01 Thread Jean-Sebastien Vachon
can you tell us what are your current settings regarding the fieldCollapseCache? I had similar issues with field collapsing and I found out that this cache was responsible for most of the OOM exceptions. Reduce or even remove this cache from your configuration and it should help. On 2010-09-0

Need help with field collapsing and out of memory error

2010-09-01 Thread Moazzam Khan
Hi guys, I have about 20k documents in the Solr index (and there's a lot of text in each of them). I have field collapsing enabled on a specific field (AdvisorID). The thing is if I have field collapsing enabled in the search request I don't get correct count for the total number of records that