aah… was doing a facet on a double field which was having 6 decimal places… No surprise that the lucene cache got full…
.z/ahoor On 17-May-2013, at 11:56 PM, J Mohamed Zahoor <zah...@indix.com> wrote: > Memory increase a lot with queries which have facets… > > > ./Zahoor > > > On 17-May-2013, at 10:00 PM, Shawn Heisey <s...@elyograg.org> wrote: > >> On 5/17/2013 1:17 AM, J Mohamed Zahoor wrote: >>> I moved to 4.2.1 from 4.1 recently.. everything was working fine until i >>> added few more stats query.. >>> Now i am getting this error frequently that solr does not run even for 2 >>> minutes continuously. >>> All 5GB is getting used instantaneously in few queries... >> >> Someone on IRC ran into memory problems upgrading from 4.0 to 4.2. It >> wasn't OOM errors, they were just using a lot more heap than they were >> before and running into constant full garbage collections. >> >> There is another message on this list about someone who upgraded from >> 3.5 to 4.2 and is having memory troubles. >> >> The person on IRC made most of their fields unstored and reindexed, >> which fixed the problem for them. They only needed a few fields stored. >> >> Because the IRC user was on 4.0, I originally thought it had something >> to do with compressed stored fields, but on this thread, they started >> with 4.1. If that was the released 4.1.0 and not a SNAPSHOT version, >> then they had compressed stored fields before the upgrade. >> >> The user on IRC was not using termvectors or docvalues, which would be >> potential pain points unique to 4.2. >> >> I'm using 4.2.1 with no trouble in my setup, but I do have a heap that's >> considerably larger than I need. There are no apparent memory leaks - >> it's been running for over a month with updates once a minute. I've >> finally switched over from the 3.5.0 index to the new one, so for the >> last few days, it has been also taking our full query load. >> >> What could have changed between 4.1 and 4.2 to cause dramatically >> increased memory usage? >> >> From my /admin/system: >> >> <date name="startTime">2013-04-05T15:52:55.751Z</date> >> >> Thanks, >> Shawn >> >
