Re: Java heap space exception in 4.2.1

2013-05-27 Thread Erick Erickson
400M docs is quite a large number of documents for a single piece of hardware, and if you're faceting over a large number of unique values, this will chew up memory. So it's not surprising that you're seeing OOMs, I suspect you just have too many documents on a single machine.. Best Erick On Mo

Re: Java heap space exception in 4.2.1

2013-05-27 Thread Jam Luo
I am sorry about a type mistake 8,000,000,000 -> 800,000,000 2013/5/27 Jam Luo > I have the same problem. at 4.1 ,a solr instance could take 8,000,000,000 > doc. but at 4.2.1, a instance only take 400,000,000 doc, it will oom at > facet query. the facet field was token by space. > > May 27,

Re: Java heap space exception in 4.2.1

2013-05-27 Thread Jam Luo
I have the same problem. at 4.1 ,a solr instance could take 8,000,000,000 doc. but at 4.2.1, a instance only take 400,000,000 doc, it will oom at facet query. the facet field was token by space. May 27, 2013 11:12:55 AM org.apache.solr.common.SolrException log SEVERE: null:java.lang.RuntimeExcep

Re: Java heap space exception in 4.2.1

2013-05-18 Thread J Mohamed Zahoor
aah… was doing a facet on a double field which was having 6 decimal places… No surprise that the lucene cache got full… .z/ahoor On 17-May-2013, at 11:56 PM, J Mohamed Zahoor wrote: > Memory increase a lot with queries which have facets… > > > ./Zahoor > > > On 17-May-2013, at 10:00 PM, S

Re: Java heap space exception in 4.2.1

2013-05-17 Thread J Mohamed Zahoor
Memory increase a lot with queries which have facets… ./Zahoor On 17-May-2013, at 10:00 PM, Shawn Heisey wrote: > On 5/17/2013 1:17 AM, J Mohamed Zahoor wrote: >> I moved to 4.2.1 from 4.1 recently.. everything was working fine until i >> added few more stats query.. >> Now i am getting thi

Re: Java heap space exception in 4.2.1

2013-05-17 Thread Shawn Heisey
On 5/17/2013 1:17 AM, J Mohamed Zahoor wrote: > I moved to 4.2.1 from 4.1 recently.. everything was working fine until i > added few more stats query.. > Now i am getting this error frequently that solr does not run even for 2 > minutes continuously. > All 5GB is getting used instantaneously in f

Re: Java heap space exception in 4.2.1

2013-05-17 Thread J Mohamed Zahoor
Hprof introspection shows that huge Double Array are using up 75% of heap space... which belongs to Lucen's FieldCache.. ./zahoor On 17-May-2013, at 12:47 PM, J Mohamed Zahoor wrote: > Hi > > I moved to 4.2.1 from 4.1 recently.. everything was working fine until i > added few more stats qu

Java heap space exception in 4.2.1

2013-05-17 Thread J Mohamed Zahoor
Hi I moved to 4.2.1 from 4.1 recently.. everything was working fine until i added few more stats query.. Now i am getting this error frequently that solr does not run even for 2 minutes continuously. All 5GB is getting used instantaneously in few queries... SEVERE: null:java.lang.RuntimeExcep