r-user@lucene.apache.org
> Sent: Monday, March 30, 2009 12:53:21 PM
> Subject: Re: OOM at MultiSegmentReader.norms
>
> Thanks Otis and Mike.
>
> I'm indexing total of 9 fields, with 5 having norms turned on. I think
> I may not need it and will try use the omitNorms for them.
>
On Mon, Mar 30, 2009 at 12:53 PM, vivek sar wrote:
> I'm indexing total of 9 fields, with 5 having norms turned on.
So that's 500MB for norms alone, plus memory for Lucene's term index
(every 128th term by default). Solr also opens a new
IndexReader/Searcher before closing the old one, so there
Thanks Otis and Mike.
I'm indexing total of 9 fields, with 5 having norms turned on. I think
I may not need it and will try use the omitNorms for them.
How do I make use of RAMBuffer in Solr? I couldn't find anything on
this on the Wiki - any pointer?
Thanks,
-vivek
On Sat, Mar 28, 2009 at 1:09
Still, 1024M ought to be enough to load one field's norms (how many
fields have norms?). If you do things requiring FieldCache that'll
also consume RAM.
It's also possible you're hitting this bug (false OOME) in Sun's JRE:
http://issues.apache.org/jira/browse/LUCENE-1566
Feel free to go vote
That's a tiny heap. Part of it is used for indexing, too. And the fact that
your heap is so small shows you are not really making use of that nice
ramBufferSizeMB setting. :)
Also, use omitNorms="true" for fields that don't need norms (if their types
don't already do that).
Otis
--
Sematext
