How much memory are you allocating for the JVM? And are you sure the memory isn't just memory hanging around available for GCing?
An interesting test would be to restrict your available memory allowed to the JVM and see if you bumped up against that.... Here's a blog post from Mark Miller about various tools: http://www.lucidimagination.com/blog/2009/02/09/investigating-oom-and-other-jvm-issues/ <http://www.lucidimagination.com/blog/2009/02/09/investigating-oom-and-other-jvm-issues/>Sorry I cant' be more help today.... Erick On Mon, Jan 25, 2010 at 11:42 AM, Antonio Lobato <alob...@symplicity.com>wrote: > Just indexing. If I shutdown Solr, memory usage goes down to 200MB. I've > searched the mailing lists, but most situations are with people both > searching and indexing. I was under the impression that indexing shouldn't > use up so much memory. I'm trying to figure out where all the usage is > coming from though. Any ideas? > > > On Jan 25, 2010, at 11:03 AM, Erick Erickson wrote: > > Are you also searching on this machine or just indexing? >> >> I'll assume your certain that it's SOLR that's eating memory, >> as in you stop the process and your usage drops way down. >> >> But if you search the user list for memory, you'll see this >> kind of thing discussed a bunch of times, along with >> suggestions for tracking it down, whether it's just >> postponed GCing, etc..... >> >> HTH >> Erick >> >> On Mon, Jan 25, 2010 at 10:47 AM, Antonio Lobato <alob...@symplicity.com >> >wrote: >> >> Hello everyone! >>> >>> I have a question about indexing a large dataset in Solr and ram usage. >>> I >>> am currently indexing about 160 gigabytes of data to a dedicated indexing >>> server. The data is constantly being fed to Solr, 24/7. The index grows >>> as >>> I prune away old data that is not needed, so the index size stays in the >>> 150-170 gigabyte range. However, RAM usage on this machine is off the >>> wall. >>> The usage grows to about 27 gigabytes of RAM over 2 days or so. Is this >>> normal behavior for Solr? >>> >>> Thanks! >>> -Antonio >>> >>> >
