Re: Solr RAM Requirements

2010-03-17 Thread Tom Burton-West
Hi Chak Rather than comparing the overall size of your index to the RAM available for the OS disk cache, you might want to look at particular files. For example if you allow phrase queries, than the size of the *prx files is relevant, if you don't, you can look at the size of your *frq files. Y

Re: Solr RAM Requirements

2010-03-16 Thread Dennis Gearon
ww.yert.com/film.php --- On Tue, 3/16/10, Peter Sturge wrote: > From: Peter Sturge > Subject: Re: Solr RAM Requirements > To: solr-user@lucene.apache.org > Date: Tuesday, March 16, 2010, 6:25 PM > There are certainly a number of > widely varying opinions on the use of RAM > di

Re: Solr RAM Requirements

2010-03-16 Thread Peter Sturge
There are certainly a number of widely varying opinions on the use of RAM directory. Basically, though, if you need the index to be persistent at some point (i.e. saved across reboots, crashes etc.), you'll need to write to a disk, so RAM directory becomes somewhat superfluous in this case. Genera

Re: Solr RAM Requirements

2010-03-16 Thread KaktuChakarabati
Hey Peter, Thanks for your reply. My question was mainly about the fact there seems to be two different aspects to the solr RAM usage: in-process and out-process. By that I mean, yes i know the many different parameters/caches to do with solr in-process memory usage and related culprits, however

Re: Solr RAM Requirements

2010-03-16 Thread Peter Sturge
On Tue, Mar 16, 2010 at 9:08 PM, KaktuChakarabati wrote: > > Hey, > I am trying to understand what kind of calculation I should do in order to > come up with reasonable RAM size for a given solr machine. > > Suppose the index size is at 16GB. > The Max heap allocated to JVM is about 12GB. > > The