Re: configuring solr3.6 for a large intensive index only run

2012-07-17 Thread nanshi
1) In SolrConfig.xml, find ramBufferSizeMB and change to: 1024 2) Also, try decrease the mergefactor to see if it will give you less segments. In my experiment, it does. -- View this message in context: http://lucene.472066.n3.nabble.com/configuring-solr3-6-for-a-large-intensive-index-only-run

Re: configuring solr3.6 for a large intensive index only run

2012-05-24 Thread Shawn Heisey
On 5/23/2012 12:27 PM, Lance Norskog wrote: If you want to suppress merging, set the 'mergeFactor' very high. Perhaps 100. Note that Lucene opens many files (50? 100? 200?) for each segment. You would have to set the 'ulimit' for file descriptors to 'unlimited' or 'millions'. My installation (S

Re: configuring solr3.6 for a large intensive index only run

2012-05-24 Thread Otis Gospodnetic
Scott, In addition to what Lance said, make sure your ramBufferSizeMB in solrconfig.xml is high. Try with 512MB or 1024MB.  Seeing Solr/Lucene index segment merging visualization in SPM for Solr is one of my favourite reports in SPM.  It's kind of "amazing" how much index size fluctuates! Otis

Re: configuring solr3.6 for a large intensive index only run

2012-05-23 Thread Lance Norskog
If you want to suppress merging, set the 'mergeFactor' very high. Perhaps 100. Note that Lucene opens many files (50? 100? 200?) for each segment. You would have to set the 'ulimit' for file descriptors to 'unlimited' or 'millions'. Later, you can call optimize with a 'maxSegments' value. Optimize