Re: Question on Batch process

2011-04-28 Thread Otis Gospodnetic
Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Charles Wardell > To: solr-user@lucene.apache.org > Sent: Wed, April 27, 2011 7:51:20 PM > Subject: Re: Question on Batch process > > Thank you for your response. I did not m

Re: Question on Batch process

2011-04-27 Thread Charles Wardell
; > > > - Original Message > > From: Charles Wardell > > To: solr-user@lucene.apache.org > > Sent: Tue, April 26, 2011 8:01:28 PM > > Subject: Re: Question on Batch process > > > > Thank you Otis. > > Without trying to appear to stupid,

Re: Question on Batch process

2011-04-27 Thread Otis Gospodnetic
al Message > From: Charles Wardell > To: solr-user@lucene.apache.org > Sent: Tue, April 26, 2011 8:01:28 PM > Subject: Re: Question on Batch process > > Thank you Otis. > Without trying to appear to stupid, when you refer to having the params >matching your # of CPU cor

Re: Question on Batch process

2011-04-26 Thread Charles Wardell
Thank you Otis. Without trying to appear to stupid, when you refer to having the params matching your # of CPU cores, you are talking about the # of threads I can spawn with the StreamingUpdateSolrServer object? Up until now, I have been just utilizing post.sh or post.jar. Are these capable of t

Re: Question on Batch process

2011-04-26 Thread Otis Gospodnetic
Charlie, How's this: * -Xmx2g * ramBufferSizeMB 512 * mergeFactor 10 (default, but you could up it to 20, 30, if ulimit -n allows) * ignore/delete maxBufferedDocs - not used if you ran ramBufferSizeMB * use SolrStreamingUpdateServer (with params matching your number of CPU cores) or send batches