Re: SOLR 4 Alpha Out Of Mem Err

2012-08-14 Thread sausarkar
Hello Mark, Has this issue been fixed in the BETA release? - Sauvik -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-Alpha-Out-Of-Mem-Err-tp3995033p4001266.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-20 Thread Mark Miller
> > Hi Mark, > I am am also facing the same issue when trying to index in SolrCloud using > DIH running on a non-leader server. The DIH server is creating around 10k > threads and then OOM cannot create thread error. > Do you know when or which version this issue will be solved. I think a > workaro

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-20 Thread sausarkar
this issue is to find the leader from zookeeper and run the DIH on the leader. Sauvik -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-Alpha-Out-Of-Mem-Err-tp3995033p3996378.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-18 Thread solrman
solrsconfig.xml, search for change content:* 0 10 to content:notexist 0 10 -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-Alpha-Out-Of-Mem-Err-tp3995033p3995695.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-18 Thread Yonik Seeley
I think what makes the most sense is to limit the number of connections to another host. A host only has so many CPU resources, and beyond a certain point throughput would start to suffer anyway (and then only make the problem worse). It also makes sense in that a client could generate documents

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-17 Thread Mark Miller
On Jul 17, 2012, at 8:08 PM, Nick Koton wrote: > So could there be something amiss in the server side implementation of > ConcurrentUpdateSolrServer? See my earlier email. Once we decide on the appropriate change, we will address it. - Mark Miller lucidimagination.com

RE: SOLR 4 Alpha Out Of Mem Err

2012-07-17 Thread Nick Koton
: Nick Koton [mailto:nick.ko...@gmail.com] Sent: Monday, July 16, 2012 5:53 PM To: 'solr-user@lucene.apache.org' Subject: RE: SOLR 4 Alpha Out Of Mem Err > That suggests you're running out of threads Michael, Thanks for this useful observation. What I found just prior to the "

RE: SOLR 4 Alpha Out Of Mem Err

2012-07-16 Thread Nick Koton
a.lang.Thread.run(Thread.java:662) -Original Message- From: Michael Della Bitta [mailto:michael.della.bi...@appinions.com] Sent: Sunday, July 15, 2012 4:46 PM To: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err "unable to create new native thread" That sugg

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-16 Thread Mark Miller
On Jul 15, 2012, at 2:45 PM, Nick Koton wrote: > I converted my program to use > the SolrServer::add(Collection docs) method with 100 > documents in each add batch. Unfortunately, the out of memory errors still > occur without client side commits. This won't change much unfortunately - currentl

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Michael Della Bitta
est > Nick > > -Original Message- > From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley > Sent: Sunday, July 15, 2012 11:05 AM > To: Nick Koton > Cc: solr-user@lucene.apache.org > Subject: Re: SOLR 4 Alpha Out Of Mem Err > > On Sun, Jul

RE: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Nick Koton
alf Of Yonik Seeley Sent: Sunday, July 15, 2012 11:05 AM To: Nick Koton Cc: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err On Sun, Jul 15, 2012 at 11:52 AM, Nick Koton wrote: >> Do you have the following hard autoCommit in your config (as the >> stock > se

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Jack Krupansky
Agreed. That's why I say "maybe". Clearly something sounds amiss here. -- Jack Krupansky -Original Message- From: Yonik Seeley Sent: Sunday, July 15, 2012 12:06 PM To: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err On Sun, Jul 15, 2012 at

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Yonik Seeley
On Sun, Jul 15, 2012 at 12:52 PM, Jack Krupansky wrote: > Maybe your rate of update is so high that the commit never gets a chance to > run. I don't believe that is possible. If it is, it should be fixed. -Yonik http://lucidimagination.com

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Yonik Seeley
On Sun, Jul 15, 2012 at 11:52 AM, Nick Koton wrote: >> Do you have the following hard autoCommit in your config (as the stock > server does)? >> >> 15000 >> false >> > > I have tried with and without that setting. When I described running with > auto commit, that setting is

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Jack Krupansky
...@gmail.com] On Behalf Of Yonik Seeley Sent: Sunday, July 15, 2012 5:15 AM To: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err Do you have the following hard autoCommit in your config (as the stock server does)? 15000 false This is now fairly important since Solr

RE: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Nick Koton
ee...@gmail.com] On Behalf Of Yonik Seeley Sent: Sunday, July 15, 2012 5:15 AM To: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err Do you have the following hard autoCommit in your config (as the stock server does)? 15000 false This is now fairly impor

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-15 Thread Yonik Seeley
Do you have the following hard autoCommit in your config (as the stock server does)? 15000 false This is now fairly important since Solr now tracks information on every uncommitted document added. At some point we should probably hardcode some mechanism based on number o

RE: SOLR 4 Alpha Out Of Mem Err

2012-07-14 Thread Nick Koton
--Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Saturday, July 14, 2012 2:44 PM To: solr-user@lucene.apache.org Subject: Re: SOLR 4 Alpha Out Of Mem Err Can you give more info? How much RAM are you giving Solr with Xmx? Can you be more specific about the behavior y

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-14 Thread Mark Miller
Can you give more info? How much RAM are you giving Solr with Xmx? Can you be more specific about the behavior you are seeing with auto commit vs client commit? How often are you trying to commit? With the client? With auto commit? Are you doing soft commits? Std commits? A mix? What's the s

SOLR 4 Alpha Out Of Mem Err

2012-07-14 Thread Nick Koton
I have been experiencing out of memory errors when indexing via solrj into a 4 alpha cluster. It seems when I delegate commits to the server (either auto commit or commit within) there is nothing to throttle the solrj clients and the server struggles to fan out the work. However, when I handle co