Re: Solr Timeouts

2009-10-07 Thread Shalin Shekhar Mangar
On Wed, Oct 7, 2009 at 2:19 AM, Giovanni Fernandez-Kincade < gfernandez-kinc...@capitaliq.com> wrote: > > What does the "maxCommitsToKeep"(from SolrDeletionPolicy in SolrConfig.xml) > parameter actually do? Increasing this value seems to have helped a little, > but I'm wary of cranking it without

RE: Solr Timeouts

2009-10-06 Thread Giovanni Fernandez-Kincade
Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Tuesday, October 06, 2009 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts It sounds like he is indexing on a local disk, but reading the files to be index from NFS - which would be fine. You can get Lucen

Re: Solr Timeouts

2009-10-06 Thread Mark Miller
your original email. > > -Todd > > -Original Message- > From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] > Sent: Tuesday, October 06, 2009 12:39 PM > To: solr-user@lucene.apache.org; yo...@lucidimagination.com > Subject: RE: Solr Timeouts &g

RE: Solr Timeouts

2009-10-06 Thread Feak, Todd
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Tuesday, October 06, 2009 12:39 PM To: solr-user@lucene.apache.org; yo...@lucidimagination.com Subject: RE: Solr Timeouts That thread was blocking for an hour while all other threads were idle or blocked. -Original Me

RE: Solr Timeouts

2009-10-06 Thread Giovanni Fernandez-Kincade
That thread was blocking for an hour while all other threads were idle or blocked. -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: Tuesday, October 06, 2009 3:07 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts This

RE: Solr Timeouts

2009-10-06 Thread Giovanni Fernandez-Kincade
Yeah this is Java 1.6. The indexes are being written to a local disk, but they files being indexed live on a NFS. -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Tuesday, October 06, 2009 2:59 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts Is this

Re: Solr Timeouts

2009-10-06 Thread Yonik Seeley
) > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run() > java.lang.Thread.run() > > > -Original Message- > From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley > Sent: Monday, October 05, 2009 1:18 PM > To: solr-user@lucene.apache.o

Re: Solr Timeouts

2009-10-06 Thread Lance Norskog
indexing progress... > > > -Original Message- > From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] > Sent: Monday, October 05, 2009 2:11 PM > To: solr-user@lucene.apache.org; yo...@lucidimagination.com > Subject: RE: Solr Timeouts > > I just grabb

RE: Solr Timeouts

2009-10-06 Thread Giovanni Fernandez-Kincade
cene.apache.org; yo...@lucidimagination.com Subject: RE: Solr Timeouts I just grabbed another stack trace for a thread that has been similarly blocking for over an hour. Notice that there is no Commit in this one: http-8080-Processor67 [RUNNABLE] CPU time: 1:02:05 org.apache.lucene.index.

RE: Solr Timeouts

2009-10-05 Thread Giovanni Fernandez-Kincade
Yonik Seeley Sent: Monday, October 05, 2009 1:18 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts OK... next step is to verify that SolrCell doesn't have a bug that causes it to commit. I'll try and verify today unless someone else beats me to it. -Yonik http://www.lucidimagi

RE: Solr Timeouts

2009-10-05 Thread Giovanni Fernandez-Kincade
Thanks for your help! -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: Monday, October 05, 2009 1:18 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts OK... next step is to verify that SolrCell doesn't have a bug

Re: Solr Timeouts

2009-10-05 Thread Yonik Seeley
> > I tried relative and absolute paths, but no dice so far. > > Any other ideas? > > -Gio. > > -Original Message- > From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley > Sent: Monday, October 05, 2009 12:52 PM > To: solr-user@lu

RE: Solr Timeouts

2009-10-05 Thread Giovanni Fernandez-Kincade
Sent: Monday, October 05, 2009 12:52 PM To: solr-user@lucene.apache.org Subject: Re: Solr Timeouts > This is what one of my SOLR requests look like: > > http://titans:8080/solr/update/extract/?literal.versionId=684936&literal.filingDate=1997-12-04T00:00:00Z&literal.formTypeId=

RE: Solr Timeouts

2009-10-05 Thread Walter Underwood
er 05, 2009 9:30 AM To: solr-user@lucene.apache.org Subject: RE: Solr Timeouts I'm not committing at all actually - I'm waiting for all 6 million to be done. -Original Message- From: Feak, Todd [mailto:todd.f...@smss.sony.com] Sent: Monday, October 05, 2009 12:10 PM To: s

Re: Solr Timeouts

2009-10-05 Thread Yonik Seeley
ginal Message- > From: Feak, Todd [mailto:todd.f...@smss.sony.com] > Sent: Monday, October 05, 2009 12:40 PM > To: solr-user@lucene.apache.org > Subject: RE: Solr Timeouts > > > > Actually, ignore my other response. > > > > I believe you are committing, whether you

RE: Solr Timeouts

2009-10-05 Thread Giovanni Fernandez-Kincade
er 05, 2009 9:30 AM To: solr-user@lucene.apache.org Subject: RE: Solr Timeouts I'm not committing at all actually - I'm waiting for all 6 million to be done. -Original Message- From: Feak, Todd [mailto:todd.f...@smss.sony.com] Sent: Monday, October 05, 2009 12:10 PM To: s

RE: Solr Timeouts

2009-10-05 Thread Feak, Todd
@lucene.apache.org Subject: RE: Solr Timeouts I'm not committing at all actually - I'm waiting for all 6 million to be done. -Original Message- From: Feak, Todd [mailto:todd.f...@smss.sony.com] Sent: Monday, October 05, 2009 12:10 PM To: solr-user@lucene.apache.org Subject: RE: Solr Timeouts

RE: Solr Timeouts

2009-10-05 Thread Feak, Todd
ncade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, October 05, 2009 9:30 AM To: solr-user@lucene.apache.org Subject: RE: Solr Timeouts I'm not committing at all actually - I'm waiting for all 6 million to be done. -Original Message- From: Feak, Todd [mailto:todd.f..

Re: Solr Timeouts

2009-10-05 Thread Yonik Seeley
Original Message- > From: Feak, Todd [mailto:todd.f...@smss.sony.com] > Sent: Monday, October 05, 2009 12:10 PM > To: solr-user@lucene.apache.org > Subject: RE: Solr Timeouts > > How often are you committing? > > Every time you commit, Solr will close the old index and open

RE: Solr Timeouts

2009-10-05 Thread Giovanni Fernandez-Kincade
I'm not committing at all actually - I'm waiting for all 6 million to be done. -Original Message- From: Feak, Todd [mailto:todd.f...@smss.sony.com] Sent: Monday, October 05, 2009 12:10 PM To: solr-user@lucene.apache.org Subject: RE: Solr Timeouts How often are you committi

Re: Solr Timeouts

2009-10-05 Thread Yonik Seeley
On Mon, Oct 5, 2009 at 12:03 PM, Giovanni Fernandez-Kincade wrote: > Hi, > > I’m attempting to index approximately 6 million HTML/Text files using SOLR > 1.4/Tomcat6 on Windows Server 2003 x64. I’m running 64 bit Tomcat and JVM. > I’ve fired up 4-5 different jobs that are making indexing requests

RE: Solr Timeouts

2009-10-05 Thread Feak, Todd
How often are you committing? Every time you commit, Solr will close the old index and open the new one. If you are doing this in parallel from multiple jobs (4-5 you mention) then eventually the server gets behind and you start to pile up commit requests. Once this starts to happen, it will ca