RE: Solr commits before documents are added

2009-10-20 Thread SharmilaR
t: Monday, October 19, 2009 1:07 PM > To: solr-user@lucene.apache.org > Subject: RE: Solr commits before documents are added > > > Solr version is 1.3 > I am indexing total of 1.4 million documents. Yes, I > commit(waitFlush="true" > waitSearcher="true") every

RE: Solr commits before documents are added

2009-10-20 Thread Feak, Todd
-Original Message- From: SharmilaR [mailto:sranganat...@library.rochester.edu] Sent: Monday, October 19, 2009 1:07 PM To: solr-user@lucene.apache.org Subject: RE: Solr commits before documents are added Solr version is 1.3 I am indexing total of 1.4 million documents. Yes, I commit(

Re: Solr commits before documents are added

2009-10-19 Thread Yonik Seeley
On Mon, Oct 19, 2009 at 7:39 PM, Lance Norskog wrote: > commit(waitFlush="true", waitSearcher="true")  waits for the entire > operation and when it finishes, all 1 million documents should be > searchable. That waits for the commit to complete, but not any adds that may be happening in parallel (

Re: Solr commits before documents are added

2009-10-19 Thread Lance Norskog
commit(waitFlush="true", waitSearcher="true") waits for the entire operation and when it finishes, all 1 million documents should be searchable. Please try this same test with Solr 1.4 and post your results. To make it easier, here is the first release candidate: http://people.apache.org/~gsinge

RE: Solr commits before documents are added

2009-10-19 Thread SharmilaR
Solr version is 1.3 I am indexing total of 1.4 million documents. Yes, I commit(waitFlush="true" waitSearcher="true") every 100k documents and then one at the end. I have a counter next to addDoc(SolrDocument) statement to keep track of number of documents added. When I query Solr after commit,

RE: Solr commits before documents are added

2009-10-19 Thread Feak, Todd
A few questions to help the troubleshooting. Solr version #? Is there just 1 commit through Solrj for the millions of documents? Or do you do it on a regular interval (every 100k documents for example) and then one at the end to be sure? How are you observing that the last few didn't make it