A few questions to help the troubleshooting.

Solr version #?

Is there just 1 commit through Solrj for the millions of documents? 

Or do you do it on a regular interval (every 100k documents for example) and 
then one at the end to be sure?

How are you observing that the last few didn't make it in? Are you looking at a 
slave or master?

-Todd
-----Original Message-----
From: Ranganathan, Sharmila [mailto:sranganat...@library.rochester.edu] 
Sent: Monday, October 19, 2009 9:19 AM
To: solr-user@lucene.apache.org
Subject: Solr commits before documents are added

Hi,

My application indexes huge number of documents(like in millions). Below
is the snapshot of my code where I add all documents to Solr, and then
at last issue commit command. I use Solrj. I find that last few
documents are not  committed to Solr. Is this because adding documents
to Solr took longer time and it reached commit command even before it
finished adding documents? Is there are way to ensure that solr waits
for all documents to be added and then commits? Please advise me how to
solve this issue.

 

For loop

                solrServer.add(doc);   // Add document to Solr

End for loop

solrServer.commit();          // Commit to Solr

 

 

Thanks,

Sharmila


Reply via email to