That's my gut feeling (start big and go lower if OOM occurs) too. Bill
On Tue, Aug 25, 2009 at 5:34 PM, Edward Capriolo <edlinuxg...@gmail.com>wrote: > On Tue, Aug 25, 2009 at 5:29 PM, Bill Au<bill.w...@gmail.com> wrote: > > Just curious, how often do folks commit when building their Solr/Lucene > > index from scratch for index with millions of documents? Should I just > wait > > and do a single commit at the end after adding all the documents to the > > index? > > > > Bill > > > > Bill in most cases you probably cannot do one large commit as you will > hit OOM. How many documents can be uncommitted is based on the size of > the documents. Committing every document is slow. I have done a commit > every 10,000 mostly. Results may vary. Someone might have a better > answer then me. >
