How you batching all documents in one curl call? Do you have a sample, so I can modify my script and try it again.
Right now I do curl on each documents( I have 1000 docs on each folder and I have 1000 folders) using : curl http://localhost:7001/solr/update --data-binary @abc.xml -H 'Content-type:text/plain; charset=utf-8' Abc.xml is one doc, we have another 999 files ending with ".xml" Please advice. Thanks Francis -----Original Message----- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Friday, July 10, 2009 12:36 AM To: solr-user@lucene.apache.org Subject: Re: Using curl comparing with using WebService::Solr On Fri, Jul 10, 2009 at 11:50 AM, Francis Yakin <fya...@liquid.com> wrote: > I also commit too many I guess, since we have 1000 folders, so each loop > will executed the load and commit. > So 1000 loops with 1000 commits. I think it will be help if I only commit > once after the 1000 loops completed. > > Any inputs? > Commit only when you must show changes to searchers. It is best to commit once you are done with all documents. Also, batching documents in one curl call will also help a lot (save on http overhead). -- Regards, Shalin Shekhar Mangar.
