Re: newbie question on how to batch commit documents

2010-06-01 Thread Chris Hostetter
: CommonsHttpSolrServer.request() resulting in multiple searchers. My first : thought was to change the configs for autowarming. But after looking at the : autowarm params, I am not sure what can be changed or perhaps a different : approach is recommened. even with 0 autowarming (which is what

Re: newbie question on how to batch commit documents

2010-06-01 Thread olivier sallou
I would additionally suggest to use embeddedSolrServer for large uploads if possible, performance are better. 2010/5/31 Steve Kuo > I have a newbie question on what is the best way to batch add/commit a > large > collection of document data via solrj. My first attempt was to write a > multi-th

Re: newbie question on how to batch commit documents

2010-05-31 Thread findbestopensource
Add commit after the loop. I would advise to use commit in a separate thread. I do keep separate timer thread, where every minute I will do commit and at the end of every day I will optimize the index. Regards Aditya www.findbestopensource.com On Tue, Jun 1, 2010 at 2:57 AM, Steve Kuo wrote: >

Re: newbie question on how to batch commit documents

2010-05-31 Thread Erik Hatcher
Move the commit outside your loop and you'll be in better shape. Better yet, enable autocommit in solrconfig.xml and don't commit from your multithreaded client, otherwise you still run the risk of too many commits happening concurrently. Erik On May 31, 2010, at 5:27 PM, Steve Ku