Re: Tips on speeding up indexing needed...

2009-10-13 Thread William Pierce
sday, October 13, 2009 11:07 AM To: Subject: Re: Tips on speeding up indexing needed... : References: <4acb30d2.2010...@umich.edu> : <69de18140910070109m27e50d2sc82a7c7bdd683...@mail.gmail.com> : <4acc95a3.5000...@umich.edu> : : <4acfc943.4040...@umich.e

Re: Tips on speeding up indexing needed...

2009-10-13 Thread Chris Hostetter
: References: <4acb30d2.2010...@umich.edu> : <69de18140910070109m27e50d2sc82a7c7bdd683...@mail.gmail.com> : <4acc95a3.5000...@umich.edu> : : <4acfc943.4040...@umich.edu> : In-Reply-To: <4acfc943.4040...@umich.edu> : Subject: Tips on speedi

Re: Tips on speeding up indexing needed...

2009-10-11 Thread William Pierce
Thanks, Lance. I already commit at the end. I will take a look at the data import handler. Thanks again! -- Bill -- From: "Lance Norskog" Sent: Saturday, October 10, 2009 7:58 PM To: Subject: Re: Tips on speeding up indexing nee

Re: Tips on speeding up indexing needed...

2009-10-10 Thread Lance Norskog
ur help! > > -- Bill > > -- > From: "William Pierce" > Sent: Saturday, October 10, 2009 5:47 PM > To: > Subject: Tips on speeding up indexing needed... > >> Folks: >> >> I have a corpus of approx 6 M

Re: Tips on speeding up indexing needed...

2009-10-10 Thread William Pierce
y, October 10, 2009 5:47 PM To: Subject: Tips on speeding up indexing needed... Folks: I have a corpus of approx 6 M documents each of approx 4K bytes. Currently, the way indexing is set up I read documents from a database and issue solr post requests in batches (batches are set up s

Tips on speeding up indexing needed...

2009-10-10 Thread William Pierce
Folks: I have a corpus of approx 6 M documents each of approx 4K bytes. Currently, the way indexing is set up I read documents from a database and issue solr post requests in batches (batches are set up so that the maxPostSize of tomcat which is set to 2MB is adhered to). This means that in