exing speed by
> temporarily removing both of them.
>
> Thanks,
> Kalyan Manepalli
>
> -Original Message-
> From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
> Sent: Wednesday, July 01, 2009 3:31 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Tips on s
: Manepalli, Kalyan [mailto:kalyan.manepa...@orbitz.com]
Sent: Wednesday, July 01, 2009 3:41 PM
To: solr-user@lucene.apache.org
Subject: RE: Tips on speeding the indexing process
Regarding the analysis, we do couple of things during indexing. First is use a
dictionary text file for stopword filter factory
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: Wednesday, July 01, 2009 3:31 PM
To: solr-user@lucene.apache.org
Subject: Re: Tips on speeding the indexing process
Kalyan,
150/200 ms per 1 document to index seems too long, but it really depends on how
much
Message
> From: "Manepalli, Kalyan"
> To: "solr-user@lucene.apache.org"
> Sent: Wednesday, July 1, 2009 4:21:30 PM
> Subject: RE: Tips on speeding the indexing process
>
> Here are some specs for my indexer.
> Indexer is custom Java code that reads data
Manepalli
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: Wednesday, July 01, 2009 3:11 PM
To: solr-user@lucene.apache.org
Subject: Re: Tips on speeding the indexing process
Kalyan,
Using SolrJ? Use the StreamingServer, it's nice and fast.
Alternat
Kalyan,
Using SolrJ? Use the StreamingServer, it's nice and fast.
Alternatively, start multiple indexing threads (match the number of Solr server
CPU cores) and index from there.
Send batches of docs, not one by one.
Don't commit or optimize until you are done.
Otis
--
Sematext -- http://semat
Kalyan,
Tell us about your indexer. Is it DIH-powered? Custom Java code,
perhaps, using SolrJ indexing over HTTP? Is your indexer doing a lot
of work itself to preprocess documents before sending to Solr?
Erik
On Jul 1, 2009, at 3:42 PM, Manepalli, Kalyan wrote:
Hi,
