Yes, absolutely. Parallelizing indexing can make a huge difference. How you
do so will depend on your indexing environment. Most crudely, running multiple
indexing scripts on different subsets of data up to the the limitations of your
operating system and hardware is how many do it. SolrJ has some multithreaded
facility, as does DataImportHandler. Distributing the indexing to multiple
machines, but pointing all to the same Solr server, is effectively the same as
multi-threading it.... push documents into Solr from wherever as fast as it can
handle it. This is definitely how many do this.
Erik
On Feb 27, 2012, at 13:24 , Memory Makers wrote:
> Hi,
>
> Is there a way to speed up indexing by increasing the number of threads
> doing the indexing or perhaps by distributing indexing on multiple machines?
>
> Thanks.
