Re: Configuration of parallel indexing threads

2017-06-09 Thread gigo314
Thanks a lot! -- View this message in context: http://lucene.472066.n3.nabble.com/Configuration-of-parallel-indexing-threads-tp4338466p4339792.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Configuration of parallel indexing threads

2017-06-02 Thread Erick Erickson
that's pretty much my strategy. I'll add parenthetically that I often see the bottleneck for indexing to be acquiring the data from the system of record in the first place rather than Solr. Assuming you're using SolrJ, an easy test is to comment out the line that sends to Solr. There's usually som

Re: Configuration of parallel indexing threads

2017-06-02 Thread gigo314
Thanks for the replies. Just to confirm that I got it right: 1. Since there is no setting to control index writers, is it fair to assume that Solr always indexes at maximum possible speed? 2. The way to control write speed is to control number of clients that are simultaneously posting data, right?

Re: Configuration of parallel indexing threads

2017-06-01 Thread Susheel Kumar
How are you indexing currently? Are you using DIH or using SolrJ/Java? And are you indexing with multiple threads/machines simultaneously etc or just one thread/machine etc. Thnx Susheel On Thu, Jun 1, 2017 at 11:45 AM, Erick Erickson wrote: > That's been removed in LUCENE-6659. I regularly max

Re: Configuration of parallel indexing threads

2017-06-01 Thread Erick Erickson
That's been removed in LUCENE-6659. I regularly max out my CPUs by having multiple _clients_ send update simultaneously rather than trying to up the number of threads the indexing process takes. But Mike McCandless can answer authoritatively... Best, Erick On Thu, Jun 1, 2017 at 4:16 AM, gigo314