On 6/13/2013 12:08 PM, bbarani wrote:
I see that the threads parameter has been removed from DIH from all version starting SOLR 4.x. Can someone let me know the best way to initiate indexing in multi threaded mode when using DIH now? Is there a way to do that?
That parameter was removed because it didn't work right, and there was no apparent way to fix it. The change that went into a later 3.6 version was a bandaid, not a fix. I don't know all the details.
There's no way to get multithreading with DIH directly, but you can do it indirectly:
Create multiple request handlers with different names, such as /dataimport1, /dataimport2, etc. Configure each handler with settings that will pull part of your data source. Start them so they run concurrently.
Depending on your environment, it may be easier to just write a multi-threaded indexing application using the Solr API for your language of choice.
Thanks, Shawn
