RE: DIH parallel processing

2015-10-15 Thread Davis, Daniel (NIH/NLM) [C]
isn't the most elegant solution but it gets around the fact that DIH is single-threaded. James Dyer Ingram Content Group -Original Message- From: nabil Kouici [mailto:koui...@yahoo.fr] Sent: Thursday, October 15, 2015 3:58 AM To: Solr-user Subject: DIH parallel processing Hi All

RE: DIH parallel processing

2015-10-15 Thread Dyer, James
isn't the most elegant solution but it gets around the fact that DIH is single-threaded. James Dyer Ingram Content Group -Original Message- From: nabil Kouici [mailto:koui...@yahoo.fr] Sent: Thursday, October 15, 2015 3:58 AM To: Solr-user Subject: DIH parallel processing Hi All, I

Re: DIH parallel processing

2015-10-15 Thread Charlie Hull
On 15/10/2015 09:57, nabil Kouici wrote: Hi All, I'm using DIH to index more than 15M from Sql Server to Solr. This take more than 2 hours. Big amount of this time is consumed by data fetching from database. I'm thinking about a solution to have parallel (thread) loud in the same DIH. Each thr

DIH parallel processing

2015-10-15 Thread nabil Kouici
Hi All, I'm using DIH to index more than 15M from Sql Server to Solr. This take more than 2 hours. Big amount of this time is consumed by data fetching from database. I'm thinking about a solution to have parallel (thread) loud in the same DIH. Each thread load a part of data. Do you have any ex