Re: Reading data from Oracle

2018-02-15 Thread Shawn Heisey
On 2/15/2018 12:34 AM, LOPEZ-CORTES Mariano-ext wrote: > We've done the following test: From a java program, we read chunks of data > from Oracle and inject to Solr (via Solrj). > > The problem : It is really really slow (1'5 nights). > > Is there one faster method to do that ? Are you indexing w

Re: Reading data from Oracle

2018-02-15 Thread Erick Erickson
ext: >> Injecting too many rows into Solr throws Java heap exception (Higher memory? >> We have 8GB per node). >> >> Have DIH support for paging queries? >> >> Thanks! >> >> -----Message d'origine- >> De : Bernd Fehling [mailto:bernd.fehl...@uni

Re: Reading data from Oracle

2018-02-15 Thread Bernd Fehling
ode). > > Have DIH support for paging queries? > > Thanks! > > -Message d'origine- > De : Bernd Fehling [mailto:bernd.fehl...@uni-bielefeld.de] > Envoyé : jeudi 15 février 2018 10:13 > À : solr-user@lucene.apache.org > Objet : Re: Reading data from Oracle >

Re: Reading data from Oracle

2018-02-15 Thread Michal Hlavac
Did you try to use ConcurrentUpdateSolrClient instead of HttpSolrClient? m. On štvrtok, 15. februára 2018 8:34:06 CET LOPEZ-CORTES Mariano-ext wrote: > Hello > > We have to delete our Solr collection and feed it periodically from an Oracle > database (up to 40M rows). > > We've done the follow

RE: Reading data from Oracle

2018-02-15 Thread LOPEZ-CORTES Mariano-ext
-user@lucene.apache.org Objet : Re: Reading data from Oracle And where is the bottleneck? Is it reading from Oracle or injecting to Solr? Regards Bernd Am 15.02.2018 um 08:34 schrieb LOPEZ-CORTES Mariano-ext: > Hello > > We have to delete our Solr collection and feed it periodically from an Orac

Re: Reading data from Oracle

2018-02-15 Thread Bernd Fehling
And where is the bottleneck? Is it reading from Oracle or injecting to Solr? Regards Bernd Am 15.02.2018 um 08:34 schrieb LOPEZ-CORTES Mariano-ext: > Hello > > We have to delete our Solr collection and feed it periodically from an Oracle > database (up to 40M rows). > > We've done the follow