Re: URGENT HELP: Improving Solr indexing time

2011-06-13 Thread Alexey Serba
16276 ... > so I am doing a delta import of around 500,000 rows at a > time. http://wiki.apache.org/solr/DataImportHandlerDeltaQueryViaFullImport

Re: URGENT HELP: Improving Solr indexing time

2011-06-05 Thread Rohit Gupta
Sent: Sun, 5 June, 2011 10:05:22 AM Subject: Re: URGENT HELP: Improving Solr indexing time Hi Rohit, I am currently working on https://issues.apache.org/jira/browse/SOLR-2233 which fixes multithreading issues How complex is your dataimport schema? SOLR-2233 (multithreading, better connectio

Re: URGENT HELP: Improving Solr indexing time

2011-06-04 Thread Fuad Efendi
er >now. Are there any more tweeking i can do? > >Also, planning to move to master-salve model, but am failing to >understand where >to start exactly. > >Regards, >Rohit > > > > >From: lee carroll >To: solr-user@lucene.apach

Re: URGENT HELP: Improving Solr indexing time

2011-06-04 Thread Rohit Gupta
t: Re: URGENT HELP: Improving Solr indexing time Rohit - you have double posted maybe - did Otis's answer not help with your issue or at least need a response to clarify ? On 4 June 2011 22:53, Chris Cowan wrote: > How long does the query against the DB take (outside of Solr)? If that&

Re: URGENT HELP: Improving Solr indexing time

2011-06-04 Thread lee carroll
Rohit - you have double posted maybe - did Otis's answer not help with your issue or at least need a response to clarify ? On 4 June 2011 22:53, Chris Cowan wrote: > How long does the query against the DB take (outside of Solr)? If that's slow > then it's going to take a while to update the inde

Re: URGENT HELP: Improving Solr indexing time

2011-06-04 Thread Chris Cowan
How long does the query against the DB take (outside of Solr)? If that's slow then it's going to take a while to update the index. You might need to figure a way to break things up a bit, maybe use a delta import instead of a full import. Chris On Jun 4, 2011, at 6:23 AM, Rohit Gupta wrote: >

URGENT HELP: Improving Solr indexing time

2011-06-04 Thread Rohit Gupta
My Solr server takes very long to update index. The table it hits to index is huge with 10Million + records , but even in that case I feel this is very long time to index. Below is the snapshot of the /dataimport page busy A command is still running... 1:53:39.664 16276 24237 16273 0 2011-06-04