Re: Solr indexing slows down

2013-06-10 Thread Michael Della Bitta
ngliche Nachricht- > Von: Michael Della Bitta [mailto:michael.della.bi...@appinions.com] > Gesendet: Donnerstag, 6. Juni 2013 18:29 > An: solr-user@lucene.apache.org > Betreff: Re: Solr indexing slows down > > Hi Sebastian, > > What database are you using? How much RAM is availabl

Re: Solr indexing slows down

2013-06-10 Thread Walter Underwood
8 million documents in two hours is over 1000/sec. That is a pretty fast indexing rate. It may be hard to go faster than that. wunder On Jun 10, 2013, at 7:12 AM, Shawn Heisey wrote: > On 6/10/2013 2:32 AM, Sebastian Steinfeld wrote: >> Hi Shawn, >> >> thank you for your answer. >> >> I am us

Re: AW: Solr indexing slows down

2013-06-10 Thread Shawn Heisey
On 6/10/2013 2:32 AM, Sebastian Steinfeld wrote: > Hi Shawn, > > thank you for your answer. > > I am using Oracle. This is the configuration I am using: > - > name="local" > driver="oracle.jdbc.driver.OracleDriver" > url="jdbc:oracle:thin:@localhost:1521:XE" > user="" > password=

AW: Solr indexing slows down

2013-06-10 Thread Sebastian Steinfeld
Ursprüngliche Nachricht- Von: Shawn Heisey [mailto:s...@elyograg.org] Gesendet: Donnerstag, 6. Juni 2013 19:06 An: solr-user@lucene.apache.org Betreff: Re: Solr indexing slows down On 6/6/2013 4:13 AM, Sebastian Steinfeld wrote: > The amout of documents I want to index is 8 million, the fi

AW: Solr indexing slows down

2013-06-10 Thread Sebastian Steinfeld
doing nothing. Thanks, Sebastian -Ursprüngliche Nachricht- Von: Michael Della Bitta [mailto:michael.della.bi...@appinions.com] Gesendet: Donnerstag, 6. Juni 2013 18:29 An: solr-user@lucene.apache.org Betreff: Re: Solr indexing slows down Hi Sebastian, What database are you using? How

Re: Solr indexing slows down

2013-06-06 Thread Shawn Heisey
On 6/6/2013 4:13 AM, Sebastian Steinfeld wrote: The amout of documents I want to index is 8 million, the first 1,6 million are indexed in 2min, but to complete the Import it takes nearly 2 hours. The size of the index on the hard drive is 610MB. I started the solr server with 2GB memory. I read

Re: Solr indexing slows down

2013-06-06 Thread Michael Della Bitta
Hi Sebastian, What database are you using? How much RAM is available on your machine? It looks like you're selecting from a view... Have you tried paging through the view outside of Solr? Does that slow down as well? Do you notice any increased load on the Solr box or the database server? Micha

Solr indexing slows down

2013-06-06 Thread Sebastian Steinfeld
Hi, I am new to solr and we want to use Solr to speed up our product search. And it is working really nice, but I think I have a problem with the indexing. It slows down after a few minutes. I am using the DataImportHandler to import the products from the database. And I start the import by execu

Re: solr indexing slows down after few minutes

2012-09-06 Thread amit
t; > http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337p4004421.html > To unsubscribe from solr indexing slows down after few minutes, click > here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&nod

Re: solr indexing slows down after few minutes

2012-08-30 Thread pravesh
Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337p4004421.html Sent from the Solr - User mailing list archive at Nabble.com.

solr indexing slows down after few minutes

2012-08-30 Thread amit
t is wrong. I am using a win 7 machine dual core and 4 GB ram. Thanks Amit -- View this message in context: http://lucene.472066.n3.nabble.com/solr-indexing-slows-down-after-few-minutes-tp4004337.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Indexing slows down

2010-08-02 Thread Peter Karich
olr-user@lucene.apache.org >> Sent: Fri, July 30, 2010 6:19:03 PM >> Subject: Re: Solr Indexing slows down >> >> Hi Otis, >> >> does it mean that a new searcher is opened after I commit? >> I thought only on startup...(?) >> >> Regar

Re: Solr Indexing slows down

2010-07-30 Thread Otis Gospodnetic
:: http://search-lucene.com/ - Original Message > From: Peter Karich > To: solr-user@lucene.apache.org > Sent: Fri, July 30, 2010 6:19:03 PM > Subject: Re: Solr Indexing slows down > > Hi Otis, > > does it mean that a new searcher is opened after I commit? >

Re: Solr Indexing slows down

2010-07-30 Thread Peter Karich
ser@lucene.apache.org >> Sent: Fri, July 30, 2010 4:06:48 PM >> Subject: Re: Solr Indexing slows down >> >> Hi Erick! >> >> thanks for the response! >> I will answer your questions ;-) >> >> >>> How often are you making changes t

Re: Solr Indexing slows down

2010-07-30 Thread Otis Gospodnetic
:: http://search-lucene.com/ - Original Message > From: Peter Karich > To: solr-user@lucene.apache.org > Sent: Fri, July 30, 2010 4:06:48 PM > Subject: Re: Solr Indexing slows down > > Hi Erick! > > thanks for the response! > I will answer your questions ;

Re: Solr Indexing slows down

2010-07-30 Thread Peter Karich
Hi Erick! thanks for the response! I will answer your questions ;-) > How often are you making changes to your index? Every 30-60 seconds. Too heavy? > Do you have autocommit on? No. > Do you commit when updating each document? No. I commit after a batch update of 200 documents > Committ

Re: Solr Indexing slows down

2010-07-30 Thread Erick Erickson
See the subject about 1500 threads. The first place I'd look is how often you're committing. If you're committing before the warmup queries from the previous commit have done their magic, you might be getting into a death spiral. HTH Erick On Thu, Jul 29, 2010 at 7:02 AM, Peter Karich wrote: >

Solr Indexing slows down

2010-07-29 Thread Peter Karich
Hi, I am indexing a solr 1.4.0 core and commiting gets slower and slower. Starting from 3-5 seconds for ~200 documents and ending with over 60 seconds after 800 commits. Then, if I reloaded the index, it is as fast as before! And today I have read a similar thread [1] and indeed: if I set autowarm