ngliche Nachricht-
> Von: Michael Della Bitta [mailto:michael.della.bi...@appinions.com]
> Gesendet: Donnerstag, 6. Juni 2013 18:29
> An: solr-user@lucene.apache.org
> Betreff: Re: Solr indexing slows down
>
> Hi Sebastian,
>
> What database are you using? How much RAM is availabl
8 million documents in two hours is over 1000/sec. That is a pretty fast
indexing rate. It may be hard to go faster than that.
wunder
On Jun 10, 2013, at 7:12 AM, Shawn Heisey wrote:
> On 6/10/2013 2:32 AM, Sebastian Steinfeld wrote:
>> Hi Shawn,
>>
>> thank you for your answer.
>>
>> I am us
On 6/6/2013 4:13 AM, Sebastian Steinfeld wrote:
The amout of documents I want to index is 8 million, the first 1,6 million are
indexed in 2min, but to complete the Import it takes nearly 2 hours.
The size of the index on the hard drive is 610MB.
I started the solr server with 2GB memory.
I read
Hi Sebastian,
What database are you using? How much RAM is available on your machine? It
looks like you're selecting from a view... Have you tried paging through
the view outside of Solr? Does that slow down as well? Do you notice any
increased load on the Solr box or the database server?
Micha
Commit is not too often, it's a batch of 100 records, takes 40 to 60 secs
before another commit.
No I am not indexing with multi threads. It uses a single thread executor.
I have seen steady performance for now after increasing the merge factor
from 10 to 25.
Will have to wait and watch if that re
Did you checked wiki:
http://wiki.apache.org/lucene-java/ImproveIndexingSpeed
http://wiki.apache.org/lucene-java/ImproveIndexingSpeed
Do you commit often? Do you index with multiple threads? Also try
experimenting with various available MergePolicies introduced from SOLR 3.4
onwards
Thanx
Prave
olr-user@lucene.apache.org
>> Sent: Fri, July 30, 2010 6:19:03 PM
>> Subject: Re: Solr Indexing slows down
>>
>> Hi Otis,
>>
>> does it mean that a new searcher is opened after I commit?
>> I thought only on startup...(?)
>>
>> Regar
:: http://search-lucene.com/
- Original Message
> From: Peter Karich
> To: solr-user@lucene.apache.org
> Sent: Fri, July 30, 2010 6:19:03 PM
> Subject: Re: Solr Indexing slows down
>
> Hi Otis,
>
> does it mean that a new searcher is opened after I commit?
>
ser@lucene.apache.org
>> Sent: Fri, July 30, 2010 4:06:48 PM
>> Subject: Re: Solr Indexing slows down
>>
>> Hi Erick!
>>
>> thanks for the response!
>> I will answer your questions ;-)
>>
>>
>>> How often are you making changes t
:: http://search-lucene.com/
- Original Message
> From: Peter Karich
> To: solr-user@lucene.apache.org
> Sent: Fri, July 30, 2010 4:06:48 PM
> Subject: Re: Solr Indexing slows down
>
> Hi Erick!
>
> thanks for the response!
> I will answer your questions ;
Hi Erick!
thanks for the response!
I will answer your questions ;-)
> How often are you making changes to your index?
Every 30-60 seconds. Too heavy?
> Do you have autocommit on?
No.
> Do you commit when updating each document?
No. I commit after a batch update of 200 documents
> Committ
See the subject about 1500 threads. The first place I'd look is how
often you're committing. If you're committing before the warmup queries
from the previous commit have done their magic, you might be getting
into a death spiral.
HTH
Erick
On Thu, Jul 29, 2010 at 7:02 AM, Peter Karich wrote:
>
12 matches
Mail list logo
