Re: Solr commit taking too long

2013-01-17 Thread Shawn Heisey
On 1/16/2013 11:22 PM, Cool Techi wrote: We have an index of approximately 400GB in size, indexing 5000 documents was taking 20 seconds. But lately, the indexing is taking very long, committing the same amount of document is taking 5-20 mins. On checking the logs I can see that their a frequen

Re: Solr commit taking too long

2013-01-17 Thread Otis Gospodnetic
Hi, That's a juicy index. Is this on a single server? Have you considered sharding it and thus spreading the indexing work over multiple servers, disks, etc.? You could increase ramBufferSizeMB, which will help a bit with indexing speed, but not with actual merging. Otis -- Solr & ElasticSearch

Re: Solr commit taking too long

2013-01-17 Thread Upayavira
Some questions: What version of Solr? Has the number of documents in your index changed in the meantime? How many before, how many now? How does maxdocs compare to numdocs? Has this system ever been upgraded from an older Solr? Is it committing that is taking that long, or opening a searcher one

Solr commit taking too long

2013-01-16 Thread Cool Techi
Hi, We have an index of approximately 400GB in size, indexing 5000 documents was taking 20 seconds. But lately, the indexing is taking very long, committing the same amount of document is taking 5-20 mins. On checking the logs I can see that their a frequent merges happening, which I am guess