On 1/16/2013 11:22 PM, Cool Techi wrote:
We have an index of approximately 400GB in size, indexing 5000 documents was
taking 20 seconds. But lately, the indexing is taking very long, committing the
same amount of document is taking 5-20 mins.
On checking the logs I can see that their a frequen
Hi,
That's a juicy index. Is this on a single server? Have you considered
sharding it and thus spreading the indexing work over multiple servers,
disks, etc.?
You could increase ramBufferSizeMB, which will help a bit with indexing
speed, but not with actual merging.
Otis
--
Solr & ElasticSearch
Some questions:
What version of Solr?
Has the number of documents in your index changed in the meantime?
How many before, how many now?
How does maxdocs compare to numdocs?
Has this system ever been upgraded from an older Solr?
Is it committing that is taking that long, or opening a searcher one
Hi,
We have an index of approximately 400GB in size, indexing 5000 documents was
taking 20 seconds. But lately, the indexing is taking very long, committing the
same amount of document is taking 5-20 mins.
On checking the logs I can see that their a frequent merges happening, which I
am guess