-
From: Salman Akram [mailto:salman.ak...@northbaysolutions.net]
Sent: Wednesday, April 27, 2011 1:43 PM
To: solr-user@lucene.apache.org
Subject: Re: CommonGrams indexing very slow!
Thanks for the response. We got it resolved! .
We made small indexes in bulk using SOLR with Standard File Forma
Thanks for the response. We got it resolved! .
We made small indexes in bulk using SOLR with Standard File Format and then
merged it with a Lucene app which for some reason made it CFS. Now when we
started adding real time documents using SOLR (with Compound File Format set
to false) it was mergin
Hi Salman,
Sounds like somehow you are triggering merges or optimizes. What is your
mergeFactor?
Have you turned on the IndexWriter log?
In solrconfig.xml
true
In our case we feed the directory name as a Java property in our java startup
script , but you can also hard code where you want
No way. It just does this while committing.
Also before this when we merged multiple small indexes without optimization
- as it was done in past it again took around 12 hours and made around 20
CFS files (it never happened before)
On Wed, Apr 27, 2011 at 8:21 PM, Erick Erickson wrote:
> Are you
Are you by any chance optimizing?
Best
Erick
On Wed, Apr 27, 2011 at 11:04 AM, Salman Akram
wrote:
> All,
>
> We have created index with CommonGrams and the final size is around 370GB.
> Everything is working fine but now when we add more documents into index it
> takes forever (almost 12 hours)
