Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-16 Thread Dmitry Kan
Hi, I can confirm similar behaviour, but for solr 4.3.1. We use default values for merge related settings. Even though mergeFactor=10 by default, there are 13 segments in one core and 30 segments in another. I am not sure it proves there is a bug in the merging, because it depends on the TieredMer

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-13 Thread Summer Shire
Hi All, Did anyone get a chance to look at my config and the InfoStream File ? I am very curious to see what you think thanks, Summer > On Mar 6, 2015, at 5:20 PM, Summer Shire wrote: > > Hi All, > > Here’s more update on where I am at with this. > I enabled infoStream logging and quickly fi

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-06 Thread Summer Shire
Hi All, Here’s more update on where I am at with this. I enabled infoStream logging and quickly figured that I need to get rid of maxBufferedDocs. So Erick you were absolutely right on that. I increased my ramBufferSize to 100MB and reduced maxMergeAtOnce to 3 and segmentsPerTier to 3 as well. M

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-05 Thread Erick Erickson
I would, BTW, either just get rid of the all together or make it much higher, i.e. 10. I don't think this is really your problem, but you're creating a lot of segments here. But I'm kind of at a loss as to what would be different about your setup. Is there _any_ chance that you have some seco

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Shawn Heisey
On 3/4/2015 4:12 PM, Erick Erickson wrote: > I _think_, but don't know for sure, that the merging stuff doesn't get > triggered until you commit, it doesn't "just happen". > > Shot in the dark... I believe that new segments are created when the indexing buffer (ramBufferSizeMB) fills up, even wit

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Summer Shire
actually after every commit a new segment gets created. I don't see them merging down. what all could i do to debug this better. Hasn't anyone else tried to merge their segments down to a specific range :) ? On Wed, Mar 4, 2015 at 3:12 PM, Erick Erickson wrote: > I _think_, but don't know for s

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Erick Erickson
I _think_, but don't know for sure, that the merging stuff doesn't get triggered until you commit, it doesn't "just happen". Shot in the dark... Erick On Wed, Mar 4, 2015 at 1:15 PM, Summer Shire wrote: > Hi All, > > I am using solr 4.7.2 is there a bug wrt merging the segments down ? > > I rec