Re: Number of segments in collection is more than what is set in TieredMergePolicyFactory

2019-01-30 Thread Zheng Lin Edwin Yeo
t; number of passes required to complete the optimize could increase. > > The most important setting here is segmentsPerTier ... this does not > mean you will never have more than 10 total segments, it means that at > each tier, Lucene will try to keep the number of segments below 10. &

Re: Number of segments in collection is more than what is set in TieredMergePolicyFactory

2019-01-29 Thread Shawn Heisey
same time, so the number of passes required to complete the optimize could increase. The most important setting here is segmentsPerTier ... this does not mean you will never have more than 10 total segments, it means that at each tier, Lucene will try to keep the number of segments below 10. Wi

Re: Number of segments in collection is more than what is set in TieredMergePolicyFactory

2019-01-29 Thread Zheng Lin Edwin Yeo
10 > 10 > 5120 > 0.1 > 2048 > 10.0 > > > However, when we index data to the collection, the number of segments that > we are getting does not match what we configured. > For example, our collection size is 13.7 GB. With the above >

Number of segments in collection is more than what is set in TieredMergePolicyFactory

2019-01-28 Thread Zheng Lin Edwin Yeo
Hi, We have the following TieredMergePolicyFactory configuration in our solrconfig,xml 10 10 10 10 5120 0.1 2048 10.0 However, when we index data to the collection, the number of segments that we are getting does not match what we

Re: Number of segments

2013-04-09 Thread Michael Long
My main concern was just making sure we were getting the best search performance, and that we did not have too many segments. Every attempt I made to adjust the segment count resulted in no difference (segment count never changed). Looking at that blog page, it looks like 30-40 segments is prob

Re: Number of segments

2013-04-08 Thread Chris Hostetter
: How do I determine how many tiers it has? You may find this blog post from mccandless helpful... http://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html (don't ignore the videos! watching them really helpful to understand what he is talking about) Once you've obsorbed

Re: Number of segments

2013-04-08 Thread Upayavira
ust have the defaults...nothing explicitly set What issue are you trying to solve here? Generally, the tiered merge policy works well, and if searches perform well, then having a reasonable number of segments needn't cause you any issues. Indeed, with larger indexes, having too few segments ca

Re: Number of segments

2013-04-08 Thread Michael Long
On 04/08/2013 09:41 AM, Upayavira wrote: How many documents do you have? How big are the files on disk? 2,795,601 and the index dir is 50G Note it says "segments per tier", you may have multiple tiers at play meaning you can have more than ten segments. How do I determine how many tiers it h

Re: Number of segments

2013-04-08 Thread Upayavira
On Mon, Apr 8, 2013, at 02:35 PM, Michael Long wrote: > I'm running solr 4.0. I'm noticing my segments are staying in the 30+ > range, even though I have these settings: > > > > 10 > 10 > 10 > > false > > Can anyone give me some advice on what I should change or check? How man

Number of segments

2013-04-08 Thread Michael Long
I'm running solr 4.0. I'm noticing my segments are staying in the 30+ range, even though I have these settings: 10 10 10 false Can anyone give me some advice on what I should change or check?