Re: Control segment size

2009-05-11 Thread Shalin Shekhar Mangar
On Tue, May 12, 2009 at 2:30 AM, vivek sar wrote: > Here is what I've read on maxMergeDocs, > > "While merging segments, Lucene will ensure that no segment with more > than maxMergeDocs is created." > > Wouldn't that mean that no index file should contain more than max > docs? I guess the index

Re: Control segment size

2009-05-11 Thread vivek sar
Shalin, Here is what I've read on maxMergeDocs, "While merging segments, Lucene will ensure that no segment with more than maxMergeDocs is created." Wouldn't that mean that no index file should contain more than max docs? I guess the index files could also just contain the index information w

Re: Control segment size

2009-05-08 Thread Shalin Shekhar Mangar
On Fri, May 8, 2009 at 1:30 AM, vivek sar wrote: > > I did set the maxMergeDocs to 10M, but I still see couple of index > files over 30G which do not match with max number of documents. Here > are some numbers, > > 1) My total index size = 66GB > 2) Number of total documents = 200M > 3) 1M doc =

Re: Control segment size

2009-05-07 Thread vivek sar
Thanks Otis. I did set the maxMergeDocs to 10M, but I still see couple of index files over 30G which do not match with max number of documents. Here are some numbers, 1) My total index size = 66GB 2) Number of total documents = 200M 3) 1M doc = 300MB 4) 10M doc should be roughly around 3-4GB. Un

Re: Control segment size

2009-04-23 Thread Otis Gospodnetic
Hi, You are looking for maxMergeDocs, I believe. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vivek sar > To: solr-user@lucene.apache.org > Sent: Thursday, April 23, 2009 1:08:20 PM > Subject: Control segment size > > Hi, > > Is th