Re: Control segment size

2009-05-11 Thread Shalin Shekhar Mangar
On Tue, May 12, 2009 at 2:30 AM, vivek sar wrote: > Here is what I've read on maxMergeDocs, > > "While merging segments, Lucene will ensure that no segment with more > than maxMergeDocs is created." > > Wouldn't that mean that no index file should contain more than max > docs? I guess the index

Re: Control segment size

2009-05-11 Thread vivek sar
Shalin, Here is what I've read on maxMergeDocs, "While merging segments, Lucene will ensure that no segment with more than maxMergeDocs is created." Wouldn't that mean that no index file should contain more than max docs? I guess the index files could also just contain the index information w

Re: Control segment size

2009-05-08 Thread Shalin Shekhar Mangar
On Fri, May 8, 2009 at 1:30 AM, vivek sar wrote: > > I did set the maxMergeDocs to 10M, but I still see couple of index > files over 30G which do not match with max number of documents. Here > are some numbers, > > 1) My total index size = 66GB > 2) Number of total documents = 200M > 3) 1M doc =

Re: Control segment size

2009-05-07 Thread vivek sar
gt; Hi, > > You are looking for maxMergeDocs, I believe. > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > - Original Message >> From: vivek sar >> To: solr-user@lucene.apache.org >> Sent: Thursday, April 23, 200

Re: Control segment size

2009-04-23 Thread Otis Gospodnetic
Hi, You are looking for maxMergeDocs, I believe. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vivek sar > To: solr-user@lucene.apache.org > Sent: Thursday, April 23, 2009 1:08:20 PM > Subject: Control segment size >

Control segment size

2009-04-23 Thread vivek sar
Hi, Is there any configuration to control the segments' file size in Solr? Currently, I've an index (70G) with 80 segment files and one of the file is 24G. We noticed that in some cases commit takes over 2 hours to complete (committing 50K records), whereas usually it finishes in 20 seconds. Aft