Re: i don't get why my index didn't grow more...

2011-03-17 Thread Yonik Seeley
Without even looking at the different segment files, things look odd: You say that you optimize every day, yet I see segments up to 4 days old. Also look at all the segments_??? files... each represents a commit point of the index. So it looks like you have 16 snapshots (or commit points) of the in

Re: i don't get why my index didn't grow more...

2011-03-17 Thread Erick Erickson
This page: http://lucene.apache.org/java/3_0_2/fileformats.html#file-names, when combined with what Yonik said may help you figure it out... And if you're still stumped, please post the and definitions you used Best Erick On Wed, Mar 16, 2011 at 5:10 PM, Robert Petersen wrote: > OK I have

Re: i don't get why my index didn't grow more...

2011-03-16 Thread Yonik Seeley
On Wed, Mar 16, 2011 at 5:10 PM, Robert Petersen wrote: > OK I have a 30 gb index where there are lots of sparsly populated int > fields and then one title field and one catchall field with title and > everything else we want as keywords, the catchall field.  I figure it is > the biggest field in

i don't get why my index didn't grow more...

2011-03-16 Thread Robert Petersen
OK I have a 30 gb index where there are lots of sparsly populated int fields and then one title field and one catchall field with title and everything else we want as keywords, the catchall field. I figure it is the biggest field in our documents which as I mentioned is otherwise composed of a var