Re: Huge increase in index size adding just 2 fields

2008-11-06 Thread Phillip Farber
Hi Otis and Hoss, My dates are not too granular. They're always -MM-DD 00:00:00 but I see that I did not omitNorms on the date field and hlb field. Thanks for pointing me in the right direction. Phil Chris Hostetter wrote: : We added the following 2 fields to the above schema as foll

Re: Huge increase in index size adding just 2 fields

2008-11-06 Thread Chris Hostetter
: We added the following 2 fields to the above schema as follows: : : : : : where the "hlb" field consists of not more than 3-4 strings such as "Social : Sicence"/ : : Our 500,000 document index size increased to 166G! This seems completely if you don't need fieldNorms for these fields (it a

Re: Huge increase in index size adding just 2 fields

2008-11-06 Thread Otis Gospodnetic
al Message > From: Phillip Farber <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Thursday, November 6, 2008 11:08:18 AM > Subject: Re: Huge increase in index size adding just 2 fields > > May I ask again whether a index size increase from 120GB to 166GB

Re: Huge increase in index size adding just 2 fields

2008-11-06 Thread Phillip Farber
May I ask again whether a index size increase from 120GB to 166GB is expected simply by adding a stored date and a stored repeating string field if length perhaps 20 and roughly 2 values per doc for 500,000 on average? The doc is a large body of OCR and the position index dominates due to the