RE: [Solr-3.4] Norms file size is large in case of many unique indexed fields in index

2011-11-11 Thread Ivan Hrytsyuk
e...@gmail.com [ysee...@gmail.com] On Behalf Of Yonik Seeley [yo...@lucidimagination.com] Sent: Thursday, November 10, 2011 10:22 PM To: solr-user@lucene.apache.org Subject: Re: [Solr-3.4] Norms file size is large in case of many unique indexed fields in index On Thu, Nov 10, 2011 at 7:42 AM, Ivan H

Re: [Solr-3.4] Norms file size is large in case of many unique indexed fields in index

2011-11-10 Thread Yonik Seeley
On Thu, Nov 10, 2011 at 7:42 AM, Ivan Hrytsyuk wrote: > For 5000 documents (every document has 2 unique fields, 2*5000=1 > unique fields in index), index size is 48.24 MB. You might be able to turn this around and encode the "unique field" information in a multi-valued field: For example, in

Re: [Solr-3.4] Norms file size is large in case of many unique indexed fields in index

2011-11-10 Thread Robert Muir
what is the point of a unique indexed field? If for all of your fields, there is only one possible document, you don't need length normalization, scoring, or a search engine at all... just use a HashMap? On Thu, Nov 10, 2011 at 7:42 AM, Ivan Hrytsyuk wrote: > Hello everyone, > > We have large in

[Solr-3.4] Norms file size is large in case of many unique indexed fields in index

2011-11-10 Thread Ivan Hrytsyuk
Hello everyone, We have large index size in case norms are enabled. schema.xml: type declaration: fields declaration: For 5000 documents (every document has 2 unique fields, 2*5000=1 unique fields in index), index size is 48.24 MB. But if we enable omitting norms