Re: Number of values limitation in multivalued field

2010-01-19 Thread Erick Erickson
As far as I know, there's no underlying difference between adding all 42K tokens one at a time (mutlivalued) or all at once (singlevalued), with one rather technical difference: If you've changed the positionIncrementGap to something other than "1" in your schema, then the token offsets delta betwe

Re: Number of values limitation in multivalued field

2010-01-19 Thread SHS SOLR
Thanks Erik, I was not aware of the maxFieldLength. * Query performance compared to storing data by zipcode. Schema to accommodate this would have 42K * 60 documents approx. Also to consider duplicate document data with varying zipcode in the index. Hope this makes sense. We however wanted to un

Re: Number of values limitation in multivalued field

2010-01-19 Thread Erick Erickson
You should be able to do this no problem. Do be aware of the maxfieldlength though, it defaults to 10,000 tokens but you can change it in your schema.xml. Beware, there are TWO instances of this in the schema file. See: http://search.lucidimagination.com/search/document/30616a061f8c4bf6/solr_ignori