Re: limit stored field size

2016-06-28 Thread Erick Erickson
Highlighter requires indexing for sure) and > it used only indexed fields, but I'll retry. > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Tuesday, June 28, 2016 8:34 AM > To: solr-user > Subject: Re: limit stored field size >

RE: limit stored field size

2016-06-28 Thread Avi Steiner
t: Tuesday, June 28, 2016 8:34 AM To: solr-user Subject: Re: limit stored field size I'm not getting through. You do _not_ need to have a field indexed to highlight. They can (optionally) just be stored and re-analyzed just before being returned. Especially with 50 character fields to be high

Re: limit stored field size

2016-06-27 Thread Erick Erickson
I'm not getting through. You do _not_ need to have a field indexed to highlight. They can (optionally) just be stored and re-analyzed just before being returned. Especially with 50 character fields to be highlighted, the re-analysis won't be very expensive. So it's perfectly reasonable to index b

Re: limit stored field size

2016-06-26 Thread asteiner
Thanks Erick. As far as I understand (during highlight debugging) a field must have indexed=true in order to be highlighted, so the truncated field should be indexed and stored. I would like to avoid the double indexed fields. -- View this message in context: http://lucene.472066.n3.nabble.com/

Re: limit stored field size

2016-06-26 Thread Erick Erickson
Do you need to store the entire field or just the first part for highlighting? If the latter, then define the field you search as indexed="true" stored="false" and the field you want to highlight (truncated) as indexed="false" stored="true". True that defines one extra field but the cost of one

Re: limit stored field size

2016-06-26 Thread asteiner
Thanks Alex, This processor truncates the fields during index (I just checked it), but I need a different thing. Let's say I have a content of 100 characters. I want whole of this field to be indexed, but I want to store only the first 50 characters, which I will use for highlighting. i.e: conten

Re: limit stored field size

2016-06-26 Thread Alexandre Rafalovitch
http://www.solr-start.com/javadoc/solr-lucene/org/apache/solr/update/processor/TruncateFieldUpdateProcessorFactory.html Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 26 June 2016 at 15:09, asteiner wrote: > Hi > > I have a fi