Re: Highlighting for non-stored fields

2010-12-13 Thread Alessandro Benedetti
We developed a custom Highlighter to solve this issue. We added a "url" field in the solr schema doc for our domain and when highlighting is called, we access the file, extract the information and send them to the custom highlighter. If you still need some help, I can provide you, our solution in

Re: Highlighting for non-stored fields

2010-10-30 Thread Erick Erickson
Also, consider what you'd be reconstructing from if you could try it. The indexed data has been transformed by, say, stemming, casing, etc. So any attempt to reconstruct the fields for highlighting would necessarily show the transformed version, which would not be pleasing. Plus you could have syno

Re: Highlighting for non-stored fields

2010-10-26 Thread Phong Dais
Thanks for the insight. This is definitely a feasible solution because I only need to highlight when the user open the document. I guess the easiest way I can do this is to "reuse" the solr code (with some modification) in my own application. On Tue, Oct 26, 2010 at 2:35 PM, Pradeep Singh wrote:

Re: Highlighting for non-stored fields

2010-10-26 Thread Pradeep Singh
Another way you can do this is - after the search has completed, load the field in your application, write separate code to reanalyze that field/document, index it in RAM, and run it through highlighter classes. All this as part of your web application outside of Solr. Considering the size of your

Re: Highlighting for non-stored fields

2010-10-26 Thread Phong Dais
Hi, I understand that I need to store the fields in order to use highlighting "out of the box". I'm looking for a way to highlighting using term offsets instead of the actual text since the text is not stored. What am asking is is it possible to modify the response (thru custom implementation) to

Re: Highlighting for non-stored fields

2010-10-26 Thread Israel Ekpo
Check out this link http://wiki.apache.org/solr/FieldOptionsByUseCase You need to store the field if you want to use the highlighting feature. If you need to retrieve and display the highlighted snippets then the fields definitely needs to be stored. To use term offsets, it will be a good idea

Highlighting for non-stored fields

2010-10-26 Thread Phong Dais
Hi, I've been looking thru the mailing archive for the past week and I haven't found any useful info regarding this issue. My requirement is to index a few terabytes worth of data to be searched. Due to the size of the data, I would like to index without storing but I would like to use the highli