On 6/11/2014 9:30 AM, Costi Muraru wrote: > I have a text_general field and want to use its value in a custom function. > I'm unable to do so. It seems that the tokenizer messes this up and only a > fraction of the entire value is being retrieved. See below for more details.
Low-level Lucene details are where my knowledge falls extremely short ... but if you are accessing data in the index itself, you're going to get terms, not the original value. You need to access the stored data or docValues to see the full original text. I can't answer the question of whether or not this is something that is accessible (or even makes sense) at the level where your custom code lives, because I simply don't understand those details. Thanks, Shawn