Positions files analysis

2016-06-27 Thread asteiner
Hi I have a very large index and I'd like to see how can I reduce it. Some of the largest files in the index are the .pos files (positions). There are many excel files indexed with formulas, so I suspect that a large part of the index is used by junk terms as very long numbers. Is there a way I ca

Re: limit stored field size

2016-06-26 Thread asteiner
Thanks Erick. As far as I understand (during highlight debugging) a field must have indexed=true in order to be highlighted, so the truncated field should be indexed and stored. I would like to avoid the double indexed fields. -- View this message in context: http://lucene.472066.n3.nabble.com/

Re: limit stored field size

2016-06-26 Thread asteiner
Thanks Alex, This processor truncates the fields during index (I just checked it), but I need a different thing. Let's say I have a content of 100 characters. I want whole of this field to be indexed, but I want to store only the first 50 characters, which I will use for highlighting. i.e: conten

limit stored field size

2016-06-25 Thread asteiner
Hi I have a field called content which I'm indexing and use for highlighting, which means it has to be stored as well. But this field may be too big, so I want to limit the stored size to X characters (it is fine to highlight only the first X characters). One solution is to create another fi