Re: slow highlighting because of stemming

2011-08-01 Thread Orosz György
Thanks for the answers! This was the solution! :) (my fault was that I tried to use the "on" value instead of true - don't know why..) Gyuri 2011/7/30 Michael Sokolov > On 7/30/2011 3:46 AM, Orosz György wrote: > >> Hi, >> >> Thanks for the answer! >> I am doing some logging about stemming, and

Re: slow highlighting because of stemming

2011-07-30 Thread Michael Sokolov
On 7/30/2011 3:46 AM, Orosz György wrote: Hi, Thanks for the answer! I am doing some logging about stemming, and what I can see is that a lot of tokens are stemmed for the highlighting. It is the strange part, since I don't understand why does any highlighter need stemming again. Consider that t

Re: slow highlighting because of stemming

2011-07-30 Thread Ahmet Arslan
> I am doing some logging about stemming, and what I can see > is that a lot of > tokens are stemmed for the highlighting. It is the strange > part, since I > don't understand why does any highlighter need stemming > again. Highlighting do re-analyze the text being highlighted. > Anyway my docmen

Re: slow highlighting because of stemming

2011-07-30 Thread Orosz György
Hi, Thanks for the answer! I am doing some logging about stemming, and what I can see is that a lot of tokens are stemmed for the highlighting. It is the strange part, since I don't understand why does any highlighter need stemming again. Anyway my docments are not really large, just a few kilobyt

Re: slow highlighting because of stemming

2011-07-29 Thread Mike Sokolov
I'm not sure I would identify stemming as the culprit here. Do you have very large documents? If so, there is a patch for FVH committed to limit the number of phrases it looks at; see hl.phraseLimit, but this won't be available until 3.4 is released. You can also limit the amount of each doc