Re: Configure Shingle Filter to ignore ngrams made of tokens with same start and end

2013-05-03 Thread Steve Rowe
An issue exists for this problem: https://issues.apache.org/jira/browse/LUCENE-3475 On May 3, 2013, at 11:00 AM, Walter Underwood wrote: > The shingle filter should respect positions. If it doesn't, that is worth > filing a bug so we know about it. > > wunder > > On May 3, 2013, at 10:50 AM,

Re: Configure Shingle Filter to ignore ngrams made of tokens with same start and end

2013-05-03 Thread Walter Underwood
The shingle filter should respect positions. If it doesn't, that is worth filing a bug so we know about it. wunder On May 3, 2013, at 10:50 AM, Jack Krupansky wrote: > In short, no. I don't think you want to use the shingle filter on a token > stream that has multiple tokens at the same positi

Re: Configure Shingle Filter to ignore ngrams made of tokens with same start and end

2013-05-03 Thread Jack Krupansky
In short, no. I don't think you want to use the shingle filter on a token stream that has multiple tokens at the same position, otherwise, you will get confused "suggestions", as you've encountered. -- Jack Krupansky -Original Message- From: Rounak Jain Sent: Friday, May 03, 2013 7:3