Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Thu, 26 Jun 2008 01:15:34 -0300 "Jonathan Ariel" <[EMAIL PROTECTED]> wrote: > Ok. Played a bit more with that. > So I had a difference between my unit test and solr. In solr I'm actually > using a solr.RemoveDuplicatesTokenFilterFactory when querying. Tried to add > that to the test, and it fai

Re: NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Ok. Played a bit more with that. So I had a difference between my unit test and solr. In solr I'm actually using a solr.RemoveDuplicatesTokenFilterFactory when querying. Tried to add that to the test, and it fails. So in my case I think the error is trying to use a solr.RemoveDuplicatesTokenFilterF

Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Thu, 26 Jun 2008 10:44:32 +1000 Norberto Meijome <[EMAIL PROTECTED]> wrote: > On Wed, 25 Jun 2008 15:37:09 -0300 > "Jonathan Ariel" <[EMAIL PROTECTED]> wrote: > > > I've been trying to use the NGramTokenizer and I ran into a problem. > > It seems like solr is trying to match documents with all

Re: NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Well, it is working if I search just two letters, but that just tells me that something is wrong somewhere. The Analysis tools is showing me how "dog" is being tokenized to "do og", so if when indexing and querying I'm using the same tokenizer/filters (which is my case) I should get results even wh

Re: NGramTokenizer issue

2008-06-25 Thread Norberto Meijome
On Wed, 25 Jun 2008 15:37:09 -0300 "Jonathan Ariel" <[EMAIL PROTECTED]> wrote: > I've been trying to use the NGramTokenizer and I ran into a problem. > It seems like solr is trying to match documents with all the tokens that the > analyzer returns from the query term. So if I index a document with

NGramTokenizer issue

2008-06-25 Thread Jonathan Ariel
Hi, I've been trying to use the NGramTokenizer and I ran into a problem. It seems like solr is trying to match documents with all the tokens that the analyzer returns from the query term. So if I index a document with a title field with the value "nice dog" and search for "dog" (where the NGramtoke