Using synonyms might be a better solution because the use of
EdgeNGramTokenizerFactory has the potential of creating a large number
of token which will artificially increase the number of tokens in the
index which in turn will affect the IDF score.
A query for "borderland" should have returned results though. It is
difficult to troubleshoot why it didn't without knowing what query you
used, and what kind of analysis is taking place.
Have you tried using the analysis page on the admin section to see what
tokens gets generated for 'Borderlands'?
Christian
On 10/05/2009 11:01 AM, Avlesh Singh wrote:
We have indexed a product database and have come across some search terms
where zero results are returned. There are products in the index with
'Borderlands xxx xxx', 'Dragonfly xx xxx' in the title. Searches for
'Borderland' or 'Border Land' and 'Dragon Fly' return zero results
respectively.
"Borderland" should have worked for a regular text field. For all other
desired matches you can use EdgeNGramTokenizerFactory.
Cheers
Avlesh
On Mon, Oct 5, 2009 at 7:51 PM, Andrew McCombe<eupe...@gmail.com> wrote:
Hi
I am hoping someone can point me in the right direction with regards to
indexing words that are concatenated together to make other words or
product
names.
We have indexed a product database and have come across some search terms
where zero results are returned. There are products in the index with
'Borderlands xxx xxx', 'Dragonfly xx xxx' in the title. Searches for
'Borderland' or 'Border Land' and 'Dragon Fly' return zero results
respectively.
Where do I look to resolve this? The product name field is indexed using a
text field type.
Thanks in advance
Andrew
