Re: tokenize after filters

2009-11-12 Thread Chris Hostetter
: ex: "A + W Root Beer" : the field uses a keyword tokenizer to keep the string together, then : it will get converted to "aw root beer" by a custom filter ive made, i : now want to split that up into 3 tokens (aw, root, beer), but seems TokenFilter's can produce more tokens then they consume ...

RE: tokenize after filters

2009-11-02 Thread Steven A Rowe
gt; To: solr-user@lucene.apache.org > Subject: tokenize after filters > > is it possible to tokenize a field on whitespace after some filters > have been applied: > > ex: "A + W Root Beer" > the field uses a keyword tokenizer to keep the string together, then >

tokenize after filters

2009-11-02 Thread Joe Calderon
is it possible to tokenize a field on whitespace after some filters have been applied: ex: "A + W Root Beer" the field uses a keyword tokenizer to keep the string together, then it will get converted to "aw root beer" by a custom filter ive made, i now want to split that up into 3 tokens (aw, roo