hello *, im using a combination of tokenizers and filters that give me
the desired tokens, however for a particular field i want to
concatenate these tokens back to a single string, is there a filter to
do that, if not what are the steps needed to make my own filter to
concatenate tokens?

for example, i start with "Sprocket (widget) - Blue" the analyzers
churn out the tokens [sprocket,widget,blue] i want to end up with the
string "sprocket widget blue", this is a simple example and in the
general case lowercasing and punctuation removal does not work, hence
why im looking to concatenate tokens

--joe

Reply via email to