hello *, im using a combination of tokenizers and filters that give me the desired tokens, however for a particular field i want to concatenate these tokens back to a single string, is there a filter to do that, if not what are the steps needed to make my own filter to concatenate tokens?
for example, i start with "Sprocket (widget) - Blue" the analyzers churn out the tokens [sprocket,widget,blue] i want to end up with the string "sprocket widget blue", this is a simple example and in the general case lowercasing and punctuation removal does not work, hence why im looking to concatenate tokens --joe