customizing standard tokenizer

[Torsten Krah]

Hi,

is it possible to extend the standard tokenizer or use a custom one
(possible via extending the standard one) to add some "custom" tokens
like Lucene-Core to be "one" token.

regards

smime.p7s
Description: S/MIME cryptographic signature