: Another problem (just discovered this): TokenizerFactories do not get : resource handlers. So, you can't go read config or model files for : your Tokenizer. TokenFilters do, so you can use the KeywordTokenizer
TokenizerFactory subclasses can implement ResourceLoaderAware and load any resources they want. -Hoss
