On Jun 24, 2008, at 12:07 AM, Norberto Meijome wrote:
hi all,
( I'm using 1.3 nightly build from 15th June 08.)
Is there some documentation about how analysers + tokenizers are
applied in
fields ? In particular, my question :
best docs are here:
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters
- If I define 2 tokenizers in a fieldtype, only the first one is
applied, the
other is ignored. Is that because the 2nd tokenizer would have to work
recursively on the tokens generated from the previous one? Would I
have to
create my custom tokenizer to perform the job of 2 existing
tokenizers in one ?
if you define two tokenizers, solr should throw an error.... the
second one can't do anything.
The tokenizer breaks the input stream into a stream of tokens, then
token filters can modify these tokens.
ryan
