Just to make sure that there is no ambiguity the In: "Please, email john....@foo.com by 03-09, re: m37-xq." is the input given to this field for indexing and the Expected Out: "Please", "email", "john....@foo.com", "by", "03-09", "re", "m37-xq" is expected output tokens.
-- View this message in context: http://lucene.472066.n3.nabble.com/StandardTokenizerFactory-behaviour-tp3990215p3990216.html Sent from the Solr - User mailing list archive at Nabble.com.
