Re: Pattern that generates two tokens per match

2007-12-11 Thread Mike Klaas
On 11-Dec-07, at 11:51 AM, Ken Krugler wrote: Hi all, I've got a pattern in a document (call it "xy") that I want to turn into two tokens - "xy" and "y". One approach I could use is PatternTokenizer to extract "xy", and then a custom filter that returns "xy" and then "y" on the next cal

Pattern that generates two tokens per match

2007-12-11 Thread Ken Krugler
Hi all, I've got a pattern in a document (call it "xy") that I want to turn into two tokens - "xy" and "y". One approach I could use is PatternTokenizer to extract "xy", and then a custom filter that returns "xy" and then "y" on the next call (caches the next result). Or I could extend Pat