Re: Using ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr

2010-11-01 Thread Robert Muir
On Mon, Nov 1, 2010 at 1:34 PM, Burton-West, Tom wrote: > Thanks Robert, > > I'll use the workaround for now (using StandardTokenizerFactory and > specifying version 3.1), but I suspect that I don't want the added URL/IP > address recognition due to my use case.  I've also talked to a couple peo

RE: Using ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr

2010-11-01 Thread Burton-West, Tom
es. (Unless someone beats me to it :) Tom -Original Message- From: Robert Muir [mailto:rcm...@gmail.com] Sent: Monday, November 01, 2010 12:49 PM To: solr-user@lucene.apache.org Subject: Re: Using ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr On Mon, Nov 1, 2010

Re: Using ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr

2010-11-01 Thread Robert Muir
On Mon, Nov 1, 2010 at 12:24 PM, Burton-West, Tom wrote: > We are trying to solve some multilingual issues with our Solr analysis filter > chain and would like to use the new Lucene 3.x filters that are Unicode > compliant. > > Is it possible to use the Lucene ICUTokenizerFilter or StandardAnaly

Using ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr

2010-11-01 Thread Burton-West, Tom
We are trying to solve some multilingual issues with our Solr analysis filter chain and would like to use the new Lucene 3.x filters that are Unicode compliant. Is it possible to use the Lucene ICUTokenizerFilter or StandardAnalyzer with UAX#29 support from Solr? Is it just a matter of writing