Hi Otis,

Thank you for your comment.
Basicially CJKTokenizer is not the same as the NGramTokenizer - CJKTokenizer
only apply biGram on the CJK Character but not the English word

Vinci


Otis Gospodnetic wrote:
> 
> Vinci - I believe the NGram token filter can be used as a CJKTokenizer
> replacement, and there is a Factory for that in Solr, too.
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> 
> ----- Original Message ----
> From: Vinci <[EMAIL PROTECTED]>
> To: solr-user@lucene.apache.org
> Sent: Monday, March 24, 2008 4:31:49 PM
> Subject: CJKTokenizer in Solr 1.3?
> 
> 
> Hi,
> 
> I would like to ask, does any support of CJKTokenizer
> (org.apache.lucene.analysis.cjk.CJKTokenizer) available for Solr 1.3 now? 
> If it is supported, which nightly build I can try and how can I turn it
> on?
> (I have nightly build up to 2008 Mar 8 on hand)
> If it is not supported, how can I use plugin to turn on this feature in
> 1.3
> nightly build?
> 
> Thank you,
> Vinci
> 
> -- 
> View this message in context:
> http://www.nabble.com/CJKTokenizer-in-Solr-1.3--tp16260321p16260321.html
> Sent from the Solr - User mailing list archive at Nabble.com.
> 
> 
> 
> 
> 
> 

-- 
View this message in context: 
http://www.nabble.com/CJKTokenizer-in-Solr-1.3--tp16260321p16294518.html
Sent from the Solr - User mailing list archive at Nabble.com.

Reply via email to