Re: add CJKTokenizer to solr

[Erik Hatcher]

On Jan 29, 2007, at 1:08 AM, zha jimmy wrote:
hi, all

    I am try to config solr to support chinese tokenize。

    I saw the tips in schema.xml:

   <!-- One can also specify an existing Analyzer class that has a
        default constructor via the class attribute on the analyzer  
element
   <fieldtype name="text_greek" class="solr.TextField ">
     <analyzer class="org.apache.lucene.analysis.el.GreekAnalyzer"/>
   </fieldType>
   -->

   Then I modified schema.xml

  <fieldtype name="text" class="solr.TextField"  
positionIncrementGap="100">
     <analyzer>
       <tokenizer  
class="org.apache.lucene.analysis.cjk.CJKTokenizer "/>
       <filter class="solr.LowerCaseFilterFactory"/>
     </analyzer>
   </fieldtype>:

   When I start the solr there is some error Caused by:
java.lang.ClassNotFoundException:
org.apache.lucene.analysis.cjk.CJKTokenizer.

   I realized that solr do not have the CJK package ,but how can I  
add it
in?

You need to add the analyzers JAR from Lucene's contrib area to your  
Solr application, under WEB-INF/lib.  You can get that JAR from the  
latest Lucene release distribution.

        Erik