Re: Korean Tokenizer in solr

2014-07-14 Thread Poornima Jay
When I am trying to index the below error comes java.io.FileNotFoundException: /home/searchuser/multicore/apac_content/data/tlog/tlog.000 (No such file or directory) On Monday, 14 July 2014 2:07 PM, Poornima Jay wrote: Yes, Below is my defined fieldtype            

Re: Korean Tokenizer in solr

2014-07-14 Thread Alexandre Rafalovitch
What happens if you have a new collection with absolute minimum in it and then add the definition? Start from something like: https://github.com/arafalov/simplest-solr-config . Also, is there a long exception earlier in a log. It may have more clues. Regards, Alex. Personal: http://www.outerth

Re: Korean Tokenizer in solr

2014-07-14 Thread Poornima Jay
Yes, Below is my defined fieldtype                                                                                         Please correct me if I am doing anything wrong here Regards, Poornima On Monday, 14 July 2014 12:33 PM, Alexandre Rafalovitch wrote: You sure, it's not a spelli

Re: Korean Tokenizer in solr

2014-07-14 Thread Alexandre Rafalovitch
You sure, it's not a spelling error or something other weird like that? Because Solr ships with that filter in it's example schema: So, you can compare what you are doing differently with that. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources: http:/

Re: Korean Tokenizer in solr

2014-07-13 Thread Poornima Jay
I have upgrade the solr version to 4.8.1. But after making changes in the schema file i am getting the below error Error instantiating class: 'org.apache.lucene.analysis.cjk.CJKBigramFilterFactory' I assume CJKBigramFilterFactory and CJKFoldingFilterFactory are supported in 4.8.1. Do I need to m

Re: Korean Tokenizer in solr

2014-07-10 Thread Alexandre Rafalovitch
I would suggest you read through all 12 (?) articles in this series: http://discovery-grindstone.blogspot.com/2013/10/cjk-with-solr-for-libraries-part-1.html . It will probably lay out most of the issues for you. And if you are starting, I would really suggest using the latest Solr (4.9). A lot mo

Re: Korean Tokenizer in solr

2014-07-10 Thread Poornima Jay
Till now I was thinking solr will support KoreanTokenizer. I haven't used any other 3rd party one.  Actually the issue i am facing is I need to integrate English, Chinese, Japanese and Korean language search in a single site. Based on the user's selected language to search the fields will be que

Re: Korean Tokenizer in solr

2014-07-10 Thread Alexandre Rafalovitch
I don't think Solr ships with Korean Tokenizer, does it? If you are using a 3rd party one, you need to give full class name, not just solr.Korean... And you need the library added in the lib statement in solrconfig.xml (at least in Solr 4). Regards, Alex. Personal website: http://www.outerthou

Re: Korean Tokenizer in solr

2014-07-10 Thread Poornima Jay
I have defined the fieldtype inside the fields section.  When i checked the error log i found the below error Caused by: java.lang.ClassNotFoundException: solr.KoreanTokenizerFactory SEVERE: org.apache.solr.common.SolrException: analyzer without class or tokenizer & filter list Do i need to a

Re: Korean Tokenizer in solr

2014-07-10 Thread Alexandre Rafalovitch
Double check your xml file that you don't - for example - define your fieldType outside of fields section. Or maybe you have exception earlier about some component in the type definition. This is not about Korean language, it seems. Something more fundamentally about XML config. Regards, Alex.