Re: Creating CJK bigram tokens with ClassicTokenizer

2018-10-03 Thread Yasufumi Mizoguchi
Hi, Shawn Thank you for replying me. > CJKBigramFilter shouldn't care what tokenizer you're using. It should > work with any tokenizer. What problem are you seeing that you're trying > to solve? What version of Solr, what configuration, and what does it do > that you're not expecting, and what

Re: Creating CJK bigram tokens with ClassicTokenizer

2018-10-01 Thread Shawn Heisey
On 9/30/2018 10:14 PM, Yasufumi Mizoguchi wrote: I am looking for the way to create CJK bigram tokens with ClassicTokenizer. I tried this by using CJKBigramFilter, but it only supports for StandardTokenizer... CJKBigramFilter shouldn't care what tokenizer you're using.  It should work with any

Creating CJK bigram tokens with ClassicTokenizer

2018-09-30 Thread Yasufumi Mizoguchi
Hi, I am looking for the way to create CJK bigram tokens with ClassicTokenizer. I tried this by using CJKBigramFilter, but it only supports for StandardTokenizer... So, is there any good way to do that? Thanks, Yasufumi