Re: Which Tokenizer to use at searching

On 3/10/2014 6:20 AM, abhishek jain wrote: > > replacement=" punct " replace="all"/> > Is there a way i can tokenize after application of filter, please suggest i > know i am missing something basic. Use PatternReplaceCharFilterFactory instead. CharFilters are performed before tokenizers, re

Re: Which Tokenizer to use at searching

I actually meant > While indexing A,B > A and B should give result but > "A B" should not give result. > > Also I will look at analyser. > > Thanks > Abhishek > > Original Message > From: Erick Erickson > Sent: Monday, 10 March 2014 01:38 > To: abhishek

Re: Which Tokenizer to use at searching

1 To: solr-user@lucene.apache.org Reply To: solr-user@lucene.apache.org Cc: Erick Erickson Subject: Re: Which Tokenizer to use at searching Hi; What do you mean at here: "While indexing A,B A and B should give result " Thanks; Furkan KAMACI 2014-03-09 22:36 GMT+02:00 : > Hi > Oop

Re: Which Tokenizer to use at searching

t. > > Also I will look at analyser. > > Thanks > Abhishek > > Original Message > From: Erick Erickson > Sent: Monday, 10 March 2014 01:38 > To: abhishek jain > Subject: Re: Which Tokenizer to use at searching > > Then I don't see the problem. Stan

Re: Which Tokenizer to use at searching

‎Hi Oops my bad. I actually meant While indexing A,B  A and B should ‎give result but  "A B" should not give result. Also I will look at analyser. Thanks  Abhishek   Original Message   From: Erick Erickson Sent: Monday, 10 March 2014 01:38 To: abhishek jain Subject: Re: Which Tokeni

Re: Which Tokenizer to use at searching

Hi Erick, Thanks for replying, I want to index A,B (with or without space with comma) as separate words and also want to return results when A and B searched individually and also "A,B" . Please let me know your views. Let me know if i still havent explained correctly. I will try again. Thanks a

Re: Which Tokenizer to use at searching

You've contradicted yourself, so it's hard to say. Or I'm mis-reading your messages. bq: During indexing i want to token on all punctuations, so i can use StandardTokenizer, but at search time i want to consider punctuations as part of text, and in your second message: bq: when i search for "A,

Re: Which Tokenizer to use at searching

hi, Thanks for replying promptly, an example: I want to index for A,B but when i search A AND B, it should return result, when i search for "A,B" it should return result. Also Ideally when i search for "A , B" (with space) it should return result. please advice thanks abhishek On Sun, Ma

Re: Which Tokenizer to use at searching

Hi; Firstly you have to keep in mind that if you don't index punctuation they will not be visible for search. On the other hand you can have different analyzer for index and search. You have to give more detail about your situation. What will be your tokenizer at search time, WhiteSpaceTokenizer?

Which Tokenizer to use at searching

Hi Friends, I am concerned on Tokenizer, my scenario is: During indexing i want to token on all punctuations, so i can use StandardTokenizer, but at search time i want to consider punctuations as part of text, I dont store contents but only indexes. What should i use. Any advices ? -- Thank