Re: get all tokens from TokenStream in my custom filter

2017-11-20 Thread Emir Arnautović
Hi Kumar > Emir , i need all tokens of query in incrementToken() function not only > current token That was just an example - the point was that you need to set attributes - you can read all tokens from previous stream, do whatever needed with them and when ready, set attributes and return tru

Re: get all tokens from TokenStream in my custom filter

2017-11-19 Thread Ahmet Arslan
Hi Kumar, I checked the code base and I couldn't find peek method either. However, I found LookaheadTokenFilter that may be useful to you. I figured that this is a Lucene question and you can receive more answers in the Lucene user list. Ahmet On Sunday, November 19, 2017, 10:16:21 PM GMT

Re: get all tokens from TokenStream in my custom filter

2017-11-17 Thread Ahmet Arslan
Hi Kumar, If I am not wrong, I think there is method named something like peek(2) or advance(2).Some filters access tokens ahead and perform some logic. AhmetOn Wednesday, November 15, 2017, 10:50:55 PM GMT+3, kumar gaurav wrote: Hi I need to get full field value from TokenStream in m

Re: get all tokens from TokenStream in my custom filter

2017-11-16 Thread Emir Arnautović
Hi, Maybe you are not pasting entire filter code, but you need to set attributes and return true. Take a look at come other token filter how it is done. Here is how it is done in UpperCaseFilter: public final boolean incrementToken() throws IOException { if (input.incrementToken()) { c

Re: get all tokens from TokenStream in my custom filter

2017-11-15 Thread Modassar Ather
Hi, Are you getting the string but further tokens are not generated? If this is the case I think no need to end or close the stream in filter. Hope this helps. Best, Modassar On Thu, Nov 16, 2017 at 1:20 AM, kumar gaurav wrote: > Hi > > I need to get full field value from TokenStream in my cus