Re: WordDelimiterFilter looses position increments of tokens

2006-07-04 Thread Eric Jain
Yonik Seeley wrote: Your'e right, it does look possible that position info can be lost. The fix probably isn't as simple as copying the position increment in newTok()... the original increment should only be copied for the first token generated. If something like for (int i = 1, max = queue.

base64 support & containers

2006-07-04 Thread Ben Incani
Hi Solr users, Does Solr support/or will in the future base64 encoded XML documents so that binary blobs can be added to the index? I have been using this solr client by Darren Vengroff successfully. It easily plugs-in into the Solr package and could also use binary functions in org.apache.solr

Re: WordDelimiterFilter looses position increments of tokens

2006-07-04 Thread Yonik Seeley
On 7/4/06, Eric Jain <[EMAIL PROTECTED]> wrote: Just noticed that in the newTok method in the WordDelimiterFilter, the "position increment" of the token doesn't seem to be copied? Your'e right, it does look possible that position info can be lost. The fix probably isn't as simple as copying the

WordDelimiterFilter looses position increments of tokens

2006-07-04 Thread Eric Jain
Just noticed that in the newTok method in the WordDelimiterFilter, the "position increment" of the token doesn't seem to be copied?