Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Ahmet Arslan
> Ahmet, this is a good find. Can we still open a JIRA issue > so that a > more useful exception is thrown here? Robert, I created SOLR-3193 and created a test using Andrew's files.

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Ahmet Arslan
> But - the wiki page has a foot note that says "a tokenizer > must be defined > for the field, but it doesn't need to be indexed". The body > field has the > type "dcx_text" which has a tokenizer. > > Is the documentation wrong here or am I misunderstanding > something? Ah, I never read that no

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread andrew
Ah, ok - thank you for looking at it. But - the wiki page has a foot note that says "a tokenizer must be defined for the field, but it doesn't need to be indexed". The body field has the type "dcx_text" which has a tokenizer. Is the documentation wrong here or am I misunderstanding something?

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Robert Muir
On Fri, Mar 2, 2012 at 9:41 AM, Ahmet Arslan wrote: > >> Robert, I just tried with >> 3.6-SNAPSHOT 1296203 from svn - the problem is >> still there. >> >> I am just about to leave for a vacation. I'll try to open a >> JIRA issue this >> evening. > > Andrew, thanks for providing files. I also re-pr

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Ahmet Arslan
> Robert, I just tried with > 3.6-SNAPSHOT 1296203 from svn - the problem is > still there. > > I am just about to leave for a vacation. I'll try to open a > JIRA issue this > evening. Andrew, thanks for providing files. I also re-produced it. But cause of the exception is that you are trying

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread andrew
Robert, I just tried with 3.6-SNAPSHOT 1296203 from svn - the problem is still there. I am just about to leave for a vacation. I'll try to open a JIRA issue this evening. -- View this message in context: http://lucene.472066.n3.nabble.com/search-highlight-InvalidTokenOffsetsException-in-Solr-3-

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread andrew
I posted the files here: http://www.mediafire.com/?z43a5qyfvz4zxp1 -- View this message in context: http://lucene.472066.n3.nabble.com/search-highlight-InvalidTokenOffsetsException-in-Solr-3-5-tp3560997p3793496.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Robert Muir
On Fri, Mar 2, 2012 at 7:37 AM, andrew wrote: > I was able to create a test case. > > We are querying ranges of documents. When I tried to isolate the document > that causes trouble, I found it happens with exactly every second request > only for a single document query (it fails constantly when r

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread Ahmet Arslan
> I think it is not a good idea to post the Solr > XML here - it is very > long (text extract of a newspaper page) and may not > reproduce verbatim > (whitespace etc.) if I paste it here. > > iorixxx, koji - is it ok if I send the necessary artifacts > (add XML, schema, > config) via email? I s

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-02 Thread andrew
I was able to create a test case. We are querying ranges of documents. When I tried to isolate the document that causes trouble, I found it happens with exactly every second request only for a single document query (it fails constantly when requesting a range of documents where that document is in

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-01 Thread Koji Sekiguchi
(12/03/02 6:05), Ahmet Arslan wrote: I have the same problem. This happens only for some documents in the index. Andrew, can you provide a document string and a query pair? I will try to re-produce the exception. Then we can create a test case that fails. Others can look into it. +1. Please

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-01 Thread Ahmet Arslan
> I have the same problem. This happens > only for some documents in the index. Andrew, can you provide a document string and a query pair? I will try to re-produce the exception. Then we can create a test case that fails. Others can look into it.

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-03-01 Thread andrew
I have the same problem. This happens only for some documents in the index. Like sharadgaur, the problem ceased when I removed ReversedWildcardFilterFactory from my analysis chain, HTMLStripCharFilterFactory has been there before and after. I am running branch-3.6 r1238628. As far as I can tell,

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread sharadgaur
I was using fieldType text_general_rev But since I changed to fieldType text_genral. Everything is running fine not getting InvalidTokenOffsetsException exception.

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread Ahmet Arslan
> Not sure whether that question was directed at me, but I am > not using HTMLStripCharFilter but some other pattern > replacements which modify > character positions, probably in the same manner as > HTMLStripCharFilter > does. I thought that cause of the problem is https://issues.apache.org/jir

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread Marian Steinbach
Am 28. Februar 2012 21:14 schrieb Ahmet Arslan : > > Are you using HTMLStripCharFilter ? If yes this could be : > https://issues.apache.org/jira/browse/LUCENE-3690 > Not sure whether that question was directed at me, but I am not using HTMLStripCharFilter but some other pattern replacements whic

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread Ahmet Arslan
> Unfortunately I don't have any news > on that. I disabled highlighting on the > text field (sadly). > > Have you tracked down which field causes the problem? Can > you tell which > filters you are applying to the according field type? Are you using HTMLStripCharFilter ? If yes this could be : h

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread Marian Steinbach
Unfortunately I don't have any news on that. I disabled highlighting on the text field (sadly). Have you tracked down which field causes the problem? Can you tell which filters you are applying to the according field type? Marian

Re: search.highlight.InvalidTokenOffsetsException in Solr 3.5

2012-02-28 Thread sharadgaur
I am also facing same problem do you have any update on it. I am using Solr 3.5 and getting same error... Feb 28, 2012 1:40:44 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: org.apache.lucene.search.highlight.InvalidTokenOffsetsException: Token to exc