Hi Edwin, Chris it´s an old bug. I have big problems too with OffsetExceptions when i use Highlighting, or Carrot. It looks like a problem with HTMLStripCharFilter. Patch doesn´t work.
https://issues.apache.org/jira/browse/LUCENE-2208 Regards Vadim 2011/11/11 Edwin Steiner <edwin.stei...@gmail.com> > I just entered a bug: https://issues.apache.org/jira/browse/SOLR-2891 > > Thanks & regards, Edwin > > On Nov 7, 2011, at 8:47 PM, Chris Hostetter wrote: > > > > > : finally I want to use Solr highlighting. But there seems to be a > problem > > : if I combine the char filter and the compound word filter in > combination > > : with highlighting (an > > : org.apache.lucene.search.highlight.InvalidTokenOffsetsException is > > : raised). > > > > Definitely sounds like a bug somwhere in dealing with the offsets. > > > > can you please file a Jira, and include all of the data you have provided > > here? it would also be helpful to know what the analysis tool says about > > the various attributes of your tokens at each stage of the analysis? > > > > : SEVERE: org.apache.solr.common.SolrException: > org.apache.lucene.search.highlight.InvalidTokenOffsetsException: Token fall > exceeds length of provided text sized 12 > > : at > org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:469) > > : at > org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:378) > > : at > org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:116) > > : at > org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:194) > > : at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > > : at org.apache.solr.core.SolrCore.execute(SolrCore.java:1360) > > : at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > > : at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > > : at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) > > : at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) > > : at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) > > : at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175) > > : at > org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:462) > > : at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) > > : at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100) > > : at > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:851) > > : at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) > > : at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:405) > > : at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:278) > > : at > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:515) > > : at > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:302) > > : at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > > : at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > > : at java.lang.Thread.run(Thread.java:680) > > : Caused by: > org.apache.lucene.search.highlight.InvalidTokenOffsetsException: Token fall > exceeds length of provided text sized 12 > > : at > org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:228) > > : at > org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:462) > > : ... 23 more > > > > > > -Hoss > >
