[
https://issues.apache.org/jira/browse/LUCENE-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506376#comment-17506376
]
Peixin Li commented on LUCENE-10441:
------------------------------------
How many tokens should causing issue? and is there a way to improve it
currently i'm using slandered analyzer for indexWriter, it could cause too many
tokens if terms are having a lot of "-" or "." right?
> ArrayIndexOutOfBoundsException during indexing
> ----------------------------------------------
>
> Key: LUCENE-10441
> URL: https://issues.apache.org/jira/browse/LUCENE-10441
> Project: Lucene - Core
> Issue Type: Bug
> Affects Versions: 8.10
> Reporter: Peixin Li
> Priority: Major
>
> Hi experts!, i have facing ArrayIndexOutOfBoundsException during indexing and
> committing documents, this exception gives me no clue about what happened so
> i have little information for debugging, can i have some suggest about what
> could be and how to fix this error? i'm using Lucene 8.10.0
> {code:java}
> java.lang.ArrayIndexOutOfBoundsException: -1
> at org.apache.lucene.util.BytesRefHash$1.get(BytesRefHash.java:179)
> at
> org.apache.lucene.util.StringMSBRadixSorter$1.get(StringMSBRadixSorter.java:42)
> at
> org.apache.lucene.util.StringMSBRadixSorter$1.setPivot(StringMSBRadixSorter.java:63)
> at org.apache.lucene.util.Sorter.binarySort(Sorter.java:192)
> at org.apache.lucene.util.Sorter.binarySort(Sorter.java:187)
> at org.apache.lucene.util.IntroSorter.quicksort(IntroSorter.java:41)
> at org.apache.lucene.util.IntroSorter.quicksort(IntroSorter.java:83)
> at org.apache.lucene.util.IntroSorter.sort(IntroSorter.java:36)
> at
> org.apache.lucene.util.MSBRadixSorter.introSort(MSBRadixSorter.java:133)
> at org.apache.lucene.util.MSBRadixSorter.sort(MSBRadixSorter.java:126)
> at org.apache.lucene.util.MSBRadixSorter.sort(MSBRadixSorter.java:121)
> at org.apache.lucene.util.BytesRefHash.sort(BytesRefHash.java:183)
> at
> org.apache.lucene.index.SortedSetDocValuesWriter.flush(SortedSetDocValuesWriter.java:171)
> at
> org.apache.lucene.index.DefaultIndexingChain.writeDocValues(DefaultIndexingChain.java:348)
> at
> org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:228)
> at
> org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:350)
> at
> org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:476)
> at
> org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:656)
> at
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3364)
> at
> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3770)
> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3728)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
