benwtrent opened a new issue, #12570: URL: https://github.com/apache/lucene/issues/12570
### Description While testing with Lucene Util, I ran 500000 vectors through current main. To test merging, I decreased the rambuffersize to 128MB, indexed, and then force-merged. When merging, It appears we are creating more than `M*2` neighbor connections. I am still digging into the potential cause, but its been around since https://github.com/apache/lucene/commit/ef42af65f27f7f078b1ab426de9f2b2fa214ad86 I get this stack trace: ``` Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: Index 32 out of bounds for length 32 at org.apache.lucene.codecs.lucene95.Lucene95HnswVectorsReader$OffHeapHnswGraph.seek(Lucene95HnswVectorsReader.java:496) at org.apache.lucene.util.hnsw.HnswGraphSearcher.graphSeek(HnswGraphSearcher.java:448) at org.apache.lucene.util.hnsw.HnswGraphSearcher.searchLevel(HnswGraphSearcher.java:400) at org.apache.lucene.util.hnsw.HnswGraphSearcher.search(HnswGraphSearcher.java:274) at org.apache.lucene.util.hnsw.HnswGraphSearcher.search(HnswGraphSearcher.java:131) at org.apache.lucene.codecs.lucene95.Lucene95HnswVectorsReader.search(Lucene95HnswVectorsReader.java:277) at org.apache.lucene.codecs.perfield.PerFieldKnnVectorsFormat$FieldsReader.search(PerFieldKnnVectorsFormat.java:276) at org.apache.lucene.index.CodecReader.searchNearestVectors(CodecReader.java:253) at org.apache.lucene.index.LeafReader.searchNearestVectors(LeafReader.java:258) at org.apache.lucene.search.KnnFloatVectorQuery.approximateSearch(KnnFloatVectorQuery.java:82) at org.apache.lucene.search.AbstractKnnVectorQuery.getLeafResults(AbstractKnnVectorQuery.java:131) at org.apache.lucene.search.AbstractKnnVectorQuery.searchLeaf(AbstractKnnVectorQuery.java:117) at org.apache.lucene.search.AbstractKnnVectorQuery.sequentialSearch(AbstractKnnVectorQuery.java:101) at org.apache.lucene.search.AbstractKnnVectorQuery.rewrite(AbstractKnnVectorQuery.java:86) at org.apache.lucene.search.KnnFloatVectorQuery.rewrite(KnnFloatVectorQuery.java:44) at org.apache.lucene.search.IndexSearcher.rewrite(IndexSearcher.java:755) at org.apache.lucene.search.IndexSearcher.rewrite(IndexSearcher.java:766) at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:649) at org.apache.lucene.search.IndexSearcher.searchAfter(IndexSearcher.java:485) at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:500) at KnnGraphTester.doKnnVectorQuery(Unknown Source) at KnnGraphTester.testSearch(Unknown Source) at KnnGraphTester.run(Unknown Source) at KnnGraphTester.main(Unknown Source) ``` ### Version and environment details Lucene Main & Future 9.8. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
