kaivalnp commented on PR #14847:
URL: https://github.com/apache/lucene/pull/14847#issuecomment-3006871671

   @msokolov I wasn't sure about attempting to index a large amount of vector 
data, given that it'll take up a few GB of RAM. I've added a test for now, 
please let me know if I should keep it (or how to test it better). Perhaps 
having the test is fine, because we run Faiss tests (and only those) in a 
separate GH action?
   
   The test fails reproducibly when added to `main`:
   ```
      >     java.lang.IllegalStateException: Segment is too large to wrap as 
ByteBuffer. Size: 2149576700
      >         at 
__randomizedtesting.SeedInfo.seed([1B557576B3F191C9:6F03E13EF7CEF63A]:0)
      >         at 
java.base/jdk.internal.foreign.AbstractMemorySegmentImpl.checkArraySize(AbstractMemorySegmentImpl.java:374)
      >         at 
java.base/jdk.internal.foreign.AbstractMemorySegmentImpl.asByteBuffer(AbstractMemorySegmentImpl.java:199)
      >         at 
org.apache.lucene.sandbox.codecs.faiss.LibFaissC.createIndex(LibFaissC.java:224)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to