kaivalnp opened a new pull request, #14863:
URL: https://github.com/apache/lucene/pull/14863

   ### Description
   
   Off-heap scoring for quantized vectors! Related to #13515 
   
   This scorer is in-line with 
[`Lucene99MemorySegmentFlatVectorsScorer`](https://github.com/apache/lucene/blob/77f0d1f6d6762ca6ac9af5acc0c950365050d939/lucene/core/src/java24/org/apache/lucene/internal/vectorization/Lucene99MemorySegmentFlatVectorsScorer.java#L30),
 and will automatically be used with 
[`PanamaVectorizationProvider`](https://github.com/apache/lucene/blob/77f0d1f6d6762ca6ac9af5acc0c950365050d939/lucene/core/src/java24/org/apache/lucene/internal/vectorization/PanamaVectorizationProvider.java#L30C13-L30C40)
 (i.e. on adding `jdk.incubator.vector`). Note that the computations are 
already vectorized, but we're avoiding the unnecessary copy to heap here..
   
   I added off-heap Dot Product functions for two compressed 4-bit ints (i.e. 
no need to "decompress" them) -- I can try to come up with similar ones for 
Euclidean if this approach seems fine..


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to