kaivalnp opened a new pull request, #16932:
URL: https://github.com/apache/lucene/pull/16932

   ### Description
   
   Page-align raw vectors in the dedup vector format (a sandboxed format added 
in #14758) like #16771 did for the flat format.
   
   This is applicable because the format supports 
[rescoring](https://github.com/apache/lucene/blob/c5ab3e57b9ba16433fa89dade2c2d4ad5fbb83e8/lucene/sandbox/src/java/org/apache/lucene/sandbox/codecs/dedup/DedupScalarQuantizedVectorValues.java#L374-L377)
 using higher precision vectors like the flat format.
   
   The quantized vectors are still [aligned to 4 
bytes](https://github.com/apache/lucene/blob/c5ab3e57b9ba16433fa89dade2c2d4ad5fbb83e8/lucene/sandbox/src/java/org/apache/lucene/sandbox/codecs/dedup/DedupQuantizer.java#L246)
 like the [flat 
format](https://github.com/apache/lucene/blob/c5ab3e57b9ba16433fa89dade2c2d4ad5fbb83e8/lucene/backward-codecs/src/test/org/apache/lucene/backward_codecs/lucene99/Lucene99ScalarQuantizedVectorsWriter.java#L300).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to