kaivalnp commented on PR #16506:
URL: https://github.com/apache/lucene/pull/16506#issuecomment-5360071264

   > why we expect an increase in latency when de-duplicating, especially as 
the increase correlating with reduced quantized bit size
   
   I think this is a combination of two things: the fixed cost per-node for the 
indirection (off-heap `fieldOrdToGroupOrd` lookup) will be a larger 
_proportion_ of individual vector scoring with higher quantization (i.e. 1-bit 
vector computations are faster than 8-bit, so the additional latency from the 
indirection is a higher percentage increase) + more nodes being visited due to 
more approximate scores after loss of centering (also showing up as drop in 
recall).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to