benwtrent opened a new issue, #13616: URL: https://github.com/apache/lucene/issues/13616
### Description We should have a nightly test that verifies expected recall for different vector spaces. While in the past we have leaned on lucene nightly benchmarks to detect different vectors being returned, I am thinking it would be better to have an actual functional nightly test in Lucene itself. Two ways to approach this: I am not 100% sure we can utilize random data, but we may be able to. But we should have many vectors and test building all the supported vector formats and ensure recall is within some acceptable range. Have static vectors associated with some "golden recall" to ensure it never changes and if it is, we must recalculate it. It would be great if these static vectors are not unit vectors so that we adequately can test all our vector spaces. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
