benwtrent commented on PR #14078:
URL: https://github.com/apache/lucene/pull/14078#issuecomment-2679022162

   > I wonder where can I find the code for the benchmarks that you are 
mentioning in the description? Thanks!
   
   @lpld I patched a version of Lucene util, sort of like this: 
https://github.com/mikemccand/luceneutil/compare/main...benwtrent:luceneutil:bbq
   
   But obviously, it needs to be updated. Once this can get merged, I will 
update Lucene Util to make testing and benchmarking this simpler. Right now its 
admittedly a bit of a hack.
   
   Benchmarking with Lucene Util is its own adventure if you haven't done 
tackled it before. Some of the vector sets mentioned in the description are 
custom ones that I built that aren't really available anywhere for direct 
download (e.g. I generated vectors with e5-small directly and downloaded and 
munged GIST-1M to work directly with Lucene Util).
   
   However, Lucene Util has a script to download a bunch of Cohere 768 vectors 
from 🤗.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to