benwtrent commented on PR #14078: URL: https://github.com/apache/lucene/pull/14078#issuecomment-2679022162
> I wonder where can I find the code for the benchmarks that you are mentioning in the description? Thanks! @lpld I patched a version of Lucene util, sort of like this: https://github.com/mikemccand/luceneutil/compare/main...benwtrent:luceneutil:bbq But obviously, it needs to be updated. Once this can get merged, I will update Lucene Util to make testing and benchmarking this simpler. Right now its admittedly a bit of a hack. Benchmarking with Lucene Util is its own adventure if you haven't done tackled it before. Some of the vector sets mentioned in the description are custom ones that I built that aren't really available anywhere for direct download (e.g. I generated vectors with e5-small directly and downloaded and munged GIST-1M to work directly with Lucene Util). However, Lucene Util has a script to download a bunch of Cohere 768 vectors from 🤗. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org