msokolov commented on PR #12255:
URL: https://github.com/apache/lucene/pull/12255#issuecomment-1552164269
I tried running luceneutil before/after this change using this command:
```
comp = competition.Competition()
index = comp.newIndex('baseline', sourceData,
vectorFile=constants.GLOVE_VECTOR_DOCS_FILE,
vectorDimension=100,
vectorEncoding='FLOAT32')
comp.competitor('baseline', 'baseline',
vectorDict=constants.GLOVE_WORD_VECTORS_FILE,
index = index, concurrentSearches = concurrentSearches)
comp.competitor('candidate', 'candidate',
vectorDict=constants.GLOVE_WORD_VECTORS_FILE,
index = index, concurrentSearches = concurrentSearches)
comp.benchmark("baseline_vs_candidate")
```
and I get this error:
```
File "src/python/vector-test.py", line 65, in <module>
[39/1959]
comp.benchmark("baseline_vs_candidate")
File
"/local/home/sokolovm/workspace/lbench/luceneutil/src/python/competition.py",
line 510, in benchmark
searchBench.run(id, base, challenger,
File
"/local/home/sokolovm/workspace/lbench/luceneutil/src/python/searchBench.py",
line 196, in run
raise RuntimeError('errors occurred: %s' % str(cmpDiffs))
RuntimeError: errors occurred: ([],
["query=KnnFloatVectorQuery:vector[0.0223385,...][100] filter=None sort=None
groupField=None hi
tCount=100: hit 51 has wrong field/score value ([994765], '0.9567487') vs
([824922], '0.9567554')", "query=KnnFloatVectorQuery:vect
or[-0.061654933,...][100] filter=None sort=None groupField=None
hitCount=100: hit 16 has wrong field/score value ([813187], '0.8702
4546') vs ([134050], '0.8707979')",
"query=KnnFloatVectorQuery:vector[-0.111742884,...][100] filter=None sort=None
groupField=None
hitCount=100: hit 27 has wrong field/score value ([724125], '0.8874463') vs
([817731], '0.88757277')"], 1.0)
```
maybe it's expected that we changed the results? I think this is what Mike M
ran into with the nightly benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
