tteofili commented on PR #14191:
URL: https://github.com/apache/lucene/pull/14191#issuecomment-2631453289
preliminary tests with _luceneutil_ on Cohere-768.
**with force-merge=true**
_baseline_
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s force merge s num segments index size (MB)
selectivity filterType vec disk (MB) vec RAM (MB)
0.913 1.620 200000 100 50 32 100 no
3294 43.94 4551.45 29.43 1 596.16
1.00 post-filter 585.938 585.938
0.646 1.317 200000 100 50 32 100 7 bits
3338 33.13 6037.19 20.29 1 742.72
1.00 post-filter 732.422 146.484
0.449 1.066 200000 100 50 32 100 4 bits
3928 24.33 8219.29 12.32 1 670.88
1.00 post-filter 659.180 73.242
```
candidate
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s force merge s num segments index size (MB)
selectivity filterType vec disk (MB) vec RAM (MB)
0.915 1.636 200000 100 50 32 100 no
3289 44.20 4524.68 29.79 1 596.11
1.00 post-filter 585.938 585.938
0.652 1.336 200000 100 50 32 100 7 bits
3326 32.86 6086.98 19.58 1 742.74
1.00 post-filter 732.422 146.484
0.445 1.049 200000 100 50 32 100 4 bits
3912 24.01 8331.25 11.82 1 670.87
1.00 post-filter 659.180 73.242
```
**without force-merge**
_baseline_
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s force merge s num segments index size (MB)
selectivity filterType vec disk (MB) vec RAM (MB)
0.915 1.446 200000 100 50 32 100 no
3313 38.04 5257.35 26.52 1 596.11
1.00 post-filter 585.938 585.938
0.641 1.243 200000 100 50 32 100 7 bits
3367 28.65 6980.32 18.50 1 742.91
1.00 post-filter 732.422 146.484
0.446 0.939 200000 100 50 32 100 4 bits
3918 21.19 9437.08 10.73 1 670.88
1.00 post-filter 659.180 73.242
```
_candidate_
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s force merge s num segments index size (MB)
selectivity filterType vec disk (MB) vec RAM (MB)
0.914 1.429 200000 100 50 32 100 no
3304 43.20 4629.74 29.62 1 596.16
1.00 post-filter 585.938 585.938
0.652 1.238 200000 100 50 32 100 7 bits
3371 28.75 6957.49 18.49 1 742.91
1.00 post-filter 732.422 146.484
0.440 0.950 200000 100 50 32 100 4 bits
3943 21.31 9386.59 10.97 1 670.88
1.00 post-filter 659.180 73.242
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
