tteofili commented on PR #14094:
URL: https://github.com/apache/lucene/pull/14094#issuecomment-2681635026
updated `lucene_util` benchmarks, with different parameters.
### maxconn=32
baseline
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.963 1.262 200000 100 50 32 100 no
7984 61.61 3246.12 3 595.73 585.938
585.938
```
candidate@default
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.957 1.165 200000 100 50 32 100 no
7171 65.61 3048.36 3 595.73 585.938
585.938
0.958 1.164 200000 100 50 32 100 no
7214 63.45 3151.99 3 595.68 585.938
585.938
```
candidate@sat=0.995,patience=maxconn(32)
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB)
0.952 1.082 200000 100 50 32 100 no
6623 61.71 3240.76 3 595.71 585.938
585.938
0.952 1.119 200000 100 50 32 100 no
6682 61.04 3276.65 3 595.70 585.938
585.938
```
candidate@sat=0.95,patience=fanout(50)
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.908 0.781 200000 100 50 32 100 no
4499 61.82 3235.30 3 595.72 585.938
585.938
0.909 0.779 200000 100 50 32 100 no
4498 62.09 3221.34 3 595.69 585.938
585.938
```
candidate@sat=0.995,patience=fanout(50)
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.960 1.178 200000 100 50 32 100 no
7361 63.65 3142.33 3 595.75 585.938
585.938
0.960 1.195 200000 100 50 32 100 no
7441 62.18 3216.42 3 595.76 585.938
585.938
```
### maxconn=64
baseline
```
0.968 1.351 200000 100 50 64 100 no
8698 63.04 3172.79 3 595.76 585.938
585.938
0.968 1.328 200000 100 50 64 100 no
8744 62.29 3210.94 3 595.77 585.938
585.938
```
candidate@default
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.960 1.193 200000 100 50 64 100 no
7751 62.79 3185.27 3 595.76 585.938
585.938
0.961 1.213 200000 100 50 64 100 no
7789 61.73 3240.02 3 595.73 585.938
585.938
```
candidate@sat=0.995,patience=maxconn(64)
```
0.965 1.282 200000 100 50 64 100 no
8364 62.86 3181.88 3 595.72 585.938
585.938
0.964 1.274 200000 100 50 64 100 no
8361 62.42 3203.90 3 595.79 585.938
585.938
```
candidate@sat=0.95,patience=fanout(50)
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.913 0.863 200000 100 50 64 100 no
4945 63.00 3174.80 3 595.81 585.938
585.938
0.916 0.797 200000 100 50 64 100 no
4965 62.70 3189.89 3 595.78 585.938
585.938
```
candidate@sat=0.995,patience=fanout(50)
```
recall latency (ms) nDoc topK fanout maxConn beamWidth quantized
visited index s index docs/s num segments index size (MB) vec disk (MB)
vec RAM (MB)
0.962 1.226 200000 100 50 64 100 no
7991 64.13 3118.52 3 595.82 585.938
585.938
0.963 1.236 200000 100 50 64 100 no
7859 62.52 3199.23 3 595.80 585.938
585.938
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
