stefanvodita commented on PR #12844: URL: https://github.com/apache/lucene/pull/12844#issuecomment-1836064137
I did 5 benchmark runs for 4 configurations. To avoid making this comment way too large, I'll just report the averages across the 5 runs per configuration. It looks like there are some genuine differences between the baseline and cadidate, but I'm not sure the differences between different candidate configurations are significant. How do we trade off between the extra miliseconds and the memory savings? ``` baseline recall latency nDoc fanout maxConn beamWidth visited index ms 0.720 0.16 10000 0 64 250 100 2502 1.00 post-filter 0.542 0.23 100000 0 64 250 100 43624 1.00 post-filter 0.512 0.28 200000 0 64 250 100 111019 1.00 post-filter candidate with INITIAL_CAPACITY == 10 recall latency nDoc fanout maxConn beamWidth visited index ms 0.720 0.16 10000 0 64 250 100 2498 1.00 post-filter 0.542 0.23 100000 0 64 250 100 45063 1.00 post-filter 0.512 0.28 200000 0 64 250 100 116683 1.00 post-filter candidate with INITIAL_CAPACITY == 100 recall latency nDoc fanout maxConn beamWidth visited index ms 0.720 0.16 10000 0 64 250 100 2528 1.00 post-filter 0.542 0.23 100000 0 64 250 100 46055 1.00 post-filter 0.512 0.28 200000 0 64 250 100 115407 1.00 post-filter candidate with INITIAL_CAPACITY == 1000 recall latency nDoc fanout maxConn beamWidth visited index ms 0.720 0.16 10000 0 64 250 100 2518 1.00 post-filter 0.542 0.23 100000 0 64 250 100 46617 1.00 post-filter 0.512 0.29 200000 0 64 250 100 118359 1.00 post-filter ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
