alessandrobenedetti commented on PR #926: URL: https://github.com/apache/lucene/pull/926#issuecomment-1164571753
@msokolov your input has been invaluable! I run the tests on the same machine, with the preprocessed files and now the results are different. The main and this branch present basically the same performance, which is still good to go ahead with this cleaning. I'll have my colleague @eliaporciani to repeat the tests on Apple M1. The following tests were executed on Intellij running the org.apache.lucene.util.hnsw.KnnGraphTester. 2.4 GHz 8-Core Intel Core i9 - 32 GB 2667 MHz DDR4 'INDEXING EUCLIDEAN SIFT -beamWidthIndex 100 -maxConn 16 -ndoc 80000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/sift-128-euclidean.hdf5-train -metric euclidean ORIGINAL IW 0 [2022-06-23T13:54:27.747641Z; main]: 63533 msec to write vectors IW 0 [2022-06-23T13:55:48.843182Z; main]: 64045 msec to write vectors IW 0 [2022-06-23T13:57:49.295840Z; main]: 61186 msec to write vectors THIS BRANCH IW 0 [2022-06-23T14:03:37.728524Z; main]: 62374 msec to write vectors IW 0 [2022-06-23T14:05:08.103138Z; main]: 59842 msec to write vectors IW 0 [2022-06-23T14:06:29.304945Z; main]: 60854 msec to write vectors INDEXING EUCLIDEAN FASHION -beamWidthIndex 100 -maxConn 16 -ndoc 80000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/fashion-mnist-784-euclidean.hdf5-train -metric euclidean ORIGINAL IW 0 [2022-06-23T13:59:09.597175Z; main]: 31619 msec to write vectors IW 0 [2022-06-23T13:59:53.456692Z; main]: 31519 msec to write vectors IW 0 [2022-06-23T14:01:08.290438Z; main]: 32137 msec to write vectors THIS BRANCH IW 0 [2022-06-23T14:14:35.732944Z; main]: 31096 msec to write vectors IW 0 [2022-06-23T14:15:32.317792Z; main]: 30997 msec to write vectors IW 0 [2022-06-23T14:16:20.496127Z; main]: 31145 msec to write vectors INDEXING ANGULAR LASTFM -beamWidthIndex 100 -maxConn 16 -ndoc 50000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/lastfm-64-dot.hdf5-train -metric angular ORIGINAL IW 0 [2022-06-23T14:40:01.946477Z; main]: 18302 msec to write vectors IW 0 [2022-06-23T14:41:08.918642Z; main]: 18159 msec to write vectors IW 0 [2022-06-23T14:41:45.277353Z; main]: 18434 msec to write vectors THIS BRANCH IW 0 [2022-06-23T14:37:00.629288Z; main]: 19394 msec to write vectors IW 0 [2022-06-23T14:37:36.090859Z; main]: 19088 msec to write vectors IW 0 [2022-06-23T14:38:12.640373Z; main]: 18438 msec to write vectors INDEXING ANGULAR NY -beamWidthIndex 100 -maxConn 16 -ndoc 10000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/nytimes-256-angular.hdf5-train -metric angular ORIGINAL IW 0 [2022-06-23T14:42:46.883227Z; main]: 37087 msec to write vectors IW 0 [2022-06-23T14:43:49.080938Z; main]: 37791 msec to write vectors IW 0 [2022-06-23T14:46:02.353413Z; main]: 37156 msec to write vectors THIS BRANCH IW 0 [2022-06-23T14:47:30.493401Z; main]: 36602 msec to write vectors IW 0 [2022-06-23T14:48:34.029209Z; main]: 36707 msec to write vectors IW 0 [2022-06-23T14:49:29.004465Z; main]: 38374 msec to write vectors —————————————————————————— SEARCH EUCLIDEAN SIFT -niter 500 -beamWidthIndex 100 -maxConn 16 -ndoc 80000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/sift-128-euclidean.hdf5-train -search /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/sift-128-euclidean.hdf5-test -metric euclidean ORIGINAL completed 500 searches in 762 ms: 656 QPS CPU time=761ms completed 500 searches in 760 ms: 657 QPS CPU time=759ms completed 500 searches in 770 ms: 649 QPS CPU time=769ms THIS BRANCH completed 500 searches in 745 ms: 671 QPS CPU time=745ms completed 500 searches in 756 ms: 661 QPS CPU time=755ms completed 500 searches in 771 ms: 648 QPS CPU time=769ms SEARCH EUCLIDEAN FASHION -niter 500 -beamWidthIndex 100 -maxConn 16 -ndoc 80000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/fashion-mnist-784-euclidean.hdf5-train -search /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/fashion-mnist-784-euclidean.hdf5-test -metric euclidean ORIGINAL completed 500 searches in 340 ms: 1470 QPS CPU time=339ms completed 500 searches in 342 ms: 1461 QPS CPU time=341ms completed 500 searches in 350 ms: 1428 QPS CPU time=349ms THIS BRANCH completed 500 searches in 339 ms: 1474 QPS CPU time=339ms completed 500 searches in 347 ms: 1440 QPS CPU time=346ms completed 500 searches in 346 ms: 1445 QPS CPU time=345ms SEARCH ANGULAR LASTFM -niter 500 -beamWidthIndex 100 -maxConn 16 -ndoc 50000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/lastfm-64-dot.hdf5-train -search /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/lastfm-64-dot.hdf5-test -metric angular ORIGINAL completed 500 searches in 263 ms: 1901 QPS CPU time=260ms completed 500 searches in 281 ms: 1779 QPS CPU time=280ms completed 500 searches in 280 ms: 1785 QPS CPU time=278ms THIS BRANCH completed 500 searches in 269 ms: 1858 QPS CPU time=268ms completed 500 searches in 273 ms: 1831 QPS CPU time=272ms completed 500 searches in 279 ms: 1792 QPS CPU time=278ms SEARCH ANGULAR NY -niter 500 -beamWidthIndex 100 -maxConn 16 -ndoc 10000 -reindex -docs /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/nytimes-256-angular.hdf5-train -search /Users/sease/JavaProjects/ann-benchmarks/ann_benchmarks/datasets/nytimes-256-angular.hdf5-test -metric angular ORIGINAL completed 500 searches in 948 ms: 527 QPS CPU time=947ms completed 500 searches in 1027 ms: 486 QPS CPU time=1025ms completed 500 searches in 1052 ms: 475 QPS CPU time=1050ms THIS BRANCH completed 500 searches in 1033 ms: 484 QPS CPU time=1033ms completed 500 searches in 988 ms: 506 QPS CPU time=987ms completed 500 searches in 972 ms: 514 QPS CPU time=971ms' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
