benwtrent commented on issue #15286: URL: https://github.com/apache/lucene/issues/15286#issuecomment-3365621937
So, before we had bulk scoring, I tried this and it actually harmed performance :(. But, I was doing something silly I think (https://github.com/apache/lucene/pull/13586) It seems to me we should be able to smartly pre-fetch particular sets of ordinals and bulk score them for much faster cold start for HNSW. That combined with the bi-partite ordering might make hnsw work much better in restricted memory environments. One downside to how Lucene does prefetching is that the call to adjust the OS advise is synchronous. During a hot path query, this just isn't free. Related to async (direct) IO: https://github.com/apache/lucene/pull/15224 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
