benwtrent commented on PR #15224: URL: https://github.com/apache/lucene/pull/15224#issuecomment-3411723508
> Isn't DirectIODirectory today only inserting itself for merge context reading & writing? Correct, its only used in certain scenarios. We are experimenting using it in more areas (e.g. vector rescoring, to keep from polluting the off-heap cache with rescoring vectors) > it might eventually be that DirectIO, alone, is sufficient for good query latency/throughput? Its not quite there yet. I have seen this improve throughput by more than 2x though depending on the read patterns. MMAP still has TONS of advantages (direct memory segment access being a HUGE one for vectors). Virtual threads make this VERY easy, but I am sure there is a lot of headroom for improvements. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
