benwtrent opened a new pull request, #15224:
URL: https://github.com/apache/lucene/pull/15224
This adds prefetching to directIO. The idea is pretty simple,
- configure a number of "prefetch buffers" that are the same size as the
directIO buffer
- calling prefetch will start a prefetch virtual thread to fill an
available buffer
- On read, DirectIO will attempt to refill from any prefetched buffers that
match the position before attempting to do directIO itself.
When doing many prefetches and handling things in batches, this can
significantly improve throughput.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
