mayya-sharipova opened a new pull request #728: URL: https://github.com/apache/lucene/pull/728
Currently VectorValuesWriter buffers vectors in memory. The problem is that as multi-dimensional vectors consume a lot of memory, a lot of flushes are triggered. Each flush is a very expensive involving the construction of an HNSW graph. This patch instead buffers KNN vectors on disk, which prevents construction of new segments only because RAM is full. Also unset RAMBufferSizeMB in KnnGraphTester, now defaults to 16Mb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org