Re: In-memory docValues speedup

2016-06-22 Thread Aashish Dattani
Could it be because of how the DirectDocValuesProducer populates the entire bytes array for each request? i.e. for each call of getNumericDocValues(), it reads all the bytes into an array first. The get() method itself seems to be a simple array lookup. Link to the loadNumeric() of DirectDocValue

In-memory docValues speedup

2016-06-22 Thread Aashish Dattani
Hi everyone, I have 2 million documents in my Solr index. I have enabled docValues on one of the integer fields, and set its docValuesFormat to Memory. This is because I want to have very quick forward lookups on this field in my custom component. I am running my Solr installation on a 35GB RAM