Re: In-memory docValues speedup

2016-06-22 Thread Aashish Dattani
Could it be because of how the DirectDocValuesProducer populates the entire bytes array for each request? i.e. for each call of getNumericDocValues(), it reads all the bytes into an array first. The get() method itself seems to be a simple array lookup. Link to the loadNumeric() of DirectDocValue

Re: In-memory docValues speedup

2016-06-22 Thread Toke Eskildsen
Joel Bernstein wrote: > I've tested with the Direct docValuesFormat which is uncompressed > in-memory. But I haven't seen any noticeable performance gain. I've been > meaning to dig into exactly why I wasn't seeing a performance gain, but > haven't had the chance to do this yet. If this is about

Re: In-memory docValues speedup

2016-06-22 Thread Joel Bernstein
I've tested with the Direct docValuesFormat which is uncompressed in-memory. But I haven't seen any noticeable performance gain. I've been meaning to dig into exactly why I wasn't seeing a performance gain, but haven't had the chance to do this yet. If you test out the Direct docValuesFormant, I'd