Yes, thanks.
Actually some months back I made PoC of a FieldCache that could expand
beyond the heap. Basically imagine a FieldCache with room for
"unlimited" data-arrays, that just behind the scenes goes to
memory-mapped files when there is no more room on heap. Never finished
it, and it might be kinda stupid because you actually just go read the
data from lucene indices and write them to memory-mapped files in order
to use them. It is better to just use the data in the Lucene indices
instead. But it had some nice features. But that solution will also have
the "running out of swap space"-problems.
Regards, Per Steffensen
On 9/12/13 12:48 PM, Erick Erickson wrote:
Per:
One thing I'll be curious about. From my reading of DocValues, it uses
little or no heap. But it _will_ use memory from the OS if I followed
Simon's slides correctly. So I wonder if you'll hit swapping issues...
Which are better than OOMs, certainly...
Thanks,
Erick
