On Fri, Aug 1, 2014 at 10:48 AM, Joel Cohen <jco...@grubhub.com> wrote: > The only thing so far that I see as a hurdle here is the data set size vs. > heap size. If the index grows too large, then we have to increase the heap > size, which could lead to longer GC times. Servers could pop in and out of > the load balancer if they are unavailable for too long when a major GC > happens.
We took this on specifically in the Heliosearch fork of Solr via off-heap data: http://heliosearch.org/off-heap-filters/ http://heliosearch.org/solr-off-heap-fieldcache/ If you try it out, let us know how it works! -Yonik http://heliosearch.org - native code faceting, facet functions, sub-facets, off-heap data