: want to add docs every 2 seconds all while doing queries. if I do : commits every 2 seconds I basically loose any caching advantage and my : faceting performance goes down the tube. If however, I were to add : things to a smaller index and then roll it into the larger one every ~30 : minutes then I only take the hit on computing the larger filters caches
searching across both of these indexes (the big and the little) would require something like a MultiReader, a way to unify DocSets between the two, and the ability to cache on the sub indexes and on the main MultiReader. fortunately, a MultiReader is exactly what Lucence uses under the covers when dealing with an FSDIrectory, so we're half way there. something like these might get us the rest of the way... https://issues.apache.org/jira/browse/LUCENE-831 https://issues.apache.org/jira/browse/LUCENE-743 -Hoss
