On Fri, Dec 5, 2008 at 5:24 PM, wojtekpia <[EMAIL PROTECTED]> wrote: > > I've seen some strangle results in the last few days of testing, but this one > flies in the face of everything I've read on this forum: Reducing > filterCache size has increased performance. > > I have posted my setup here: > http://www.nabble.com/Throughput-Optimization-td20335132.html. > > My original filterCache was 700,000. Reducing it to 20,000, I found: > - Average response time decreased by 85% > - Average throughput increased by 250% > - CPU time used by the garbage collector decreased by 85% > - The system showed to weird GC issues (reported yesterday at: > http://www.nabble.com/new-faceting-algorithm-td20674902.html) > > Further reducing the filterCache to 10,000 > - Average response time decreased by another 27% > - Average throughput increased by another 30% > - GC CPU usage also dropped > - System behavior changed after ~30 minutes, with a slight performance > degradation > > These results came from a load test. I'm running trunk code from Dec 2 with > Yonik's faceting improvement turned on.
Old faceting used the filterCache exclusively. New faceting only uses it for terms that cover ~5% of the index, so you can reduce the filterCache quite a bit potentially, save more RAM, and increase the amount of memory you can give to the OS cache. -Yonik
