So I made a few changes, but I still seem to be dealing with this pesky periodic slowness.
Changes: 1) I'm now only forcing commits every 5 minutes. This was done by specifying commitWithin=300000 when doing document adds. 2) I'm specifying an -Xmx12g to force the java heap to take more memory 3) I'm using the GC configuration parameters from the wiki ( http://wiki.apache.org/solr/ShawnHeisey#GC_Tuning) The new startup args are: -DzkRun -Xmx12g -XX:+AggressiveOpts -XX:+UseLargePages -XX:+ParallelRefProcEnabled -XX:+CMSParallelRemarkEnabled -XX:CMSMaxAbortablePrecleanTime=6000 -XX:CMSTriggerPermRatio=80 -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSFullGCsBeforeCompaction=1 -XX:PretenureSizeThreshold=64m -XX:+CMSScavengeBeforeRemark -XX:+UseConcMarkSweepGC -XX:MaxTenuringThreshold=8 -XX:TargetSurvivorRatio=90 -XX:SurvivorRatio=4 -XX:NewRatio=3 I'm still seeing the same periodic slowness about every 3.5 minutes. This slowness occurs whether or not I'm indexing content, so it appears to be unrelated to my commit schedule. See the most recent graph here: http://farm4.staticflickr.com/3819/10999523464_328814e358_o.png To keep things consistent I'm still testing with 200 threads. When I test with 10 threads everything is much faster, but I still get the same periodic slowness. One thing I've noticed is that while Java is aware of the 12 gig heap, Solr doesn't seem to be using much of it. The system panel of the Web UI shows 11.5GB of JVM-Memory available, but only 2.11GB in use. Screenshot: http://farm4.staticflickr.com/3822/10999509515_72a9013ec7_o.jpg So I've told Java to use more memory. Do I need to tell Solr to use more as well? Thanks everyone! -Dave On Fri, Nov 22, 2013 at 12:09 PM, Shawn Heisey <s...@elyograg.org> wrote: > On 11/22/2013 10:01 AM, Shawn Heisey wrote: > >> You can see how much the max heap is in the Solr admin UI dashboard - >> it'll be the right-most number on the JVM-Memory graph. On my 64-bit linux >> development machine with 16GB of RAM, it looks like Java defaults to a 4GB >> max heap. I have the heap size manually set to 7GB for Solr on that >> machine. The 6GB heap you have mentioned might not be enough, or it might >> be more than you need. It all depends on the kind of queries you are doing >> and exactly how Solr is configured. >> > > Followup: I would also recommend starting with my garbage collection > settings. This wiki page is linked on the wiki page I've already given you. > > http://wiki.apache.org/solr/ShawnHeisey#GC_Tuning > > You might need a script to start Solr. There is also a redhat-specific > init script on that wiki page. I haven't included any instructions for > installing it. Someone who already knows about init scripts won't have > much trouble getting it working on a redhat-derived OS, and someone who > doesn't will need extensive instructions or an install script, neither of > which has been written. > > Thanks, > Shawn > >
