Shawn, On Thu, Jun 27, 2013 at 5:03 PM, Shawn Heisey <s...@elyograg.org> wrote: > On 6/27/2013 5:59 AM, Robert Krüger wrote: >> sometime forcing oneself to describe a problem is the first step to a >> solution. I just realized that I also had an autocommit statement in >> my config with the exact same amount of time the seemed to be between >> the warnings. >> >> I removed that, because I don't think I really need it, and now the >> warnings are gone. So it seems it happened whenever my manual commits >> overlapped with an autocommit, which, of course, was more likely when >> many commits were issued in sequence. > > If all you are doing is soft commits, your transaction logs are going to > grow out of control.
you are absolutely right. I was shooting myself in the foot with that change. > http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_startup > > My recommendation: > > 1) Remove all commits from your indexing application. > 2) Configure autoCommit with values similar to that wiki page. > 3) Configure autoSoftCommit to happen often. > > The autoCommit must have openSearcher set to false. For autoSoftCommit, > include a maxTime between 1000 and 5000 (milliseconds) and leave maxDocs > out. I did that but without autoSoftCommit because I need control over when the commits happen and soft-commit in my application. Thank you so much, Robert
