Shawn: To see how much of an issue it is, look at the admin>>statistics page. The delta between numDocs and maxDocs is the number of non-expunged deletes in your index. That may ease your temptation to, as Walter says, turn that knob..
Best Erick On Mon, Nov 26, 2012 at 8:18 PM, Walter Underwood <wun...@wunderwood.org>wrote: > Normal merges expunge deletes. You do not need to force a merge. Once per > hour is almost certainly way too often. > > Before I used Solr, I worked was on the Ultraseek team for nine years. > Ultraseek had the same merging strategy, with a force merge option. I've > worked with many, many customers on this issue. > > wunder > > On Nov 26, 2012, at 5:05 PM, Shawn Heisey wrote: > > > On 11/26/2012 5:56 PM, Walter Underwood wrote: > >> You can optimize during updates, but you should not optimize at all, > especially if you are doing continuous updates. Hands off that knob. > > > > I promise I'm not optimizing just because it's got a cool name, or > because a README/HOWTO said to do it. I optimize my tiny index once an > hour, and the large indexes once every six days (one of them gets optimized > every day, using DAY_OF_YEAR % 6). > > > > The only reason I do the optimizes is to expunge deletes. The indexer > program does inserts, reinserts, and deletes once a minute, most of which > hit the tiny index. On the large indexes, between 25000 and 500000 > documents get deleted over the course of the six day optimize interval. > > > > Thanks, > > Shawn > > > > > >