I wouldn't expect the transaction log to go to 0 because the transaction log is kept around for "peer synch" so it can catch up another node that is a little behind. But I _would_ expect it to roll over. So my question is whether the files within your log directories roll over. What you should see is after the commit, a new transaction log is opened and an older one is deleted.
More detail here: enough transaction logs are kept around to contain at least the last 100 documents. Then on commit, the intent is enough transaction logs are kept around so there are 100 docs in them and the older ones are deleted. As to your second question: The "top level" caches, including the ones configured in solrconfig.xml are purged on soft commit. Various segment-level caches are kept around and essentially "added to" on soft commit. Best Erick On Wed, Jun 19, 2013 at 8:52 AM, Joshi, Shital <shital.jo...@gs.com> wrote: > Hi, > > We hard committed (/update/csv?commit=true) about 20,000 documents to > SolrCloud (5 shards, 1 replicas = 10 jvm instances). We have commented out > both autoCommit and autoSoftCommit settings from solrconfig.xml. What we > noticed that the transaction log size never goes down to 0. We thought once > fsync to all replicas etc. finishes the trans log should get deleted since > everything is persisted. We restarted cloud couple times but trans log was > always bigger than size of the index for that shard. Why is that? > > 1.9M $HOME/solr_data/solr1 > 3.0M $HOME/solr_data/solr1_tranlog > 2.2M $HOME/solr_data/solr2 > 3.0M $HOME/solr_data/solr2_tranlog > .................................... > > If we have commented out autoCommit setting from solrconfig.xml and we hard > commit say 20K documents every 10 minutes, when will a new searcher get > created? Without autoCommit setting, what is the default behavior of new > searcher? > > One last question, does a new searcher get created and all caches gets > refreshed for every soft commit? OR Solr updates the existing searcher with > what got changed during last soft commit? > > Many Thanks! >
