Re: Solr Cores going down in Solrcloud 4.3.1

2014-03-07 Thread Veera Raghavan
I did more deep diving and found out the following exception while it tries to replicate. 135531514-ERROR - 2014-03-07 23:08:35.454; org.apache.solr.common.SolrException; SnapPull failed :org.apache.lucene.store.AlreadyClosedException: Already closed 135531665- at org.apache.solr.core.CachingDirec

Re: Solr Cores going down in Solrcloud 4.3.1

2014-03-07 Thread Veera Raghavan
Forgot to attach the log during the recovery failed solr.log.129:1625677:ERROR - 2014-03-06 13:29:31.909; org.apache.solr.common.SolrException; Error while trying to recover:org.apache.solr.common.SolrException: Replication for recovery failed. solr.log.129-1625849- at org.apache.solr.cloud.Recove

Solr Cores going down in Solrcloud 4.3.1

2014-03-07 Thread Veera Raghavan
Hi there I have a 6 node solrcloud cluster with 50 collections. All collections are sharded across all the 6 nodes. I am seeing a weird behavior where both the replicas for a shard go to down to go to a "recovering" state and never come back (No specific corelation to writes or reads). I manu