Thanks Erick, I'll take a look at the replication on Solr. But I don't know if it well support incremental backup or not.
And I want to use SSD because my index cannot be held in memory. The index is about 200GB on each instance and the RAM is 61GB and the update frequency is high. So, I want to use SSDs equipped with the servers instead on EBSs. Would you explain what you mean with proper warming? Thanks, Mahmoud On Mon, Jul 18, 2016 at 5:46 PM, Erick Erickson <erickerick...@gmail.com> wrote: > Have you tried the replication API backup command here? > > https://cwiki.apache.org/confluence/display/solr/Index+Replication#IndexReplication-HTTPAPICommandsfortheReplicationHandler > > Warning, I haven't worked with this personally in this > situation so test. > > I do have to ask why you think SSDs are required here and > if you've measured. With proper warming, most of the > index is held in memory anyway and the source of > the data (SSD or spinning) is not a huge issue. SSDs > certainly are better/faster, but have you measured whether > they are _enough_ faster to be worth the added > complexity? > > Best, > Erick > > Best, > Erick > > On Mon, Jul 18, 2016 at 4:05 AM, Mahmoud Almokadem > <prog.mahm...@gmail.com> wrote: > > Hi, > > > > We have SolrCloud 6.0 installed on 4 i2.2xlarge instances with 4 shards. > We store the indices on EBS attached to these instances. Fortunately these > instances are equipped with TEMPORARY SSDs. We need to the store the > indices on the SSDs but they are not safe. > > > > The index is updated every five minutes. > > > > Could we use the SSDs to store the indices and create an incremental > backup or cold replication on the EBS? So we use EBS only for storing > indices not serving the data to the solr. > > > > Incase of losing the data on SSDs we can restore a backup from the EBS. > Is it possible? > > > > Thanks, > > Mahmoud > > > > >
