Re: Cold replication

2016-07-19 Thread Erick Erickson
The fact that your index is 200G is meaningless, assuming you're talking about disk size. Please just measure before you make assumptions about what will work, it'll save you a world of hurt. I'm not claiming that just using EBS will satisfy your need, but if you're swapping your search speed will

Re: Cold replication

2016-07-19 Thread Emir Arnautovic
Hi Mahmoud, What you can do is use local SSD disk as cache for EBS. You can try lvmcache or bcache. It will boost your performance while data will remain on EBS. Thanks, Emir -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://semate

Re: Cold replication

2016-07-18 Thread Mahmoud Almokadem
Thanks Erick, I'll take a look at the replication on Solr. But I don't know if it well support incremental backup or not. And I want to use SSD because my index cannot be held in memory. The index is about 200GB on each instance and the RAM is 61GB and the update frequency is high. So, I want to

Re: Cold replication

2016-07-18 Thread Erick Erickson
Have you tried the replication API backup command here? https://cwiki.apache.org/confluence/display/solr/Index+Replication#IndexReplication-HTTPAPICommandsfortheReplicationHandler Warning, I haven't worked with this personally in this situation so test. I do have to ask why you think SSDs are req