Hi Mahmoud,
What you can do is use local SSD disk as cache for EBS. You can try
lvmcache or bcache. It will boost your performance while data will
remain on EBS.
Thanks,
Emir
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On 18.07.2016 19:34, Mahmoud Almokadem wrote:
Thanks Erick,
I'll take a look at the replication on Solr. But I don't know if it well
support incremental backup or not.
And I want to use SSD because my index cannot be held in memory. The index
is about 200GB on each instance and the RAM is 61GB and the update
frequency is high. So, I want to use SSDs equipped with the servers instead
on EBSs.
Would you explain what you mean with proper warming?
Thanks,
Mahmoud
On Mon, Jul 18, 2016 at 5:46 PM, Erick Erickson <erickerick...@gmail.com>
wrote:
Have you tried the replication API backup command here?
https://cwiki.apache.org/confluence/display/solr/Index+Replication#IndexReplication-HTTPAPICommandsfortheReplicationHandler
Warning, I haven't worked with this personally in this
situation so test.
I do have to ask why you think SSDs are required here and
if you've measured. With proper warming, most of the
index is held in memory anyway and the source of
the data (SSD or spinning) is not a huge issue. SSDs
certainly are better/faster, but have you measured whether
they are _enough_ faster to be worth the added
complexity?
Best,
Erick
Best,
Erick
On Mon, Jul 18, 2016 at 4:05 AM, Mahmoud Almokadem
<prog.mahm...@gmail.com> wrote:
Hi,
We have SolrCloud 6.0 installed on 4 i2.2xlarge instances with 4 shards.
We store the indices on EBS attached to these instances. Fortunately these
instances are equipped with TEMPORARY SSDs. We need to the store the
indices on the SSDs but they are not safe.
The index is updated every five minutes.
Could we use the SSDs to store the indices and create an incremental
backup or cold replication on the EBS? So we use EBS only for storing
indices not serving the data to the solr.
Incase of losing the data on SSDs we can restore a backup from the EBS.
Is it possible?
Thanks,
Mahmoud
