Yes, however, for anyone dealing with this in the future, adding a second
EBS volume is much quicker during a crisis. Granted, I haven't yet gone
through the process of merging the two volumes, but it sounds like it
should be fairly straight forward. The tradeoff, of course, is spending
the time
Yep, nodes were added one at a time and I ran clearsnapshots (there weren't
any). The way I finally got past this was adding a second volume via
data_file_directories (JBOD).
On Tue, Feb 16, 2016 at 12:57 PM, Robert Coli wrote:
> On Sat, Feb 13, 2016 at 4:30 PM, Branton Davis > wrote:
>
>> We
+1 to checking for snapshots. Cassandra by default will automatically
snapshot tables before destructive actions like drop or truncate.
Some general advice regarding cleanup. Cleanup will result in a temporary
increase in both disk I/O load and disk space usage (especially with STCS).
It should on
On Sat, Feb 13, 2016 at 4:30 PM, Branton Davis
wrote:
> We use SizeTieredCompaction. The nodes were about 67% full and we were
> planning on adding new nodes (doubling the cluster to 6) soon.
>
Be sure to add those new nodes one at a time.
Have you checked for, and cleared, old snapshots? Snap
We use SizeTieredCompaction. The nodes were about 67% full and we were
planning on adding new nodes (doubling the cluster to 6) soon. I've been
watching the disk space used, and the nodes were taking about 100GB during
compaction, so I thought we were going to be okay for another week. The
other
Hi,
what kind of compaction strategy do you use? What you are about to see is a
compaction likely - think of 4 sstables of 50gb each, compacting those can take
up 200g while rewriting the new sstable. After that the old ones are deleted
and space will be freed again.
If using SizeTieredCompac
One of our clusters had a strange thing happen tonight. It's a 3 node
cluster, running 2.1.10. The primary keyspace has RF 3, vnodes with 256
tokens.
This evening, over the course of about 6 hours, disk usage increased from
around 700GB to around 900GB on only one node. I was at a loss as to wh
