We run an 8 node Cassandra v2.1.16 cluster (4 nodes in two discrete
datacentres) and we're currently investigating a problem where by
restarting Cassandra on a node resulted in the filling of
Eden/Survivor/Old and frequent GCs.
http://imgur.com/a/OR1dk
This hammered reads from our application
We run some checks from our Monitoring software that rely on mx4j.
The checks typically grab some xml via HTTP request and parse it. For
example, CF Stats on 'MyKeySpace' and 'MyColumnFamily' are retrieved
using:
http://cassandra001:8081/mbean?template=identity&objectname=org.apache.cassandra