Re: Suggestions for tuning and monitoring.

2012-09-15 Thread Henrik Schröder
I started digging in the logfiles, and here's the full log of a crash. We have 4GB of heap, and if you watch either OpsCenter or through a JMX console, used heap size is always below 3GB, and it swings between 1.5 to 3GB ever 5 minutes or so. So why would it suddenly run out of heap space? INFO

Re: Suggestions for tuning and monitoring.

2012-09-10 Thread aaron morton
> It's impossible to start new connections, or impossible to send requests, or > it just doesn't return anything when you've sent a request. If it's totally frozen it sounds like GC. How long does it freeze for? > Despite that, we occasionally get OOM exceptions, and nodes crashing, maybe a > fe

Suggestions for tuning and monitoring.

2012-09-10 Thread Henrik Schröder
Hi all, We're running a small Cassandra cluster (v1.0.10) serving data to our web application, and as our traffic grows, we're starting to see some weird issues. The biggest of these is that sometimes, a single node becomes unresponsive. It's impossible to start new connections, or impossible to s