Re: Server crashed due to "OutOfMemoryError: Java heap space"

2012-02-28 Thread Vitalii Tymchyshyn
Hello. Any messages about GC earlier in the logs? Cassandra server monitors memory and starts complaining in advance if memory gets full. Any chance you've got a full key delete-only scenario for some column families? Cassandra has a bug not being able to flush such memtables. I've filled a bu

Re: Server crashed due to "OutOfMemoryError: Java heap space"

2012-02-27 Thread Jonathan Ellis
What does the heap dump show is using the memory? On Fri, Feb 24, 2012 at 3:14 PM, Feng Qu wrote: > Hello, > > We have a 6-node ring running 0.8.6 on RHEL 6.1. The first node also runs > OpsCenter community. This node has crashed few time recently with > "OutOfMemoryError: Java heap space" while

Re: Server crashed due to "OutOfMemoryError: Java heap space"

2012-02-26 Thread aaron morton
> several compactions on few 200-300 GB SSTables Sounds like some big files. Out of interest how much data do you have per node ? Also do you have wide rows ? Can check via nodetool cfstats. In cases where OOM / GC is related to compaction these are the steps i take first. It's heavy handed an

Server crashed due to "OutOfMemoryError: Java heap space"

2012-02-24 Thread Feng Qu
Hello,  We have a 6-node ring running 0.8.6 on RHEL 6.1. The first node also runs OpsCenter community. This node has crashed few time recently with "OutOfMemoryError: Java heap space" while several compactions on few 200-300 GB SSTables were running. We are using 8GB Java heap on host with 96GB