Thanks. The only logs I have are system and cassandra. I've included
those. I don't have gcinspector logs. I log gc via munin on other
machines, but I need to install it on these.
On 8/25/11 2:22 PM, Adi wrote:
Ernst,
Can you share the logs just before the crash. Specially the
GC
Ernst,
Can you share the logs just before the crash. Specially the
GCInspector logs.Check the last reported used heap space and whether
it was close to the threshold for full GC.
Also how frequent are your OOM crashes?
The cassandra default for kicking in full GC is 75% (
-XX:CMSInitiati
So, we're on 8, so I don't think there's a key cache setting. Am I wrong?
here's my newest crash log:
ERROR [Thread-210] 2011-08-24 06:29:53,247 AbstractCassandraDaemon.java
(line 113) Fatal exception in thread Thread[Thread-210,5,main]
java.util.concurrent.RejectedExecutionException: ThreadPo
If by magical, you mean magically shuts down randomly, then yes, that is
magical.
We're on 8, but we discovered that 8 has an undocumented feature where
turning off the commitlog doesn't work, so we're upgrading to 8.1 or
whatever is current.
It doesn't seem to be tied to high or low load, r
First thing is are you on 0.8 ? It has some automagical memory management that
is both automatic and magical
http://thelastpickle.com/2011/05/04/How-are-Memtables-measured/
Secondly if you are OOM'ing you need to look at how much memory your schema is
taking. See the link above, or just use 0.8
Thanks,
We had already been running cassandra with a larger heap size, but
it meant that java took way too long between garbage collections. The
advice I'd found was to set the heap size at the 8 we're running at. It
was ok for a while, but now some nodes crash. It's definitely our
expe
2011/8/23 Ernst D Schoen-René :
> Hi,
> I'm running a 16-node cassandra cluster, with a reasonably large amount of
> data per node (~1TB). Nodes have 16G ram, but heap is set to 8G.
>
> The nodes keep stopping with this output in the log. Any ideas?
>
> ERROR [Thread-85] 2011-08-23 21:00:38,723
Hi,
I'm running a 16-node cassandra cluster, with a reasonably large
amount of data per node (~1TB). Nodes have 16G ram, but heap is set to 8G.
The nodes keep stopping with this output in the log. Any ideas?
ERROR [Thread-85] 2011-08-23 21:00:38,723 AbstractCassandraDaemon.java
(line 113)
