We can get Cassandra to run great for a few hours now. Writing to and
reading from cassandra work well and the read/write times are good etc. We
also changed our config to enable row caching (we're hoping to ditch our
memcache server layer entirely).
Unfortunately, running on an EC2 High Memory
curious how did things turn out?
On Tue, May 18, 2010 at 1:38 PM, Curt Bererton wrote:
> We only have a few CFs (6 or 7). I've increased the MemtableThroughputInMB
> and MemtableOperationsInMillions as per your suggestions. Do we really
> need a swap file though? I suppose it can't hurt, but wi
We only have a few CFs (6 or 7). I've increased the MemtableThroughputInMB
and MemtableOperationsInMillions as per your suggestions. Do we really need
a swap file though? I suppose it can't hurt, but with my problem in
particular we weren't maxing out main memory.
We'll be running another test to
How many different CFs do you have? If you only have a few, I would highly
recommend increasing the MemtableThroughputInMB and
MemtableOperationsInMillions.
We only have to CFs and I have it set at 256MB and 2.5m. Since most of our
columns are relatively small, these values are practically equiva
Agreed, and I just saw that in storage conf that a higher value for the
MemtableFlushAfterMinutes is suggested otherwise you might get a "flush
storm: of all your memtables flushing at once". I've changed that as well.
--
Curt, ZipZapPlay Inc., www.PlayCrafter.com,
http://apps.facebook.com/happyha
Since you only have 7.5GB of memory, it's a really bad idea to set your heap
space to a max of 7GB. Remember, the java process heap will be larger than
what Xmx is allowed to grow to. If you reach this level, you can
start swapping which is very very bad. As Brandon pointed out, you haven't
exhaust
Thanks for the help guys:
First answering the first question: both cores are pegged:
Cpu0 : 43.8%us, 34.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.0%si,
22.1%st
Cpu1 : 40.5%us, 36.2%sy, 0.0%ni, 0.4%id, 0.0%wa, 0.0%hi, 0.2%si,
22.6%st
Mem: 7872040k total, 3620180k used, 4251860k free,
Also, I am using batch_mutate for all of my writes.
Lee Parker
On Mon, May 17, 2010 at 7:11 PM, Lee Parker wrote:
> What are your storage-conf settings for Memtable thresholds? One thing
> that could cause lots of CPU usage is dumping the memtables too frequently
> and then having to do lots of
What are your storage-conf settings for Memtable thresholds? One thing that
could cause lots of CPU usage is dumping the memtables too frequently and
then having to do lots of compaction. With that much available heap space
you could definitely go larger than the default thresholds. Also, do you
On Mon, May 17, 2010 at 6:02 PM, Curt Bererton wrote:
> So pretty much the defaults aside from the 7Gig max heap. CPU is totally
> hammered right now, and it is receiving 0 ops/sec from me since I
> disconnected it from our application right now until I can figure out what's
> going on.
>
> runni
Here are the current jvm args and java version:
# Arguments to pass to the JVM
JVM_OPTS=" \
-ea \
-Xms128M \
-Xmx7G \
-XX:TargetSurvivorRatio=90 \
-XX:+AggressiveOpts \
-XX:+UseParNewGC \
-XX:+UseConcMarkSweepGC \
-XX:+CMSParallelRem
Can you provide us with the current JVM args? Also, what type of work load
you are giving the ring (op/s)?
On Mon, May 17, 2010 at 6:39 PM, Curt Bererton wrote:
> Hello Cassandra users+experts,
>
> Hopefully someone will be able to point me in the correct direction. We
> have cassandra 0.6.1 wor
Hello Cassandra users+experts,
Hopefully someone will be able to point me in the correct direction. We have
cassandra 0.6.1 working on our test servers and we *thought* everything was
great and ready to move to production. We are currently running a ring of 4
large instance EC2 (http://aws.amazon.
13 matches
Mail list logo
