Re: Cold boot performance problems

2010-10-08 Thread Anthony Molinaro
On Fri, Oct 08, 2010 at 05:31:28PM -0700, Dave Viner wrote: > Has anyone found solid step-by-step docs on how to raid0 the ephemeral disks > in ec2 for use by Cassandra? No, but here's a script I used to raid0 3 ephemerals in an xlarge instance. You can edit the top part for different configs for

Re: Cold boot performance problems

2010-10-08 Thread Dave Viner
Has anyone found solid step-by-step docs on how to raid0 the ephemeral disks in ec2 for use by Cassandra? On Fri, Oct 8, 2010 at 12:11 PM, Jason Horman wrote: > We are currently using EBS with 4 volumes striped with LVM. Wow, we > didn't realize you could raid the ephemeral disks. I thought the

Re: Cold boot performance problems

2010-10-08 Thread aaron morton
Creating more ColumnFamilies in more Keyspaces creates more memory overhead. I do not believe sharding your data is the way to go with cassandra. You mentioned that you read 200 to 300 keys per request, and it sounded like all this data was for a single user. If you can group all the user data

Re: Cold boot performance problems

2010-10-08 Thread Jason Horman
We are currently using EBS with 4 volumes striped with LVM. Wow, we didn't realize you could raid the ephemeral disks. I thought the opinion for Cassandra though was that the ephemeral disks were dangerous. We have lost of a few machines over the past year, but replicas hopefully prevent real troub

Re: Cold boot performance problems

2010-10-08 Thread Jonathan Ellis
Two things that can help: In 0.6.5, enable the dynamic snitch with -Dcassandra.dynamic_snitch_enabled=true -Dcassandra.dynamic_snitch=cassandra.dynamic_snitch_enabled which if you are doing a rolling restart will let other nodes route around the slow node (at CL.ONE) until it's warmed up (by the

Cold boot performance problems

2010-10-08 Thread Jason Horman
We are experiencing very slow performance on Amazon EC2 after a cold boot. 10-20 tps. After the cache is primed things are much better, but it would be nice if users who aren't in cache didn't experience such slow performance. Before dumping a bunch of config I just had some general questions.