Re: Newbie Performance Question

2010-03-28 Thread malcolm smith
Ok - so I guess that between 1400 and 3500 inserts per second is reasonably good results -- we are going to continue working on our custom code but it seems like we need a design that uses lots of row-keys and fewer column family keys and is heavily threaded. Thanks for your help in pointing out t

Re: Newbie Performance Question

2010-03-26 Thread Scott White
Right, that's what I meant, thanks for the correction. On Fri, Mar 26, 2010 at 1:11 PM, Brandon Williams wrote: > On Fri, Mar 26, 2010 at 3:08 PM, Scott White wrote: > >> Yep I believe those are inserts per second. Take the last line: >> >> "811653,1666,250" >> >> I believe that's telling you t

Re: Newbie Performance Question

2010-03-26 Thread Brandon Williams
On Fri, Mar 26, 2010 at 3:08 PM, Scott White wrote: > Yep I believe those are inserts per second. Take the last line: > > "811653,1666,250" > > I believe that's telling you that during that 10 second interval you did > 1666 inserts but your overall insert rate is 811653/250 = 3246.612 > inserts/s

Re: Newbie Performance Question

2010-03-26 Thread Scott White
Yep I believe those are inserts per second. Take the last line: "811653,1666,250" I believe that's telling you that during that 10 second interval you did 1666 inserts but your overall insert rate is 811653/250 = 3246.612 inserts/sec. Timeouts may be due to your machine(s) being fully saturated?

Re: Newbie Performance Question

2010-03-26 Thread malcolm smith
Ok I ran the stress test with out of box settings -- 50 threads and 1M row inserts. It seems to get as high as 4400 ops per second and as low as 968. Am I reading these correctly as inserts per second? These are results below. But is also generates timeouts and failures in the python code like

Re: Newbie Performance Question

2010-03-26 Thread Brandon Williams
On Fri, Mar 26, 2010 at 10:45 AM, malcolm smith < malsm...@treehousesystems.com> wrote: > I've been getting a feel for the performance elements of Cassandra using > version 0.51. I've done similar tests on HBase before, but Cassandra has > some very appealing aspects that I would like to pursue.

Newbie Performance Question

2010-03-26 Thread malcolm smith
I've been getting a feel for the performance elements of Cassandra using version 0.51. I've done similar tests on HBase before, but Cassandra has some very appealing aspects that I would like to pursue. However I'm not seeing the what seems like the common level of performance others are seeing.