Re: Python CQL Batching is slower than single statements

2012-01-25 Thread Blake Visin
Aaron, - Version of Cassandra is 1.0.7, python cql is 1.0.7 - I AM shutting down the server and deleting the /var/lib/cassandra directory the starting it back up between tests - nodetool cfstats always looks like this: http://pastebin.com/95EAkZK5 with only the MutationStage Complet

Re: Python CQL Batching is slower than single statements

2012-01-25 Thread Dan Kuebrich
Not that familiar with CQL in particular, but what timeout is set in pycassa? It could be too low for your batch size. If your request is timing out, it will do exponential back off between retries. On Jan 25, 2012 2:53 AM, "aaron morton" wrote: > There are few slight differences in the execution

Re: Python CQL Batching is slower than single statements

2012-01-24 Thread aaron morton
There are few slight differences in the execution paths, nothing jumps out (it *looks* like the authorization to write to the CF is checked for each statement in the batch, not sure how heavy that is.). If you send a batch with more statements that concurrent_writers in the yaml some of those s

Python CQL Batching is slower than single statements

2012-01-24 Thread Blake Visin
So I decided that it would be beneficial to use batching in my application since I am doing many, many inserts. When I implemented batching in CQL using 'BEGIN BATCH'..'APPLY BATCH' I saw a significant decrease in the speed of inserts, no matter the number of insert statements I included between b