Re: sometimes get timeout while batch inserting. (using pycassa)

2012-09-20 Thread Tyler Hobbs
That's showing a client-side socket timeout. By default, the timeout for pycassa connections is fairly low, at 0.5 seconds. With the default batch insert size of 100 rows, you're probably hitting this timeout occasionally. I suggest lowering the batch size and using multiple threads for the highe

Re: sometimes get timeout while batch inserting. (using pycassa)

2012-09-20 Thread Yan Chunlu
forgot to mention the rpc configuration in cassandra.yaml is: rpc_timeout_in_ms: 2 and the cassandra version on production server is: 1.1.3 the cassandra version I am using on my macbook is: 1.0.10 On Thu, Sep 20, 2012 at 6:07 PM, Yan Chunlu wrote: > I am testing the performance of 1 cas

sometimes get timeout while batch inserting. (using pycassa)

2012-09-20 Thread Yan Chunlu
I am testing the performance of 1 cassandra node on a production server. I wrote a script to insert 1 million items into cassandra. the data is like below: *prefix = "benchmark_"* *dct = {}* *for i in range(0,100):* *key = "%s%d" % (prefix,i)* *dct[key] = "abc"*200* and the inserting