Re: Is that normal to have some percent of reads/writes time out?

2010-04-22 Thread Ken Sandney
By the way, my testing cluster are 4 normal PCs with 2GB RAM assigned to JVM, Intel(R) Celeron(R) CPU E3200 2.40GHz. How many concurrent reads/writes should be reasonable? Or how much memory/CPU usage would be healthy for this kind of test cluster?

Re: Is that normal to have some percent of reads/writes time out?

2010-04-22 Thread Ken Sandney
yes, I've tried the patch on https://issues.apache.org/jira/browse/THRIFT-347, but seems not work for me. I doubt I am involving another issue with Thrift. If my column value size is more than 8KB(with thrift php extension enabled), my client has more chances to get "timed out error". I am still wo

Is that normal to have some percent of reads/writes time out?

2010-04-22 Thread Ken Sandney
Hi I am doing some load test with 4 nodes cluster. My client is PHP. I found some reads/writes were time out no matter how I tuned the parameters. These time-outs could be caught by client code. My question is: are these time-outs normal even in production environment? Should they be treated as no

Re: PHP client crashed if a column value > 8192 bytes

2010-04-21 Thread Ken Sandney
After many attempts I found this error only occurred when using PHP thrift_protocol extension. I don't know if there are some parameters that I could adjust for this issue. By the way, without the ext the speed is obviously slow. On Thu, Apr 22, 2010 at 12:01 PM, Ken Sandney wrote: > I

PHP client crashed if a column value > 8192 bytes

2010-04-21 Thread Ken Sandney
I am using PHP as client to talk to Cassandra server but I found out if any column value > 8192 bytes, the client crashed with the following error: PHP Fatal error: Uncaught exception 'TException' with message 'TSocket: > timed out reading 1024 bytes from 10.0.0.177:9160' in > /home/phpcassa/incl

Re: TException: Error: TSocket: timed out reading 1024 bytes from 10.1.1.27:9160

2010-04-21 Thread Ken Sandney
I've tried the patch on https://issues.apache.org/jira/browse/THRIFT-347 , but still got this error: PHP Fatal error: Uncaught exception 'TException' with message 'TSocket: > timed out reading 1024 bytes from 10.0.0.169:9160' in > /home/phpcassa/include/thrift/transport/TSocket.php:266 > Stack tr

Re: 0.6.1 insert 1B rows, crashed when using py_stress

2010-04-19 Thread Ken Sandney
> > to > >> > JVM. > >> > > >> > I have a long experience in telecom and embedded software in past ten > >> > years, > >> > where need robust programs and small RAM. I want to discuss following > >> > ideas > >>

Re: 0.6.1 insert 1B rows, crashed when using py_stress

2010-04-19 Thread Ken Sandney
programs and small RAM. I want to discuss following > ideas > > with the community: > > > > 1. Manage the memory by ourselves: allocate objects/resource (memory) at > > initiating phase, and assign instances at runtime. > > 2. Reject the request when be short of re

Re: 0.6.1 insert 1B rows, crashed when using py_stress

2010-04-19 Thread Ken Sandney
at 9:32 AM, Schubert Zhang wrote: > >> Please also post your jvm-heap and GC options, i.e. the seting in >> cassandra.in.sh >> And what about you node hardware? >> >> On Tue, Apr 20, 2010 at 9:22 AM, Ken Sandney wrote: >> >>> Hi >>> I am doing

0.6.1 insert 1B rows, crashed when using py_stress

2010-04-19 Thread Ken Sandney
Hi I am doing a insert test with 9 nodes, the command: > stress.py -n 10 -t 1000 -c 10 -o insert -i 5 -d > 10.0.0.1,10.0.0.2. and 5 of the 9 nodes were cashed, only about 6'500'000 rows were inserted I checked out the system.log and seems the reason are 'out of memory'. I don't if th

Re: [RELEASE] 0.6.1

2010-04-18 Thread Ken Sandney
Cheers On Mon, Apr 19, 2010 at 10:04 AM, Jeff Hodges wrote: > It does, however, include a change the networking layout[1]. It's not > a simple rolling deploy. You will have to do a full cluster restart to > upgrade. > > [1] https://issues.apache.org/jira/browse/CASSANDRA-969 > -- > Jeff > > On S

Re: Any optimization strategy?

2010-04-16 Thread Ken Sandney
.169,10.0.0.185 -o insert > total,interval_op_rate,interval_key_rate,avg_latency,elapsed_time > 20,2,2,0.0264923011231,5 > On Fri, Apr 16, 2010 at 9:04 PM, Ken Sandney wrote: > uh, yes, I am using single thread. Thank you for your link, it helps > > > On Fri, Apr 16, 201

Re: Any optimization strategy?

2010-04-16 Thread Ken Sandney
r 16, 2010 at 5:59 AM, Ken Sandney wrote: > > Hi, > > I am just doing a simple insert test with a cluster of two nodes, but > seems > > relatively slow: about 1000 rows/second. The test box are normal PC, 2GB > > RAM, Intel E3200 2.4GHz. Are there any general optimization strategy? > > Thanks >

Any optimization strategy?

2010-04-16 Thread Ken Sandney
Hi, I am just doing a simple insert test with a cluster of two nodes, but seems relatively slow: about 1000 rows/second. The test box are normal PC, 2GB RAM, Intel E3200 2.4GHz. Are there any general optimization strategy? Thanks

Re: Is that possible to write a file system over Cassandra?

2010-04-14 Thread Ken Sandney
tried CassFS, but not stable yet, may be a good prototype to start On Thu, Apr 15, 2010 at 12:15 PM, Michael Greene wrote: > On Wed, Apr 14, 2010 at 11:01 PM, Ken Sandney wrote: > >> a fuse based FS maybe better I guess > > > This has been done, for better or wor

Re: Is that possible to write a file system over Cassandra?

2010-04-14 Thread Ken Sandney
a fuse based FS maybe better I guess On Thu, Apr 15, 2010 at 11:50 AM, Jonathan Ellis wrote: > You forked Cassandra 0.5 for that? > > That's... a strange way to do it. > > On Wed, Apr 14, 2010 at 9:36 PM, Jeff Zhang wrote: > > We are currently doing such things, and now we are still at the sta

Re: Is that possible to write a file system over Cassandra?

2010-04-14 Thread Ken Sandney
Large files can be split into small blocks, and the size of block can be tuned. It may increase the complexity of writing such a file system, but can be for general purpose (not only for relative small files) On Thu, Apr 15, 2010 at 10:08 AM, Tatu Saloranta wrote: > On Wed, Apr 14, 2010 at 6:42 P