Question on load balancing in a cluster

2010-08-04 Thread anand_s
Hi, Have some thoughts on load balancing on current / new nodes. I have come across some posts around this, but not sure of what is being finally proposed, so.. >From what I have read, a nodebalance on a node does a decommission and bootstrap of that node. Is there a reason why it is that way (d

Re: stress.py

2010-08-04 Thread SSam
Thanks for the reply, Issue resolved, thift site-packages/thrift/transport/TTransport.py not in proper path. I have updated Python PATH , stress.py worked without any issues. From: Peter Schuller To: user@cassandra.apache.org Sent: Wed, August 4, 20

Re: stress.py

2010-08-04 Thread Peter Schuller
> After I add the thift libs to CLASS_PATH , it's failing with following > error. > > /stress.py: line 21: have_multiproc: command not found > ./stress.py: line 22: try:: command not found And that sounds like stress.py is being run by a shell rather than by Python. Not sure how that happened sinc

Re: stress.py

2010-08-04 Thread Peter Schuller
(Jonathan Ellis' suggestion to just use 'ant gen-thrift-py' is of course preferred over my manual approach) As for this: > Now it's failing with following error. Do I have put thrift.jar in  JAVA > CLASSPATH. > > Traceback (most recent call last): >   File "stress.py"

Re: stress.py

2010-08-04 Thread SSam
After I add the thift libs to CLASS_PATH , it's failing with following error. /stress.py: line 21: have_multiproc: command not found ./stress.py: line 22: try:: command not found ./stress.py: line 23: from: command not found ./stress.py: line 24: from: command not found ./stress.py: line 25: Thr

Re: stress.py

2010-08-04 Thread SSam
Peter, Thank you so much for reply. I am not much familiar with python. I have executed the commands mentioned in your reply. Now it's failing with following error. Do I have put thrift.jar in JAVA CLASSPATH. Traceback (most recent call last): File "stress.p

Re: stress.py

2010-08-04 Thread Jonathan Ellis
or just ant gen-thrift-py python contrib/py_stress/stress.py On Wed, Aug 4, 2010 at 5:53 PM, Peter Schuller wrote: >> Can somebody please give steps to run cassandra stess.py  program. > > Assuming you have the thrift compiler installed, something like (from > memory, not tested): > > cd contrib

Re: Limit total number of columns for multiget_slice

2010-08-04 Thread Jonathan Ellis
No. I can't think of a data model where that would be a good fit. On Wed, Aug 4, 2010 at 5:15 PM, Kartal Guner wrote: > Hello, I want to know if the following is possible: > > > > I want to query multiple keys in a column family.  I want to limit the total > # of columns returned. > > > > The nu

Re: what causes MESSAGE-DESERIALIZER-POOL to spike

2010-08-04 Thread Jonathan Ellis
Let's centralize that conversation over on https://issues.apache.org/jira/browse/CASSANDRA-1358 On Wed, Aug 4, 2010 at 4:32 PM, Mike Malone wrote: > So after 4096 messages get pushed on the row-read-stage queue (or any other > multiThreadedStage) the deserializer basically becomes a single-thread

Re: stress.py

2010-08-04 Thread Peter Schuller
> Can somebody please give steps to run cassandra stess.py  program. Assuming you have the thrift compiler installed, something like (from memory, not tested): cd contrib/py_stress thrift --gen py:new ../../interface/cassandra.thrift export PYTHONPATH=$(pwd)/gen-py python stress.py -- / Peter S

Limit total number of columns for multiget_slice

2010-08-04 Thread Kartal Guner
Hello, I want to know if the following is possible: I want to query multiple keys in a column family. I want to limit the total # of columns returned. The number of columns for a given key can be anywhere from 0 to several million. For example I want to get 50 columns total from keys A & C. I

Re: Cassandra disk space utilization WAY higher than I would expect

2010-08-04 Thread Julie
Jonathan Ellis gmail.com> writes: > > did you try compact instead of cleanup, anyway? > Hi Jonathan, Thanks for your reply. Actually, I didn't use compact, I used cleanup. But I did some testing with compact today since you mentioned it. Using nodetool compact does improve my disk usage on e

stress.py

2010-08-04 Thread SSam
Can somebody please give steps to run cassandra stess.py program.

Re: what causes MESSAGE-DESERIALIZER-POOL to spike

2010-08-04 Thread Mike Malone
So after 4096 messages get pushed on the row-read-stage queue (or any other multiThreadedStage) the deserializer basically becomes a single-threaded blocking queue that prevents any other inter-node RPC from occurring..? Sounds like it's a problem either way. If the row read stage is what's backed

Re: RuntimeException: Cannot service reads while bootstrapping!

2010-08-04 Thread Ran Tavory
reported https://issues.apache.org/jira/browse/CASSANDRA-1359 On Wed, Aug 4, 2010 at 9:51 PM, Jonathan Ellis wrote: > That's definitely a bug. > > On Wed, Aug 4, 2010 at 2:13 PM, Ran Tavory wrote: > > ok, so I don't send writes to bootstrapping or decommissioned nodes, > that's > > cool, but wh

Re: RuntimeException: Cannot service reads while bootstrapping!

2010-08-04 Thread Jonathan Ellis
That's definitely a bug. On Wed, Aug 4, 2010 at 2:13 PM, Ran Tavory wrote: > ok, so I don't send writes to bootstrapping or decommissioned nodes, that's > cool, but what about the inconsistent ring view after nodetool move, isn't > this strange? > After the move, the moved node has the correct vi

Re: what causes MESSAGE-DESERIALIZER-POOL to spike

2010-08-04 Thread Jonathan Ellis
No, MDP is backing up because Row-Read-Stage [the stage after MDP on reads] is full at 4096, meaning you're not able to process reads as quickly as the requests are coming in. On Wed, Aug 4, 2010 at 2:21 PM, Mike Malone wrote: > This may be your > problem: https://issues.apache.org/jira/browse/CA

java.util.concurrent.RejectedExecutionException: ThreadPoolExecutor has shut down

2010-08-04 Thread Waqas Badar
I have ring of three nodes. When i try to decommission one of the machine then i got the following exception: java.util.concurrent.RejectedExecutionException: ThreadPoolExecutor has shut down at org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor $1.rejectedExecution(DebuggableTh

Re: what causes MESSAGE-DESERIALIZER-POOL to spike

2010-08-04 Thread Mike Malone
This may be your problem: https://issues.apache.org/jira/browse/CASSANDRA-1358 The message deserializer executor is being created with a core pool size of 1. Since it uses a queue with unbounded capacity new requests are always queued and the thread pool never grows. So the message deserializer be

Re: RuntimeException: Cannot service reads while bootstrapping!

2010-08-04 Thread Ran Tavory
ok, so I don't send writes to bootstrapping or decommissioned nodes, that's cool, but what about the inconsistent ring view after nodetool move, isn't this strange? After the move, the moved node has the correct view of the ring but all other nodes have the old view. I waited a few minutes after th

Re: configure login access to cassandra

2010-08-04 Thread Alaa Zubaidi
Please let me know what happens when you test it for Windows. Alaa lisek wrote: Ok, I've figure it out with little help with people from IRC, , at first of course you have to edit access.properties and passwd.properties in “conf” dir – I think you will know what to do here. After that, edit ca

Re: what is the expected result of changing this in storage.conf

2010-08-04 Thread Peter Schuller
> Thanks for the link but that doesn't answer my question. I happen to know > quite allot about tuning Linux/Solaris/*NIX. I'm trying to figure out the > limits in cassandra, when it breaks, and why. > > So, anyone know of or published benchmarks on messing with these values? In order for such a b

Use cases for Cassandra Summit

2010-08-04 Thread Jeremy Hanna
If you're heading to the Cassandra Summit next week and have an interesting use case for Cassandra, you can submit your use case as a lightning talk. See: http://www.riptano.com/blog/lightning-talks-cassandra-summit-sf

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-04 Thread Peter Schuller
> Are you saying this based on your personal experience? > Or is this just an educated guess? Whatever the cause, the end result is that javax.management.remote.JMXConnector does not exist. So the most likely culprits would be that CLASSPATH is different, or you're using a different JVM. For examp

Re: Changing schema w/o losing data - Can it be done?

2010-08-04 Thread Gary Dusbabek
NullPointerException--it sounds like you're restarting? If so, you should look into `nodetool drain`. http://wiki.apache.org/cassandra/FAQ#modify_cf_config Gary On Wed, Aug 4, 2010 at 03:27, David Boxenhorn wrote: > When I change schema I need to delete the commit logs - otherwise I get a > nul

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-04 Thread osishkin osishkin
Are you saying this based on your personal experience? Or is this just an educated guess? On Tue, Aug 3, 2010 at 11:19 PM, Brandon Williams wrote: > On Fri, Jul 30, 2010 at 9:58 AM, osishkin osishkin > wrote: >> >> I'm talking about the James Golick plugin. I followed the >> instructions, and go

Re: RuntimeException: Cannot service reads while bootstrapping!

2010-08-04 Thread Jonathan Ellis
Don't point clients at nodes that aren't part of the ring. Cassandra rejecting requests when you do is a "feature." On Wed, Aug 4, 2010 at 6:52 AM, Ran Tavory wrote: > Is this a known issue? > Running 0.6.2 I moved a node to different token and eventually saw errors in > the log. > > ERROR [ROW-

Re: bad behavior of my Cassandra cluster

2010-08-04 Thread Jonathan Ellis
Put your commitlog on a different device than the data files. On Tue, Aug 3, 2010 at 10:46 PM, Mingfan Lu wrote: > Hi, >  I have a 4-node cassandra cluster. And I find when the 4 nodes are > flushing memtable and gc at the very similar moment, the throughput > will drop and latency will increase

Re: Bootstrap looks like stopping after 2 min into cluster, 2B records.

2010-08-04 Thread Jonathan Ellis
"During bootstrap nodetool may report that the new node is not receiving nor sending any streams, this is because the sending node will first copy out locally the data they will send to the receiving one, which can be seen in the sending node through the the "AntiCompacting... AntiCompacted" log me

Re: Changing schema w/o losing data - Can it be done?

2010-08-04 Thread David Boxenhorn
Thanks! On Wed, Aug 4, 2010 at 1:36 PM, Matthew Grogan wrote: > See steps 1-3 in the description section of the issue below: > > https://issues.apache.org/jira/browse/CASSANDRA-44 > > > On 4 August 2010 09:27, David Boxenhorn wrote: > >> When I change schema I need to delete the commit logs - ot

Re: configure login access to cassandra

2010-08-04 Thread lisek
Ok, I've figure it out with little help with people from IRC, , at first of course you have to edit access.properties and passwd.properties in “conf” dir – I think you will know what to do here. After that, edit cassandra.in.sh wich is in bin directory where you have installation of Cassandra. A

configure login access to cassandra

2010-08-04 Thread lisek
Hi all, Could someone tell me what I have to add in storage .conf to login into Cassandra? I’ve got in .conf org.apache.cassandra.auth.SimpleAuthenticator I found this http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Login-failure-with-SimpleAuthenticator-td4973907.html Where is

RuntimeException: Cannot service reads while bootstrapping!

2010-08-04 Thread Ran Tavory
Is this a known issue? Running 0.6.2 I moved a node to different token and eventually saw errors in the log. ERROR [ROW-READ-STAGE:116804] 2010-08-04 06:34:29,699 DebuggableThreadPoolExecutor.java (line 101) Error in ThreadPoolExecutor java.lang.RuntimeException: Cannot service reads while bootst

Re: Changing schema w/o losing data - Can it be done?

2010-08-04 Thread Matthew Grogan
See steps 1-3 in the description section of the issue below: https://issues.apache.org/jira/browse/CASSANDRA-44 On 4 August 2010 09:27, David Boxenhorn wrote: > When I change schema I need to delete the commit logs - otherwise I get a > null pointer exception. > > Is there a way that I can forc

Changing schema w/o losing data - Can it be done?

2010-08-04 Thread David Boxenhorn
When I change schema I need to delete the commit logs - otherwise I get a null pointer exception. Is there a way that I can force Cassandra to empty the commit logs so I won't lose data??? (There has not been much recent activity, nor is there much current activity. There was only one log and it

RE: unable to start cassandra

2010-08-04 Thread Maciej Lisowski
Ok, problem solved - I've removed all from logs and data directories run it with sun jdk and for now everything works fine. From: Maciej Lisowski [mailto:m.lisow...@powerprice.pl] Sent: Tuesday, August 03, 2010 4:47 PM To: user@cassandra.apache.org Subject: unable to start cassandra Hi al