Re: Problem adding a new node to a cluster

2017-12-17 Thread Pradeep Chhetri
Hello Kurt, I realized it was because of RAM shortage which caused the issue. I bumped up the memory of the machine and node bootstrap started but this time i hit this bug of cassandra 3.9: https://issues.apache.org/jira/browse/CASSANDRA-12905 I tried running nodetool bootstrap resume multiple t

Re: Lots of simultaneous connections?

2017-12-17 Thread kurt greaves
Yep. With those kind of numbers you're likely overwhelming the cluster with connections. You be better off if you can configure it to have either 1 connection per machine, or at least 1 connection per test. Creating lots of connections is definitely not a good idea, and remember that each connectio

Re: Problem adding a new node to a cluster

2017-12-17 Thread kurt greaves
You haven't provided enough logs for us to really tell what's wrong. I suggest running *nodetool netstats* *| grep -v 100% *to see if any streams are still ongoing, and also running *nodetool compactionstats -H* to see if there are any index builds the node might be waiting for prior to joining the

Problem adding a new node to a cluster

2017-12-17 Thread Pradeep Chhetri
Hello all, I am trying to add a 4th node to a 3-node cluster which is using SimpleSnitch. But this new node is stuck in Joining state for last 20 hours. We have around 10GB data per node with RF as 3. Its mostly stuck in redistributing index summaries phase. Here are the logs: https://gist.gith