Re: Adding nodes

2022-07-20 Thread Bowen Song via user
To unsubscribe, please send an email to user-unsubscr...@cassandra.apache.org On 20/07/2022 18:34, emmanuel warreng wrote: Unsubscribe On Thu, Jul 7, 2022, 16:49 Marc Hoppins wrote: Hi all, Cluster of 2 DC and 24 nodes DC1 (RF3) = 12 nodes, 16 tokens each DC2 (RF3) = 12 no

Re: Adding nodes

2022-07-20 Thread emmanuel warreng
Unsubscribe On Thu, Jul 7, 2022, 16:49 Marc Hoppins wrote: > Hi all, > > Cluster of 2 DC and 24 nodes > > DC1 (RF3) = 12 nodes, 16 tokens each > DC2 (RF3) = 12 nodes, 16 tokens each > > Adding 12 more nodes to DC1: I installed Cassandra (version is the same > across all nodes) but, after the fir

Re: Adding nodes

2022-07-12 Thread Jeff Jirsa
> The reply to suggest that folk head off a pay for a course when there are > ‘pre-sales’ questions is not a practical response as any business is > unlikely to be spending speculative money. > > > > *From:* Jeff Jirsa > *Sent:* Tuesday, July 12, 2022 4:43 PM > *To:* cassa

Re: Adding nodes

2022-07-12 Thread Bowen Song via user
ask. The reply to suggest that folk head off a pay for a course when there are ‘pre-sales’ questions is not a practical response as any business is unlikely to be spending speculative money. *From:*Jeff Jirsa *Sent:* Tuesday, July 12, 2022 4:43 PM *To:* cassandra *Cc:* Bowen Song *Subjec

RE: Adding nodes

2022-07-12 Thread Marc Hoppins
’ questions is not a practical response as any business is unlikely to be spending speculative money. From: Jeff Jirsa Sent: Tuesday, July 12, 2022 4:43 PM To: cassandra Cc: Bowen Song Subject: Re: Adding nodes EXTERNAL On Tue, Jul 12, 2022 at 7:27 AM Marc Hoppins mailto:marc.hopp...@eset.com

Re: Adding nodes

2022-07-12 Thread Jeff Jirsa
On Tue, Jul 12, 2022 at 7:27 AM Marc Hoppins wrote: > > I was asking the questions but no one cared to answer. > This is probably a combination of "it is really hard to answer a question with insufficient data" and your tone. Nobody here gets paid to help you solve your company's problems except

Re: Adding nodes

2022-07-12 Thread Jeff Jirsa
motely > > > > *From:* Bowen Song via user > *Sent:* Tuesday, July 12, 2022 12:29 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Adding nodes > > > > EXTERNAL > > For RF=2 in your DC1, you will not be able to achieve both strong > consistency and

RE: Adding nodes

2022-07-12 Thread Durity, Sean R via user
per DC. Adding racks can theoretically help with availability in a data center - if you can match the actual physical layout and points of failure. However, it can also unbalance the data and cause other admin tasks (adding nodes, etc) to be much more complicated. I only use racks in the cloud (to

Re: Adding nodes

2022-07-12 Thread Bowen Song via user
, data  or whatever, it is a serious limitation as not every business/organisation is going to have multiple racks available. *From:*Bowen Song via user *Sent:* Monday, July 11, 2022 8:57 PM *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes EXTERNAL I've noticed the joining node

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
/organisation is going to have multiple racks available. From: Bowen Song via user Sent: Monday, July 11, 2022 8:57 PM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL I've noticed the joining node has a different rack than the rest of the nodes, is this intended? Will you add al

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
:*Joe Obernberger *Sent:* Monday, July 11, 2022 1:29 PM *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes EXTERNAL I too came from HBase and discovered adding several nodes at a time doesn't work.  Are you absolutely sure that the clocks are in sync across the nodes?  This has bitten

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
uld be run after adding all nodes to reduce unnecessary strain on the cluster. From: Marc Hoppins Sent: Monday, July 11, 2022 2:15 PM To: user@cassandra.apache.org Subject: RE: Adding nodes All clocks are fine. Why would time synch would affect whether or not a node appears in the nodetool statu

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
Obernberger Sent: Monday, July 11, 2022 1:29 PM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL I too came from HBase and discovered adding several nodes at a time doesn't work. Are you absolutely sure that the clocks are in sync across the nodes? This has bitten me se

Re: Adding nodes

2022-07-11 Thread Joe Obernberger
er *Sent:* Monday, July 11, 2022 11:56 AM *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes EXTERNAL Checking on multiple nodes won't help if the joining node suffers from any of the issues I described, as it will likely be flipping up and down frequently, and the existing nodes

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
s=0.00, real=0.03 secs] *From:*Bowen Song via user *Sent:* Monday, July 11, 2022 11:56 AM *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes EXTERNAL Checking on multiple nodes won't help if the joining node suffers from any of the issues I described, as it will likely be flipping u

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
NEW NODE manually. No seconds. No pauses. No timeouts. Just waiting. From: Bowen Song via user Sent: Monday, July 11, 2022 12:13 PM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL How long doe it take to add a new node? I'm 100% sure neither 90s nor 120s is the answer

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
e initial setup with no data in the cluster. “What exactly are you waiting for by doing that?” I wanted to see for myself how long it took to add a new node.  Isn’t that what RESEARCH is all about?  I suppose I could have just ‘googled’ it. “Since adding nodes doesn't interfere with the

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
ser=0.22 sys=0.00, real=0.03 secs] From: Bowen Song via user Sent: Monday, July 11, 2022 11:56 AM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL Checking on multiple nodes won't help if the joining node suffers from any of the issues I described, as it will likely be fli

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
e – which is already in the cluster, has been so for several weeks, and is also functioning without error. *From:*Bowen Song via user *Sent:* Monday, July 11, 2022 11:40 AM *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes EXTERNAL A node in joining state can disappearing from th

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
Sent: Monday, July 11, 2022 11:40 AM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL A node in joining state can disappearing from the cluster from other nodes' perspective if the joining node stops sending/receiving gossip messages to other nodes. This can happen whe

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
to add a new node. Isn’t that what RESEARCH is all about? I suppose I could have just ‘googled’ it. “Since adding nodes doesn't interfere with the client queries, the time it takes to add a node shouldn't be a concern at all…” It IS a concern if one has to add many nodes and the

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
new node shows up but from the original seed node, it does not appear in the nodetool status. Can anyone shed any light on this phenomena? *From:*Marc Hoppins *Sent:* Monday, July 11, 2022 10:02 AM *To:* user@cassandra.apache.org *Cc:* Bowen Song *Subject:* RE: Adding nodes Well then… I left

Re: Adding nodes

2022-07-11 Thread Bowen Song via user
f you want to wait for the node's state becomes normal (from joining), be explicit about it, check the nodetool output or the system.log file periodically instead of waiting for a fixed 90 seconds. Streaming 600GB in a few hours sounds fairly reasonable. Since adding nodes doesn't int

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
up but from the original seed node, it does not appear in the nodetool status. Can anyone shed any light on this phenomena? From: Marc Hoppins Sent: Monday, July 11, 2022 10:02 AM To: user@cassandra.apache.org Cc: Bowen Song Subject: RE: Adding nodes Well then… I left this on Friday (still

RE: Adding nodes

2022-07-11 Thread Marc Hoppins
which is unlikely to cause problems? After all, in the modern world of big (how big is big?) data, 600G per node is far less than the real BIG big-data. Marc From: Jeff Jirsa Sent: Friday, July 8, 2022 5:46 PM To: cassandra Cc: Bowen Song Subject: Re: Adding nodes EXTERNAL Having a node UJ

Re: Adding nodes

2022-07-08 Thread Jeff Jirsa
878 2 > None of this addresses the issue of not being able to add more nodes. > > -Original Message- > From: Bowen Song via user > Sent: Friday, July 8, 2022 11:47 AM > To: user@cassandra.apache.org > Subject: Re: Adding nodes > > EXTERNAL > > > I would ass

Re: Adding nodes

2022-07-08 Thread Bowen Song via user
small messages. It needs investigation. Adding node one by one is fine. If your data can grow at speed that's close to or faster than the speed of adding nodes, you have a much more serious problem. We usually leave it running in the background with an automated process, and we don

RE: Adding nodes

2022-07-08 Thread Marc Hoppins
2 None of this addresses the issue of not being able to add more nodes. -Original Message- From: Bowen Song via user Sent: Friday, July 8, 2022 11:47 AM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL I would assume that's 85 GB (i.e. gigabytes) then

Re: Adding nodes

2022-07-08 Thread Bowen Song via user
e is added within 2minutes. It is hardly practical in production. -Original Message- From: Bowen Song via user Sent: Thursday, July 7, 2022 8:43 PM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL 86Gb (that's gigabits, which is 10.75GB, gigabytes) took an e

RE: Adding nodes

2022-07-07 Thread Marc Hoppins
, 2022 8:43 PM To: user@cassandra.apache.org Subject: Re: Adding nodes EXTERNAL 86Gb (that's gigabits, which is 10.75GB, gigabytes) took an entire day seems obviously too long. I would check the network bandwidth, disk IO and CPU usage and find out what is the bottleneck. On 07/07/2022

Re: Adding nodes

2022-07-07 Thread Bowen Song via user
86Gb (that's gigabits, which is 10.75GB, gigabytes) took an entire day seems obviously too long. I would check the network bandwidth, disk IO and CPU usage and find out what is the bottleneck. On 07/07/2022 15:48, Marc Hoppins wrote: Hi all, Cluster of 2 DC and 24 nodes DC1 (RF3) = 12 nodes,

Re: Adding nodes

2022-07-07 Thread Jeff Jirsa
What version are you using? When you run `nodetool netstats` on the joining node, what is the output? How much data is there per node (presumably more than 86G)? On Thu, Jul 7, 2022 at 7:49 AM Marc Hoppins wrote: > Hi all, > > Cluster of 2 DC and 24 nodes > > DC1 (RF3) = 12 nodes, 16 tokens

Adding nodes

2022-07-07 Thread Marc Hoppins
Hi all, Cluster of 2 DC and 24 nodes DC1 (RF3) = 12 nodes, 16 tokens each DC2 (RF3) = 12 nodes, 16 tokens each Adding 12 more nodes to DC1: I installed Cassandra (version is the same across all nodes) but, after the first node added, I couldn't seem to add any further nodes. I check nodetool

Re: Curiosity in adding nodes

2019-10-21 Thread guo Maxwell
1.the node added to the ring will calculate the token range it owns, then get the data of the range from the nodes originally owned the data. 2.then the streamed sstable and the range of the sstable should be estimated. 3.then streaming begins .secondary index will be build afther sstabte streamed

Re: Curiosity in adding nodes

2019-10-21 Thread Craig Pastro
If I understand correctly this is controlled by setting `auto_bootstrap`. If it is set to true (the default), once the node joins the cluster it will have some portion of the data assigned to it, and its data will be streamed to it from the other nodes. Once the data has finished streaming only the

Curiosity in adding nodes

2019-10-21 Thread Eunsu Kim
Hi experts, When a new node was added, how can the coordinator find data that has been not yet streamed? Or is new nodes not used until all data is streamed? Thanks in advance - To unsubscribe, e-mail: user-unsubscr...@cassandr

Re: adding nodes to a cluster and changing rf

2017-07-14 Thread kurt greaves
Increasing RF will result in nodes that previously didn't have a replica of the data now being responsible for it. This means that a repair is required after increasing the RF. Until the repair completes you will suffer from inconsistencies in data. For example, in a 3 node cluster with RF 2, node

adding nodes to a cluster and changing rf

2017-07-13 Thread Micha
Hi, I want to extend my cluster (C* 3.9) from three nodes with RF 2 to seven nodes with RF 3. Is there a preferable way to do this? For example: setting "auto_bootstrap: true" and bootstrapping each new node at a time? setting "auto_bootstrap: false" , starting all new nodes at once and then "

RE: Adding nodes and cleanup

2017-06-19 Thread ZAIDI, ASAD A
! From: Mark Furlong [mailto:mfurl...@ancestry.com] Sent: Monday, June 19, 2017 2:28 PM To: user@cassandra.apache.org Subject: Adding nodes and cleanup I have added a few nodes and now am running some cleanups. Can I add an additional node while these cleanups are running? What are the ramifications

Adding nodes and cleanup

2017-06-19 Thread Mark Furlong
I have added a few nodes and now am running some cleanups. Can I add an additional node while these cleanups are running? What are the ramifications of doing this? Mark Furlong Sr. Database Administrator mfurl...@ancestry.com M: 801-859-7427 O: 801-705-7115 1300 W

RE: Local_serial >> Adding nodes

2017-06-08 Thread ZAIDI, ASAD A
Please share exact timeout error message text to get idea what type of timeout you're facing. From: Nitan Kainth [mailto:ni...@bamlabs.com] Sent: Wednesday, June 07, 2017 7:24 AM To: vasu gunja Cc: user@cassandra.apache.org Subject: Re: Local_serial >> Adding nodes What is in syste

Re: Local_serial >> Adding nodes

2017-06-07 Thread Nitan Kainth
What is in system log? Does it show new tokens allocated? nodetool netstats > On Jun 7, 2017, at 6:50 AM, vasu gunja wrote: > > Yeah all of them are in UJ state.. > > Thanks, > Vasu > > On Jun 7, 2017, at 6:32 AM, Nitan Kainth > wrote: > >> Is the streaming still g

Re: Local_serial >> Adding nodes

2017-06-07 Thread vasu gunja
Yeah all of them are in UJ state.. Thanks, Vasu > On Jun 7, 2017, at 6:32 AM, Nitan Kainth wrote: > > Is the streaming still going on? > Timeouts are in reads or writes? > > Sent from my iPhone > >> On Jun 6, 2017, at 9:50 PM, vasu gunja wrote: >> >> Hi All, >> >> We are having 2 DC setup

Re: Local_serial >> Adding nodes

2017-06-07 Thread Nitan Kainth
Is the streaming still going on? Timeouts are in reads or writes? Sent from my iPhone > On Jun 6, 2017, at 9:50 PM, vasu gunja wrote: > > Hi All, > > We are having 2 DC setup each consists of 20 odd nodes and recently we > decided to add 6 more nodes to DC1. We are using LWT's, application

Local_serial >> Adding nodes

2017-06-06 Thread vasu gunja
Hi All, We are having 2 DC setup each consists of 20 odd nodes and recently we decided to add 6 more nodes to DC1. We are using LWT's, application dirvers are configuared to use LOCAL_SERIAL. As we are adding multiple nodes at a time we used option "-Dcassandra.consistent.rangemovement=false" we

Re: How are writes handled while adding nodes to cluster?

2015-10-06 Thread Robert Coli
On Tue, Oct 6, 2015 at 11:10 AM, Tyler Hobbs wrote: > When a node is joining, writes are sent to both the current replicas *and* > the joining replica. However, the joining replica does not count towards > the consistency level. So, for example, if you write at > ConsistencyLevel.TWO, and only

Re: How are writes handled while adding nodes to cluster?

2015-10-06 Thread Tyler Hobbs
When a node is joining, writes are sent to both the current replicas *and* the joining replica. However, the joining replica does not count towards the consistency level. So, for example, if you write at ConsistencyLevel.TWO, and only one existing replica and the joining replica respond, the writ

How are writes handled while adding nodes to cluster?

2015-10-06 Thread Erik Forsberg
Hi! How are writes handled while I'm adding a node to a cluster, i.e. while the new node is in JOINING state? Are they queued up as hinted handoffs, or are they being written to the joining node? In the former case I guess I have to make sure my max_hint_window_in_ms is long enough for the node

Re: Adding Nodes With Inconsistent Data

2015-06-29 Thread Robert Coli
On Sun, Jun 28, 2015 at 10:46 AM, Anuj Wadehra wrote: > Thanks Jake!! But I think most people have 2.0.x in Production right now > as 2.1.6 is very recently declared Production Ready. I think the bug is too > important to be left open in 2.0.x as it leads to data loss. Should I open > JIRA? > So

Re: Adding Nodes With Inconsistent Data

2015-06-28 Thread Anuj Wadehra
Thanks Jake!! But I think most people have 2.0.x in Production right now as 2.1.6 is very recently declared Production Ready. I think the bug is too important to be left open in 2.0.x as it leads to data loss. Should I open JIRA? ThanksAnuj Wadehra On Thursday, 25 June 2015 2:47 AM, Jake

Re: Adding Nodes With Inconsistent Data

2015-06-24 Thread Jake Luciani
This is no longer an issue in 2.1. https://issues.apache.org/jira/browse/CASSANDRA-2434 We now make sure the replica we bootstrap from is the one that will no longer own that range On Wed, Jun 24, 2015 at 4:58 PM, Alain RODRIGUEZ wrote: > It looks to me that can indeed happen theoretically (I m

Re: Adding Nodes With Inconsistent Data

2015-06-24 Thread Alain RODRIGUEZ
It looks to me that can indeed happen theoretically (I might be wrong). However, - Hinted Handoff tends to remove this issue, if this is big worry, you might want to make sure HH are enabled and well tuned - Read Repairs (synchronous or not) might have mitigate things also, if you read fresh data

Adding Nodes With Inconsistent Data

2015-06-24 Thread Anuj Wadehra
Hi, We faced a scenario where we lost little data after adding 2 nodes in the cluster. There were intermittent dropped mutations in the cluster. Need to verify my understanding how this may have happened to do Root Cause Analysis: Scenario: 3 nodes, RF=3, Read / Write CL= Quorum 1. Due to o

Re: Adding nodes to existing cluster

2015-04-20 Thread Sebastian Estevez
; > Pythian - Love your data > > > > rolo@pythian | Twitter: cjrolo | Linkedin: > linkedin.com/in/carlosjuzarterolo > > Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649 > > www.pythian.com > > > > On Mon, Apr 20, 2015 at 1:58 PM, Or Sher wrote: > >>

Re: Adding nodes to existing cluster

2015-04-20 Thread Or Sher
, Apr 20, 2015 at 1:58 PM, Or Sher wrote: >> >> Thanks for the response. >> Sure we'll monitor as we're adding nodes. >> We're now using 6 nodes on each DC. (We have 2 DCs) >> Each node contains ~800GB >> >> Do you know how rack configurations ar

RE: Adding nodes to existing cluster

2015-04-20 Thread Matthew Johnson
Hi Colin, To remove your address from the list, send a message to: Cheers, Matt *From:* Colin Clark [mailto:co...@clark.ws] *Sent:* 20 April 2015 14:10 *To:* user@cassandra.apache.org *Subject:* Re: Adding nodes to existing cluster unsubscribe On Apr 20, 2015, at 8:08 AM

Re: Adding nodes to existing cluster

2015-04-20 Thread Colin Clark
linkedin.com/in/carlosjuzarterolo > <http://linkedin.com/in/carlosjuzarterolo> > Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649 > www.pythian.com <http://www.pythian.com/> > On Mon, Apr 20, 2015 at 1:58 PM, Or Sher <mailto:or.sh...@gmail.com>> wrote: > Thank

Re: Adding nodes to existing cluster

2015-04-20 Thread Carlos Rolo
On Mon, Apr 20, 2015 at 1:58 PM, Or Sher wrote: > Thanks for the response. > Sure we'll monitor as we're adding nodes. > We're now using 6 nodes on each DC. (We have 2 DCs) > Each node contains ~800GB > > Do you know how rack configurations are relevant here? > D

Re: Adding nodes to existing cluster

2015-04-20 Thread Or Sher
Thanks for the response. Sure we'll monitor as we're adding nodes. We're now using 6 nodes on each DC. (We have 2 DCs) Each node contains ~800GB Do you know how rack configurations are relevant here? Do you see any reason to bootstrap them one by one if we're not using rack

Re: Adding nodes to existing cluster

2015-04-20 Thread Carlos Rolo
Start one node at a time. Wait 2 minutes before starting each node. How much data and nodes you have already? Depending on that, the streaming of data can stress on the resources you have. I would recommend to start one and monitor, if things are ok, add another one. And so on. Regards, Carlos

Adding nodes to existing cluster

2015-04-20 Thread Or Sher
Hi all, In the near future I'll need to add more than 10 nodes to a 2.0.9 cluster (using vnodes). I read this documentation on datastax website: http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_add_node_to_cluster_t.html In one point it says: "If you are using racks, you can safe

Re: Question about adding nodes to a cluster

2015-02-10 Thread Robert Coli
On Mon, Feb 9, 2015 at 5:25 PM, Seth Edwards wrote: > I see what you are saying. So basically take whatever existing token I > have and divide it by 2, give or take a couple of tokens? > Yep! "bisect the token ranges" if you want to be fancy about it. =Rob

Re: Question about adding nodes to a cluster

2015-02-09 Thread Seth Edwards
I see what you are saying. So basically take whatever existing token I have and divide it by 2, give or take a couple of tokens? On Mon, Feb 9, 2015 at 5:17 PM, Robert Coli wrote: > On Mon, Feb 9, 2015 at 4:59 PM, Seth Edwards wrote: > >> We are choosing to double our cluster from six to twelve

Re[2]: Question about adding nodes to a cluster

2015-02-09 Thread Plotnik, Alexey
Sorry, No - you are not doing it wrong ^) Yes, Cassandra partitioner is based on hash ring. Doubling number of nodes is the best cluster exctending policy I've ever seen, because it's zero-overhead. Hashring - you get MD5 max (2^128-1), divide it by number of nodes (partitions) getting N point

Re: Question about adding nodes to a cluster

2015-02-09 Thread Robert Coli
On Mon, Feb 9, 2015 at 4:59 PM, Seth Edwards wrote: > We are choosing to double our cluster from six to twelve. I ran the token > generator. Based on what I read in the documentation, I expected to see the > same first six tokens and six new tokens. Instead I see almost the same > tokens but off

Re: Question about adding nodes to a cluster

2015-02-09 Thread Plotnik, Alexey
Yes, Cassandra partitioner is based on hash ring. Doubling number of nodes is the best cluster exctending policy I've ever seen, because it's zero-overhead. Hashring - you get MD5 max (2^128-1), divide it by number of nodes (partitions) getting N points and then evenly distribute them across you

Question about adding nodes to a cluster

2015-02-09 Thread Seth Edwards
I am on Cassandra 1.2.19 and I am following the documentation for adding existing nodes to a cluster . We are choosing to double our cluster from six to twelve. I ran the token generator. Based on what I r

Re: Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges?

2014-10-16 Thread Robert Coli
On Wed, Oct 15, 2014 at 3:25 PM, Donald Smith < donald.sm...@audiencescience.com> wrote: > So, my point is that to avoid the need to bootstrap and to cleanup, it's > better to bring all nodes up at about the same time. If this is wrong, > please explain why. > Oh, sure. As you say, you avoid hav

Re: Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges?

2014-10-15 Thread Alain RODRIGUEZ
; > Thanks, Don > -- > *From:* Robert Coli > *Sent:* Wednesday, October 15, 2014 1:54 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Question about adding nodes incrementally to a new > datacenter: wait til all hosts come up

Re: Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges?

2014-10-15 Thread Donald Smith
Sent: Wednesday, October 15, 2014 1:54 PM To: user@cassandra.apache.org Subject: Re: Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges? On Tue, Oct 14, 2014 at 4:52 PM, Donald Smith mailto:donald.sm...@audiencescience.com>&

Re: Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges?

2014-10-15 Thread Robert Coli
On Tue, Oct 14, 2014 at 4:52 PM, Donald Smith < donald.sm...@audiencescience.com> wrote: > Suppose I create a new DC with 25 nodes. I have their IPs in > cassandra-topology.properties. Twenty-three of the nodes start up, but two > of the nodes fail to start. If I start replicating (via "nodeto

Question about adding nodes incrementally to a new datacenter: wait til all hosts come up so they can learn the token ranges?

2014-10-14 Thread Donald Smith
Suppose I create a new DC with 25 nodes. I have their IPs in cassandra-topology.properties. Twenty-three of the nodes start up, but two of the nodes fail to start. If I start replicating (via "nodetool rebuild") without those two nodes, then when those 2 nodes enter the DC the distribution o

Re: StreamException while adding nodes

2014-06-12 Thread Philipp Potisk
As we are still failing to add the 3 additional nodes, we still appreciate any further thoughts. I have removed all 3 half-joined nodes, deleted the data-directories and started only one node. Since than (more than 24h hoursa ago) the node is in status JOINING (nodetool status: UJ, nodetool gossip

Re: StreamException while adding nodes

2014-06-10 Thread Philipp Potisk
Hey Rob, thanks for pointing out the issue with simultaneous bootstraps. However, I am not sure if this applies in my case. As a matter of fact I did not start the nodes simultaneously - I waited about 10min until they were receiving streams from other nodes. So I guess the topology-changes were e

Re: StreamException while adding nodes

2014-06-10 Thread Robert Coli
On Tue, Jun 10, 2014 at 2:21 PM, Philipp Potisk wrote: > First I added one node, which joined after 120min successfully. During > that time there was no additional load on the cluster. Afterwards I started > the other 3 new nodes after each other in order to join the cluster > simultaneously. >

StreamException while adding nodes

2014-06-10 Thread Philipp Potisk
Hi, I tried to double the size of an existing cluster from 4 to 8 nodes. First I added one node, which joined after 120min successfully. During that time there was no additional load on the cluster. Afterwards I started the other 3 new nodes after each other in order to join the cluster simultaneo

Re: Impact of adding nodes to cluster

2014-04-24 Thread John Pyeatt
Leave the RF at 3. Especially since you use write ALL consistency. It's actually a really bad idea to have your RF set to the same value as the number of nodes you have. If one of your nodes goes down, your writes will fail. In fact I would suggest leaving your RF at 3 and set read and write consi

Impact of adding nodes to cluster

2014-04-24 Thread Katriel Traum
Hello list, I have a cluster of 3 nodes with RF=3. The cluster load is daily bulk write/delete/compact, and read the rest of the time. For better read performance, and to make sure data is 100% consistent, we write with "ALL" and read "ONE", stopping the write process if there is a problem. My pr

Re: Adding nodes to a cluster and 2 minutes rule

2013-12-30 Thread Robert Coli
On Mon, Nov 18, 2013 at 10:28 AM, Carlos Alvarez wrote: > Here > http://www.datastax.com/documentation/cassandra/1.2/webhelp/cassandra/operations/ops_add_node_to_cluster_t.html > says > that it is needed to wait 2 minutes between adding nodes. > > I was trying to figure out why

Re: Adding nodes to a cluster and 2 minutes rule

2013-11-21 Thread Carlos Alvarez
ulting > http://www.thelastpickle.com > > On 19/11/2013, at 7:28 am, Carlos Alvarez wrote: > > Hi. > > Here > http://www.datastax.com/documentation/cassandra/1.2/webhelp/cassandra/operations/ops_add_node_to_cluster_t.html > says > that it is needed to wait 2

Re: Adding nodes to a cluster and 2 minutes rule

2013-11-20 Thread Aaron Morton
p/cassandra/operations/ops_add_node_to_cluster_t.html > says that it is needed to wait 2 minutes between adding nodes. > > I was trying to figure out why, and how to check if after 2 minutes the > conditions to add more nodes are met or I have to wait more... any clues? > > Thanks! > Carlos.

Adding nodes to a cluster and 2 minutes rule

2013-11-18 Thread Carlos Alvarez
Hi. Here http://www.datastax.com/documentation/cassandra/1.2/webhelp/cassandra/operations/ops_add_node_to_cluster_t.html says that it is needed to wait 2 minutes between adding nodes. I was trying to figure out why, and how to check if after 2 minutes the conditions to add more nodes are met or

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-29 Thread John Watson
t;> >>> On Fri, Apr 26, 2013 at 5:07 AM, Francisco Nogueira Calmon Sobral < >>> fsob...@igcorp.com.br> wrote: >>> >>>> I am using the same version and observed something similar. >>>> >>>> I've added a new node, but the instru

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-29 Thread John Watson
t;> - John >>>> >>>> >>>> On Fri, Apr 26, 2013 at 5:07 AM, Francisco Nogueira Calmon Sobral < >>>> fsob...@igcorp.com.br> wrote: >>>> >>>>> I am using the same version and observed something similar. >>>&g

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-29 Thread Sam Overton
ve added a new node, but the instructions from Datastax did not work >>>> for me. Then I ran "nodetool rebuild" on the new node. After finished this >>>> command, it contained two times the load of the other nodes. Even when I >>>> ran "nodetool cle

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-29 Thread aaron morton
quot;nodetool cleanup" on the older nodes, the situation was the same. >> >> The problem only seemed to disappear when "nodetool repair" was applied to >> all nodes. >> >> Regards, >> Francisco Sobral. >> >> >> >> >>

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-28 Thread John Watson
ed this >>> command, it contained two times the load of the other nodes. Even when I >>> ran "nodetool cleanup" on the older nodes, the situation was the same. >>> >>> The problem only seemed to disappear when "nodetool repair" was appli

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-28 Thread aaron morton
ven when I ran > "nodetool cleanup" on the older nodes, the situation was the same. > > The problem only seemed to disappear when "nodetool repair" was applied to > all nodes. > > Regards, > Francisco Sobral. > > > > > On Apr 25, 2013, at

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-26 Thread Bryan Talbot
t;> ran "nodetool cleanup" on the older nodes, the situation was the same. >> >> The problem only seemed to disappear when "nodetool repair" was applied >> to all nodes. >> >> Regards, >> Francisco Sobral. >> >> >> >> >

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-26 Thread John Watson
PM, John Watson wrote: > > After finally upgrading to 1.2.3 from 1.1.9, enabling vnodes, and running > upgradesstables, I figured it would be safe to start adding nodes to the > cluster. Guess not? > > It seems when new nodes join, they are streamed *all* sstables in the > cluster. > >

Re: Adding nodes in 1.2 with vnodes requires huge disks

2013-04-26 Thread Francisco Nogueira Calmon Sobral
1.2.3 from 1.1.9, enabling vnodes, and running > upgradesstables, I figured it would be safe to start adding nodes to the > cluster. Guess not? > > It seems when new nodes join, they are streamed *all* sstables in the cluster. > > https://dl.dropbox.com/s/bampemkvlfck2dt/Screen%20Shot

Adding nodes in 1.2 with vnodes requires huge disks

2013-04-25 Thread John Watson
After finally upgrading to 1.2.3 from 1.1.9, enabling vnodes, and running upgradesstables, I figured it would be safe to start adding nodes to the cluster. Guess not? It seems when new nodes join, they are streamed *all* sstables in the cluster. https://dl.dropbox.com/s/bampemkvlfck2dt/Screen

Re: Benifits by adding nodes to the cluster

2012-11-01 Thread aaron morton
Is it easy to > convert the existing installation to use virtual nodes? > > Thanks. > -Wei > > From: aaron morton > To: user@cassandra.apache.org > Sent: Wednesday, October 31, 2012 2:23 PM > Subject: Re: Benifits by adding nodes to the cluster > >> I have been t

Re: Benifits by adding nodes to the cluster

2012-10-31 Thread Wei Zhu
t: Re: Benifits by adding nodes to the cluster I have been told that it's much easier to scale the cluster by doubling the >number of nodes, since no token changed needed on the existing nodes.Yup. But if the number of nodes is substantial, it's not realistic to double it >every time

Re: Benifits by adding nodes to the cluster

2012-10-31 Thread aaron morton
> > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Benifits-by-adding-nodes-to-the-cluster-tp7583437p7583466.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

Re: Benifits by adding nodes to the cluster

2012-10-30 Thread weiz
operation cost. Any real world experience is very much appreciated. Thanks. -Wei -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Benifits-by-adding-nodes-to-the-cluster-tp7583437p7583466.html Sent from the cassandra-u...@incubator.apache.o

Re: Benifits by adding nodes to the cluster

2012-10-30 Thread Hiller, Dean
? >> >> /Roshan >> >> >> >> -- >> View this message in context: >>http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Benifits >>-by-adding-nodes-to-the-cluster-tp7583437.html >> Sent from the cassandra-u...@incubator.apache.org mailing list archive >>at Nabble.com.

Re: Benifits by adding nodes to the cluster

2012-10-29 Thread Andrey Ilinykh
availability. Any others? > > /Roshan > > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Benifits-by-adding-nodes-to-the-cluster-tp7583437.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

RE: Adding nodes to cluster (Cassandra 1.0.8)

2012-03-15 Thread Rishabh Agrawal
After clearing the system files I was able to successfully join the node. thanks. From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Thursday, March 15, 2012 2:13 PM To: user@cassandra.apache.org Subject: Re: Adding nodes to cluster (Cassandra 1.0.8) There have been two similar reports

Re: Adding nodes to cluster (Cassandra 1.0.8)

2012-03-15 Thread aaron morton
> > 2012/3/14 Rishabh Agrawal : >> I am using storage port 7000 (deafult) across all nodes. >> >> -Original Message- >> From: Maki Watanabe [mailto:watanabe.m...@gmail.com] >> Sent: Wednesday, March 14, 2012 3:42 PM >> To: user@cassandra.apache.org &g

  1   2   >