Re: Corrupt sstables_activity

2020-07-06 Thread manish khandelwal
I did a POC on CCM, removed sstable_activity sstables files from directory after stopping the node. Restarted the node, sstable_activity table was generated again. You can verify it in your test environment and see if node is working fine without any issues. Important thing is to validate any step

Re: Corrupt sstables_activity

2020-07-06 Thread F
Allow me to simplify the question: Are there any tables under the system keyspace, if deleted, will rebuild themselves safely or could be configured to be rebuilt without trashing the entire node? https://docs.datastax.com/en/dse/6.0/cql/cql/cql_using/useQuerySystem.html Particular table i am lo

Re: Question on cass-operator

2020-07-06 Thread John Sanda
Hi Manu, The 2/2 indicates that there are two containers and each is in the ready state. As Vishal suggested, run kubectl describe pod to get more details. You also use kubectl get pod -o yaml. The former will include events in the output. You can run nodetool commands like this: $ kubectl -n c

Re: Safely enabling internode TLS encryption on live cassandra cluster

2020-07-06 Thread vishal kharjul
Agree. We were planning same change and tested multiple scenarios with conclusion that it needs downtime to be on safer side. With right automation in place implementation can be made faster but not without downtime at least in our case. On Mon, Jul 6, 2020, 1:26 PM Durity, Sean R wrote: > I pl

RE: Safely enabling internode TLS encryption on live cassandra cluster

2020-07-06 Thread Durity, Sean R
I plan downtime for changes to security settings like this. I could not come up with a way to not have degraded access or inconsistent data or something else bad. The foundational issue is that unencrypted nodes cannot communicate with encrypted ones. I depend on Cassandra’s high availability f

Re: Safely enabling internode TLS encryption on live cassandra cluster

2020-07-06 Thread Egan Neuhengen
Thank you for the expedient answer. That is what we suspected and it's helpful to get that confirmation. On Mon, Jul 6, 2020 at 10:12 AM Jeff Jirsa wrote: > The optional setting in 4.0 is designed to fix this. Without optional, you > basically have to take an outage - the only control you have i

Re: Safely enabling internode TLS encryption on live cassandra cluster

2020-07-06 Thread Jeff Jirsa
The optional setting in 4.0 is designed to fix this. Without optional, you basically have to take an outage - the only control you have is the nature of that outage. On Mon, Jul 6, 2020 at 9:50 AM Egan Neuhengen wrote: > Hello, > > We are trying to come up with a safe way to turn on internode

Re: Cassandra on K8S

2020-07-06 Thread Jeff Jirsa
On Mon, Jul 6, 2020 at 10:01 AM manish khandelwal < manishkhandelwa...@gmail.com> wrote: > I have started reading about how to deploy Cassandra with K8S. But as I > read more I feel there are a lot of challenges in running Cassandra on K8s. > Some of the challenges which I feel are > > 1. POD IPs

Cassandra on K8S

2020-07-06 Thread manish khandelwal
I have started reading about how to deploy Cassandra with K8S. But as I read more I feel there are a lot of challenges in running Cassandra on K8s. Some of the challenges which I feel are 1. POD IPs identification - If the pods go down and when they come up their IPs change, how is it handled as w

Safely enabling internode TLS encryption on live cassandra cluster

2020-07-06 Thread Egan Neuhengen
Hello, We are trying to come up with a safe way to turn on internode (NOT client-server) TLS encryption on a cassandra cluster with two datacenters, anywhere from 3 to 20 nodes in each DC, 3+ racks in each DC. Cassandra version is 3.11.6, OS is CentOS 7. We have full control over cassandra configu