Re: Node Stuck while restarting

2016-05-29 Thread Bhuvan Rawal
Hi Mike, PFA the details you asked for: and some others if that helps: we are using jvm params -Xms8G -Xmx8G MAX_HEAP_SIZE: & HEAP_NEWSIZE: is not being set and possibly calculated by calculate_heap_sizes function. (And we are using default calculations): here are the results, pls correct me if i

Re: Node Stuck while restarting

2016-05-29 Thread Mike Yeap
Hi Bhuvan, how big are your current commit logs in the failed node, and what are the sizes MAX_HEAP_SIZE and HEAP_NEWSIZE? Also the values of following properties in cassandra.yaml?? memtable_allocation_type memtable_cleanup_threshold memtable_flush_writers memtable_heap_space_in_mb memtable_offh

Node Stuck while restarting

2016-05-29 Thread Bhuvan Rawal
Hi, We are running a 6 Node cluster in 2 DC on DSC 3.0.3, with 3 Node each. One of the node was showing UNREACHABLE on other nodes in nodetool describecluster and on that node it was showing all others UNREACHABLE and as a measure we restarted the node. But on doing that it is stuck possibly at