Re: Increased read timeouts during rolling upgrade to C* 1.2

2013-10-04 Thread Paulo Motta
One more piece of information to help troubleshooting the issue: During the "nodetool drain" operation just before the upgrade, instead of just stopping accepting new writes, the node actually shuts itself down. This bug was also reported in this other thread: http://mail-archives.apache.org/mod_m

Re: Increased read timeouts during rolling upgrade to C* 1.2

2013-10-04 Thread Robert Coli
On Fri, Oct 4, 2013 at 9:09 AM, Paulo Motta wrote: > I manually tried to insert and retrieve some data into both the newly > upgraded nodes and the old nodes, and the behavior was very unstable: > sometimes it worked, sometimes it didn't (TimedOutException), so I don't > think it was a network pro

Increased read timeouts during rolling upgrade to C* 1.2

2013-10-04 Thread Paulo Motta
Hello, I have isolated one of our data centers to simulate a rolling restart upgrade from C* 1.1.10 to 1.2.10. We replayed our production traffic to the C* nodes during the upgrade and observed an increased number of read timeouts during the upgrade process. I executed nodetool drain before upgra