Re: Frequent timeout issues

2015-04-02 Thread daemeon reiydelle
gt; >>> monitoring iostat and gc logs may help.. >>> >>> Thanks >>> Anuj Wadehra >>> -- >>> *From*:"Amlan Roy" >>> *Date*:Wed, 1 Apr, 2015 at 9:27 pm >>> *Subject*:Re: Frequent timeout

Re: Frequent timeout issues

2015-04-02 Thread Jonathan Haddad
sh que size is set at least equal to no of indexes.. >> >> monitoring iostat and gc logs may help.. >> >> Thanks >> Anuj Wadehra >> ---------- >> *From*:"Amlan Roy" >> *Date*:Wed, 1 Apr, 2015 at 9:27 pm >> *Su

Re: Frequent timeout issues

2015-04-02 Thread daemeon reiydelle
..make sure that memtable > flush que size is set at least equal to no of indexes.. > > monitoring iostat and gc logs may help.. > > Thanks > Anuj Wadehra > -- > *From*:"Amlan Roy" > *Date*:Wed, 1 Apr, 2015 at 9:27 pm > *Subj

Re: Frequent timeout issues

2015-04-01 Thread Anuj Wadehra
indexes in cf ..make sure that memtable flush que size is set at least equal to no of indexes.. monitoring iostat and gc logs may help.. Thanks Anuj Wadehra From:"Amlan Roy" Date:Wed, 1 Apr, 2015 at 9:27 pm Subject:Re: Frequent timeout issues Did not see any exception in cassand

Re: Frequent timeout issues

2015-04-01 Thread Robert Coli
On Wed, Apr 1, 2015 at 8:37 AM, Amlan Roy wrote: > Replication factor is 2. > It is relatively unusual for people to use a replication factor of 2, for what it's worth. =Rob

Re: Frequent timeout issues

2015-04-01 Thread Amlan Roy
Did not see any exception in cassandra.log and system.log. Monitored using JConsole. Did not see anything wrong. Do I need to see any specific info? Doing almost 1000 writes/sec. HBase and Cassandra are running on different clusters. For cassandra I have 6 nodes with 64GB RAM(Heap is at default

Re: Frequent timeout issues

2015-04-01 Thread Amlan Roy
y prohibited. > > > > From: Amlan Roy > Reply-To: > Date: Wednesday, April 1, 2015 at 11:37 AM > To: > Subject: Re: Frequent timeout issues > > Replication factor is 2. > CREATE KEYSPACE ct_keyspace WITH replication = { > 'class': 'NetworkTopo

Re: Frequent timeout issues

2015-04-01 Thread Brian O'Neill
ecipient is strictly prohibited. From: Amlan Roy Reply-To: Date: Wednesday, April 1, 2015 at 11:37 AM To: Subject: Re: Frequent timeout issues Replication factor is 2. CREATE KEYSPACE ct_keyspace WITH replication = { 'class': 'NetworkTopologyStrategy', 'DC1&

Re: Frequent timeout issues

2015-04-01 Thread Amlan Roy
Replication factor is 2. CREATE KEYSPACE ct_keyspace WITH replication = { 'class': 'NetworkTopologyStrategy', 'DC1': '2' }; Inserts are happening from Storm using java driver. Using prepared statement without batch. On 01-Apr-2015, at 8:42 pm, Brice Dutheil wrote: > And the keyspace? What

Re: Frequent timeout issues

2015-04-01 Thread Eric R Medley
Are HBase and Cassandra running on the same servers? Are the writes to each of these databases happening at the same time? Regards, Eric R Medley > On Apr 1, 2015, at 10:12 AM, Brice Dutheil wrote: > > And the keyspace? What is the replication factor. > > Also how are the inserts done? > >

Re: Frequent timeout issues

2015-04-01 Thread Eric R Medley
Are you seeing any exceptions in the cassandra logs? What are the loads on your servers? Have you monitored the performance of those servers? How many writes are you performing at a time? How many writes per seconds? Regards, Eric R Medley > On Apr 1, 2015, at 9:40 AM, Amlan Roy wrote: > > W

Re: Frequent timeout issues

2015-04-01 Thread Brice Dutheil
And the keyspace? What is the replication factor. Also how are the inserts done? On Wednesday, April 1, 2015, Amlan Roy wrote: > Write consistency level is ONE. > > This is the describe output for one of the tables. > > CREATE TABLE event_data ( > event text, > week text, > bucket int, >

Re: Frequent timeout issues

2015-04-01 Thread Amlan Roy
Write consistency level is ONE. This is the describe output for one of the tables. CREATE TABLE event_data ( event text, week text, bucket int, date timestamp, unique text, adt int, age list, arrival list, bank text, bf double, cabin text, card text, carrier list, cb d

Re: Frequent timeout issues

2015-04-01 Thread Amlan Roy
Hi Eric, Thanks for the reply. Some columns are big but I see the issue even when I stop storing the big columns. Some of the writes are timing out, not all. Where can I find the number of writes to Cassandra? Regards, Amlan On 01-Apr-2015, at 7:43 pm, Eric R Medley wrote: > Amlan, > > Can

Re: Frequent timeout issues

2015-04-01 Thread Eric R Medley
Also, can you provide the table details and the consistency level you are using? Regards, Eric R Medley > On Apr 1, 2015, at 9:13 AM, Eric R Medley wrote: > > Amlan, > > Can you provide information on how much data is being written? Are any of the > columns really large? Are any writes succe

Re: Frequent timeout issues

2015-04-01 Thread Eric R Medley
Amlan, Can you provide information on how much data is being written? Are any of the columns really large? Are any writes succeeding or are all timing out? Regards, Eric R Medley > On Apr 1, 2015, at 9:03 AM, Amlan Roy wrote: > > Hi, > > I am new to Cassandra. I have setup a cluster with Ca

Frequent timeout issues

2015-04-01 Thread Amlan Roy
Hi, I am new to Cassandra. I have setup a cluster with Cassandra 2.0.13. I am writing the same data in HBase and Cassandra and find that the writes are extremely slow in Cassandra and frequently seeing exception “Cassandra timeout during write query at consistency ONE". The cluster size for bot