RE: Would warnings about overlapping SStables explain high pending compactions?

2014-09-25 Thread Donald Smith
Version 2.0.9. We have 11 ongoing compactions on that node. From: Marcus Eriksson [mailto:krum...@gmail.com] Sent: Thursday, September 25, 2014 12:45 AM To: user@cassandra.apache.org Subject: Re: Would warnings about overlapping SStables explain high pending compactions? Not really What

Re: Would warnings about overlapping SStables explain high pending compactions?

2014-09-25 Thread Marcus Eriksson
Not really What version are you on? Do you have pending compactions and no ongoing compactions? /Marcus On Wed, Sep 24, 2014 at 11:35 PM, Donald Smith < donald.sm...@audiencescience.com> wrote: > On one of our nodes we have lots of pending compactions (499).In the > past we’ve seen pending

Would warnings about overlapping SStables explain high pending compactions?

2014-09-24 Thread Donald Smith
On one of our nodes we have lots of pending compactions (499).In the past we've seen pending compactions go up to 2400 and all the way back down again. Investigating, I saw warnings such as the following in the logs about overlapping SStables and about needing to run "nodetool scrub" on a ta

Re: high pending compactions

2014-07-15 Thread Chris Lohfink
ponses. > From: clohf...@blackbirdit.com > Subject: Re: high pending compactions > Date: Mon, 9 Jun 2014 14:11:36 -0500 > To: user@cassandra.apache.org > > Bean: org.apache.cassandra.db.CompactionManager > > also nodetool compactionstats gives you how many are in the queue

Re: high pending compactions

2014-07-14 Thread Greg Bone
2:14 PM, S C wrote: > Thank you all for quick responses. > -- > From: clohf...@blackbirdit.com > Subject: Re: high pending compactions > Date: Mon, 9 Jun 2014 14:11:36 -0500 > To: user@cassandra.apache.org > > Bean: org.apache.cassandra.db.Compac

RE: high pending compactions

2014-06-09 Thread S C
Thank you all for quick responses. From: clohf...@blackbirdit.com Subject: Re: high pending compactions Date: Mon, 9 Jun 2014 14:11:36 -0500 To: user@cassandra.apache.org Bean: org.apache.cassandra.db.CompactionManager also nodetool compactionstats gives you how many are in the queue + estimate

Re: high pending compactions

2014-06-09 Thread Chris Lohfink
il.com > Date: Mon, 9 Jun 2014 18:53:41 +0800 > Subject: Re: high pending compactions > To: user@cassandra.apache.org > > As Jake suggested, you could firstly increase > "compaction_throughput_mb_per_sec" and "concurrent_compactions" to suitable > values

RE: high pending compactions

2014-06-09 Thread S C
Thank you all for valuable suggestions. Couple more questions, How to check the compaction queue? MBean/C* system log ?What happens if the queue is full? From: colinkuo...@gmail.com Date: Mon, 9 Jun 2014 18:53:41 +0800 Subject: Re: high pending compactions To: user@cassandra.apache.org As Jake

Re: high pending compactions

2014-06-09 Thread Colin Kuo
As Jake suggested, you could firstly increase "compaction_throughput_mb_per_sec" and "concurrent_compactions" to suitable values if system resource is allowed. From my understanding, major compaction will internally acquire lock before running compaction. In your case, there might be a major compac

RE: high pending compactions

2014-06-08 Thread S C
How to check if there are any "stuck compactions"? > Date: Sun, 8 Jun 2014 12:43:45 -0400 > From: wkat...@cs.rutgers.edu > To: user@cassandra.apache.org > Subject: Re: high pending compactions > > Have you verified that these aren't "stuck compactions"

Re: high pending compactions

2014-06-08 Thread William Katsak
Have you verified that these aren't "stuck compactions"? e.g. even under no load, they don't go away? -Bill On 06/08/2014 12:32 PM, Jake Luciani wrote: 2&3 On Sunday, June 8, 2014, S C mailto:as...@outlook.com>> wrote: I am using Cassandra 1.1 (sorry bit old) and I am seeing high pe

Re: high pending compactions

2014-06-08 Thread Jake Luciani
2&3 On Sunday, June 8, 2014, S C wrote: > I am using Cassandra 1.1 (sorry bit old) and I am seeing high pending > compaction count. "pending tasks: 67" while active compaction tasks are > not more than 5. I have a 24CPU machine. Shouldn't I be seeing more > compactions? Is this a pattern of high

high pending compactions

2014-06-08 Thread S C
I am using Cassandra 1.1 (sorry bit old) and I am seeing high pending compaction count. "pending tasks: 67" while active compaction tasks are not more than 5. I have a 24CPU machine. Shouldn't I be seeing more compactions? Is this a pattern of high writes and compactions backing up? How can I im