Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Got it. Thanks again! But in versions of Cassandra after 2.0.15 getFullyExpiredSSTables is more in line with what people would consider to be fully expired (i.e. any SSTable whose newest value

Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
: Friday, June 17, 2016 4:21:02 PM To: user@cassandra.apache.org Subject: Re: [External] Re: Understanding when Cassandra drops expired time series data Correcting myself - https://issues.apache.org/jira/browse/CASSANDRA-9882 made it check for fully expired tables no more than once every 10 minutes

Re: [External] Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
: Friday, June 17, 2016 at 1:05 PM To: "user@cassandra.apache.org" Subject: [External] Re: Understanding when Cassandra drops expired time series data Anytime the memtable is flushed to disk, the compaction strategy will look for tables to compact. If there exists fully expired sstab

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
. From: jerome Reply-To: "user@cassandra.apache.org" Date: Friday, June 17, 2016 at 1:02 PM To: "user@cassandra.apache.org" Subject: Re: Understanding when Cassandra drops expired time series data Hi Jeff, Thanks for the information! That helps clear up a

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
.apache.org" Subject: Re: Understanding when Cassandra drops expired time series data Hey Jeff, Do most of those behaviors apply to TWCS too? -J On Fri, Jun 17, 2016 at 1:25 PM, Jeff Jirsa wrote: First, DTCS in 2.0.15 has some weird behaviors - https://issues.apache.

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
016 3:25:07 PM To: user@cassandra.apache.org Subject: Re: Understanding when Cassandra drops expired time series data First, DTCS in 2.0.15 has some weird behaviors - https://issues.apache.org/jira/browse/CASSANDRA-9572 . That said, some other general notes: Data deleted by TTL isn’t the sa

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jason J. W. Williams
rome > *Reply-To: *"user@cassandra.apache.org" > *Date: *Friday, June 17, 2016 at 11:52 AM > *To: *"user@cassandra.apache.org" > *Subject: *Understanding when Cassandra drops expired time series data > > > > Hello! Recently I have been trying to familia

Re: Understanding when Cassandra drops expired time series data

2016-06-17 Thread Jeff Jirsa
mmit-2015-real-world-dtcs-for-operators ) - if you’re running time series in production on DTCS, it’s worth a glance. From: jerome Reply-To: "user@cassandra.apache.org" Date: Friday, June 17, 2016 at 11:52 AM To: "user@cassandra.apache.org" Subject: Understanding

Understanding when Cassandra drops expired time series data

2016-06-17 Thread jerome
Hello! Recently I have been trying to familiarize myself with Cassandra but don't quite understand when data is removed from disk after it has been deleted. The use case I'm particularly interested is expiring time series data with DTCS. As an example, I created the following table: CREATE TABL