Re: Periodical deletes and compaction strategy

2013-08-26 Thread sankalp kohli
The problem is that tombstones will hang in there till GC grace period. You can reduce the GC grace period and then catch lost deletes in the application layer if you know you should not be seeing such an old record. Also in 1.2, they have some setting which enable an sstable to be compacted if it

Re: Periodical deletes and compaction strategy

2013-08-26 Thread cem
Hi Alain, I solved the same issue by implementing a client that manages time range partitions. Each time range partition is a CF. Cem. On Mon, Aug 26, 2013 at 11:34 AM, Alain RODRIGUEZ wrote: > Hi, > > Any guidance on this topic would be appreciated :). > > > 2013/8/23 Alain RODRIGUEZ > >> Hi

Re: Periodical deletes and compaction strategy

2013-08-26 Thread Alain RODRIGUEZ
Hi, Any guidance on this topic would be appreciated :). 2013/8/23 Alain RODRIGUEZ > Hi, > > I am currently using about 10 CF to store temporal data. Those data are > growing pretty big (hundreds of GB when I actually only need information > from the last month - i.e. about hundreds of MB). > >

Periodical deletes and compaction strategy

2013-08-23 Thread Alain RODRIGUEZ
Hi, I am currently using about 10 CF to store temporal data. Those data are growing pretty big (hundreds of GB when I actually only need information from the last month - i.e. about hundreds of MB). I am going to delete old (and useless) data, I cannot always use TTL since I have counters too. Ye