Re: Few Clarifications on Major Compactions

2012-02-29 Thread Eran Chinthaka Withana
Thanks Maki and Tyler. Re: Q1: I think its the time for me to think about LevelCompaction at this time. But I'm happy to know I can run major compactions as often as I like if I can afford. Re: Q2: Other than the high IO impact if there won't be any data corruption/consistency issues I think I ca

Re: Few Clarifications on Major Compactions

2012-02-29 Thread Tyler Hobbs
At this point, using LeveledCompaction is a much better way to have good guarantees about how many sstables your reads will hit (and thus better latency guarantees) than SizeTiered with periodic major compactions. On Wed, Feb 29, 2012 at 8:49 PM, Maki Watanabe wrote: > DataStax has not recommend

Re: Few Clarifications on Major Compactions

2012-02-29 Thread Maki Watanabe
DataStax has not recommend to run major compaction now: http://www.datastax.com/docs/1.0/operations/tuning But if you can afford it, major compaction will improve read latency as you see. Major compaction is expensive, so you will not want to run it during high traffic hours. And you should not

Few Clarifications on Major Compactions

2012-02-29 Thread Eran Chinthaka Withana
Hi, I have two questions on major compactions (the ones user initiate using nodetool) and I really appreciate if someone can help. 1. I've noticed that when I run compactions the read latency improves even more than I expected (which is good :) ) The improvement is so tempting that I'd like to ru