Re: Configuration for large number of inserts

2011-03-24 Thread aaron morton
With only 2Gb heap you are pushing things a little, see http://wiki.apache.org/cassandra/MemtableThresholds for guidelines on how to estimate the size. - turn off key and column caches - consider reducing the memtable ops, AFAIK throughput in MB calculates using the col values only. So if you

Configuration for large number of inserts

2011-03-24 Thread Adam Briffett
Hi, When doing bulk inserts of data using Pelops (~1000 million rows, column counts varying from 1 - 100,000 but more skewed towards fewer columns), we're ultimately getting a server OOME using 0.7.4. I've attempted to follow other pointers on this issue (reducing threshold before memtables flushe