Re: running cassandra on 8 GB servers

2013-04-15 Thread Nikolay Mihaylov
Just a small update here currently running on one node with 7 GB heap and no JNA all defaults except the heap, and everything looks OK. On Sun, Apr 14, 2013 at 9:10 PM, aaron morton wrote: > Hmmm, what is the recommendation for a 10G network if 1G was 300G to > 500GŠI am guessing I can't do 10 ti

Re: running cassandra on 8 GB servers

2013-04-14 Thread aaron morton
> Hmmm, what is the recommendation for a 10G network if 1G was 300G to > 500GŠI am guessing I can't do 10 times that, correct? But maybe I could > squeak out 600G to 1T? Best thing to do would be run a test on how long it takes to repair or bootstrap a node. The 300GB to 500Gb was just a guidelin

Re: running cassandra on 8 GB servers

2013-04-14 Thread aaron morton
> ERROR [Thrift:641] 2013-04-11 11:25:19,563 CassandraDaemon.java (line 164) > Exception in thread Thread[Thrift:641,5,main] > java.lang.OutOfMemoryError: Java heap space It's easier for people to help if you provide the error stack. Does this happen at startup or after it has been running for a

Re: running cassandra on 8 GB servers

2013-04-12 Thread Hiller, Dean
Hmmm, what is the recommendation for a 10G network if 1G was 300G to 500GŠI am guessing I can't do 10 times that, correct? But maybe I could squeak out 600G to 1T? Thanks, Dean On 4/11/13 2:26 PM, "aaron morton" wrote: >> The data will be huge, I am estimating 4-6 TB per server. I know this >>

Re: running cassandra on 8 GB servers

2013-04-11 Thread Nikolay Mihaylov
I am using 1.2.3, used default heap - 2 GB without JNA installed, then modified heap to 4 GB / 400 MB young generation. + JNA installed. bloom filter on the CF's is lowered (more false positives, less disk space). WARN [ScheduledTasks:1] 2013-04-11 11:09:41,899 GCInspector.java (line 142) Heap is

Re: running cassandra on 8 GB servers

2013-04-11 Thread Edward Capriolo
With that much data per node you have to raise the IndexInterval and adjust the bloom filter settings. Although the bloom filters are off heap now having that much data can but a strain on physical memory. On Thu, Apr 11, 2013 at 4:26 PM, aaron morton wrote: > > The data will be huge, I am estim

Re: running cassandra on 8 GB servers

2013-04-11 Thread aaron morton
> The data will be huge, I am estimating 4-6 TB per server. I know this is > best, but those are my resources. You will have a very unhappy time. The general rule of thumb / guideline for a HDD based system with 1G networking is 300GB to 500Gb per node. See previous discussions on this topic fo

running cassandra on 8 GB servers

2013-04-11 Thread Nikolay Mihaylov
For one project I will need to run cassandra on following dedicated servers: Single CPU XEON 4 cores no hyper-threading, 8 GB RAM, 12 TB locally attached HDD's in some kind of RAID, visible as single HDD. I can do cluster of 20-30 such servers, may be even more. The data will be huge, I am estim