RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
duh, sorry. That estimate is 2 TB would be 15 nodes rf = 3 From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Friday, December 07, 2012 7:15 AM To: user@cassandra.apache.org Subject: RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. So if my calculations

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Hiller, Dean
elastpickle.com] Sent: Thursday, December 06, 2012 9:43 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Meaning terabyte size databases. Lots of people have TB sized systems. Just add

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-07 Thread Poziombka, Wade L
de From: aaron morton [mailto:aa...@thelastpickle.com<mailto:aa...@thelastpickle.com>] Sent: Wednesday, December 05, 2012 9:23 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Basically we w

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Michael Kjellman
red to recover downed node. > But this 300-400MB business is interesting to me. > > > > Thanks in advance. > > > > Wade > > > > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Wednesday, December 05, 2012 9:23 PM > To: user@ca

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Wei Zhu
I think Aaron meant 300-400GB instead of 300-400MB. Thanks. -Wei - Original Message - From: "Wade L Poziombka" To: user@cassandra.apache.org Sent: Thursday, December 6, 2012 6:53:53 AM Subject: RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. “

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread aaron morton
; > Wade > > > > From: aaron morton [mailto:aa...@thelastpickle.com] > Sent: Wednesday, December 05, 2012 9:23 PM > To: user@cassandra.apache.org > Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered > compaction. > > > > Basically we were

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Edward Capriolo
dnesday, December 05, 2012 9:23 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered > compaction. > > ** ** > > Basically we were successful on two of the nodes. They both took ~2 days > and 11 hours to compl

RE: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread Poziombka, Wade L
12 9:23 PM To: user@cassandra.apache.org Subject: Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction. Basically we were successful on two of the nodes. They both took ~2 days and 11 hours to complete and at the end we saw one very large file ~900GB and the rest much sm

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-05 Thread aaron morton
> Basically we were successful on two of the nodes. They both took ~2 days and > 11 hours to complete and at the end we saw one very large file ~900GB and the > rest much smaller (the overall size decreased). This is what we expected! I would recommend having up to 300MB to 400MB per node on a re

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-05 Thread Alexandru Sicoe
Hi guys, Sorry for the late follow-up but I waited to run major compactions on all 3 nodes at a time before replying with my findings. Basically we were successful on two of the nodes. They both took ~2 days and 11 hours to complete and at the end we saw one very large file ~900GB and the rest muc

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread aaron morton
> From what I know having too much data on one node is bad, not really sure > why, but I think that performance will go down due to the size of indexes > and bloom filters (I may be wrong on the reasons but I'm quite sure you can't > store too much data per node). If you have many hundreds of

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread Alain RODRIGUEZ
Hi Alexandru, "We are running a 3 node Cassandra 1.1.5 cluster with a 3TB Raid 0 disk per node for the data dir and separate disk for the commitlog, 12 cores, 24 GB RAM" I think you should tune your architecture in a very different way. From what I know having too much data on one node is bad, no

Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread Alexandru Sicoe
Hello everyone, We are running a 3 node Cassandra 1.1.5 cluster with a 3TB Raid 0 disk per node for the data dir and separate disk for the commitlog, 12 cores, 24 GB RAM (12GB to Cassandra heap). We now have 1.1 TB worth of data per node (RF = 2). Our data input is between 20 to 30 GB per day, d