Re: exporting data from Cassandra cluster

2011-12-09 Thread Jeremiah Jordan
Once you get all of the data on one machine you can then flush/drain/compact shutdown the single node and then take the data folder off that machine and back it up. Then when you get your new cassandra cluster setup you can use the sstable loader to shoot the data from the backup into the new

Re: exporting data from Cassandra cluster

2011-12-09 Thread Alexandru Dan Sicoe
Hi Jeremiah, The thing is I will send the data to a massive storage facility (I don't know what's behind the scenes) so I won't be backing up on one machine where I can install Cassandra. Does the sstable loader work just for copying data from a Cassandra cluster to somewhere on a disk where there

Re: exporting data from Cassandra cluster

2011-12-07 Thread Jeremiah Jordan
Stop your current cluster. Start a new cassandra instance on the machine you want to store your data on. Use the sstable loader to load the sstables from all of the current machines into the new machine. Run major compaction a couple times. You will have all of the data on one machine. On

Re: exporting data from Cassandra cluster

2011-12-07 Thread Maxim Potekhin
Hello Alexandru, as you probably know, my group is using Amazon S3 to permanently (or sem-permanently) park the data in CSV format, which makes it portable and we can load it into anything if needed, or analyze on its own. Just my half of a Swiss centime :) And, because the S3 option is not f

Re: exporting data from Cassandra cluster

2011-12-07 Thread Alexandru Dan Sicoe
Hi Tim, There is actully...the old HW will be decommissioned before the one arrives. In the meantime I need to store my data in another place :) I've got your suggestion of how I would've done it if I didn't have this problem. Cheers, Alex On Wed, Dec 7, 2011 at 5:47 PM, Tim Smith wrote: > Al

RE: exporting data from Cassandra cluster

2011-12-07 Thread Tim Smith
Alex, Is there a reason you don't just join new hardware to the cluster and then remove the old hardware from the cluster? That would seem like the easiest way to accomplish a hardware upgrade. Tim Smith | noc administrator O: +1 503.553.2554 M: 707.738.8132 TW: @tas50 webtrends