Re: Drawbacks of Major Compaction now that Automatic Tombstone Compaction Exists

2015-04-14 Thread Anuj Wadehra
Hi Robert, By automatic tombstone compaction, I am referring to tombstone_threshold sub property under compaction strategy in CQL. It is 0.2 by default. So what I understand from the Datastax documentation is that even if a sstable does not find sstables of similar size (STCS) , an automatic t

Re: Data migration

2015-04-14 Thread Ben Bromhead
Use SSTableloader it comes with Cassandra and is designed for moving data between clusters and is far simpler than sqoop. it "should" even work with a schema change like you described (changing columns). It would probably/definitely break if you were dropping tables. Mind you I've never tried ssta

Re: Do I need to run repair and compaction every node?

2015-04-14 Thread Robert Coli
On Mon, Apr 13, 2015 at 11:43 PM, Jeff Ferland wrote: > Just read the source and well… yup. I’m guessing now that the options are > indeed only rolling repair on each node (with -pr stopping the duplicate > work) or -st -9223372036854775808 -et 9223372036854775807 to actually cover > all ranges.

Re: Data migration

2015-04-14 Thread Prem Yadav
Look into sqoop. I believe using sqoop you can transfer data between C* clusters. I haven't tested it though. other option is to write a program to read from one cluster and write the required data to another. On Tue, Apr 14, 2015 at 12:27 PM, skrynnikov_m wrote: > Hello!!! > Need to migrate dat

Data migration

2015-04-14 Thread skrynnikov_m
Hello!!! Need to migrate data from one C* cluster to another periodically. During migration schema can change(add or remove one, two fields). Could you please suggest some tool?