Re: Help with migration from Thrift to CQL3 on Cassandra 2.0.10

2014-08-31 Thread Todd Nine
Jack Krupansky wrote: > You might want to take a look at Titan, a graph database that can use > Cassandra as its storage engine, and see how it does these things. > > -- Jack Krupansky > > *From:* Todd Nine > *Sent:* Sunday, August 31, 2014 11:06 AM > *To:* user@cassandr

Re: Help with migration from Thrift to CQL3 on Cassandra 2.0.10

2014-08-31 Thread Todd Nine
d, nodeType) IN ( > (uuid1, 'foo'), (uuid1, 'bar'), > (uuid2, 'foo'), (uuid2, 'bar'), > (uuid3, 'foo'), (uuid3, 'bar') > ); > > ml > > PS Of course you could boldly go to 2.1 now for a nice performance

Help with migration from Thrift to CQL3 on Cassandra 2.0.10

2014-08-30 Thread Todd Nine
Hi all, I'm working on transferring our thrift DAOs over to CQL. It's going well, except for 2 cases that both use multi get. The use case is very simple. It is a narrow row, by design, with only a few columns. When I perform a multiget, I need to get up to 1k rows at a time. I do not want t

Re: Help with batch renaming legacy sstable files

2014-06-26 Thread Todd Nine
the old naming convention. Thoughts? On Thu, Jun 26, 2014 at 10:19 AM, Robert Coli wrote: > On Wed, Jun 25, 2014 at 9:49 PM, Todd Nine wrote: >> >> I'm working on migrating some data from 1.0.x clusters to a 1.2.16 >> cluster. Part of my testing is (locally) loa

Help with batch renaming legacy sstable files

2014-06-25 Thread Todd Nine
Hey guys, I'm working on migrating some data from 1.0.x clusters to a 1.2.16 cluster. Part of my testing is (locally) loading the old 1.0 sstables into my environment in 1.2.16. Since the 1.0 days, the file format has changes from this format. [Keyspace]-[CF name]-[table number]-Data.db To t

Configuring ephemeral only column family

2013-08-16 Thread Todd Nine
Hi guys, We're using expiring columns as a mean for locking. All of this data should be completely ephemeral with only a 5 second ttl per column. We're seeing some strangeness where our rows are getting quite large with tombstones. We really don't need the commit log, nor the sstables in our u

Re: Script to load sstables from v1.0.x to v 1.1.x

2013-01-08 Thread Todd Nine
nning repair to ensure the data is distributed correctly in the ring. -- Todd Nine On Tuesday, January 8, 2013 at 12:32 PM, Michael Kjellman wrote: > I thought this was to load between separate clusters not to upgrade within > the same cluster. No? > > On Jan 8, 2013, at 11

Script to load sstables from v1.0.x to v 1.1.x

2013-01-08 Thread Todd Nine
Hi all, I have recently been trying to restore backups from a v1.0.x cluster we have into a 1.1.7 cluster. This has not been as trivial as I expected, and I've had a lot of help from the IRC channel in tackling this problem. As a way of saying thanks, I'd like to contribute the updated ruby scr

Multic DC on EC2 with no VPC

2012-03-08 Thread Todd Nine
Hi all, I've recently upgraded a test cluster from 0.8.x to 1.0.8 for testing multi data center communications. I have the following configuration file on 3 nodes in a single data center. https://gist.github.com/4671e4ae562a47f96ed2 However, when I run node tool on any of these nodes, they r

Size calculations for off heap caching

2011-10-18 Thread Todd Nine
Hi guys, We've just built a K tree implementation in cassandra. We're going for relatively "wide" nodes in our tree to minimize our tree depth and increase our search times. Most of the links between parent/child nodes are longs. We're ready to start tuning the size of K so that our most acce

Re: Input on difficult migration issue from 0.7.4 to 0.8.2

2011-08-03 Thread Todd Nine
the next compaction, and used for reads or is it ignored? Thanks, Todd On Tue, 2011-08-02 at 22:17 -0500, Jonathan Ellis wrote: > Yes, that should work. For better/worse, CF metadata is stored in the > system schema, not individual sstables. > > On Tue, Aug 2, 2011 at 10:00 PM, Tod

Secondary indexing and order clauses

2011-08-02 Thread Todd Nine
Hi guys, Now that dynamic composite have been introduced as part of cassandra core, has any thought been given to implementing "order by" semantics to secondary indexing? The dynamic composite allows asc/desc order sorting of each component in the composite, allowing for mixed asc/desc order in

Re: Input on difficult migration issue from 0.7.4 to 0.8.2

2011-08-02 Thread Todd Nine
files after redefining the schema? > > On Tue, Aug 2, 2011 at 8:06 PM, Todd Nine wrote: > > Hi all, > > I seem to have backed myself into a corner and I cannot easily upgrade > > from a custom 0.7.4 installation to the default 0.8.2. Any help I could get > > would be

Input on difficult migration issue from 0.7.4 to 0.8.2

2011-08-02 Thread Todd Nine
Hi all, I seem to have backed myself into a corner and I cannot easily upgrade from a custom 0.7.4 installation to the default 0.8.2. Any help I could get would be greatly appreciated. Below is an outline of the problem. Current installation: 0.7.4 with Ed Anuff's custom composite comparators.

Re: Invalid token errors when all nodes appear to have tokens.

2011-01-23 Thread Todd Nine
It sure seems to think it's using OPP and not BOP... > > On Sun, Jan 23, 2011 at 11:22 PM, Todd Nine wrote: > > Hi all, > > I'm getting some strange invalid token errors. I'm on Cassandra > 0.7.0. > > Using the JMX console, each node has a valid tok

Invalid token errors when all nodes appear to have tokens.

2011-01-23 Thread Todd Nine
Hi all, I'm getting some strange invalid token errors. I'm on Cassandra 0.7.0. Using the JMX console, each node has a valid token. Also, each node shows as a live node in the cluster. Any ideas why I'm getting this error? I've restarted the entire cluster and I can't seem to resolve the pro

Re: cassandra for a inbox search with high reading qps

2010-08-30 Thread Todd Nine
We use Lucandra as well for searching for users, as well as geo-encoding. It really works well except for numeric fields. https://issues.apache.org/jira/browse/CASSANDRA-1235 That bug may be a bit of an issue, but after they release 0.6.5 all the Lucene functionality will be available to you. T

Re: Running code on pelops

2010-06-28 Thread Todd Nine
http://code.google.com/p/pelops/ On 27 June 2010 01:11, GH wrote: > Still looking for Hector and Thrift code, but took some time on pelops... > I am currently trying the pelops code base, I could not get the code from > svn in google with the path supplied on the site. I downloaded the jar file

sstable2json and key ordering

2010-06-25 Thread Todd Nine
Hi all, I'm having a lot of problems getting Lucandra to correctly handle numeric document fields. After examining the keys it has written to the CF, I believe it may be an issue of column ordering by bytes. After dumping the CF with the test data using sstable2json, the keys are in opposite o

Re: hector or pelops

2010-06-25 Thread Todd Nine
I like both. Personally, I have switched from Hector to Pelops. Let me be clear, this is not because Hector is not a good client. Ran has done an excellent job with Hector, and it was what I initially used for my plugin. I preferred Pelops for my Datanucleus plugin since it requires slightly le

Re: Questions regarding batch mutates and transactions

2010-05-27 Thread Todd Nine
Correct Ran. It seems like the only way I'm going to get true mutations in a single op is to use Cages. Thankfully a majority of our application won't require it, just a few specialized components. On Wed, 2010-05-26 at 12:57 +0300, Ran Tavory wrote: > The summary of your question is: is batch_

Questions regarding batch mutates and transactions

2010-05-26 Thread Todd Nine
Hey guys, I originally asked this on the Hector group, but no one was sure of the answer. Can I get some feedback on this. I'd prefer to avoid having to use something like Cages if I can for most of our use cases. Long term I can see we'll need to use something like Cages, especially when it c

Questions regarding network topography and automated adminstration

2010-04-09 Thread Todd Nine
Hi all, First off, thanks for putting out such a great product and documentation. I had a node up and running on CentOs in 10 minutes, and had our C# app communicating with it in 10 more! Now that I have basic prototyping working, I have a few networking and data center configurations. We will