Re: A Big Data Trifecta: Storm, Kafka and Cassandra

2012-08-04 Thread Philip Nelson
--- On Sat, 8/4/12, Brian O'Neill wrote: > From: Brian O'Neill > Subject: A Big Data Trifecta: Storm, Kafka and Cassandra > To: user@cassandra.apache.org > Date: Saturday, August 4, 2012, 4:41 AM > Philip, > > I figured I would reply via blog post. =) > http://brianoneill.blogspot.com/2012/08/a

Re: How to process new rows in parallel?

2012-08-03 Thread Philip Nelson
Brian -- thanks. > We were looking to do the same thing, but in the end decided > to go with Kafka. > Given your throughput requirements, Kafka might be a good > option for you as well. This might be off-topic, so I'll keep it short. Kafka is reasonably stable? Mature (I see it's in the Incubato

How to process new rows in parallel?

2012-08-03 Thread Philip Nelson
Hello, I am using a Column Family in Cassandra to store incoming messages, which arrive at a high rate (100s of thousands per second). I then have a process wake up periodically to work on those messages, and then delete them. I'd like to understand how I could have multiple processes running,