Re: Queuing System

2014-02-23 Thread Edward Capriolo
> > Jagan > > Queue-like data structures are known to be one of the worst anti > patterns for Cassandra: > http://www.datastax.com/dev/blog/cassandra-anti-patterns-queues-and-queue-like-datasets > > > > On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan wrote: >

Re: Queuing System

2014-02-23 Thread Jagan Ranganathan
Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries that were considered along wi

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
sed from the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries that were considered along with the limitation I see, Redis - Data Loss

Re: Queuing System

2014-02-22 Thread Joe Stein
, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan wrote: > Hi, > > I need to decouple some of the work being processed from the user thread to > provide better user experience. For that I need a > queuing system with the following needs, > High Availability > No Data

Re: Queuing System

2014-02-22 Thread thunder stumpges
This seems a bit overkill. We run far more than 100mps (closer to 600) in rabbit with very good latency on a 3 node cluster. It has been very reliable as well. Thunder - Reply message - From: "Jagan Ranganathan" To: Subject: Queuing System Date: Sat, Feb 22, 2014 9:06

Re: Queuing System

2014-02-22 Thread thunder stumpges
We use this same setup also and it works great. Thunder - Reply message - From: "Laing, Michael" To: Subject: Queuing System Date: Sat, Feb 22, 2014 7:31 AM We use RabbitMQ for queuing and Cassandra for persistence. RabbitMQ with clustering and/or federation should meet

Re: Queuing System

2014-02-22 Thread DuyHai Doan
e-like-datasets > > > > On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan wrote: > > Hi, > > I need to decouple some of the work being processed from the user thread > to provide better user experience. For that I need a queuing system with > the following needs

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
;ja...@zohocorp.com> wrote: Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
v/blog/cassandra-anti-patterns-queues-and-queue-like-datasets On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a qu

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
/dev/blog/cassandra-anti-patterns-queues-and-queue-like-datasets On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan <ja...@zohocorp.com> wrote: Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I

Re: Queuing System

2014-02-22 Thread Joe Stein
r Cassandra: > http://www.datastax.com/dev/blog/cassandra-anti-patterns-queues-and-queue-like-datasets > > > > On Sat, Feb 22, 2014 at 4:03 PM, Jagan Ranganathan wrote: > Hi, > > I need to decouple some of the work being processed from the user thread to > provid

Re: Queuing System

2014-02-22 Thread Jagan Ranganathan
the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries that were considered along with the limitation I see, Redis - Data Loss ZooKeeper - Not advise

Re: Queuing System

2014-02-22 Thread Tupshin Harper
scussing appropriate data-models and access patterns if you decide to go down this path. -Tupshin On Sat, Feb 22, 2014 at 10:03 AM, Jagan Ranganathan wrote: > Hi, > > I need to decouple some of the work being processed from the user thread > to provide better user experience. For t

Re: Queuing System

2014-02-22 Thread Laing, Michael
user thread >> to provide better user experience. For that I need a queuing system with >> the following needs, >> >>- High Availability >>- No Data Loss >>- Better Performance. >> >> Following are some libraries that were considered alon

Re: Queuing System

2014-02-22 Thread DuyHai Doan
ork being processed from the user thread > to provide better user experience. For that I need a queuing system with > the following needs, > >- High Availability >- No Data Loss >- Better Performance. > > Following are some libraries that were considered

Queuing System

2014-02-22 Thread Jagan Ranganathan
Hi, I need to decouple some of the work being processed from the user thread to provide better user experience. For that I need a queuing system with the following needs, High Availability No Data Loss Better Performance. Following are some libraries that were considered along with the