Re: How to store unique visitors in cassandra

2015-04-01 Thread Jim Ancona
Very interesting. I had saved your email from three years ago in hopes of an elegant answer. Thanks for sharing! Jim On Tue, Mar 31, 2015 at 8:16 AM, Alain RODRIGUEZ wrote: > People keep asking me if we finally found a solution (even if this is 3+ > years old) so I will just update this thread

Re: How to store unique visitors in cassandra

2015-03-31 Thread Alain RODRIGUEZ
Hi Laing, I think you answered the wrong mail =). This one is around UV on custom range model. But I am happy that you agree on my last message about the Datacenter switch. C*heers 2015-03-31 16:29 GMT+02:00 Laing, Michael : > We use Alain's solution as well to make major operational revisions

Re: How to store unique visitors in cassandra

2015-03-31 Thread Laing, Michael
We use Alain's solution as well to make major operational revisions. We have a "red team" and a "blue team in each AWS region, so we just add and drop datacenters to get where we want to be. Pretty simple. ml On Tue, Mar 31, 2015 at 8:16 AM, Alain RODRIGUEZ wrote: > People keep asking me if w

Re: How to store unique visitors in cassandra

2015-03-31 Thread Alain RODRIGUEZ
People keep asking me if we finally found a solution (even if this is 3+ years old) so I will just update this thread with our findings. We finally achieved doing this thanks to our bigdata and reporting stacks by storing blobs corresponding to HLL (HyperLogLog) structures. HLL is an algorithm use

Re: How to store unique visitors in cassandra

2012-01-19 Thread Milind Parikh
You might want to look at the code in countandra.org; regardless of whether you use it. It use a model of dynamic composite keys (although static composite keys would have worked as well). For the actual query,only one row is hit. This of course only works bc the data model is attuned for the query

Re: How to store unique visitors in cassandra

2012-01-19 Thread Tyler Hobbs
On Thu, Jan 19, 2012 at 8:25 AM, Alain RODRIGUEZ wrote: > > I'm still in the dark about how to get the number of unique visitors > between 2 dates (randomly chosen, because chosen by user) efficiently. > > I could easily count them per hour, day, week, month... But it's a bit > harder to give thi

Re: How to store unique visitors in cassandra

2012-01-19 Thread Alain RODRIGUEZ
Thanks aaron, I already paid attention to these slides and I just looked at them again. I'm still in the dark about how to get the number of unique visitors between 2 dates (randomly chosen, because chosen by user) efficiently. I could easily count them per hour, day, week, month... But it's a bi

Re: How to store unique visitors in cassandra

2012-01-19 Thread aaron morton
Some tips here from Matt Dennis on how to model time series data http://www.slideshare.net/mattdennis/cassandra-nyc-2011-data-modeling Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/01/2012, at 10:30 PM, Alain RODRIGUEZ wrote: > Hi than

Re: How to store unique visitors in cassandra

2012-01-19 Thread Alain RODRIGUEZ
Hi thanks for your answer but I don't want to add more layer on top of Cassandra. I also have done all of my application without Countandra and I would like to continue this way. Furthermore there is a Cassandra modeling problem that I would like to solve, and not just hide. Alain 2012/1/18 Luca

Re: How to store unique visitors in cassandra

2012-01-18 Thread Lucas de Souza Santos
Why not http://www.countandra.org/ Lucas de Souza Santos (ldss) On Wed, Jan 18, 2012 at 3:23 PM, Alain RODRIGUEZ wrote: > I'm wondering how to modelize my CFs to store the number of unique > visitors in a time period in order to be able to request it fast. > > I thought of sharding them by da

How to store unique visitors in cassandra

2012-01-18 Thread Alain RODRIGUEZ
I'm wondering how to modelize my CFs to store the number of unique visitors in a time period in order to be able to request it fast. I thought of sharding them by day (row = 20120118, column = visitor_id, value = '') and perform a getcount. This would work to get unique visitors per day, per week