Re: pagination through slices with deleted keys

2010-05-07 Thread Mike Malone
On Fri, May 7, 2010 at 5:29 AM, Joost Ouwerkerk wrote: > +1. There is some disagreement on whether or not the API should > return empty columns or skip rows when no data is found. In all of > our use cases, we would prefer skipped rows. And based on how > frequently new cassandra users appear t

Re: pagination through slices with deleted keys

2010-05-07 Thread Mark Greene
I like your idea about specifying it at the SP level. On Fri, May 7, 2010 at 8:29 AM, Joost Ouwerkerk wrote: > +1. There is some disagreement on whether or not the API should > return empty columns or skip rows when no data is found. In all of > our use cases, we would prefer skipped rows. And

Re: pagination through slices with deleted keys

2010-05-07 Thread Joost Ouwerkerk
+1. There is some disagreement on whether or not the API should return empty columns or skip rows when no data is found. In all of our use cases, we would prefer skipped rows. And based on how frequently new cassandra users appear to be confused about the current behaviour, this might be a more

Re: pagination through slices with deleted keys

2010-05-06 Thread Mike Malone
On Thu, May 6, 2010 at 3:27 PM, Ian Kallen wrote: > Cool, is this a patch you've applied on the server side? Are you running > 0.6.x? I'm wondering if this kind of thing can make it into future versions > of Cassandra. > Yea, server side. It's basically doing the same thing clients typically wan

Re: pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
Cool, is this a patch you've applied on the server side? Are you running 0.6.x? I'm wondering if this kind of thing can make it into future versions of Cassandra. -Ian On Thu, May 6, 2010 at 2:56 PM, Mike Malone wrote: > Our solution at SimpleGeo has been to hack Cassandra to (optionally, at > l

Re: pagination through slices with deleted keys

2010-05-06 Thread Mike Malone
Our solution at SimpleGeo has been to hack Cassandra to (optionally, at least) be sensible and drop Rows that don't have any Columns. The claim from the FAQ that "Cassandra would have to check if there are any other columns in the row" is inaccurate. The common case for us at least is that we're on

Re: pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
Thanks Mark, great illustration. I'm already splitting my time developing directly with hector and a vastly simplified jython wrapper around it; I guess I'll address it at some wrapping layer (patch hector or let the jython layer deal). My grumpy editorial about this stuff is that on the cassandra

Re: pagination through slices with deleted keys

2010-05-06 Thread Mark Greene
Hey Ian, I actually just wrote a quick example of how to iterate over a CF that may have tombstones. This may help you out: http://markjgreene.wordpress.com/2010/05/05/iterate-over-entire-cassandra-column-family/ On Thu, May 6, 2010 at 12:17 PM, Ian Kallen wrote: > I read the DistributedDeletes

pagination through slices with deleted keys

2010-05-06 Thread Ian Kallen
I read the DistributedDeletes and the range_ghosts FAQ entry on the wiki which do a good job describing how difficult deletion is in an eventually consistent system. But practical application strategies for dealing with it aren't there (that I saw). I'm wondering how folks implement pagination in t