Re: solandra or pig or....?

2011-06-21 Thread Mark Kerzner
Me too! I would be interested to know how such queries are done in Solandra. I would understand it if it creates a complete Lucene index of everything that's in Cassandra, and adds the text search. Then your query goes against Lucene. But if some data is found in column families in Cassandra, and

Re: What's the best approach to search in Cassandra

2011-06-15 Thread Mark Kerzner
Fri, Jun 3, 2011 at 8:07 PM, Jake Luciani wrote: > Mark, > > Check out Solandra. http://github.com/tjake/Solandra > > > On Fri, Jun 3, 2011 at 7:56 PM, Mark Kerzner wrote: > >> Hi, >> >> I need to store, say, 10M-100M documents, with each document having s

Re: Can I get all the query data back into memory?

2011-06-09 Thread Mark Kerzner
Thanks a bunch. Mark On Thu, Jun 9, 2011 at 10:26 PM, Jonathan Ellis wrote: > On Thu, Jun 9, 2011 at 9:50 PM, Mark Kerzner > wrote: > > Hi, > > when I am issuing some query, that returns a HashMap, does the whole > HashMap > > have to be in memory? > > Yes.

Re: Secondary indices with multiple conditions?

2011-06-09 Thread Mark Kerzner
; See > http://www.datastax.com/dev/blog/whats-new-cassandra-07-secondary-indexes > for an example. > > On Thu, Jun 9, 2011 at 9:53 PM, Mark Kerzner > wrote: > > Hi, > > if I am using Cassandra's secondary indices, or even if I am doing it > myself > > follow

Secondary indices with multiple conditions?

2011-06-09 Thread Mark Kerzner
Hi, if I am using Cassandra's secondary indices, or even if I am doing it myself following Ed Anuff's advice, can I do multiple slices? That is, how do I imitate a SQL query of where column_1 > 5 and column_2 < 4 and so on, up to d

Can I get all the query data back into memory?

2011-06-09 Thread Mark Kerzner
Hi, when I am issuing some query, that returns a HashMap, does the whole HashMap have to be in memory? If so, it can easily use up all memory? Is there some cursor or paging provisions? Thank you very much. Mark

What's the best approach to search in Cassandra

2011-06-03 Thread Mark Kerzner
Hi, I need to store, say, 10M-100M documents, with each document having say 100 fields, like author, creation date, access date, etc., and then I want to ask questions like give me all documents whose author is like abc**, and creation date any time in 2010 and access date in 2010-2011, and so on

Re: Cassandra and concurrent programming

2011-05-16 Thread Mark Kerzner
Thank you for a quick answer - I could impress my colleagues at the meeting :) On Mon, May 16, 2011 at 2:54 PM, Peter Schuller wrote: > > In threading, you would do an atomic "put if not present," is there such > a > > thing in Cassandra? > > No. In general, one works to avoid the need for stron

Cassandra and concurrent programming

2011-05-16 Thread Mark Kerzner
Hi, guys, what happens if I have two threads or two processes, both of which need to ask if some condition in Cassandra is fulfilled, and then, say, write the data based on that. If one receives the "no" answer and decides to write, but before he does, the other one receives the "no" answer and wr