Re: How do secondary indices work

2011-02-09 Thread Jonathan Ellis
"Iterating through all of the rows matching an index clause on your cluster is guaranteed to touch N/RF of the nodes in your cluster, because each node only knows about data that is indexed locally." On Wed, Feb 9, 2011 at 9:13 AM, wrote: > One more question: does each node keep an index of thei

Re: How do secondary indices work

2011-02-09 Thread altanis
One more question: does each node keep an index of their own values, or is the index global? Alexander > Thank you very much, this is the information I was looking for. I started > adding secondary index functionality to Cassandra myself, and it turns out > I am doing almost exactly the same thin

Re: How do secondary indices work

2011-02-09 Thread altanis
Thank you very much, this is the information I was looking for. I started adding secondary index functionality to Cassandra myself, and it turns out I am doing almost exactly the same thing. I will try to change my code to use your implementation as well to compare results. Alexander > Alexander:

Re: How do secondary indices work

2011-02-09 Thread Stu Hood
Alexander: The secondary indexes in 0.7.0 (type KEYS) are stored internally in a column family, and are kept synchronized with the base data via locking on a local node, meaning they are always consistent on the local node. Eventual consistency still applies between nodes, but a returned result wi

Re: How do secondary indices work

2011-02-09 Thread altanis
Thank you for the links, I did read a bit in the comments of the ticket, but I couldn't get much out of it. I am mainly interested in how the index is stored and partitioned, not how it is used. I think the people in the dev list will probably be better qualified to answer that. My questions alway

Re: How do secondary indices work

2011-02-09 Thread altanis
Thank you for the reply, although I didn't quite understand you. All I got was that Index data is stored in some kind of external data structure. Alexander > > On Feb 8, 2011, at 21:23, Aaron Morton wrote: > 1) Is data stored in some external data structure, or is it stored in an a

Re: How do secondary indices work

2011-02-09 Thread Timo Nentwig
On Feb 8, 2011, at 21:23, Aaron Morton wrote: >>> 1) Is data stored in some external data structure, or is it stored in an >>> actual Cassandra table, as columns within column families? Yes. Own files next to the CF files and own node IndexColumnFamilies in JMX. And they are built asynchronousl

Re: How do secondary indices work

2011-02-08 Thread Aaron Morton
AFAIK this was the ticket the original work was done under https://issues.apache.org/jira/browse/CASSANDRA-1415also  http://www.datastax.com/docs/0.7/data_model/secondary_indexesand  http://pycassa.github.com/pycassa/tutorial.html#indexes may help(sorry on reflection the email prob did not need to

Re: How do secondary indices work

2011-02-08 Thread Aaron Morton
Moving to the user group.On 08 Feb, 2011,at 11:39 PM, alta...@ceid.upatras.gr wrote:Hello, I'd like some information about how secondary indices work under the hood. 1) Is data stored in some external data structure, or is it stored in an actual Cassandra table, as columns within column families?