RE: boonfilters

2010-04-07 Thread Stu Hood
> 1. Is the only place boonfilters are used in Cassandra is when you want to > see if a particular key exists in a particular node? Each node stores a set of SSTables locally, each with a BloomFilter attached: the filters are used to check whether a particular SSTable contains information about a

Re: boonfilters

2010-04-07 Thread Benjamin Black
(Should mention: suggesting reading the Dynamo paper for general background, not for Bloom filters, which are fantastically covered in the Wikipedia entry). On Wed, Apr 7, 2010 at 4:11 PM, Benjamin Black wrote: > Please read this: > http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html

Re: boonfilters

2010-04-07 Thread David Strauss
On 2010-04-07 20:34, Peter Schüller wrote: > Re-sizing a bloom filter implies re-creating it from scratch. Not necessarily. Depending on your hash, you can sometimes shrink without regeneration (and without other penalties). It's also sometimes possible to enlarge the bloom filter without regenera

Re: boonfilters

2010-04-07 Thread Benjamin Black
Please read this: http://www.allthingsdistributed.com/2007/10/amazons_dynamo.html On Wed, Apr 7, 2010 at 1:27 PM, S Ahmed wrote: > Just reading up on boonfilters, few questions. > > Basically boonfilters let give you a true/false if a particular key exists, > and they *may* give you a false posit

Re: boonfilters

2010-04-07 Thread Jonathan Ellis
2010/4/7 Peter Schüller : > Someone correct me if I'm wrong, but my understanding is that the > bloom filters are only used to optimize the case of a key being > non-existent, such that you only have to go down on disk for a very > small number of requests for non-existent keys. I do not believe bl

Re: boonfilters

2010-04-07 Thread Peter Schüller
(bloomfilters, not boonfilters) Speaking in general, not specific to cassandra: > 2. Are boonfilters a fixed size, or they adjust as to the # of keys?  any > example size? Bloom filters are by their very nature lossy in the sense that you cannot determine later what you put into it. Re-sizing a

Re: boonfilters

2010-04-07 Thread Tim Estes
Bloomfilters I think is what you mean- correct? Sent from my iPhone On Apr 7, 2010, at 3:27 PM, "S Ahmed" wrote: Just reading up on boonfilters, few questions. Basically boonfilters let give you a true/false if a particular key exists, and they *may* give you a false positive i.e. they ke

boonfilters

2010-04-07 Thread S Ahmed
Just reading up on boonfilters, few questions. Basically boonfilters let give you a true/false if a particular key exists, and they *may* give you a false positive i.e. they key exists but never a false negative i.e. the key doesn't exist. The core of boonfilters is its hashing mechanism that mar

Re: Keyspace Keyspace1 doesnot exist

2010-04-07 Thread Gary Dusbabek
On Wed, Apr 7, 2010 at 05:41, shirish wrote > > and one more thing the startup message at node says : Couldn't detect any > schema definitions in local storage. I hope you've got a plan. > There exists a JMX method in StorageServiceMBean that can be used to load the schema from XML for a brand ne

Re: Keyspace Keyspace1 doesnot exist

2010-04-07 Thread shirish
Thanks Jonathan, I am cleaning up the mess :) downloading development release 0.6.0-rc1. On Wed, Apr 7, 2010 at 5:45 PM, Jonathan Ellis wrote: > this is because of https://issues.apache.org/jira/browse/CASSANDRA-44. > > you probably shouldn't be running trunk. > > On Wed, Apr 7, 2010 at 5:39 A

Re: Keyspace Keyspace1 doesnot exist

2010-04-07 Thread Jonathan Ellis
this is because of https://issues.apache.org/jira/browse/CASSANDRA-44. you probably shouldn't be running trunk. On Wed, Apr 7, 2010 at 5:39 AM, shirish wrote: > Hello , > > I just pulled the latest code from git and built it. When I ran cassandra > with the storage-conf.xml as attached which cle

Re: is there any suggestion for tuning cassandra for the best performance?

2010-04-07 Thread Mark Greene
This question is probably better served for the users list, not the dev list. JVM tuning is mainly based on the application profile. For example, if you have a lot of columns that have a decent amount of data in them, the node will require more memory to do compactions. But if you give it to much

Re: Keyspace Keyspace1 doesnot exist

2010-04-07 Thread shirish
Hello , > > I just pulled the latest code from git and built it. When I ran cassandra > with the storage-conf.xml as attached which clearly has Keyspace1, Column > family. It runs fine but when I connect using cassandra-cli and do set > Keyspace1.Standard1['foo']['bar']='abc'; it displays the messa

Keyspace Keyspace1 doesnot exist

2010-04-07 Thread shirish
Hello , I just pulled the latest code from git and built it. When I ran cassandra with the storage-conf.xml as attached which clearly has Keyspace1, Column family. It runs fine but when I connect using cassandra-cli and do set Keyspace1.Standard1['foo']['bar']='abc'; it displays the message Keyspa