Re: Roadmap of Cassandra

2010-06-20 Thread Benjamin Black
https://issues.apache.org/jira/browse/CASSANDRA/fixforversion/12314533 On Sun, Jun 20, 2010 at 7:30 PM, Anthony Ikeda < anthony.ik...@cardlink.com.au> wrote: > Is there such a thing? Where might I be able to see what is planned for > Cassandra. > > > > > > Anthony Ikeda > > Java Analyst/Programm

Roadmap of Cassandra

2010-06-20 Thread Anthony Ikeda
Is there such a thing? Where might I be able to see what is planned for Cassandra. Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283 *

Re: django or pylons

2010-06-20 Thread S Ahmed
aren't you guys using django though? :) On Sun, Jun 20, 2010 at 7:40 PM, Joe Stump wrote: > A lot of the magic that Django brings to the table is derived from the ORM. > If you're skipping that then Pylons likely makes more sense. > > --Joe > > On Jun 20, 2010, at 5:08 PM, Charles Woerner > wro

Re: django or pylons

2010-06-20 Thread Joe Stump
A lot of the magic that Django brings to the table is derived from the ORM. If you're skipping that then Pylons likely makes more sense. --Joe On Jun 20, 2010, at 5:08 PM, Charles Woerner wrote: > I recently looked into this and came to the same conclusion, but I'm not an > expert in either

Re: django or pylons

2010-06-20 Thread Charles Woerner
I recently looked into this and came to the same conclusion, but I'm not an expert in either Django or Pylons so I'd also be interested in hearing what someone with more Python experience would say. On Sun, Jun 20, 2010 at 1:42 PM, S Ahmed wrote: > Seeing as I will be using a different ORM, woul

Re: Atomic Compare and Swap

2010-06-20 Thread Benjamin Black
No. On Sun, Jun 20, 2010 at 2:42 PM, Rishi Bhardwaj wrote: > Hi > I was wondering if Cassandra has any plans for supporting atomic compare and > swap operation on a column value? Compare could be on timestamp for the > column or the column value itself and the write of course is on the column > v

Atomic Compare and Swap

2010-06-20 Thread Rishi Bhardwaj
Hi I was wondering if Cassandra has any plans for supporting atomic compare and swap operation on a column value? Compare could be on timestamp for the column or the column value itself and the write of course is on the column value + a new timestamp. If there are no plans on supporting such an

Re: Instability and memory problems

2010-06-20 Thread James Golick
I opened #1214 about this. I hope people will take a look and provide their feedback. https://issues.apache.org/jira/browse/CASSANDRA-1214 Thanks. On Sun, Jun 20, 2010 at 3:58 PM, James Golick wrote: > uh. wow. I just read up on all this again, and read the code, and I'm a > little surprised,

django or pylons

2010-06-20 Thread S Ahmed
Seeing as I will be using a different ORM, would it make more sense to use pylons over django? >From what I understand, pylons assumes less as compared to django.

RE: Lucandra issues

2010-06-20 Thread Carlos Sanchez
Jake, I will be interested in this functionality Carlos From: Jake Luciani [jak...@gmail.com] Sent: Friday, June 18, 2010 10:57 PM To: user@cassandra.apache.org Subject: Re: Lucandra issues Hi Maxim, Lucandra doesn't support numeric queries quite yet. A

Re: Thrift Client on Ruby, does it need compiled bindings? (or anything else to make it faster?)

2010-06-20 Thread Christian van der Leeden
Hi Thomas, my tests show that it is not only an issue with inserts but also with gets, so importer or not, the ruby client is not the fastest on earth... And my app is RoR, so I'm stuck to using ruby (not that I don't like it...) Christian On Jun 20, 2010, at 8:34 PM, Thomas Heller wrot

Re: Instability and memory problems

2010-06-20 Thread James Golick
uh. wow. I just read up on all this again, and read the code, and I'm a little surprised, to be honest. There's no attempt to manage the total size of the mmap()'d IO, and the default buffer allocation is quite sizeable. So, basically, if you have any data, over time, you will run out of memory, a

Re: Instability and memory problems

2010-06-20 Thread James Golick
Thanks for your thoughts. Answers below: On Sun, Jun 20, 2010 at 2:21 PM, Peter Schuller wrote: > > The memory problems I've posted about before have gotten much worse and > our > > nodes are becoming incredibly slow/unusable every 24 hours or so. > Basically, > > the JVM reports that only 14GB

Re: Thrift Client on Ruby, does it need compiled bindings? (or anything else to make it faster?)

2010-06-20 Thread Thomas Heller
Hey there, I saw the same thing and it worried me a little bit, but honestly its just ONE core of your CPU capping out. You could either add some threading to your insert script, or just spin up another process and see your insert rate nearly double. Although C might add some speed, I found that i

Re: Thrift Client on Ruby, does it need compiled bindings? (or anything else to make it faster?)

2010-06-20 Thread Benjamin Black
Only one: don't use it if you want performance. On Sun, Jun 20, 2010 at 11:11 AM, Christian van der Leeden wrote: > Hi, > >        I'm just experimenting and benchmarking cassandra for my use case. > I'm using the fauna/cassandra and fauna/thrift_client. Is there a C or any > other form of non-ru

Re: Instability and memory problems

2010-06-20 Thread Peter Schuller
> The memory problems I've posted about before have gotten much worse and our > nodes are becoming incredibly slow/unusable every 24 hours or so. Basically, > the JVM reports that only 14GB is committed, but the RSS of the process is > 22GB, and cassandra is completely unresponsive, but still havin

Thrift Client on Ruby, does it need compiled bindings? (or anything else to make it faster?)

2010-06-20 Thread Christian van der Leeden
Hi, I'm just experimenting and benchmarking cassandra for my use case. I'm using the fauna/cassandra and fauna/thrift_client. Is there a C or any other form of non-ruby library that would speed up the ruby part of the thrift client? In my tests (inserting 1000 new columns 250 times into

bulk loading

2010-06-20 Thread Torsten Curdt
I am trying to get the bulk loading example to work for simple CF. List columnFamilies = new LinkedList(); while(...) { String[] fields = ... ColumnFamily columnFamily = ColumnFamily.create(keyspace, family); long now = System.currentTimeMillis(); for (i

unsubscribe

2010-06-20 Thread Sébastien MORATINOS
unsubscribe

Re: Instability and memory problems

2010-06-20 Thread Ran Tavory
I don't have the answer but if you provide jmap output, cfstats output that may help. Are you using mmap files? Do you see swap? Gc in the logs? On Jun 20, 2010 7:25 PM, "James Golick" wrote: As I alluded to in another post, we just moved from 2-4 nodes. Since then, the cluster has been incredib

Instability and memory problems

2010-06-20 Thread James Golick
As I alluded to in another post, we just moved from 2-4 nodes. Since then, the cluster has been incredibly The memory problems I've posted about before have gotten much worse and our nodes are becoming incredibly slow/unusable every 24 hours or so. Basically, the JVM reports that only 14GB is comm

Re: Uneven distribution using RP

2010-06-20 Thread James Golick
I know, but that's not a big enough difference to warrant the huge amount of difference in load. On Sun, Jun 20, 2010 at 10:53 AM, Jordan Pittier - Rezel wrote: > Node 1 should have token 42535295865117307932921825928971026432 and node > 3 127605887595351923798765477786913079296 according to the

Re: Uneven distribution using RP

2010-06-20 Thread Jordan Pittier - Rezel
Node 1 should have token 42535295865117307932921825928971026432 and node 3 127605887595351923798765477786913079296 according to the formula i * (2**127 / 4) for i=1..4 On Sun, Jun 20, 2010 at 4:31 PM, James Golick wrote: > I ran cleanup on all of them and the distribution looked roughly even aft

Re: Uneven distribution using RP

2010-06-20 Thread James Golick
I ran cleanup on all of them and the distribution looked roughly even after that, but a couple of days later, it's looking pretty uneven. On Sun, Jun 20, 2010 at 10:21 AM, Jordan Pittier - Rezel wrote: > Hi, > Have you tried nodetool repair (or cleanup) on your nodes ? > > > On Sun, Jun 20, 2010

Re: Uneven distribution using RP

2010-06-20 Thread Jordan Pittier - Rezel
Hi, Have you tried nodetool repair (or cleanup) on your nodes ? On Sun, Jun 20, 2010 at 4:16 PM, James Golick wrote: > I just increased my cluster from 2 to 4 nodes, and RF=2 to RF=3, using RP. > > The tokens seem pretty even on the ring, but two of the nodes are far more > heavily loaded than t

Re: Problem with Deletes

2010-06-20 Thread Jonathan Ellis
"major compaction" = manually invoked compact-all-sstables you're seeing "minor compactions" which are done automatically but cannot remove tombstones On Sun, Jun 20, 2010 at 3:21 AM, Amir wrote: > Benjamin Black b3k.us> writes: > >> >> http://wiki.apache.org/cassandra/DistributedDeletes >> >>

Uneven distribution using RP

2010-06-20 Thread James Golick
I just increased my cluster from 2 to 4 nodes, and RF=2 to RF=3, using RP. The tokens seem pretty even on the ring, but two of the nodes are far more heavily loaded than the others. I understand that there are a variety of possible reasons for this, but I'm wondering whether anybody has suggestion

Re: Learning-by-doing (also announcing a new Ruby Client Codename: "Greek Architect")

2010-06-20 Thread Thomas Heller
Hey, of course I know about http://github.com/fauna/cassandra http://github.com/nzkoz/cassandra_object and they are awesome and without them I probably would have had a much harder time learning about Cassandra since its always good to have some way to actually throw some stuff in there. The ca

Re: Problem with Deletes

2010-06-20 Thread Amir
Benjamin Black b3k.us> writes: > > http://wiki.apache.org/cassandra/DistributedDeletes > > On Thu, Jun 17, 2010 at 9:10 AM, Amir yahoo.com> wrote: > > Hi All, > > > > I'm running a benchmark on Cassandra while using a benchmark client which I've > > written myself. > > > > I'm running the fol

Re: Problem with Deletes

2010-06-20 Thread Benjamin Black
http://wiki.apache.org/cassandra/DistributedDeletes On Thu, Jun 17, 2010 at 9:10 AM, Amir wrote: > Hi All, > > I'm running a benchmark on Cassandra while using a benchmark client which I've > written myself. > > I'm running the following scenario: > One Cassandra node on the same machine as the c