Re: bad behavior of my Cassandra cluster

2010-08-03 Thread Mingfan Lu
I think you can download the log files now. I am using mmap, at the same time, I use hugepages, so that the jvm heap won't be swapped out, I also swapoff my swap partition According to the https://issues.apache.org/jira/browse/CASSANDRA-1214. I enlarge the memtable threshold I want to reduce the fr

Bootstrap looks like stopping after 2 min into cluster, 2B records.

2010-08-03 Thread Ken Matsumoto
Hi all, I just tried to bootstrap a new server into an existed cluster of 3 servers. Set up a bootstrapping mode on a new server, I put it in a cluster. After 1'30" + 30"sleep I ran "nodetool cleanup" on neighbour servers, and saw the status with "nodetool streams". But the result was "not sen

Re: what causes MESSAGE-DESERIALIZER-POOL to spike

2010-08-03 Thread Dathan Pattishall
The output of htop shows threads as procs with a breakdown of how much cpu /etc per thread (in ncurses color!). All of these Java "procs" are just Java threads of only 1 instance of Cassandra per Server. On Sat, Jul 31, 2010 at 3:45 PM, Benjamin Black wrote: > Sorry, I just noticed: are you runn

Re: bad behavior of my Cassandra cluster

2010-08-03 Thread Aaron Morton
Just guessing here, but your mem table settings are very high compared to the defaults (64MB and 0.3 Million). It may be that flushing 1GB of mem table data is taking a while. You may also want to look at the  FlushDataBufferSizeInMB and FlushIndexBufferSizeInMB settings in storage-conf.xml.Is the

bad behavior of my Cassandra cluster

2010-08-03 Thread Mingfan Lu
Hi, I have a 4-node cassandra cluster. And I find when the 4 nodes are flushing memtable and gc at the very similar moment, the throughput will drop and latency will increase rapidly and the nodes are dead and up frequently You could download the IOPS variance of data disk (sda here) and sy

Re: what is the expected result of changing this in storage.conf

2010-08-03 Thread Dathan Pattishall
Thanks for the link but that doesn't answer my question. I happen to know quite allot about tuning Linux/Solaris/*NIX. I'm trying to figure out the limits in cassandra, when it breaks, and why. So, anyone know of or published benchmarks on messing with these values? On Tue, Aug 3, 2010 at 7:08 PM

Re: what is the expected result of changing this in storage.conf

2010-08-03 Thread Jonathan Ellis
You need to find out where your bottleneck is, before you start trying to mitigate it. Some good first steps are at http://spyced.blogspot.com/2010/01/linux-performance-basics.html On Tue, Aug 3, 2010 at 9:03 PM, Dathan Pattishall wrote: > Do reads at high concurrency get a boost if I where to r

Re: Two questions : Server crash during compaction and UnavailableException

2010-08-03 Thread Ilun Ahn
You're right... I missed posting crash log. I was too busy and under press of business at that time. Please understand. These are head and tail of the JVM crash log when it stopped : --- T H R E A D --- Current thread (0x002ca9903400): JavaThread "COMPACTION-POOL:1

what is the expected result of changing this in storage.conf

2010-08-03 Thread Dathan Pattishall
Do reads at high concurrency get a boost if I where to raise this value? 8 32 Any benchmarks/reports showing a good sweet spot per CPU core?

Re: [RELEASE] 0.6.4

2010-08-03 Thread Clint Byrum
FYI, the Cassandra Ubuntu PPA has been updated to v0.6.4 Please see https://launchpad.net/~cassandra-ubuntu/+archive/stable For more information. On Jul 30, 2010, at 10:02 PM, Eric Evans wrote: > > Another month and the 0.6 branch is a month better. The 0.6.4 release > has a number of import

Re: Graceful restart

2010-08-03 Thread Aaron Morton
Under 0.6.* you need to alter the storage-conf.xml and restart the node. You can do this as a rolling restart in the cluster. Under 0.7* you can make dynamic changes to the storage config through the API. If your experimenting perhaps you could grab the source code for 0.7 and give it a try. I thin

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-03 Thread Brandon Williams
On Fri, Jul 30, 2010 at 9:58 AM, osishkin osishkin wrote: > I'm talking about the James Golick plugin. I followed the > instructions, and got nowhere. > http://github.com/jamesgolick/cassandra-munin-plugins > I saw in the mailing list that other people successfully got it to work > > I'm pretty su

RE: unable to start cassandra

2010-08-03 Thread Maciej Lisowski
I've got standard storage config from Cassandra package, all directories exists with properly permissions. Maciek From: atin sood [mailto:atins...@gmail.com] Sent: Tuesday, August 03, 2010 4:59 PM To: user@cassandra.apache.org Subject: Re: unable to start cassandra I am not sure but c

Graceful restart

2010-08-03 Thread Mark
We just started using Cassandra 0.6.4 yesterday for simple logging of a particular action. This is pretty much experimental for us at this stage so we only have 1 node up and running (no gasps please). My question is how can I add another column family (ie alter storage-conf.xml) without disrup

Re: Very slow reads - connected to TBufferedTransport buffer sizes

2010-08-03 Thread Dave Gardner
Yes this is the issue. Thanks. Dave On Tuesday, August 3, 2010, Jonathan Ellis wrote: > Sounds like https://issues.apache.org/jira/browse/THRIFT-638, where > Arya Goudarzi posted a patch. > > On Tue, Aug 3, 2010 at 5:18 AM, Dave Gardner wrote: >> Hi all >> >> I'm working on a PHP/Cassandra appl

RE: kundera: Open source JPA 1.0 compliant ORM for Cassandra

2010-08-03 Thread Ashwin Jayaprakash
Something like http://carbonado.sourceforge.net/index.html Carbonado would also be cool. I'm not sure how JPA's relations would work on a de-normalized form like Cassandra. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Chirper-Open-source-NET

RE: kundera: Open source JPA 1.0 compliant ORM for Cassandra

2010-08-03 Thread Ashwin Jayaprakash
Does the JPA adapter affect performance? It would be nice to see what overhead (if any) it adds. Looks cool though! -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Chirper-Open-source-NET-webapp-with-Cassandra-backend-tp5358052p5369266.html Sent

Re: Server takes a long time to answer

2010-08-03 Thread Jean-Yves LEBLEU
Thanks for the anwser. We started cassandra with 1 Gbyte of memory ... but on a machine with only 256 Mbytes of memory. Seems that it was the problem. We added memory on the server and it seems to be better. Regards. Jean-Yves On Mon, Aug 2, 2010 at 9:31 PM, Jonathan Ellis wrote: > Sounds a

Re: Avro Runtime Exception Bad Index

2010-08-03 Thread Stu Hood
Thanks for the report Arya! I've opened https://issues.apache.org/jira/browse/CASSANDRA-1351 to take care of this. -Original Message- From: "Arya Goudarzi" Sent: Friday, July 30, 2010 5:17pm To: user@cassandra.apache.org Cc: stu.h...@rackspace.com Subject: Re: Avro Runtime Exception Bad

Re: when should new nodes be added to a cluster

2010-08-03 Thread Artie Copeland
Thanx for the insight On Mon, Aug 2, 2010 at 4:48 PM, Benjamin Black wrote: > you have insufficient i/o bandwidth and are seeing reads suffer due to > competition from memtable flushes and compaction. adding additional > nodes will help some, but i recommend increasing the disk i/o > bandwidth,

Re: unable to start cassandra

2010-08-03 Thread Edward Capriolo
On Tue, Aug 3, 2010 at 11:44 AM, Edward Capriolo wrote: > On Tue, Aug 3, 2010 at 10:47 AM, Maciej Lisowski > wrote: >> Hi all, >> >> I’m new here and new with Cassandra and I’ve got problem to run it (v. >> 0.6.4) with jdk1.6.0_21. >> >> When I type “cassandra” to run it I get error: >> >> >> >>

Re: unable to start cassandra

2010-08-03 Thread Edward Capriolo
On Tue, Aug 3, 2010 at 10:47 AM, Maciej Lisowski wrote: > Hi all, > > I’m new here and new with Cassandra and I’ve got problem to run it (v. > 0.6.4) with jdk1.6.0_21. > > When I type “cassandra” to run it I get error: > > > > ERROR 16:23:53,803 Uncaught exception in thread > Thread[ROW-MUTATION-S

Re: unable to start cassandra

2010-08-03 Thread atin sood
I am not sure but can you please attach your storage.conf file.. that might help in debugging I guess s.th is messed up in the column families described in the storage conf.. did you change the storage.conf that comes with the install On Tue, Aug 3, 2010 at 8:17 PM, Maciej Lisowski wrote: > Hi

unable to start cassandra

2010-08-03 Thread Maciej Lisowski
Hi all, I'm new here and new with Cassandra and I've got problem to run it (v. 0.6.4) with jdk1.6.0_21. When I type "cassandra" to run it I get error: ERROR 16:23:53,803 Uncaught exception in thread Thread[ROW-MUTATION-STAGE:5,5,main] java.util.concurrent.ExecutionException: java.lang.Runt

Re: Very slow reads - connected to TBufferedTransport buffer sizes

2010-08-03 Thread Jonathan Ellis
Sounds like https://issues.apache.org/jira/browse/THRIFT-638, where Arya Goudarzi posted a patch. On Tue, Aug 3, 2010 at 5:18 AM, Dave Gardner wrote: > Hi all > > I'm working on a PHP/Cassandra application. Yesterday we experienced a > strange situation when testing random reads. The background t

Re: Two questions : Server crash during compaction and UnavailableException

2010-08-03 Thread Jonathan Ellis
If you have a crash log you should post at least the header rather than playing 20 questions with us. But if it's not OOM then it's likely to be a bug in the JVM, so upgrading is probably your best option. On Tue, Aug 3, 2010 at 3:49 AM, Ilun Ahn wrote: > No, I don't think the direct cause is ou

Re: Setting initial token in 0.7

2010-08-03 Thread Jonathan Ellis
As you might guess, setting initial_token in the yaml works. On Tue, Aug 3, 2010 at 3:02 AM, Viktor Jevdokimov wrote: > Hi, > > > > I’ve missed how to set initial token in 0.7 (trunk) version – there’s no > initial token in cassandra.yaml > > > > Viktor -- Jonathan Ellis Project Chair, Apache

Re: SV: Using Cassandra for storing measurement data

2010-08-03 Thread Stefan Kaufmann
Thank you very much for those impulses. I see, that I'm still thinking to much in RDMS. I'll try thoses out. Stefan On Tue, Aug 3, 2010 at 11:44 AM, Aaron Morton wrote: > As Justus said, you need to consider the way you want to get the data back > and then denormalise to suit. Do you need to sup

Re: CLI limit/count

2010-08-03 Thread David Boxenhorn
I don't have Python or Ruby. How does that work? Do I have to install one of those languages and the Cassandra client, or is there some tool that I can download? On Tue, Aug 3, 2010 at 2:52 AM, Benjamin Black wrote: > Yes, python or ruby from the command line. The CLI is not useful. > > On Mon

Re: SV: Using Cassandra for storing measurement data

2010-08-03 Thread Aaron Morton
As Justus said, you need to consider the way you want to get the data back and then denormalise to suit. Do you need to support ad-hoc queries or will you know how you want to query ahead of time?Some different approaches may beStandard CF to hold the measurements taken, grouped by day{device_id/20

Very slow reads - connected to TBufferedTransport buffer sizes

2010-08-03 Thread Dave Gardner
Hi all I'm working on a PHP/Cassandra application. Yesterday we experienced a strange situation when testing random reads. The background to this test was that we inserted 10,000 rows with simple row keys. The number of columns in each row varies between about 5 columns and 40 columns (all random)

Re: Two questions : Server crash during compaction and UnavailableException

2010-08-03 Thread Ilun Ahn
No, I don't think the direct cause is out of heap space. It didn't left any heap dump file with the option -XX:+HeapDumpOnOutOfMemoryError. My system.log for the last minute is as follows(many GC occurs): INFO [HINTED-HANDOFF-POOL:1] 2010-08-02 20:33:50,254 HintedHandOffManager.java (line 153) St

Re: Two questions : Server crash during compaction and UnavailableException

2010-08-03 Thread Ilun Ahn
2010/8/2 Peter Schuller > > First, Cassandra suddenly dies during compaction. Java core dump says > that > > the last thread run was "COMPACTION-POOL:1". > > I suspect that my business logic could lead size of columns in a column > > family per a row to be greater than two gigabytes. (but i coul

SV: Using Cassandra for storing measurement data

2010-08-03 Thread Thorvaldsson Justus
It sounds to me that it's an good idea to use Cassandra in your case, I figure I help you as we Europeans need to cooperate some even though I only worked with Cassandra for a month. =) 1: What is the query you want to use when charting the data? Use it to decide how to storage and sort your da

Using Cassandra for storing measurement data

2010-08-03 Thread Stefan Kaufmann
Dear Cassandra Users, I'm quite new to Cassandra and I'm still trying to figure out, if I'm on the right path for my requirements. I like to explain my Cassandra design and hope to receive feedback, if this would work. I like to use Cassandra to store measurement data from several devices. Each d

Setting initial token in 0.7

2010-08-03 Thread Viktor Jevdokimov
Hi, I've missed how to set initial token in 0.7 (trunk) version - there's no initial token in cassandra.yaml Viktor