Re: new node gets no data

2012-03-15 Thread Thorsten von Eicken
Thanks for the suggestion Aaron, unfortunately, that seems to do absolutely nothing: # nodetool -h localhost repair INFO [RMI TCP Connection(160)-127.0.0.1] 2012-03-16 06:15:13,718 StorageService.java (line 1770) Starting repair command #1, repairing 1 ranges. INFO [AntiEntropySessions:1] 2012-

Re: Bootstrapping a new node to a running cluster

2012-03-15 Thread aaron morton
The documentation is correct. I was mistakenly remembering discussions in the past about RF > #nodes. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 16/03/2012, at 4:34 AM, Doğan Çeçen wrote: >> I'm not sure why this is not allowed. As l

Re: Single Node Cassandra Installation

2012-03-15 Thread Drew Kutcharian
Thanks for the comments, I guess I will end up doing a 2 node cluster with replica count 2 and read consistency 1. -- Drew On Mar 15, 2012, at 4:20 PM, Thomas van Neerijnen wrote: > So long as data loss and downtime are acceptable risks a one node cluster is > fine. > Personally this is usual

Re: Question regarding secondary indices

2012-03-15 Thread aaron morton
You should see a log line with "Index build of {} complete". You can also see which indexes are built using the describe command in cassandra-cli. - Aaron Morton[default@XX] describe; Keyspace: XX: ... Column Families: ColumnFamily: XXX ... Built indexes: [

Re: new node gets no data

2012-03-15 Thread aaron morton
trying running nodetool repair on 10.80.161.101 and then cleanup on 10.102.37.168 if everything is ok. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 16/03/2012, at 6:45 AM, Thorsten von Eicken wrote: > I added a second node to a single-

Re: Does the 'batch' order matter ?

2012-03-15 Thread aaron morton
> Given atomicity is not possible, it is ok for a brief period of > inconsistency but I cannot afford permanent inconsistency for even a > single successful or timed-out write. Even when using a strongly consistent CL level you may still get logical inconsistencies if your batch_mutation fails wi

Re: 1.0.8 with Leveled compaction - Possible issues

2012-03-15 Thread Watanabe Maki
update column family with LCS option + upgradesstables should convert all of your sstables. Set lig4j config: org.apache.cassandra.db.compaction=DEBUG in conf/log4j-server.properties and retry your procedure to find what is happen. maki On 2012/03/16, at 7:05, Johan Elmerfjord wrote: > Hi, I'

RE: Large hints column family

2012-03-15 Thread Bryce Godfrey
We were having some occasional memory pressure issues, but we just added some more RAM a few days ago to the nodes and things are running more smoothly now, but in general nodes have not been going up and down. I tried to do a "list HintsColumnFamily" from Cassandra-cli and it locks my Cassandr

Re: Single Node Cassandra Installation

2012-03-15 Thread Thomas van Neerijnen
So long as data loss and downtime are acceptable risks a one node cluster is fine. Personally this is usually only acceptable on my workstation, even my dev environment is redundant, because servers fail, usually when you least want them to, like for example when you've decided to save costs by wai

Re: 1.0.8 with Leveled compaction - Possible issues

2012-03-15 Thread Thomas van Neerijnen
Heya I'd suggest staying away from Leveled Compaction until 1.0.9. For the why see this great explanation I got from Maki Watanabe on the list: http://mail-archives.apache.org/mod_mbox/cassandra-user/201203.mbox/%3CCALqbeQbQ=d-hORVhA-LHOo_a5j46fQrsZMm+OQgfkgR=4rr...@mail.gmail.com%3E Keep an eye o

Re: Datastax Enterprise mixed workload cluster configuration

2012-03-15 Thread Alexandru Sicoe
Sorry for that last message, I was confused because I thought I needed to use the DseSimpleSnitch but of course I can use the PropertyFileSnitch and that allows me to get the configuration with 3 data centers explained. Cheers, Alex On Thu, Mar 15, 2012 at 10:56 AM, Alexandru Sicoe wrote: > Tha

1.0.8 with Leveled compaction - Possible issues

2012-03-15 Thread Johan Elmerfjord
Hi, I'm testing the community-version of Cassandra 1.0.8. We are currently on 0.8.7 in our production-setup. We have 3 Column Families that each takes between 20 and 35 GB on disk per node. (8*2 nodes total) We would like to change to Leveled Compaction - and even try compression as well to reduce

Question regarding secondary indices

2012-03-15 Thread Sanjeev Kulkarni
Hi, I'm using a 4 node cassandra cluster running 0.8.10 with rf=3. Its a brand new setup. I have a single col family which contains about 10 columns. I have enabled secondary indices on 3 of them. I used sstableloader to bulk load some data into this cluster. I poked around the logs and saw the fol

Re: Single Node Cassandra Installation

2012-03-15 Thread R. Verlangen
Hi Drew, One other disadvantage is the lack of "consistency level" and "replication". Both ware part of the high availability / redundancy. So you would really need to backup your single-node-"cluster" to some other external location. Good luck! 2012/3/15 Drew Kutcharian > Hi, > > We are worki

Instructor position at DataStax

2012-03-15 Thread Jonathan Ellis
DataStax is looking for an Instructor to conduct training courses for Apache Cassandra. Details and requirements for this position can be found in the link below [1]. Depending on where you live the position may require a substantial amount of travel. If you are interested in the position, or you w

new node gets no data

2012-03-15 Thread Thorsten von Eicken
I added a second node to a single-node ring. RF=1. I can't get the new node to receive any data. Logs look fine. Here's what nodetool reports: # nodetool -h localhost ring Address DC RackStatus State Load OwnsToken

Single Node Cassandra Installation

2012-03-15 Thread Drew Kutcharian
Hi, We are working on a project that initially is going to have very little data, but we would like to use Cassandra to ease the future scalability. Due to budget constraints, we were thinking to run a single node Cassandra for now and then add more nodes as required. I was wondering if it is

Re: Failure in Cassandra Ring Running on ESXi (Ubuntu 11.10)

2012-03-15 Thread Nick Summerlin
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Found the debian init script, you'll probably need to change the paths: http://svn.apache.org/repos/asf/cassandra/trunk/debian/init You can find the init script for other distros if you peel back to '/cassandra/trunk/'. - -- - - Nick Summerlin

Re: Bootstrapping a new node to a running cluster

2012-03-15 Thread Doğan Çeçen
> I'm not sure why this is not allowed. As long as I do not use CL.all there > will be enough nodes available to satisfy the read / write (at least when I > look at ReadCallback and the WriteResponseHandler). Or am I missing > something here? According to http://www.datastax.com/docs/1.0/cluster_a

Re: counter columns question

2012-03-15 Thread Tamar Fraenkel
Thanks, already added a dedicated column family and all works fine! *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Thu, Mar 15, 2012 at 2:58 PM, Rustam Aliyev wrote: >

Re: Does the 'batch' order matter ?

2012-03-15 Thread A J
ok . disappointing. You could have got atomicity like behavior most of the time, if it was otherwise. How does one execute a logical write that is spread in several CFs (say in User CF, you have 'state' as a column and userid as rowkey. But in State CF, you have state as rowkey and userid as a

Re: counter columns question

2012-03-15 Thread Rustam Aliyev
No, it's not possible. On 15/03/2012 10:53, Tamar Fraenkel wrote: Watched the video, really good! One question: I wonder if it is possible to mix counter columns in Cassandra 1.0.7 with regular columns in the same CF.

Re: Bootstrapping a new node to a running cluster

2012-03-15 Thread Mikael Wikblom
Hi Aaron, On 03/15/2012 10:52 AM, aaron morton wrote: 1. a running cluster of N=3, R=3 2. upgrade R to 4 You should not be allowed to set the RF higher than the number of nodes. I'm not sure why this is not allowed. As long as I do not use CL.all there will be enough nodes available to satisf

Re: counter columns question

2012-03-15 Thread Tamar Fraenkel
Watched the video, really good! One question: I wonder if it is possible to mix counter columns in Cassandra 1.0.7 with regular columns in the same CF. Even if it is possible, I am not sure I should mix them as I use Hector, and this means I will have to user both Hector and CQL, Am I right? Than

Re: Bootstrapping a new node to a running cluster (setting RF > N)

2012-03-15 Thread Mateusz Korniak
On Thursday 15 of March 2012, aaron morton wrote: > > 1. a running cluster of N=3, R=3 > > 2. upgrade R to 4 > > You should not be allowed to set the RF higher than the number of nodes. I wonder why is that restriction ? It would be easier to increase RF first (similar as having new node down),

Re: Datastax Enterprise mixed workload cluster configuration

2012-03-15 Thread Alexandru Sicoe
Thanks Tyler, I see that cassandra.yaml has "endpoint_snitch: com.datastax.bdp.snitch.DseSimpleSnitch". Will this pick up the configuration from the cassandra-topology.properties file as does the PropertyFileSnitch ? Or is there some other way of telling it which nodes are in withc DC? Cheers, Al

Re: Bootstrapping a new node to a running cluster

2012-03-15 Thread aaron morton
> 1. a running cluster of N=3, R=3 > 2. upgrade R to 4 You should not be allowed to set the RF higher than the number of nodes. I'm going to assume that clients on the web server only talk to the local cassandra. So that when you add the new cassandra node it will not have any clients until yo

0.8.1 Vs 1.0.7

2012-03-15 Thread Ravikumar Govindarajan
Hi, I ran some data import tests for cassandra 0.8.1 and 1.0.7. The results were a little bit surprising 0.8.1, SimpleStrategy, Rep_Factor=3,QUORUM Writes, RP, SimpleSnitch XXX.XXX.XXX.A datacenter1 rack1 Up Normal 140.61 GB 12.50% XXX.XXX.XXX.B datacenter1 rack1 Up

Re: Load balancing using 'nodetool move'

2012-03-15 Thread aaron morton
Check nodetool ring to see what state the nodes are in, they all need to be UP. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/03/2012, at 7:31 PM, Rishabh Agrawal wrote: > Hello, > > I initially had two node cluster and now I joined

Re: Does the 'batch' order matter ?

2012-03-15 Thread aaron morton
The simple thing to say is: If you send a batch_mutate the order which the rows are written is undefined. So you should not make any assumptions such as if rows C is stored, rows A and B also have. They may do but AFAIK it is not part of the API contract. For the thrift API batch_mutate takes

RE: Adding nodes to cluster (Cassandra 1.0.8)

2012-03-15 Thread Rishabh Agrawal
After clearing the system files I was able to successfully join the node. thanks. From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Thursday, March 15, 2012 2:13 PM To: user@cassandra.apache.org Subject: Re: Adding nodes to cluster (Cassandra 1.0.8) There have been two similar reports

Re: Composite keys and range queries

2012-03-15 Thread aaron morton
> is there any disadvantage to using supercolumns here? There are some http://wiki.apache.org/cassandra/CassandraLimitations I would avoid them if you can. The one thing you cannot do when using CompositeTypes for column names is a range delete. If you delete a super column, then you delete a

Re: Large hints column family

2012-03-15 Thread aaron morton
Is there anything going on in the logs ? Are nodes going up and down ? Can you see any messages about delivering hints ? If the query to read the hints errors it will log "HintsCF getEPPendingHints timed out" at INFO level. Also checking, do the hinted_handoff_* settings in cassandra.yaml ha

Bootstrapping a new node to a running cluster

2012-03-15 Thread Mikael Wikblom
Hi, I'm using cassandra (1.0.8) embedded in the same jvm as a webapplication. All data is available on all nodes (R = N), read / write CL.ONE. Is it correct to assume in the following scenario that the newly added node has all data locally and that secondary indexes are fully created afte

Re: CAn't bootstrap a new node to my cluster

2012-03-15 Thread Cyril Scetbon
Ok I'll give it a try. Thank you Aaron On 3/15/12 9:16 AM, aaron morton wrote: - use the join command normally join-ring is only used when the node is having some sort of problem. The best approach to bringing up a new is to explicitly set the token and start it with auto_bootstrap=true. h

Re: Adding nodes to cluster (Cassandra 1.0.8)

2012-03-15 Thread aaron morton
There have been two similar reports in the last few days. The joining node is unable to discover the cluster information it needs to find the correct place to join. However there code appears to have checks in place to prevent that from happening. If you have time can you please try to reprod

Re: CAn't bootstrap a new node to my cluster

2012-03-15 Thread aaron morton
>> - use the join command normally join-ring is only used when the node is having some sort of problem. The best approach to bringing up a new is to explicitly set the token and start it with auto_bootstrap=true. http://www.datastax.com/docs/1.0/operations/cluster_management#adding-capacity-to-

Failure in Cassandra Ring Running on ESXi (Ubuntu 11.10)

2012-03-15 Thread Tamar Fraenkel
I added a third node to the cluster. Sure enough, this morning I come and only one node is up, in the other two the cassandra process is not running. In the cassandra log there is nothing, but in /var/log/syslog I see In one node: Mar 15 07:50:51 Cassandra3 kernel: [58566.666906] Out of memory: Ki