Re: Need help on dealing with Cassandra robustness and zombie data

2019-07-01 Thread Jeff Jirsa
> > > > yuping wang schrieb am Mo., 1. Juli 2019, 13:33: >> Hi all, >> >> Sorry for the interruption. But I need help. >> >> >>Due to specific reasons of our use case, we have gc grace on the order >> of 10 minutes instead of default

Re: Need help on dealing with Cassandra robustness and zombie data

2019-07-01 Thread yuping wang
> Hi all, > > Sorry for the interruption. But I need help. > > >Due to specific reasons of our use case, we have gc grace on the order of > 10 minutes instead of default 10 days. Since we have a large amount of nodes > in our Cassandra fleet, not surprisingly, we

Re: Need help on dealing with Cassandra robustness and zombie data

2019-07-01 Thread Rhys Campbell
.html yuping wang schrieb am Mo., 1. Juli 2019, 13:33: > Hi all, > > Sorry for the interruption. But I need help. > > >Due to specific reasons of our use case, we have gc grace on the order > of 10 minutes instead of default 10 days. Since we have a large amount o

Need help on dealing with Cassandra robustness and zombie data

2019-07-01 Thread yuping wang
Hi all, Sorry for the interruption. But I need help. Due to specific reasons of our use case, we have gc grace on the order of 10 minutes instead of default 10 days. Since we have a large amount of nodes in our Cassandra fleet, not surprisingly, we encounter occasionally node status

Re: Need help with incremental repair

2017-10-30 Thread Blake Eggleston
Ah cool, I didn't realize reaper did that. On October 30, 2017 at 1:29:26 PM, Paulo Motta (pauloricard...@gmail.com) wrote: > This is also the case for full repairs, if I'm not mistaken. Assuming I'm not > missing something here, that should mean that he shouldn't need to mark > sstables as unr

Re: Need help with incremental repair

2017-10-30 Thread Paulo Motta
> This is also the case for full repairs, if I'm not mistaken. Assuming I'm not > missing something here, that should mean that he shouldn't need to mark > sstables as unrepaired? That's right, but he mentioned that he is using reaper which uses subrange repair if I'm not mistaken, which doesn't

Re: Need help with incremental repair

2017-10-30 Thread Blake Eggleston
> Once you run incremental repair, your data is permanently marked as repaired This is also the case for full repairs, if I'm not mistaken. I'll admit I'm not as familiar with the quirks of repair in 2.2, but prior to 4.0/CASSANDRA-9143, any global repair ends with an anticompaction that marks s

Re: Need help with incremental repair

2017-10-29 Thread kurt greaves
Yes mark them as unrepaired first. You can get sstablerepairedset from source if you need (probably make sure you get the correct branch/tag). It's just a shell script so as long as you have C* installed in a default/canonical location it should work. https://github.com/apache/cassandra/blob/trunk/

Re: Need help with incremental repair

2017-10-29 Thread Aiman Parvaiz
re that out too. From: Paulo Motta Sent: Sunday, October 29, 2017 1:56:38 PM To: user@cassandra.apache.org Subject: Re: Need help with incremental repair > Assuming the situation is just "we accidentally ran incremental repair", you > shouldn't have to do anything. It&#x

Re: Need help with incremental repair

2017-10-29 Thread Paulo Motta
> Assuming the situation is just "we accidentally ran incremental repair", you > shouldn't have to do anything. It's not going to hurt anything Once you run incremental repair, your data is permanently marked as repaired, and is no longer compacted with new non-incrementally repaired data. This c

Re: Need help with incremental repair

2017-10-28 Thread Blake Eggleston
Hey Aiman, Assuming the situation is just "we accidentally ran incremental repair", you shouldn't have to do anything. It's not going to hurt anything. Pre-4.0 incremental repair has some issues that can cause a lot of extra streaming, and inconsistencies in some edge cases, but as long as you'

Need help with incremental repair

2017-10-28 Thread Aiman Parvaiz
Hi everyone, We seek your help in a issue we are facing in our 2.2.8 version. We have 24 nodes cluster spread over 3 DCs. Initially, when the cluster was in a single DC we were using The Last Pickle reaper 0.5 to repair it with incremental repair set to false. We added 2 more DCs. Now the prob

Re: need help tuning dropped mutation messages

2017-07-06 Thread Subroto Barua
c* version: 3.0.11 cross_node_timeout: truerange_request_timeout_in_ms: 1write_request_timeout_in_ms: 2000counter_write_request_timeout_in_ms: 5000cas_contention_timeout_in_ms: 1000 On Thursday, July 6, 2017, 11:43:44 AM PDT, Subroto Barua wrote: I am seeing these errors: MessagingService

need help tuning dropped mutation messages

2017-07-06 Thread Subroto Barua
I am seeing these errors: MessagingService.java: 1013 -- MUTATION messages dropped in last 5000 ms: 0 for internal timeout and 4 for cross node timeout write consistency @ LOCAL_QUORUM is failing on a 3-node cluster and 18-node cluster..

Re: Attached profiled data but need help understanding it

2017-03-06 Thread Romain Hardouin
Hi Kant, You'll find more information about ixgbevf here  http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/sriov-networking.htmlI repeat myself but don't underestimate VMs placement: same AZ? same placement group? etc.Note that LWT are not discouraged but as the doc says: "[...] reserve lightw

Re: Attached profiled data but need help understanding it

2017-03-06 Thread Kant Kodali
Hi Romain, We may be able to achieve what we need without LWT but that would require bunch of changes from the application side and possibly introducing caching layers and designing solution around that. But for now, we are constrained to use LWT's for another month or so. All said, I still would

Re: Attached profiled data but need help understanding it

2017-03-03 Thread Romain Hardouin
Also, I should have mentioned that it would be a good idea to spawn your three benchmark instances in the same AZ, then try with one instance on each AZ to see how network latency affects your LWT rate. The lower latency is achievable with three instances on the same placement group of course bu

Re: Attached profiled data but need help understanding it

2017-03-02 Thread Romain Hardouin
Hi Kant, > By backporting you mean I should cherry pick CASSANDRA-11966 commit and > compile from source? Yes Regarding the network utilization: you checked throughput but latency is more important for LWT. That's why you should make sure your m4 instances (both C* and client) are using ixgbevf

Re: Attached profiled data but need help understanding it

2017-02-28 Thread Kant Kodali
Hi Romain, I am using Cassandra version 3.0.9 and here is the generated report (Graphical view) of my thread dump as well!. Just send this over in case if it helps. Thanks, kant On Tue, Feb

Re: Attached profiled data but need help understanding it

2017-02-28 Thread Kant Kodali
Hi Romain, Thanks again. My response are inline. kant On Tue, Feb 28, 2017 at 10:04 AM, Romain Hardouin wrote: > > we are currently using 3.0.9. should we use 3.8 or 3.10 > > No, don't use 3.X in production unless you really need a major feature. > I would advise to stick to 3.0.X (i.e. 3.0.1

Re: Attached profiled data but need help understanding it

2017-02-28 Thread Romain Hardouin
> we are currently using 3.0.9.  should we use 3.8 or 3.10 No, don't use 3.X in production unless you really need a major feature.I would advise to stick to 3.0.X (i.e. 3.0.11 now).You can backport CASSANDRA-11966 easily but of course you have to deploy from source as a prerequisite. > I haven't

Re: Attached profiled data but need help understanding it

2017-02-27 Thread Kant Kodali
Hi! My answers are inline. On Mon, Feb 27, 2017 at 11:48 AM, Kant Kodali wrote: > > > On Mon, Feb 27, 2017 at 10:30 AM, Romain Hardouin > wrote: > >> Hi, >> >> Regarding shared pool workers see CASSANDRA-11966. You may have to >> backport it depending on your Cassandra version. >> > > *we a

Re: Attached profiled data but need help understanding it

2017-02-27 Thread Kant Kodali
On Mon, Feb 27, 2017 at 10:30 AM, Romain Hardouin wrote: > Hi, > > Regarding shared pool workers see CASSANDRA-11966. You may have to > backport it depending on your Cassandra version. > *we are currently using 3.0.9. should we use 3.8 or 3.10?* > > Did you try to lower compaction throughp

Re: Attached profiled data but need help understanding it

2017-02-27 Thread Romain Hardouin
Hi, Regarding shared pool workers see CASSANDRA-11966. You may have to backport it depending on your Cassandra version.  Did you try to lower compaction throughput to see if it helps? Be sure to keep an eye on pending compactions, SSTables count and SSTable per read of course. "alloc" is the memo

Re: Attached profiled data but need help understanding it

2017-02-27 Thread Kant Kodali
Also Attached is a flamed graph generated from a thread dump. On Mon, Feb 27, 2017 at 2:32 AM, Kant Kodali wrote: > Hi, > > Attached are the stats of my Cassandra node running on a 4-core CPU. I am > using sjk-plus tool for the first time so what are the things I should > watched out for in my a

Re: Need help with simple schema for time-series

2016-08-28 Thread Noorul Islam K M
http://kairosdb.github.io/ Regards, Noorul Peter Figliozzi writes: > I have data from many sensors as time-series: > >- Sensor name >- Date >- Time >- value > > I want to query windows of both date and time. For example, 8am - 9am from > Aug. 1st to Aug 10th. > > Here's what I

Re: Need help with simple schema for time-series

2016-08-26 Thread Peter Figliozzi
Thanks, guys, for your help. I tried the filtering method and it works great. Sincerely, Pete On Sat, Aug 27, 2016 at 12:36 AM, Jonathan Haddad wrote: > Ah, i see what you're looking for. No, my schema wouldn't work for that. > I had read through your question a little quickly. > > In cassandr

Re: Need help with simple schema for time-series

2016-08-26 Thread Jonathan Haddad
Ah, i see what you're looking for. No, my schema wouldn't work for that. I had read through your question a little quickly. In cassandra 3.5 support was added for more flexible ALLOW FILTERING statements. Here's an example: CREATE TABLE mytable ( sensorname text, date date, time tim

Re: Need help with simple schema for time-series

2016-08-26 Thread Jeff Jirsa
Figliozzi Reply-To: "user@cassandra.apache.org" Date: Friday, August 26, 2016 at 10:02 PM To: "user@cassandra.apache.org" Subject: Re: Need help with simple schema for time-series I don't believe that would let me query a time of day range, over a date range, would it?

Re: Need help with simple schema for time-series

2016-08-26 Thread Peter Figliozzi
I don't believe that would let me query a time of day range, over a date range, would it? For example, between 8am and 9am, August 1st through August 10th. On Fri, Aug 26, 2016 at 11:52 PM, Jonathan Haddad wrote: > Use a timestamp instead of 2 separate fields and you can query on the > range. >

Re: Need help with simple schema for time-series

2016-08-26 Thread Jonathan Haddad
Use a timestamp instead of 2 separate fields and you can query on the range. CREATE TABLE mytable ( sensorname text, reading_time timestamp, data MAP, PRIMARY KEY (sensorname, reading_time) ); On Fri, Aug 26, 2016 at 8:17 PM Peter Figliozzi wrote: > I have data from many senso

Need help with simple schema for time-series

2016-08-26 Thread Peter Figliozzi
I have data from many sensors as time-series: - Sensor name - Date - Time - value I want to query windows of both date and time. For example, 8am - 9am from Aug. 1st to Aug 10th. Here's what I did: CREATE TABLE mykeyspace.mytable ( sensorname text, date date, time time,

Re: Need Help with Cassandra Tombstone

2014-12-15 Thread DuyHai Doan
Hello Chamila If you're deleting and inserting again a clustering column, it looks like a queue anti-pattern to be avoided: http://www.datastax.com/dev/blog/cassandra-anti-patterns-queues-and-queue-like-datasets On Mon, Dec 15, 2014 at 10:06 AM, Chamila Wijayarathna < cdwijayarat...@gmail.com

Need Help with Cassandra Tombstone

2014-12-15 Thread Chamila Wijayarathna
Hello all, I have a column family where I have to update a field frequency, but it is a clustering key. So I am deleting the existing row and adding a new row again with updated frequency. I want to free the space used for deleted rows as soon as possible, so I decided to change gc_grace_seconds

unable to connect R with Cassandra using JDBC, need help

2014-06-18 Thread Osman Khalid
I am trying to follow an example given on " http://www.datastax.com/dev/blog/big-analytics-with-r-cassandra-and-hive"; to connect R with Cassandra. Following is my code: library(RJDBC) #Load in the Cassandra-JDBC diver cassdrv <- JDBC("org.apache.cassandra.cql.jdbc.CassandraDriver", list.

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-25 Thread Jonathan Lacefield
Sorry to hear about the frustration. How often are you deleting data/what are you setting for ttl on cols? Jonathan Lacefield Solutions Architect, DataStax (404) 822 3487

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-25 Thread Oleg Dulin
Sigh, so I am back to where I started from... I did lower gc_grace... jmap -histo:live shows heap is stuffed with DeletedColumn and ExpiringColumn This is extremely frustrating. On 2014-03-11 19:24:50 +, Oleg Dulin said: Good news is that since I lowered gc_grace period it collected

Need help understanding hinted_handoff_throttle_in_kb

2014-03-13 Thread Oleg Dulin
I came across something on the cassandra it that made me concerned. Default value for hinted_handoff_throttle_in_kb is 1024, one Meg per second. I have four nodes and rf=2. I have hints timeout set to 24, to avoid having to do repairs if I took longer than that to reboot a node. What got me think

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-11 Thread Oleg Dulin
Good news is that since I lowered gc_grace period it collected over 100Gigs of tombstones and seems much happier now. Oleg On 2014-03-10 13:33:43 +, Jonathan Lacefield said: Hello,   You have several options:   1) going forward lower gc_grace_seconds http://www.datastax.com/documentati

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-11 Thread Takenori Sato
In addition to the suggestions by Jonathan, you can run a user defined compaction against a particular set of SSTable files, where you want to remove tombstones. But to do that, you need to find such an optimal set. Here you can find a couple of helpful tools. https://github.com/cloudian/support-

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Keith Wright
Date: Monday, March 10, 2014 at 8:33 AM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram Hello, You have several options: 1) going forwa

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Jonathan Lacefield
Hello, You have several options: 1) going forward lower gc_grace_seconds http://www.datastax.com/documentation/cassandra/1.2/cassandra/configuration/configStorage_r.html?pagename=docs&version=1.2&file=configuration/storage_configuration#gc-grace-seconds - this is very use case specific

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-10 Thread Oleg Dulin
I get that :) What I'd like to know is how to fix that :) On 2014-03-09 20:24:54 +, Takenori Sato said: You have millions of org.apache.cassandra.db.DeletedColumn instances on the snapshot. This means you have lots of column tombstones, and I guess, which are read into memory by slice q

Re: need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-09 Thread Takenori Sato
You have millions of org.apache.cassandra.db.DeletedColumn instances on the snapshot. This means you have lots of column tombstones, and I guess, which are read into memory by slice query. On Sun, Mar 9, 2014 at 10:55 PM, Oleg Dulin wrote: > I am trying to understand why one of my nodes keeps

need help with Cassandra 1.2 Full GCing -- output of jmap histogram

2014-03-09 Thread Oleg Dulin
I am trying to understand why one of my nodes keeps full GC. I have Xmx set to 8gigs, memtable total size is 2 gigs. Consider the top entries from jmap -histo:live @ http://pastebin.com/UaatHfpJ -- Regards, Oleg Dulin http://www.olegdulin.com

need help with triggers

2013-10-30 Thread kaveh minooie
Hi everyone I am trying to write a trigger and I am having a hard time figuring out how to extract data from the name field of the columns. I can read the value reletavily easy by getting the abstractype for that column from CFMetadata and use it to decode the value bytebuffer, but due to the

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-09-23 Thread Cyril Scetbon
I tried with 1.2.10 and don't meet the issue anymore. Regards -- Cyril SCETBON On Sep 19, 2013, at 10:28 PM, Cyril Scetbon wrote: > Hi, > > Did you try to build 1.2.10 and to use it for your tests ? I've got the same > issue and will give it a try as soon as it's released (expected at the en

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-09-19 Thread Cyril Scetbon
Hi, Did you try to build 1.2.10 and to use it for your tests ? I've got the same issue and will give it a try as soon as it's released (expected at the end of the week). Regards -- Cyril SCETBON On Sep 2, 2013, at 3:09 PM, Miguel Angel Martin junquera wrote: > hi all: > > More info : > >

Need help configuring WAN replication over slow WAN

2013-09-18 Thread Oleg Dulin
Here is a problem: My customer has a 45Megabit connection to their off-site DR data center. They have about 500G worth of data. That connection is shared. Needless to say this is not an optimal configuration. To replicate all that in real time it'll take a week. My primary cluster is 4 nodes

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-09-02 Thread Miguel Angel Martin junquera
hi all: More info : https://issues.apache.org/jira/browse/CASSANDRA-5941 I tried this (and gen. cassandra 1.2.9) but do not work for me, git clone http://git-wip-us.apache.org/repos/asf/cassandra.git cd cassandra git checkout cassandra-1.2 patch -p1 < 5867-bug-fix-filter-push-down-1.2-branch

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-09-02 Thread Miguel Angel Martin junquera
hi: I test this in cassandra 1.2.9 new version and the issue still persists . :-( Miguel Angel Martín Junquera Analyst Engineer. miguelangel.mar...@brainsins.com 2013/8/30 Miguel Angel Martin junquera > I try this: > > *rows = LOAD > 'cql://keyspace1/test?page_size=1&split_size=4&where_

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-08-30 Thread Miguel Angel Martin junquera
I try this: *rows = LOAD 'cql://keyspace1/test?page_size=1&split_size=4&where_clause=age%3D30' USING CqlStorage();* *dump rows;* *ILLUSTRATE rows;* *describe rows;* * * *values2= FOREACH rows GENERATE TOTUPLE (id) as (mycolumn:tuple(name,value));* *dump values2;* *describe values2;* * * B

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-08-28 Thread Miguel Angel Martin junquera
hi: I can not understand why the schema is define like *"id:chararray,age:int,title:chararray" and it does not define like tuples or bag tuples, if we have pair key-values columns* * * * * *I try other time to change schema but it does not work.* * * *any ideas ...* * * *perhaps, is the issue

Re: how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-08-27 Thread Miguel Angel Martin junquera
hi all: Regards Still i can resolve this issue. . does anybody have this issue or try to test this simple example? i am stumped I can not find a solution working. I appreciate any comment or help 2013/8/22 Miguel Angel Martin junquera > hi all: > > > > > I,m testing the new CqlStorag

how can i get the column value? Need help!.. cassandra 1.28 and pig 0.11.1

2013-08-22 Thread Miguel Angel Martin junquera
hi all: I,m testing the new CqlStorage() with cassandra 1.28 and pig 0.11.1 I am using this sample data test: http://frommyworkshop.blogspot.com.es/2013/07/hadoop-map-reduce-with-cassandra.html And I load and dump data Righ with this script: *rows = LOAD 'cql://keyspace1/test?page_size=1&

Re: Need help

2013-03-08 Thread Jason Wee
Shouldn't be difficult to google what you want for starter... but here are some below, http://wiki.apache.org/cassandra/GettingStarted http://wiki.apache.org/cassandra/ClientOptions http://wiki.apache.org/cassandra/HadoopSupport http://www.slideshare.net/jeromatron/cassandrahadoop-integration Ja

RE Need help in updating metadata of an existing column family

2012-11-29 Thread Romain HARDOUIN
> > user , > > cc > > Objet > > Need help in updating metadata of an existing column family > > Hi, > > I have an existing column family that is created with comparator > BytesType. I want to add a built-in index to this column

Re: Need help in updating metadata of an existing column family

2012-11-29 Thread Roshan Dawrani
Is it possible to update the column-metadata of a column family definition programmatically? If yes, can someone please point me to the right classes to use? Thanks. On Thu, Nov 29, 2012 at 3:58 PM, Roshan Dawrani wrote: > Hi, > > I have an existing column family that is created with comparator

Re: Composite key in thrift java api - still need help!!

2012-07-06 Thread aaron morton
AFAIK in all cases we consider values to be just bytes. They are passed to the ADT to turn into type aware instances. Can you try doing what you want to do with Hector or Astyanax? Then take a look at how they work if you still want to roll your own. Cheers - Aaron Morton Fre

RE: Composite key in thrift java api - still need help!!

2012-07-06 Thread Leonid Ilyevsky
I tried it, does not work for my batch_mutate (I tried both CompositeType.Builder and also my own implementation following the code examples). So it seems that the format with short length before the field and zero byte after does not work for the key. I found by experiment and debugger that in

Re: need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-28 Thread Piavlo
> Anyone can help with this? > > Thanks > > On 11/24/2011 11:55 AM, Piavlo wrote: >> >> Hi, >> >> We need help with choosing correct tokens for ByteOrderedPartitioner >> Originally the key where supposed to be member_id-mmdd >> but since w

Re: need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-28 Thread Benoit Perroud
You may want to add 29991231 instead of appending. Le lundi 28 novembre 2011, Piavlo a écrit : > Anyone can help with this? > > Thanks > > On 11/24/2011 11:55 AM, Piavlo wrote: >> >> Hi, >> >> We need help with choosing correct tokens for ByteOrdered

Re: need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-28 Thread Piavlo
Anyone can help with this? Thanks On 11/24/2011 11:55 AM, Piavlo wrote: Hi, We need help with choosing correct tokens for ByteOrderedPartitioner Originally the key where supposed to be member_id-mmdd but since we need to male rage scans on same member_id and varying date ranges

need help with choosing correct tokens for ByteOrderedPartitioner

2011-11-24 Thread Piavlo
Hi, We need help with choosing correct tokens for ByteOrderedPartitioner Originally the key where supposed to be member_id-mmdd but since we need to male rage scans on same member_id and varying date ranges mmdd we decided to use ByteOrderedPartitioner, so we need that same member

Re: need help setting up production environment

2011-09-03 Thread Jeremy Hanna
Okay - I just really wanted to point out Matt's presentation as food for thought. We've had some painful experiences we've learned a lot from and wished we had some of those tips when we were starting out. On Sep 3, 2011, at 5:19 PM, Ben Ashton wrote: > Hi Jeremy, > > I dont remember setting

Re: need help setting up production environment

2011-09-03 Thread Ben Ashton
Hi Jeremy, I dont remember setting up snitch. The servers are all in a VPC, the only thing I did was configure the seed IP so all the nodes can see each other. Ben On Sat, Sep 3, 2011 at 11:13 PM, Jeremy Hanna wrote: > I would look at http://www.slideshare.net/mattdennis/cassandra-on-ec2 > > A

Re: need help setting up production environment

2011-09-03 Thread Jeremy Hanna
I would look at http://www.slideshare.net/mattdennis/cassandra-on-ec2 Also, people generally do raid0 on the ephemerals. EBS is a bad fit for cassandra - see the presentation above. However, that means you'll need to have a backup strategy, which is also mentioned in the presentation. Also ar

need help setting up production environment

2011-09-03 Thread Ben Ashton
I've been dropped in it a little and had to build a prod setup going live on monday. At the moment I have setup three server in EC2 US, one each AZ the servers are setup as follows:- m1.xlarge using the Amazons AMI instance storage image, the ephemerals 4 x 420 GB setup in raid10 and formatted w

Re: Need help in CF design

2011-08-11 Thread aaron morton
>> 1) Is it possible to design to get equivalent results for above >> query ( using CQL or Hector) with Cassandra. If this is a common query in your app it's god idea to design the data model to support the request. Seems safe to assume the PK in your example is non unique, I'll call it the FKID

Re: Need help in CF design

2011-08-11 Thread Benoit Perroud
You can apply this query really simply using cassandra and secondary indexes. You will have a CF "TABLE", where row keys are your PK. Just to be sure of my understanding, your SQL query will either return 1 row or no row, right ? 3) SliceQuery returns a range of columns for a given key, it m

Need help in CF design

2011-08-10 Thread abhi
I recently started with Cassandra and found interesting. I was curious in SQL we have SELECT * from TABLE where PK="primary_key" and other_attribute between 500 and 1000; My questions are : 1) Is it possible to design to get equivalent results for above query ( using CQL or Hector) with Cassan

Re: Need help json2sstable

2011-07-21 Thread aaron morton
In my DB the keys added by the client were ascii strings like "foo", but these are stored as binary arrays in cassandra. So I cannot use the string "foo" with 22table2json I have to use the ascii encoding 666f6f . This will *probably* be what you see in the output from cassandra-cli list (unles

Re: Need help json2sstable

2011-07-21 Thread Nilabja Banerjee
Thank You... But truely speaking I dnt get you what do you mean by* key is binary, so thats the ascii encoding for foo * and another thing... this is the output of "list BTP" command RowKey: 0902 => (super_column=0902, (column=30, value=303039303030303032, timestamp=1310471032735

Re: Need help json2sstable

2011-07-21 Thread aaron morton
mmm, there is no -f option for sstable2json / SSTableExport. Datastax guys/girls ?? this works for me bin/sstable2json /var/lib/cassandra/data/dev/data-g-1-Data.db -k 666f6f > output.txt NOTE: key is binary, so thats the ascii encoding for foo Cheers - Aaron Morton Freelanc

Re: Need help json2sstable

2011-07-21 Thread Nilabja Banerjee
This is the full path of SSTables: /Users/nilabja/Development/Cassandra/apache-cassandra-0.7.5/data/*cctest* /BTP-f-1-Data.db *cctest= *keyspace *BTP*= Columnfamily name json file= /Users/nilabja/Development/Cassandra/testjson.txt commands are: bin/sstable2json -f output.txt /Users/nilabja/Deve

Re: Need help json2sstable

2011-07-21 Thread aaron morton
What is the command line you are executing ? That error is only returned by sstable2json when an sstable path is not passed on the command line. Cheers - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 21 Jul 2011, at 18:50, Nilabja Ba

Re: Need help json2sstable

2011-07-20 Thread Nilabja Banerjee
Thank you... but I have already gone through that.. but still not working... I am getting .. "*You must supply exactly one sstable * Can you tell me why I am getting this? On 21 July 2011 02:41, Tyler Hobbs wrote: > The sstable2json/json2sstable format is detailed here: > http://www.datastax.c

Re: Need help json2sstable

2011-07-20 Thread Tyler Hobbs
The sstable2json/json2sstable format is detailed here: http://www.datastax.com/docs/0.7/utilities/sstable2json On Wed, Jul 20, 2011 at 4:58 AM, Nilabja Banerjee wrote: > > > > > On 20 July 2011 11:33, Nilabja Banerjee wrote: >> >> Hi All, >> >> Here Is my Json structure. >> >> >> {"Fetch_CC" :{

Re: Need help json2sstable

2011-07-20 Thread Nilabja Banerjee
On 20 July 2011 11:33, Nilabja Banerjee wrote: > Hi All, > > Here Is my Json structure. > > > {"Fetch_CC" :{ > "cc":{ "":"1000", > ":"ICICI", > "":"", > "city":{ >

Re: Need help json2sstable

2011-07-20 Thread Nilabja Banerjee
Yes.Actually, I was just asking you guys to give me one example with one sample of small json structure. Thank you in advance :) On 20 July 2011 11:53, Sasha Dolgy wrote: > You are missing " after > > On Wed, Jul 20, 2011 at 8:03 AM, Nilabja Banerjee > wrote: > > Hi All, > > > >

Re: Need help json2sstable

2011-07-19 Thread Sasha Dolgy
You are missing " after On Wed, Jul 20, 2011 at 8:03 AM, Nilabja Banerjee wrote: > Hi All, > > Here Is my Json structure. > > > {"Fetch_CC" :{ >                 "cc":{ "":"1000", >                     ":"ICICI", >                          "":"", >               

Need help json2sstable

2011-07-19 Thread Nilabja Banerjee
Hi All, Here Is my Json structure. {"Fetch_CC" :{ "cc":{ "":"1000", ":"ICICI", "":"", "city":{ "name":"banglore" };

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-11-02 Thread hoivan
65146.n2.nabble.com/Re-Please-need-help-with-Munin-Cassandra-Munin-plugin-problem-tp5351794p5698748.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: Need help to overcome: InvalidRequestException(why:UUIDs must be exactly 16 bytes)

2010-10-14 Thread Eric Evans
On Thu, 2010-10-14 at 13:42 -0500, Eric Evans wrote: > This list is for the development of Cassandra directly, your question is > better posed on user@cassandra.apache.org (moving it there). > > Before following up though, you might want to check the wiki and list > archives, questions about creat

Re: Need help to overcome: InvalidRequestException(why:UUIDs must be exactly 16 bytes)

2010-10-14 Thread Eric Evans
This list is for the development of Cassandra directly, your question is better posed on user@cassandra.apache.org (moving it there). Before following up though, you might want to check the wiki and list archives, questions about creating TimeUUIDs from Java have been pretty common. For example:

Re: Need help in cassandra data model..

2010-09-01 Thread aaron morton
From what you have described that sounds OK (am assuming there is not millions of events per transaction). When designing the model consider all the ways you will want to read the data back and then dernomalize the data appropriately. Ideally each request for data from cassandra should be handle

Need help in cassandra data model..

2010-09-01 Thread Manikandan R
Hello Everyone, I am doing study on cassandra to make use of it for the below problem - My current system has many components. To complete any transaction(request), it has to pass through all the components. While it passes through, there is no clear visibility to know what is happening behind ea

Re: need help on cassandra client

2010-08-30 Thread Dave Viner
HI Cassam, I'm using the perl Thrift API against 0.6.4 currently. It sounds like you are having trouble getting thrift installed and/or getting the perl bindings built. If you already have thrift installed, you can just run: % thrift --gen perl interface/cassandra.thrift The libraries are now

Re: need help on cassandra client

2010-08-28 Thread Eric Evans
On Sat, 2010-08-28 at 13:00 +0530, cassam read wrote: > I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . > everything (column,super-column, > replication,failover) i tried was successful from cli. > But I am stucked with thrift client. How to access cassandra thrift. > Do i hav

Re: need help on cassandra client

2010-08-28 Thread Jonathan Ellis
you need thrift before you can use any of the clients built on top of it. http://wiki.apache.org/cassandra/InstallThrift On Sat, Aug 28, 2010 at 2:30 AM, cassam read wrote: > Hi guys > I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . > everything (column,super-column, > repli

need help on cassandra client

2010-08-28 Thread cassam read
Hi guys I have tried cassandra 0.6.4 with replication factor 3 on 4 VM node . everything (column,super-column, replication,failover) i tried was successful from cli. But I am stucked with thrift client. How to access cassandra thrift. Do i have to compile thrift pkg for perl or I can directly used

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-05 Thread osishkin osishkin
I've managed to find the problem. Not a IBM vs. Sun JRE issue. It had to do with my RHEL distribution JRE defintions which caused conflicts (from /etc/java/java.conf...). When invoking with absolute path to java executable, instead of simply java the errors were gone. So no more errors in munin-nod

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-04 Thread Peter Schuller
> Are you saying this based on your personal experience? > Or is this just an educated guess? Whatever the cause, the end result is that javax.management.remote.JMXConnector does not exist. So the most likely culprits would be that CLASSPATH is different, or you're using a different JVM. For examp

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-04 Thread osishkin osishkin
Are you saying this based on your personal experience? Or is this just an educated guess? On Tue, Aug 3, 2010 at 11:19 PM, Brandon Williams wrote: > On Fri, Jul 30, 2010 at 9:58 AM, osishkin osishkin > wrote: >> >> I'm talking about the James Golick plugin. I followed the >> instructions, and go

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-08-03 Thread Brandon Williams
On Fri, Jul 30, 2010 at 9:58 AM, osishkin osishkin wrote: > I'm talking about the James Golick plugin. I followed the > instructions, and got nowhere. > http://github.com/jamesgolick/cassandra-munin-plugins > I saw in the mailing list that other people successfully got it to work > > I'm pretty su

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-07-30 Thread osishkin osishkin
I'm talking about the James Golick plugin. I followed the instructions, and got nowhere. http://github.com/jamesgolick/cassandra-munin-plugins I saw in the mailing list that other people successfully got it to work Thanks

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-07-29 Thread Dave Viner
Is your code posted somewhere such that others could try it? On Thu, Jul 29, 2010 at 5:57 AM, Miriam Allalouf wrote: > Hi, > Please, can someone help us with Munin?? > Thanks, > Miriam > > > On Mon, Jul 26, 2010 at 1:58 PM, osishkin osishkin > wrote: > > Hi, > > > > I'm trying to use Munin to m

Re: Please need help with Munin: Cassandra Munin plugin problem

2010-07-29 Thread Miriam Allalouf
Hi, Please, can someone help us with Munin?? Thanks, Miriam On Mon, Jul 26, 2010 at 1:58 PM, osishkin osishkin wrote: > Hi, > > I'm trying to use Munin to monitor cassandra. > I've seen other people using munin here ,so I hope someone ran into > this problem. > The default plugins are working,