Re: Sorting & pagination in apache cassandra 2.1

2016-01-13 Thread Narendra Sharma
In the example you gave the primary key user _ name is the row key. Since the default partition is random you are getting rows in random order. Since each row no clustering column there is no further grouping of data. Or in simple terms each row has one record and is being returned ordered by colu

Re: Cassandra table as Queue

2015-08-20 Thread Narendra Sharma
n the README. > > https://github.com/algermissen/cassandra-ruby-sharded-workers > > Given the tombstone problem I what I know by now, I'd rather not use a TTL > on the messages but remove outdated time shards completely after e.g. a > week. But since reads never really go

Re: Cassandra leap second

2015-07-01 Thread Narendra Sharma
t;>> https://blog.mozilla.org/it/2012/06/30/mysql-and-the-leap-second-high-cpu-and-the-fix/ >>> >>> Seeing high cpu consumption for cassandra process >>> >>> >>> >> >> >> -- >> Sent from Jeff Dean's printf() mobile console >> > > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.aeris.com>* *http://narendrasharma.blogspot.com/ <http://narendrasharma.blogspot.com/>*

Re: Data model suggestions

2015-04-23 Thread Narendra Sharma
I think one table say record should be good. The primary key is record id. This will ensure good distribution. Just update the active attribute to true or false. For range query on active vs archive records maintain 2 indexes or try secondary index. On Apr 23, 2015 1:32 PM, "Ali Akhtar" wrote: >

Re: question about secondary index or not

2014-01-30 Thread Narendra Sharma
the result efficiently to pick the employee who > has gender column value equal to "male" > >>>>>> 2/ > >>>>>> add a seconday index > >>>>>> create index gender_index on people(gender) > >>>>>> select * from people where company_id='xxx' and gender='male' > >>>>>> > >>>>>> I though #2 seems more appropriate, but I also thought the > secondary index is helping only locating the primary row key, with the > select clause in #2, is it more efficient than #1 where application > responsible loop through the result and filter the right content? > >>>>>> ( > >>>>>> It totally make sense if I only need to find out all the male > employee(and not within a company) by using > >>>>>> select * from people where gender='male" > >>>>>> ) > >>>>>> thanks > >>>> > >>> > >> > > > > > > -- > Sorry this was sent from mobile. Will do less grammar and spell check than > usual. > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.aeris.com>* *http://narendrasharma.blogspot.com/ <http://narendrasharma.blogspot.com/>*

Re: Cassandra ring not behaving like a ring

2014-01-16 Thread Narendra Sharma
Haddad wrote: > Please include the output of "nodetool ring", otherwise no one can help > you. > > > On Thu, Jan 16, 2014 at 12:45 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Any pointers? I am planning to do rolling restart of the clu

Re: Cassandra ring not behaving like a ring

2014-01-16 Thread Narendra Sharma
Any pointers? I am planning to do rolling restart of the cluster nodes to see if it will help. On Jan 15, 2014 2:59 PM, "Narendra Sharma" wrote: > RF=3. > On Jan 15, 2014 1:18 PM, "Andrey Ilinykh" wrote: > >> what is the RF? What does nodetool ring show? >&

Re: Cassandra ring not behaving like a ring

2014-01-15 Thread Narendra Sharma
RF=3. On Jan 15, 2014 1:18 PM, "Andrey Ilinykh" wrote: > what is the RF? What does nodetool ring show? > > > On Wed, Jan 15, 2014 at 1:03 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Sorry for the odd subject but something is wrong with

Cassandra ring not behaving like a ring

2014-01-15 Thread Narendra Sharma
streaming from N1, N2, N6 and N7. I expect it to steam from (worst case) N5, N6, N7, N8. What could potentially cause the node to get confused about the ring? -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.aeris.com>* *http://narendrasharma.blogspot.com/

Re: Cassandra 1.1.6 crash without any exception or error in log

2014-01-02 Thread Narendra Sharma
ry Analyzer (Eclipse > MAT <http://www.eclipse.org/mat>) to figure out root causes and potential > leaks > > Hope this helps > -- Nitin > > > On Thu, Jan 2, 2014 at 9:00 PM, Narendra Sharma > wrote: > >> The root cause turned out to be high heap. The Li

Re: Cassandra 1.1.6 crash without any exception or error in log

2014-01-02 Thread Narendra Sharma
. syslog helped figure this out. About Linux OOM Killer "It is the job of the linux 'oom killer' to *sacrifice* one or more processes in order to free up memory for the system when all else fails" On Thu, Jan 2, 2014 at 10:38 AM, Robert Coli wrote: > On Thu, Jan 2, 2014 at 8

Cassandra 1.1.6 crash without any exception or error in log

2014-01-02 Thread Narendra Sharma
8 node cluster running in aws. Any pointers where I should start looking? No kill -9 in history.

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-18 Thread Narendra Sharma
ling on something. >> >> Cheers >> >> - >> Aaron Morton >> New Zealand >> @aaronmorton >> >> Co-Founder & Principal Consultant >> Apache Cassandra Consulting >> http://www.thelastpickle.com >> >> On 17/

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-18 Thread Narendra Sharma
> @aaronmorton > > Co-Founder & Principal Consultant > Apache Cassandra Consulting > http://www.thelastpickle.com > > On 17/12/2013, at 12:28 pm, Narendra Sharma > wrote: > > No snapshots. > > I restarted the node and now the Load in ring is in sync with the disk

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-16 Thread Narendra Sharma
ill link to sstables which will cause them not be deleted. > > > > -Arindam > > > > *From:* Narendra Sharma [mailto:narendra.sha...@gmail.com] > *Sent:* Sunday, December 15, 2013 1:15 PM > *To:* user@cassandra.apache.org > *Subject:* Cassandra 1.1.6 - Disk usage and Loa

Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-15 Thread Narendra Sharma
B 2. nodetool cfstats for the CF reported: SSTable count: 16 Space used (live): 670524321067 Space used (total): 670524321067 3. 'ls -1 *Data* | wc -l' in the data folder for CF returned 16 4. 'du -ksh .' in the data folder for CF returned 625G -Naren -- Narendra Sh

Re: Cassandra 1.1.6 - New node bootstrap not completing

2013-11-01 Thread Narendra Sharma
I was successfully able to bootstrap the node. The issue was RF > 2. Thanks again Robert. On Wed, Oct 30, 2013 at 10:29 AM, Narendra Sharma wrote: > Thanks Robert. > > I didn't realize that some of the keyspaces (not all and esp. the biggest > one I was focusing on) had RF

Re: Cassandra 1.1.6 - New node bootstrap not completing

2013-10-29 Thread Narendra Sharma
ct 29, 2013 at 11:45 AM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> We had a cluster of 4 nodes in AWS. The average load on each node was >> approx 750GB. We added 4 new nodes. It is now more than 30 hours and the >> node is still in JOINING mode. >&

Cassandra 1.1.6 - New node bootstrap not completing

2013-10-29 Thread Narendra Sharma
further analyze the issue? I haven't restarted the Cassandra process. I am afraid the node will start bootstrap again if I restart the node. Thanks, Naren -- Narendra Sharma Software Engineer *http://www.aeris.com* *http://narendrasharma.blogspot.com/*

Re: Querying for rows without a particular column

2012-02-14 Thread Narendra Sharma
t; > -- > Asankha C. Perera > AdroitLogic, http://adroitlogic.org > > http://esbmagic.blogspot.com > > > > > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: Deleting a column vs setting it's value to empty

2012-02-10 Thread Narendra Sharma
ould not even > exist), what would happen when I delete a non existent column? > > Thanks, > > Drew > > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: Implications of length of column names

2012-02-10 Thread Narendra Sharma
zing+Storage+of+Small+Objects > Does this apply to Cassandra column names? > > > -- Drew > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: Unbalanced cluster with RandomPartitioner

2012-01-19 Thread Narendra Sharma
ion. If you have received > > this e-mail by mistake, please contact us immediately and completely delete > > it (and any attachments) and do not forward it or inform any other person > of > > its contents. If you send us messages by e-mail, we take this as your > > a

Re: How to reliably achieve unique constraints with Cassandra?

2012-01-06 Thread Narendra Sharma
ian wrote: > So what are the common RIGHT solutions/tools for this? > > > On Jan 6, 2012, at 2:46 PM, Narendra Sharma wrote: > > >>>It's very surprising that no one seems to have solved such a common use > case. > I would say people have solved it using RIGHT tool

Re: How to reliably achieve unique constraints with Cassandra?

2012-01-06 Thread Narendra Sharma
> instance where the lock manager is down and two users are > >>>> registering with the same email, can cause major issues. > >>> > >>> For most applications, if the lock managers is down, you don't > >>> acquire the lock, so you don't enter the critical section. Rather > >>> than allowing inconsistency, you become unavailable (at least to > >>> writes that require a lock). > >>> > >>> -Bryce > >> > > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: Cassandra memory usage

2012-01-03 Thread Narendra Sharma
RES SHR S %CPU %MEMTIME+ > COMMAND > > 2549 cassy 21 0 156g * 15g 11g *S 66.9 65.5 338:02.72 java > > > Thank you in advance, > > > Daning > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: How to convert start_token,end_token to real key value?

2012-01-01 Thread Narendra Sharma
k with 0.7.1 > > Thanks and Regards > Ravi > > > -- Narendra Sharma Software Engineer *http://www.aeris.com <http://www.persistentsys.com>* *http://narendrasharma.blogspot.com/*

Re: Unable to add columns to empty row in Column family: Cassandra

2011-05-12 Thread Narendra Sharma
r, columns are not being inserted. > But, when tried from command line client, it worked correctly. > > Any pointer on this would be of great use > > Thanks in advance, > > Regards, > Anuya > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: network topology issue

2011-05-11 Thread Narendra Sharma
gt;>> I started first node then I when I restarted second node I got an error >>> that token "0" is already being used.Why am I getting this error. >>> >>> Second Question: I already have cassandra running in two different data >>> centers I want to add a new keyspace which uses networkTopology strategy >>> in the light of above errors how can I accomplish this. >>> >>> >>> Thanks >>> Anurag >>> >> >> > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Newbie question

2011-05-10 Thread Narendra Sharma
ching this problem > > Regards > > Sam > *__ > Sam Ganesan Ph.D. > Distinguished member, Technical Staff > Motorola Mobility - On Demand Video > 900 Chelmsford Street, > Lowell, MA 01851 > tel:+1 978 614-3165 (changed) > mob:+1 978 328-7132 > mailto: sam.ga

Re: cassandra not reading keyspaces defined in cassandra.yaml

2011-05-09 Thread Narendra Sharma
a.locator.RackUnawareStrategy > replication_factor: 1 > > Cassandra starts properly without giving any warnngs/error but does not > create the keyspace offline > which is defined above. > > Please suggest. > > Thanks > Anurag > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Manual Conflict Resolution in Cassandra

2011-04-25 Thread Narendra Sharma
olution in Cassandra? > > Please see attachment for why this is important in some cases. > > > Regards > > Milind > > > > > I think about this often. LDAP servers like SunOne have pluggable > conflict resolution. I could see the read-repair algorithm being > pluggable. > > > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: seed faq

2011-04-20 Thread Narendra Sharma
ate or boot > without the seed. But it is recommended to have multiple seeds in > production system to maintain the ring. > > > > Thanks > -- > maki > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Starting the Cassandra server from Java (without command line)

2011-04-14 Thread Narendra Sharma
ttp://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Starting-the-Cassandra-server-from-Java-without-command-line-tp6273826p6273826.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com. > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Cassandra 2 DC deployment

2011-04-12 Thread Narendra Sharma
ke corrective action. So > try QUORUM under normal circumstances, if unavailable try ONE. My questions > - > Do you guys see any flaws with this approach? > What happens when DC1 comes back up and we start reading/writing at QUORUM > again? Will we read stale data in this case? >

Re: weird error when connecting to cassandra mbean proxy

2011-04-07 Thread Narendra Sharma
ax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:90) > > I have attached the code file. > > Cassandra is running on the port I am trying to connect to . > > Please Suggest > Thanks > Anurag > > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: old JMX code is not working with new cassandra version

2011-04-05 Thread Narendra Sharma
w > ObjectName("org.apache.cassandra.db:type=ColumnFamilyStores,keyspace="+keyspace+",columnfamily="+columnfamily); > > // Create a dedicated proxy for the MXBean instead of > // going directly through the MBean server connection >

Re: Understanding cfhistogram output

2011-04-01 Thread Narendra Sharma
l with cfhistogram I dont fully understand the > output.Can someone please shower some light on it. > Thanks > Anurag > > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Cassandra error Insufficient space to compact

2011-03-30 Thread Narendra Sharma
011-03-30 18:46:33,272 CompactionManager.java > (line 406) insufficient space to compact all requested files SSTableReader( > > I am using 16G of java heap space ,please let me know should I consider > this as a sign of something which I need to worry about. > Thanks > Anurag >

Re: Fatal error from a cassandra node

2011-03-30 Thread Narendra Sharma
ng that is causing OOM. -Naren On Wed, Mar 30, 2011 at 4:45 PM, Anurag Gujral wrote: > > I am using 16G of heap space how much more should i increase. > Please suggest > > Thanks > Anurag > > On Wed, Mar 30, 2011 at 11:43 AM, Narendra Sharma < > narendra.sha...@gmail

Re: difference between compaction, repair, clean

2011-03-30 Thread Narendra Sharma
ns: > > - compaction > - repair > - clean > > I understand that compaction consolidates the SSTables and physically > performs deletes by taking into account the Tombstones. But what does clean > and repair do then? > > > > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: Fatal error from a cassandra node

2011-03-30 Thread Narendra Sharma
eap. > > There's a wiki page somewhere that describes the overall rule of thumb > for heap sizing, but I can't find it right now. > > -- > / Peter Schuller > -- Narendra Sharma Solution Architect *http://www.persistentsys.com* *http://narendrasharma.blogspot.com/*

Re: client connection timeouts vs. thrift timeouts

2011-03-29 Thread Narendra Sharma
n later, and I don't want it to have > to wait however long I've set the thrift socket timeout to be. The feedback > I got initially was that I would run into problems with high load, and could > run into delays when cassandra gets overwhelmed. > > Does this make sense or a

Re: atomicity in cassandra

2011-03-28 Thread Narendra Sharma
transaction can leave the data in an > inconsistent state. Is there a way to figure out such inconsistencies ? Will > Cassandra keep a log of failed batch_mutate() operations, or partially > completed operations, that might require manual intervention when the client > comes back up

Re: memtable_threshold

2011-03-28 Thread Narendra Sharma
Hope this makes it clear. Thanks, Naren On Mon, Mar 28, 2011 at 2:15 PM, ruslan usifov wrote: > > > 2011/3/29 Narendra Sharma > >> This is because the memtable threshold is not correct to the last byte. >> The threshold basically account for column name, value and timestamp

Re: cassandra client sample code for 0.7.3

2011-03-25 Thread Narendra Sharma
Hope you find following useful. It uses raw thirft. In case you find difficulty in build and/or running the code, please reply back. private Cassandra.Client createClient(String host, int port) { TTransport framedTransport = new TFramedTransport(new TSocket(host, port)); TProtocol framedPr

Option for ordering columns by timestamp in CF

2011-03-24 Thread Narendra Sharma
Cassandra 0.7.4 Column names in my CF are of type byte[] but I want to order columns by timestamp. What is the best way to achieve this? Does it make sense for Cassandra to support ordering of columns by timestamp as option for a column family irrespective of the column name type? Thanks, Naren

Re: How to find what node a key is on

2011-03-23 Thread Narendra Sharma
The logic to find the node is not complicated. You compute the MD5 hash of the key. Create sorted list of tokens assigned to the nodes in the ring. Find the first token greater than the hash. This is the first node. Next in the list is the replica, which depends on the RF. Now this is simple becau

Re: ParNew (promotion failed)

2011-03-23 Thread Narendra Sharma
uslan usifov wrote: > > > 2011/3/23 Narendra Sharma > >> I understand that. The overhead could be as high as 10x of memtable data >> size. So overall the overhead for 16CF collectively in your case could be >> 300*10 = 3G. >> >> >> And how about G1 GC

Re: ParNew (promotion failed)

2011-03-23 Thread Narendra Sharma
I understand that. The overhead could be as high as 10x of memtable data size. So overall the overhead for 16CF collectively in your case could be 300*10 = 3G. Thanks, Naren On Wed, Mar 23, 2011 at 11:18 AM, ruslan usifov wrote: > > > 2011/3/23 Narendra Sharma > >> I

Re: ParNew (promotion failed)

2011-03-23 Thread Narendra Sharma
I think it is due to fragmentation in old gen, due to which survivor area cannot be moved to old gen. 300MB data size of memtable looks high for 3G heap. I learned that in memory overhead of memtable can be as high as 10x of memtable data size in memory. So either increase the heap or reduce the me

Re: Pauses of GC

2011-03-17 Thread Narendra Sharma
take lot of time. Check if it is due to some JVM bug. http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6477891 -Naren On Thu, Mar 17, 2011 at 9:47 AM, ruslan usifov wrote: > > > 2011/3/17 Narendra Sharma > >> What heap size are you running with? and Which version of C

Re: Pauses of GC

2011-03-17 Thread Narendra Sharma
What heap size are you running with? and Which version of Cassandra? Thanks, Naren On Thu, Mar 17, 2011 at 3:45 AM, ruslan usifov wrote: > Hello > > Some times i have very long GC pauses: > > > Total time for which application threads were stopped: 0.0303150 seconds > 2011-03-17T13:19:56.476+030

Re: getting exception when cassandra 0.7.3 is starting

2011-03-16 Thread Narendra Sharma
Is this new install or upgrade? Thanks, Naren On Wed, Mar 16, 2011 at 11:15 PM, Anurag Gujral wrote: > I am getting exception when starting cassandra 0.7.3 > > ERROR 01:10:48,321 Exception encountered during startup. > java.lang.NegativeArraySizeException > at > org.apache.cassandra.db.Colum

Re: Cassandra c++ client

2011-03-16 Thread Narendra Sharma
libcassandra isn't vary active. Since we already has a object pool library, we went for using raw thrift in C++ instead of using any other library. Thanks, Naren On Wed, Mar 16, 2011 at 10:03 PM, Primal Wijesekera < primalwijesek...@yahoo.com> wrote: > You could try this, > > https://github.com/

Re: calculating initial_token

2011-03-14 Thread Narendra Sharma
it wrong. the output shows a > nice fancy column called "Owns" but i've only ever seen the percentage > ... the amount of data or "load" is even ... doh. thanks for the > reply. cheers > -sd > > On Mon, Mar 14, 2011 at 10:47 PM, Narendra Sharma >

Re: calculating initial_token

2011-03-14 Thread Narendra Sharma
On the same page there is a section on Load Balance that talks about python script to compute tokens. I believe your question is more about assigning new tokens and not compute tokens. 1. "nodetool loadbalance" will result in recomputation of tokens. It will pick tokens based on the load and not t

Re: Calculate memory used for keycache

2011-03-14 Thread Narendra Sharma
Sometime back I looked at the code to find that out. Following is the result. There will be some additional overhead for internal DS for ConcurrentLinkedHashMap. * (<8 bytes for position i.e. value> + + <16 bytes for token (RP)> + <8 byte reference for DecoratedKey> + <8 bytes for descriptor ref

Re: Does the memtable replace the old version of column with the new overwriting version or is it just a simple append ?

2011-03-08 Thread Narendra Sharma
Multiple write for same key and column will result in overwriting of column in a memtable. Basically multiple updates for same (key, column) are reconciled based on the column's timestamp. This happens per memtable. So if a memtable is flushed to an sstable, this rule will be valid for the next mem

Re: OOM exceptions

2011-03-04 Thread Narendra Sharma
I have been through tuning for GC and OOM recently. If you can provide the cassandra.yaml, I can help. Mostly I had to play with memtable thresholds. Thanks, Naren On Fri, Mar 4, 2011 at 12:43 PM, Mark wrote: > We have 7 column families and we are not using the default key cache > (20). > >

Cassandra 0.7.2 - Enable/Disable HH via JMX (Jconsole)

2011-03-03 Thread Narendra Sharma
I am unable to enable/disable HH via JMX (JConsole). Even though the load is on and read/writes happening, I don't see "operations" component on Jconsole. To clarify further, I see only Jconsole->MBeans->org.apache.cassandra.db.StorageProxy.Attributes. I don't see Jconsole->MBeans->org.apache.cass

Re: dropped mutations, UnavailableException, and long GC

2011-02-24 Thread Narendra Sharma
1. Why 24GB of heap? Do you need this high heap? Bigger heap can lead to longer GC cycles but 15min look too long. 2. Do you have ROW cache enabled? 3. How many column families do you have? 4. Enable GC logs and monitor what GC is doing to get idea of why it is taking so long. You can add following

Re: New thread for : How does Cassandra handle failure during synchronous writes

2011-02-24 Thread Narendra Sharma
You are missing the point. The coordinator node that is handling the request won't wait for all the nodes to return their copy/digest of data. It just wait for Q (RF/2+1) nodes to return. This is the reason I explained two possible scenarios. Further, on what basis Cassandra will know that the dat

Re: How does Cassandra handle failure during synchronous writes

2011-02-23 Thread Narendra Sharma
ange will > be discarded via read repair > > On Wed, Feb 23, 2011 at 6:47 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Remember the simple rule. Column with highest timestamp is the one that >> will be considered correct EVENTUALLY. So consider follow

Re: How does Cassandra handle failure during synchronous writes

2011-02-23 Thread Narendra Sharma
Remember the simple rule. Column with highest timestamp is the one that will be considered correct EVENTUALLY. So consider following case: Cluster size = 3 (say node1, node2 and node3), RF = 3, Read/Write CL = QUORUM a. QUORUM in this case requires 2 nodes. Write failed with successful write to on

Changing comparators

2011-02-23 Thread Narendra Sharma
Today it is not possible to change the comparators (compare_with and compare_subcolumns_with). I went through the discussion on thread http://comments.gmane.org/gmane.comp.db.cassandra.user/12466. Does it make sense to atleast allow one way change i.e. from specific types to generic type? For eg c

sstable2json for SuperCounter CF not working

2011-02-01 Thread Narendra Sharma
Version: Cassandra 0.7.1 (build from trunk) Setup: - Cluster of 2 nodes (Say A and B) - HH enabled - Using the default Keyspace definition in cassandra.yaml - Using SuperCounter1 CF Steps: - Started the two nodes, loaded schema using nodetool - Executed counter update and read operations on A wit

Does HH work (or make sense) for counters?

2011-02-01 Thread Narendra Sharma
Version: Cassandra 0.7.1 (build from trunk) Setup: - Cluster of 2 nodes (Say A and B) - HH enabled - Using the default Keyspace definition in cassandra.yaml - Using SuperCounter1 CF Client: - Using CL of ONE I started the two Cassandra nodes, created schema and then shutdown one of the instances

Question on max_hint_window_in_ms

2011-01-31 Thread Narendra Sharma
As per config: # this defines the maximum amount of time a dead host will have hints # generated. After it has been dead this long, hints will be dropped. max_hint_window_in_ms: 360 # one hour Will this result in deletion of existing hints (from mem and disk)? or it will just stop creating ne

EOFException in ReadStage

2011-01-30 Thread Narendra Sharma
Version: Cassandra 0.7.1 I am seeing following exception at regular interval (very frequently) in Cassandra. I did a clean install of Cassandra 0.7.1 and deleted all old data. Any idea what could be the cause? The stack is same for all the occurrances. Thanks, Naren ERROR [ReadStage:11232] 2011-

Re: Using Cassandra for storing large objects

2011-01-27 Thread Narendra Sharma
e do > still have minor compactions turned on. > > > On Thu, Jan 27, 2011 at 12:56 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Thanks Anand. Few questions: >> - What is the size of nodes (in terms for data)? >> - How long have you been running? >

Re: Using Cassandra for storing large objects

2011-01-27 Thread Narendra Sharma
There is some latency that needs to be sorted out, but overall I > am positive. This is with 6.6, am in the process of moving it to 0.7. > > On Wed, Jan 26, 2011 at 11:37 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Anyone using Cassandra for storing large

Using Cassandra for storing large objects

2011-01-26 Thread Narendra Sharma
Anyone using Cassandra for storing large number (millions) of large (mostly immutable) objects (200KB-5MB size each)? I would like to understand the experience in general considering that Cassandra is not considered a good fit for large objects. https://issues.apache.org/jira/browse/CASSANDRA-265

Re: get_range_slices getting deleted rows

2011-01-25 Thread Narendra Sharma
Yes. See this http://wiki.apache.org/cassandra/FAQ#range_ghosts -Naren On Tue, Jan 25, 2011 at 2:59 PM, Nick Santini wrote: > Hi, > I'm trying a test scenario where I create 100 rows in a CF, then > use get_range_slices to get all the rows, and I get 100 rows, so far so good > then after the tes

Re: quick question about super columns

2011-01-06 Thread Narendra Sharma
With raw thrift APIs: 1. Fetch column from supercolumn: ColumnPath cp = new ColumnPath("ColumnFamily"); cp.setSuper_column("SuperColumnName"); cp.setColumn("ColumnName"); ColumnOrSuperColumn resp = client.get(getByteBuffer("RowKey"), cp, ConsistencyLevel.ONE); Column c = resp.getColumn(); 2. Add

Re: cassandra 0.7.0 noob question

2011-01-06 Thread Narendra Sharma
The schema is not loaded from cassandra.yaml by default. You need to either load it through jconsole or define it through CLI. Please read following page for details: http://wiki.apache.org/cassandra/LiveSchemaUpdates Also look for "Where are my keyspaces" on following page: http://wiki.apache.org

Cassandra 0.7 - Query on network topology

2011-01-05 Thread Narendra Sharma
Hi, We are working on defining the ring topology for our cluster. One of the plans under discussion is to have a RF=2 and perform read/write operations with CL=ONE. I know this could be an issue since it doesn't satisfy R+W > RF. This will work if we can always force the clients to go to the first

Re: Any GUI for Cassandra database on Windows?

2010-12-29 Thread Narendra Sharma
gt; I am using Cassandra 0.7.0-rc2. > > I will try this DB client. Thanks. > > > On Tue, Dec 28, 2010 at 10:41 AM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Please do mention the Cassandra version you are using in all ur queries. >> It helps. &g

Re: Supercolumn Maximums

2010-12-27 Thread Narendra Sharma
#1 - No limit #2 - If you are referring to secondary indexes then NO. Also see https://issues.apache.org/jira/browse/CASSANDRA-598 #3 - No limit Following are key limitations: 1. All data for a single row must fit (on disk) on a single machine in the cluster 2. A single column value may not be lar

Re: Any GUI for Cassandra database on Windows?

2010-12-27 Thread Narendra Sharma
Please do mention the Cassandra version you are using in all ur queries. It helps. Try https://github.com/driftx/chiton Thanks, Naren On Mon, Dec 27, 2010 at 7:37 PM, Roshan Dawrani wrote: > Hi, > > Is there a GUI client for a Cassandra database for a Windows based setup? > > I tried the one av

Re: read repair across datacenters?

2010-12-27 Thread Narendra Sharma
The comment in the cassandra.yaml says: "specifies the probability with which read repairs should be invoked on * non-quorum* reads" Does this mean RR chance is applicable only for non-quorum reads? Another question on same topic: Will RR use one of the node in the other datacenter as coordinat

Re: I have TimeUUID sorted keys. Can I get the range query return rows in the same order as sorted keys?

2010-12-27 Thread Narendra Sharma
;t be sure of a query that was based on order of the rows in the > column family, so I didn't explore that much. > > > > On Mon, Dec 27, 2010 at 9:55 PM, Narendra Sharma < > narendra.sha...@gmail.com> wrote: > >> Did you look at get_range_slices? Once you get t

Re: I have TimeUUID sorted keys. Can I get the range query return rows in the same order as sorted keys?

2010-12-27 Thread Narendra Sharma
Did you look at get_range_slices? Once you get the columns from super column, pick the first and last to form the range and fire the get_range_slice. Thanks, -Naren On Mon, Dec 27, 2010 at 6:12 AM, Roshan Dawrani wrote: > This silly question is retrieved back with apology. There couldn't be > an

Different sort order for each SC

2010-12-21 Thread Narendra Sharma
Hi, Is it possible to specify different sort order for each SuperColumn. My CF has 3 different SuperColums. They contain different type of data. Is it possible to specify different sort order for eg TimeUUIDType for SuperColumn1 and AsciiType for SuperColumn2 etc? If yes, can someone share the syn

Re: Cassandra 0.7 - Impact of row size and columns on compaction

2010-12-05 Thread Narendra Sharma
nger to compact that row. > > Hope that helps. > Aaron > > > On 04 Dec, 2010,at 09:23 AM, Narendra Sharma > wrote: > > What is the impact (performance and I/O) of row size (in bytes) on > compaction? > What is the impact (performance and I/O) of number of super col

Cassandra 0.7 - Impact of row size and columns on compaction

2010-12-03 Thread Narendra Sharma
What is the impact (performance and I/O) of row size (in bytes) on compaction? What is the impact (performance and I/O) of number of super columns and columns on compaction? Does anyone has any details and data to share? Thanks, Naren

Re: Fetch a SuperColumn based on value of column

2010-12-02 Thread Narendra Sharma
s for super column families >> is not supported yet, so you have to implement your own >> >> easy way: keep another column family where the row key is the value of >> your field and the columns are the row keys of your super column family >> >> (inverted index) >

Fetch a SuperColumn based on value of column

2010-12-02 Thread Narendra Sharma
Hi, My schema has a row that has thousands of Super Columns. The size of each super column is around 500B (20 columns). I need to query 1 SuperColumn based on value of one of its column. Something like SELECT SuperColumn FROM Row WHERE SuperColumn.column="value" Questions: 1. Is this possible wi

C++ client for Cassandra

2010-11-30 Thread Narendra Sharma
Are there any C++ clients out there similar to Hector (in terms of features) for Cassandra? I am looking for C++ Client for Cassandra 0.7. Thanks, Naren

Re: Cassandra 0.7 - documentation on Secondary Indexes

2010-11-29 Thread Narendra Sharma
On Mon, Nov 29, 2010 at 9:32 PM, Jonathan Ellis wrote: > On Mon, Nov 29, 2010 at 11:26 PM, Narendra Sharma > wrote: > > Thanks Jonathan. > > > > Couple of more questions: > > 1. Is there any technical limit on the number of secondary indexes that > can

Re: Cassandra 0.7 - documentation on Secondary Indexes

2010-11-29 Thread Narendra Sharma
Nov 29, 2010 at 7:59 PM, Narendra Sharma > wrote: > > Is there any documentation available on what is possible with secondary > > indexes? > > Not yet. > > > - Is it possible to define secondary index on columns within a > SuperColumn? > > No. > > >

Cassandra 0.7 - documentation on Secondary Indexes

2010-11-29 Thread Narendra Sharma
Is there any documentation available on what is possible with secondary indexes? For eg - Is it possible to define secondary index on columns within a SuperColumn? - If I define a secondary index at run time, does Cassandra index all the existing data or only new data is indexed? Some documentatio

batch_mutate vs number of write operations on CF

2010-11-29 Thread Narendra Sharma
Hi, I am using Cassandra 0.7 beta3 and Hector. I create a mutation map. The mutation involves adding few columns for a given row. After that I use batch_mutate API to send the changes to Cassandra. Question: If there are multiple column writes on same row in a mutation_map, does Cassandra show (

Re: working of get_range_slices

2010-10-14 Thread Narendra Sharma
the performance of those two predicates is equivalent, assuming a row > "start key" actually exists. > > On Thu, Oct 14, 2010 at 1:09 PM, Narendra Sharma > wrote: > > Hi, > > > > I am using Cassandra 0.6.5. Our application uses the get_range_slices to >

working of get_range_slices

2010-10-14 Thread Narendra Sharma
Hi, I am using Cassandra 0.6.5. Our application uses the get_range_slices to get rows in the given range. Could someone please explain how get_range_slices works internally esp when a count parameter (value = 1) is also specified in the SlicePredicate? Does Cassandra first search all in the given

Re: Retaining commit logs

2010-10-06 Thread Narendra Sharma
Thanks Oleg! Could you please share the patch. I have build Cassandra before from source. I can definitely give it try. -Naren On Wed, Oct 6, 2010 at 3:55 AM, Oleg Anastasyev wrote: > > Is it possible to retain the commit logs? > > In off-the-shelf cassandra 0.6.5 this is not possible, AFAIK.

Re: Query on sstable2json - possible bug

2010-10-06 Thread Narendra Sharma
Has any one used sstable2json on 0.6.5 and noticed the issue I described in my email below? This doesn't look like data corruption issue as sstablekeys shows the keys. Thanks, Naren On Tue, Oct 5, 2010 at 8:09 PM, Narendra Sharma wrote: > 0.6.5 > > -Naren > > > On Tue,

Retaining commit logs

2010-10-06 Thread Narendra Sharma
Cassandra Version: 0.6.5 I am running a long duration test and I need to keep the commit log to see the sequence of operations to debug few application issues. Is it possible to retain the commit logs? Apart from increasing the value of CommitLogRotationThresholdInMB what is the other way to achie

Re: Query on sstable2json - possible bug

2010-10-05 Thread Narendra Sharma
0.6.5 -Naren On Tue, Oct 5, 2010 at 6:56 PM, Jonathan Ellis wrote: > Version? > > On Tue, Oct 5, 2010 at 7:28 PM, Narendra Sharma > wrote: > > Hi, > > > > I am using sstable2json to extract row data for debugging some > application > > issue. I first r

Query on sstable2json - possible bug

2010-10-05 Thread Narendra Sharma
Hi, I am using sstable2json to extract row data for debugging some application issue. I first ran sstablekeys to find the list of keys in the sstable. Then I use the key to fetch row from sstable. The sstable is from Lucandra deployment. I get following. -bash-3.2$ ./sstablekeys Documents-37-Data

  1   2   >