Re: Recommend Cassandra consultant

2024-09-27 Thread Aaron Ploetz
Casting a second vote for Jon Haddad. You can reach out to him on LinkedIn: https://www.linkedin.com/in/rustyrazorblade/ Thanks, Aaron On Fri, Sep 27, 2024 at 3:57 AM guo Maxwell wrote: > I want to at Jon Haddad 😁 > > Bowen Song via user 于2024年9月27日周五 16:39写道: > >> Hel

Re: storage engine series

2024-04-30 Thread Aaron Ploetz
Nice! This sounds awesome, Jon. On Mon, Apr 29, 2024 at 6:25 PM Jon Haddad wrote: > Hey everyone, > > I'm doing a 4 week YouTube series on the C* storage engine. My first > video was last week where I gave an overview into some of the storage > engine internals [1]. > > The next 3 weeks are loo

Re: Upgrade from C* 3 to C* 4 per datacenter

2023-10-26 Thread Aaron Ploetz
Just a heads-up, but there have been issues (at least one) reported when upgrading a multi-DC cluster from 3.x to 4.x when the cluster uses node-to-node SSL/TLS encryption. This is largely attributed to the fact that the secure port in 4.x changes to 9142, whereas in 3.x it continues to run on 9042

Re: Cassandra 5 & Support for JDK 17

2023-08-22 Thread Aaron Ploetz
-16895 <https://issues.apache.org/jira/browse/CASSANDRA-16895>. Its current status is "In Progress," which suggests that there may be some issues that haven't been resolved. I'd suggest keeping an eye on that ticket, as that should give you a pulse on this issue. Thanks, A

Re: Reads not returning data after adding node

2023-04-03 Thread Aaron Ploetz
that? > > Re the racks. I just asked that question on this list and the answer was > that adding the new nodes as rack4, rack5 and rack6 is fine. They are all > on separate physical racks. Is that ok? > > On Mon, Apr 3, 2023 at 5:16 PM Aaron Ploetz wrote: > >> The time it

Re: Reads not returning data after adding node

2023-04-03 Thread Aaron Ploetz
The time it takes to stream data off of a node varies by network, cloud region, and other factors. So it's not unheard of for it to take a bit to finish. Just thought I'd mention that auto_bootstrap is true by default. So if you're not setting it, the node should bootstrap as long as it's not a

Accord and elector selection

2023-03-01 Thread Aaron Ploetz
Under the premise of an Accord transaction, how does replica/elector selection happen? Does it choose replicas based on the partition keys? Or is there another way? Thanks! Aaron

Re: Cleanup

2023-02-16 Thread Aaron Ploetz
So if I remember right, setting compaction_throughput_per_mb to zero effectively disables throttling, which means cleanup and compaction will run as fast as the instance will allow. For normal use, I'd recommend capping that at 8 or 16. Aaron On Thu, Feb 16, 2023 at 9:43 AM Marc Hoppins

Re: [DISCUSS] Formation of Apache Cassandra Publicity & Marketing Group

2023-01-26 Thread Aaron Ploetz
> > We are going to have our first gathering next Wednesday at 8AM PT I'd like to help out, too, if you wouldn't mind forwarding that meeting on to me. Thanks, Aaron

Re: Denylisting with a composite partition key

2022-10-25 Thread Aaron Ploetz
everything is working. Thanks again, Cheng! Aaron On Fri, Oct 21, 2022 at 9:48 AM Aaron Ploetz wrote: > Awesome. Thank you, Cheng! I’ll give this a shot and let you know. > > Thanks, > > Aaron > > > On Oct 21, 2022, at 12:45 AM, Cheng Wang wrote: > >  > Hi

Re: Denylisting with a composite partition key

2022-10-21 Thread Aaron Ploetz
Awesome. Thank you, Cheng! I’ll give this a shot and let you know. Thanks, Aaron > On Oct 21, 2022, at 12:45 AM, Cheng Wang wrote: > >  > Hi Aaron, > > After reading through the code, I finally figured out the issue. So back to > your original question where you f

Re: Denylisting with a composite partition key

2022-10-20 Thread Aaron Ploetz
No worries, Cheng! So I actually pivoted a little and adjusted my example table to use a single integer-based partition key. aaron@cqlsh:stackoverflow> SELECT ks_name, table_name, blobAsint(key) FROM system_distributed.partition_denylist WHERE ks_name='stackoverflow' A

Re: Denylisting with a composite partition key

2022-10-19 Thread Aaron Ploetz
Just checking, but for this to work, do I have to mess with these settings in the YAML at all? partition_denylist_enabled: true denylist_reads_enabled: true They're commented out by default. Thanks, Aaron On Mon, Oct 17, 2022 at 4:53 PM Aaron Ploetz wrote: > Thanks for the help

Re: Denylisting with a composite partition key

2022-10-17 Thread Aaron Ploetz
0. Here's what I've got out there so far: aaron@cqlsh:stackoverflow> select ks_name, table_name, blobAsText(key) from system_distributed.partition_denylist; ks_name | table_name | system.blobastext(key) ---+-+-

Denylisting with a composite partition key

2022-10-17 Thread Aaron Ploetz
tKey with 4 parameters doesn't exist in bean org.apache.cassandra.db:type=StorageProxy Obviously, it's reading the space between "Minneapolis," and "MN" as a delimiter. What's the right way to handle commas, spaces, and composite keys for this? Also, is there another way to accomplish this without using JMX? Thanks, Aaron

Apache Cassandra(R) Corner podcast - Call for guests

2022-07-14 Thread Aaron Ploetz
ve to have you on as a guest. Feel free to reach out to me at either address: aaronplo...@gmail.com aaron.plo...@datastax.com Thanks! Aaron

The Apache Cassandra(R) Corner Podcast

2022-06-30 Thread Aaron Ploetz
The Apache Cassandra® Corner podcast is available on most major podcast platforms. It is intended to highlight cool use cases for Cassandra as well as the folks in the community who implement them. If you would like to be a guest on the podcast, please reach out to me! Thanks, Aaron

Re: Guardrails in Cassandra 4.1 Alpha

2022-06-23 Thread Aaron Ploetz
Ahh...yes, my default "aaron" user is indeed a SUPERUSER. Ok, so I created a new, non-superuser and tried again... > SELECT * FROm stackoverflow.movies WHERE title='Sneakers (1992)' ALLOW FILTERING; InvalidRequest: Error from server: code=2200 [Invalid query] message=&qu

Guardrails in Cassandra 4.1 Alpha

2022-06-23 Thread Aaron Ploetz
ILTERING; id | genre | title --++- 1396 | Crime|Drama|Sci-Fi | Sneakers (1992) (1 rows) Is there like some main "guardrails enabled" setting that I missed? Thanks, Aaron

new Cassandra Corner episode w/ Patrick McFadin

2022-06-22 Thread Aaron Ploetz
Nothing to see here...because well, it's a podcast, right? But I did get to spend some time with Patrick McFadin discussing our favorite database - Apache Cassandra! Listen in as we talk a little about the early days of Cassandra as well as the new, upcoming Cassandra 4.1 release. https://anchor.f

Re: Topology vs RackDC

2022-06-02 Thread Aaron Ploetz
ion of the cassandra-rackdc.properties file into our node-add automation. That way it looks at the target instance, and already knows which DC and rack to inject into the file. Thanks, Aaron P.S. - When using the cassandra-rackdc.properties file, the prevailing production wisdom has always been to

Re: The "Cassandra Corner" podcast

2022-06-01 Thread Aaron Ploetz
Maxn, Ah! That's because I had to explicitly enable RSS in the settings. Doh! Give that URL another shot and let me know if it doesn't work. Thanks, Aaron On Wed, Jun 1, 2022 at 12:54 PM Max Campos wrote: > Hi Aaron, > > Do you have the RSS feed URL handy? I looked a

The "Cassandra Corner" podcast

2022-06-01 Thread Aaron Ploetz
-corner/episodes/ep1---Lakhan-Samani-Authorizer-e1j10hv This podcast is intended to highlight cool use cases for Cassandra and the folks in the Apache Cassandra community who implement them. If you would like to be a guest on the podcast, please reach out to me. Thanks everyone, Aaron

Re: Cassandra tarball install and systemd

2022-02-09 Thread Aaron Ploetz
the user starting Cassandra has access to /var/run/casandra/ . Aaron On Wed, Feb 9, 2022 at 9:53 AM Bowen Song wrote: > Isn't the /etc/init.d/cassandra script supposed to create the PID file if > it doesn't exist? See: > https://github.com

Re: update cassandra.yaml file on number of cluster nodes

2021-10-18 Thread Aaron Ploetz
When I was at Target, we had a lot of success with Rundeck. It was a quick way to push out changes to hundreds of clusters. https://www.rundeck.com/open-source On Mon, Oct 18, 2021 at 12:19 PM Yakir Gibraltar wrote: > We manage via Puppet: https://github.com/voxpupuli/puppet-cassandra > > On

Re: Vulnerability in libthrift library (CVE-2019-0205)

2021-10-05 Thread Aaron Ploetz
In reading the Jira ticket, I see this line: "a server or client may run into an endless loop *when fed with specific input data.*" That seems to suggest that if the cassandra.yaml contains start_rpc: false, you should be ok. On Mon, Oct 4, 2021 at 8:12 PM rammohan ganapavarapu < rammohanga...@g

Re: Use NetworkTopologyStrategy for single data center and add data centers later

2020-12-19 Thread Aaron Ploetz
Yes, you absolutely can (and should) use NetworkTopologyStrategy with a single data center. In fact, I would argue that SimpleStrategy should almost never be used. But that's just me. Thanks, Aaron On Sat, Dec 19, 2020 at 3:21 AM Manu Chadha wrote: > Is it possibl

Re: Cassandra timeout during read query

2020-09-14 Thread Aaron Ploetz
Deepak, Can you reply with: 1) The query you are trying to run. 2) The table definition (PRIMARY KEY, specifically). 3) Maybe a little description of what the table is designed to do. 4) How much data you're expecting returned (both # of rows and data size). Thanks, Aaron On Mon, S

Re: Cassandra crashes when using offheap_objects for memtable_allocation_type

2020-06-02 Thread Aaron Ploetz
primary key ((partition_key, clustering_key)) Also, this primary key definition does not define a partitioning key and a clustering key. It defines a *composite* partition key. If you want it to instantiate both a partition and clustering key, get rid of one set of parens. primary key (partitio

Re: Cassandra crashes when using offheap_objects for memtable_allocation_type

2020-06-02 Thread Aaron Ploetz
ing does. You can't just pick-and-choose. Regards, Aaron On Tue, Jun 2, 2020 at 1:31 AM onmstester onmstester wrote: > I just changed these properties to increase flushed file size (decrease > number of compactions): > >- memtable_allocation_type from heap_buffers to offh

Re: Cassandra didn't order data according to clustering order

2018-07-15 Thread Aaron Ploetz
nt doesn't appear to be in any discernable order until you apply the token function to it. Aaron On Sun, Jul 15, 2018 at 8:05 AM, Soheil Pourbafrani wrote: > To the point, Thanks! > > On Sun, Jul 15, 2018 at 4:31 PM, shalom sagges > wrote: > >> The clustering column is or

Re: Bootstrapping node on Cassandra 3.7 causes cluster-wide performance issues

2017-09-11 Thread Aaron Wykoff
Unsubscribe On Mon, Sep 11, 2017 at 4:48 PM, Paul Pollack wrote: > Hi, > > We run 48 node cluster that stores counts in wide rows. Each node is using > roughly 1TB space on a 2TB EBS gp2 drive for data directory and > LeveledCompactionStrategy. We have been trying to bootstrap new nodes that > u

Re: Openstack and Cassandra

2016-12-22 Thread Aaron Ploetz
r external cloud providers. Hope that helps, Aaron On Thu, Dec 22, 2016 at 9:51 AM, Shalom Sagges wrote: > Thanks Vladimir! > > I guess I'll just have to deploy and continue from there. > > > > > Shalom Sagges > DBA > T: +972-74-700-4035 <+972%2074-700-4035&g

Re: Question about hector api documentation

2016-06-25 Thread Aaron Ploetz
ava driver. Aaron On Fri, Jun 24, 2016 at 11:09 AM, Jonathan Haddad wrote: > +1, do not use Hector. It hasn't had a commit in years and uses the thrift > protocol which is now marked deprecated. The DataStax Java driver is > recommended, possibly with Achilles to make things a bit

Re: Detect Repair is finish

2015-06-22 Thread Aaron Ploetz
You can do this with two nodetool commands: nodetool compactionstats will check on active Merkle Tree calculations. nodetool netstats will list out any active repair streams. Aaron Morton posted a Bash script/command a while back that you can just paste into the (linux) command line to monitor

Re: Consolidating records and TTL

2014-06-05 Thread Aaron Morton
can then delete ledger entries if needed. Don’t forget to ensure that only one client thread is doing this at a time. Hope that helps. Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Memory issue

2014-05-29 Thread Aaron Morton
sult in part of the JVM being swapped out, especially with mmapped > I/O enabled. > Increase RLIMIT_MEMLOCK or run Cassandra as root. Is there anything in the system logs ? Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cas

Re: What % of cassandra developers are employed by Datastax?

2014-05-29 Thread Aaron Morton
do to contribute to the health of the project. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 24/05/2014, at 7:28 am, Michael Shuler wrote: > On 05/23/2014 01:23 PM, Peter Li

Re: Increased Cassandra connection latency

2014-05-29 Thread Aaron Morton
running ParNew ? (it only logs when it’s longer than 200ms) Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 10:35 pm, Alexey Sverdelov wrote: > Hi all, &g

Re: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-28 Thread Aaron Morton
tell you the compression ratio. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 9:46 am, Phil Luckhurst wrote: > Hi Andreas, > > So does

Re: CQL 3 and wide rows

2014-05-20 Thread Aaron Morton
ary key columns. IMHO Wide partitions (storage engine rows) are more prevalent in CQL3 than thrift models. > But still - I do not see Iteration, so it looks to me that CQL 3 is limited > when compared to CLI/Hector. Now days you can do pretty much everything you can in cli. Provide

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-19 Thread Aaron Morton
ce is probably what you consider to “working” to mean. The token ranges are handled the same, it’s the row in them that changes. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-19 Thread Aaron Morton
> so that this amount is predictable (like 5% of entire dataset)? if you suppled a token range is that is 5% of the possible range of values for the token that should be close to a random 5% sample. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder &

Re: Question about READS in a multi DC environment.

2014-05-19 Thread Aaron Morton
In this case I was not thinking about what was happening synchronous to client request, only that the request was hitting all nodes. You are right, when reading at LOCAL_ONE the coordinator will only be blocking for one response (the data response). Cheers Aaron - Aaron

Re: Cassandra counter column family performance

2014-05-19 Thread Aaron Morton
> I get a lot of TExceptions What are the exceptions ? In general counters are slower than writes, but that does not lead them to fail like that. Check the logs for errors and/or messages from the GCInspector saying the garbage collection is going on. Cheers A ----- Aa

Re: Datacenter understanding question

2014-05-19 Thread Aaron Morton
. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/05/2014, at 3:55 am, Mark Farnan wrote: > Yes they will > > From: ng [mailto:pipeli...@gmail.com] &g

Re: Query returns incomplete result

2014-05-19 Thread Aaron Morton
Calling execute the second time runs the query a second time, and it looks like the query mutates instance state during the pagination. What happens if you only call execute() once ? Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consul

Re: Schema errors when bootstrapping / restarting node

2014-05-19 Thread Aaron Morton
pe and you have defined an index on a column and specified the column name as “column1” which is not a valid hex value. You should be able to fix this by dropping the index or dropping the CF. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-

Re: Effect of number of keyspaces on write-throughput....

2014-05-19 Thread Aaron Morton
rticular row. In general you can improve throughput by having more client threads hitting more machines. You can expect 3,000 to 4,000 non counter writes per code per node. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Princip

Re: idempotent counters

2014-05-19 Thread Aaron Morton
urrent design. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 1:07 am, Jabbar Azam wrote: > Hello, > > Do people use counters when they want

Re: Storing log structured data in Cassandra without compactions for performance boost.

2014-05-15 Thread Aaron Morton
. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/05/2014, at 8:36 am, DuyHai Doan wrote: > Hello Kevin > > You can disable compaction by configuring the compa

Re: How to balance this cluster out ?

2014-05-15 Thread Aaron Morton
distributed. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/05/2014, at 11:58 pm, Oleg Dulin wrote: > I have a cluster that looks like this: > > Datace

Re: How long are expired values actually returned?

2014-05-15 Thread Aaron Morton
> Is this normal or am I doing something wrong?. probably this one. But the TTL is set based on the system clock on the server, first through would be to check the times are correct. If that fails, send over the schema and the insert. Cheers Aaron ----- Aaron Morton

Re: Disable reads during node rebuild

2014-05-15 Thread Aaron Morton
> As of 2.0.7, driftx has added this long-requested feature. Thanks A ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/05/2014, at 9:36 am, Robert Coli wrote: > On Mon, May 12,

Re: Disable reads during node rebuild

2014-05-13 Thread Aaron Morton
ge tasks on the node you want to rebuild. If you have read repair enabled it will still get some traffic. * Do rebuild * Reset severity to 0 Hope that helps. Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http

Re: Really need some advices on large data considerations

2014-05-12 Thread Aaron Morton
) and bootstrapping. I’d recommend testing a smaller cluster, say 12 nodes, with a high load per node 3TB. cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 12:09

Re: Cassandra & MapReduce/Storm/ etc

2014-05-12 Thread Aaron Morton
timeout and is generally not a recommended access pattern in > Cassandra. The Hadoop integration is token aware, it splits the tasks to run local on the node. The tasks then scan over the token range local to the node. Hope that helps. A - Aaron Morton New Zealand @aaron

Re: Effect of number of keyspaces on write-throughput....

2014-05-12 Thread Aaron Morton
pace instead of multiple keyspaces to > increase the write throughput? > > You should expect to get 3,000 to 4,000 writes per core per node. What are you getting now? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consul

Re: Question about READS in a multi DC environment.

2014-05-12 Thread Aaron Morton
ground. Setting this to 1.0 will mean it’s active across the entire cluster for each read. Change read_repair_chance to 0 and set dclocal_read_repair_chance to 0.1 so that read repair will only happen local to the DC you are connected to. Hope that helps. A - Aaron Mort

Re: Cassandra mad GC

2014-01-16 Thread Aaron Morton
? > cpu load > 1000% Is this all from cassandra ? try jvmtop (https://code.google.com/p/jvmtop/) to see what cassandra threads are doing. It’s a lot easier to tune a system with fewer non default settings. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Foun

Re: various Cassandra performance problems when CQL3 is really used

2014-01-16 Thread Aaron Morton
the write path. So I would normally say make a new table to store the data you want to read, or change the layout of a table to me more flexible. Can you provide the table definition and the query you are using ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Pr

Re: upgrade from cassandra 1.2.3 -> 1.2.13 + start using SSL

2014-01-16 Thread Aaron Morton
able to run repair. All nodes have to use the same file version, file versions are here https://github.com/apache/cassandra/blob/cassandra-1.2/src/java/org/apache/cassandra/io/sstable/Descriptor.java#L52 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Prin

Re: Need ur expertise on Cassandra issue!!

2014-01-16 Thread Aaron Morton
. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/01/2014, at 3:53 pm, Arun wrote: > Hi , > > I need your help & suggestions for our production issue. > > Details: > --

Re: Problem in running cassandra-2.0.4 trigger example

2014-01-16 Thread Aaron Morton
>> But i am getting error: Bad Request: Key may not be empty My guess is the trigger is trying to create a row with an empty key. Add some logging to the trigger to see what it’s doing. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consult

Re: Understanding about Cassandra read repair with QUORUM

2014-01-16 Thread Aaron Morton
safe to set > "read_repair_chance=0 & dclocal_read_repair_chance=0" in column family > definition. It’s safe, read repair does not affect consistency. It’s designed to reduce the chance that the server will need to repair an inconsistency during a read for a client. Cheers

Re: upgrade from cassandra 1.2.3 -> 1.2.13 + start using SSL

2014-01-09 Thread Aaron Morton
use repair to fix the data on disk. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/01/2014, at 7:24 am, Robert Coli wrote: > On Wed, Jan 8, 2014 at 1:17 AM, Jir

Re: nodetool cleanup / TTL

2014-01-09 Thread Aaron Morton
.org/jira/browse/CASSANDRA-3442 They cannot be forced, but if there is nothing else to compact they will look for single sstables to compact. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle

Re: massive spikes in read latency

2014-01-09 Thread Aaron Morton
will also include information about the number tombstones touched in a read. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/01/2014, at 2:15 am, Jason Wee wrote: > /**

Re: Cassandra consuming too much memory in ubuntu as compared to within windows, same machine.

2014-01-09 Thread Aaron Morton
. Try 2Gb so there is room for other things. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 7/01/2014, at 9:03 am, Erik Forkalsud wrote: > On 01/04/2014 08:04 AM, Ertio Le

Re: Nodetool ring

2014-01-09 Thread Aaron Morton
Owns is how much of the entire, cluster wide, data set the node has. In both your examples every node has a full copy of the data. If you have 6 nodes and RF 3 they would have 50%. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Ap

Re: offheap component

2014-01-09 Thread Aaron Morton
blog posts at datastax. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 2/01/2014, at 7:08 pm, Jason Wee wrote: > Solely by the Cassandra version. Are you asking about a par

Re: Cleanup and old files

2013-12-30 Thread Aaron Morton
about the file. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 30/12/2013, at 1:28 pm, David McNelis wrote: > I am currently running a cluster with 1.2.8. One of my larger

Re: cassandra monitoring

2013-12-30 Thread Aaron Morton
r, maybe behind an “Advanced” button. The Ops Centre agent talks to the server to find out what JMX port it should use to talk to the local Cassandra install. Also check the logs in /var/log/datastax Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consu

Re: Offline migration: Random->Murmur

2013-12-30 Thread Aaron Morton
n bulk load them into the destination system.This will be much faster. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 29/12/2013, at 6:26 am, Edward Capriolo wrote: > Internally w

Re: querying time series from hadoop

2013-12-30 Thread Aaron Morton
a single row. Can you provide some more info on what you are doing ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/12/2013, at 9:56 pm, mete wrote: > Hello folks, > &

Re: Broken pipe with Thrift

2013-12-30 Thread Aaron Morton
the same as the one in the cassandra lib on the server. Can you do some simple tests using cqlsh from the client machine? That would eliminate the client driver. Hope that helps. ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandr

Re: Astyanax - multiple key search with pagination

2013-12-30 Thread Aaron Morton
You will need to paginate the list of keys to read in your app. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 12:58 pm, Parag Patel wrote: > Hi, > &

Re: MUTATION messages dropped

2013-12-30 Thread Aaron Morton
lot of CF’s and/or secondary indexes. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 6:03 am, Ken Hancock wrote: > I ended up changing memtable_flush_

Re: Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-23 Thread Aaron Morton
isting, it should settle down once compaction catches up. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 10:51 pm, Andreas Finke wrote: > Hi Aaron, > > I assume y

Re: Issue upgrading from 1.2 to 2.0.3

2013-12-23 Thread Aaron Morton
If this is still a concern can you post the output from nodetool gossipinfo ? It will give the details of the nodes think of the other ones. A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: WriteTimeoutException on Lightweight transactions

2013-12-23 Thread Aaron Morton
get to start the write. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 10:05 am, Demian Berjman wrote: > Hi. I am using Cassandra 2.0.3 with Datastax Java client.

Re: WriteTimeoutException instead of UnavailableException

2013-12-23 Thread Aaron Morton
elay in other nodes knowing it is down. If you stop gossip (nodetool disablegossip) the node will cancel the gossip thread (without interrupting), wait two seconds, then inform other nodes it’s leaving gossip. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder &am

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
odels. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 7:22 am, Kumar Ranjan wrote: > Rob - I got a question following your advice. This is how, I defi

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
> First approach: Sounds good. > Second approach ( I used in production ): If the row gets big enough this will have bad performance. A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.

Re: org.apache.thrift.TApplicationException: get_range_slices failed: out of sequence response

2013-12-23 Thread Aaron Morton
ers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12/2013, at 11:38 pm, Jason Wee wrote: > Hi, > In regards to recv_get_range_slices(), in my cassandra client code, it always

Re: Best way to measure write throughput...

2013-12-23 Thread Aaron Morton
nodetool proxyhistograms shows the throughput for the node, nodetool cfhistograms shows it for a single node. If you want to get an overview install something like Ops Centre http://www.datastax.com/what-we-offer/products-services/datastax-opscenter Cheers - Aaron Morton New

Re: How to tune cassandra to avoid OOM

2013-12-23 Thread Aaron Morton
w low the total heap use get’s to after CMS. JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=4" JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=2" JVM_OPTS="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=50” Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Fou

Re: Writes during schema migration

2013-12-23 Thread Aaron Morton
It depends a little on the nature of the change, but you need some coordination between the schema change and your code. e.g. add new column, change code to write to it or add new column, change code to use new column and not old column, remove old column. Cheers - Aaron

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-23 Thread Aaron Morton
u can reproduce this in a simple way please create a ticket at https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12/2013, at 2:42 am,

Re: Improving write performance in Cassandra and a few related issues...

2013-12-19 Thread Aaron Morton
?? > > Logging at the client level ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/12/2013, at 5:02 pm, Krishna Chaitanya wrote: > Thanks for the reply. By pac

Re: various Cassandra performance problems when CQL3 is really used

2013-12-17 Thread Aaron Morton
dary indexes are useful when you have a query pattern that is used infrequently. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/12/2013, at 3:47 am, Ondřej Černoš wrote: &

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-17 Thread Aaron Morton
-tmp- files will sit in the data dir, if there was an error creating them during compaction or flushing to disk they will sit around until a restart. Check the logs for errors to see if compaction was failing on something. Cheers - Aaron Morton New Zealand @aaronmorton Co

Re: Cassandra 1.2 : OutOfMemoryError: unable to create new native thread

2013-12-17 Thread Aaron Morton
Try using jstack to see if there are a lot of threads there. Are you using vNodea and Hadoop ? https://issues.apache.org/jira/browse/CASSANDRA-6169 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: Improving write performance in Cassandra and a few related issues...

2013-12-17 Thread Aaron Morton
f you are not seeing that it may be configuration or the client. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/12/2013, at 7:51 pm, Krishna Chaitanya wrote: > Hel

Re: Bulkoutputformat

2013-12-17 Thread Aaron Morton
> Request did not complete within rpc_timeout. The node is overloaded and did not return in time. Check the logs for errors or excessive JVM GC and try selecting less data. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Ca

Re: Write performance with 1.2.12

2013-12-17 Thread Aaron Morton
n the two it’s wait time + network time. As a general rule you should get around 3k to 4k writes per second per core. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/201

Re: Get all the data for x number of seconds from CQL?

2013-12-17 Thread Aaron Morton
nteger, record_name text, record_valueblob, PRIMARY KEY (day, timestamp, record_name) ) Store the day as MMDD and the timestamp as before, you can then do queries like select * from test1 where day = 20131218 and timestamp > X and timestamp < y; Cheers ---

Re: Cassandra data update for a row

2013-12-17 Thread Aaron Morton
roved": "true"}'),]) > > How can I set approved to 'false' ?? > > It looks like the value of the 411186035495010304 column is a string, to cassandra that’s an opaque typer we do not make partial updates to. If you need to update the values individually they need to

Re: Cassandra pytho pagination

2013-12-17 Thread Aaron Morton
something like, What client are you using ? xget is not a standard cassandra function. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/2013, at 4:56 am, Kumar Ranjan wrote:

Re: Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-17 Thread Aaron Morton
cluster? If so they do not bootstrap. The extra writes in nodes 5 and 6 could be from Read Repair writing to them. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, a

  1   2   3   4   5   6   7   8   9   10   >