Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Hello kooljava2, There aren't many books about Cassandra, but one of the most famous is the "Cassandra: The definitive guide: Distributed Data at Web Scale", by Hewitt The problem is that as Cassandra evolves very fast, these books get out of date quickly. To understand some concepts that exist in

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Thank you Jeff Jirsa by your comments, How can we do this: "fix this by not scheduling the major compaction until we know all of the sstables in the window are available to be compacted"? About the column-family schema, I had to customize the cassandra-stress tool so that it could create a reaso

Re: Cassandra upgrade from 2.1 to 3.0

2018-05-14 Thread kooljava2
We are using datstax java driver  1.5.0 Thank you. On Saturday, 12 May 2018, 10:37:04 GMT-7, Jeff Jirsa wrote: I haven't seen this before, but I have a guess. What client/driver are you using? Are you using a prepared statement that has every column listed for the update, and leaving

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Jeff Jirsa
Interesting! I suspect I know what the increased disk usage in TWCS, and it's a solvable problem, the problem is roughly something like this: - Window 1 has sstables 1, 2, 3, 4, 5, 6 - We start compacting 1, 2, 3, 4 (using STCS-in-TWCS first window) - The TWCS window rolls over - We flush (sstable

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread kooljava2
Hello, Thank you Lucas for sharing.  I am still a beginner in Cassandra NoSQL world. Are there any other good books related to Performance tuning and Architecture overview? Thank you. On Monday, 14 May 2018, 07:57:38 GMT-7, Nitan Kainth wrote: Hi Lucas, I am not able to download. can

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Nitan Kainth
Hi Lucas, I am not able to download. can you share as attachment in email? Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g Certified On Mon, May 14, 2018 at 9:12 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Dear community, > >

Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Dear community, I want to tell you about my paper published in a conference in March. The title is " NoSQL Database Performance Tuning for IoT Data - Cassandra Case Study" and it is available (not for free) in http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0006782702770284 . TWC

RE: [EXTERNAL] Re: Error after 3.1.0 to 3.11.2 upgrade

2018-05-14 Thread Durity, Sean R
A couple additional things: - Make sure that you ran repair on the system_auth keyspace on all nodes after changing the RF - If you are not often changing roles/permissions, you might look to increase permissions_validity_in_ms and roles_validity_in_ms so they are not being