Re: Academic paper about Cassandra database compaction

2018-05-15 Thread Jeff Jirsa
On Mon, May 14, 2018 at 11:04 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Thank you Jeff Jirsa by your comments, > > How can we do this: "fix this by not scheduling the major compaction > until we know all of the sstables in the window are available to be > compacted"? > > Would r

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Hello kooljava2, There aren't many books about Cassandra, but one of the most famous is the "Cassandra: The definitive guide: Distributed Data at Web Scale", by Hewitt The problem is that as Cassandra evolves very fast, these books get out of date quickly. To understand some concepts that exist in

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Thank you Jeff Jirsa by your comments, How can we do this: "fix this by not scheduling the major compaction until we know all of the sstables in the window are available to be compacted"? About the column-family schema, I had to customize the cassandra-stress tool so that it could create a reaso

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Jeff Jirsa
Interesting! I suspect I know what the increased disk usage in TWCS, and it's a solvable problem, the problem is roughly something like this: - Window 1 has sstables 1, 2, 3, 4, 5, 6 - We start compacting 1, 2, 3, 4 (using STCS-in-TWCS first window) - The TWCS window rolls over - We flush (sstable

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread kooljava2
Hello, Thank you Lucas for sharing.  I am still a beginner in Cassandra NoSQL world. Are there any other good books related to Performance tuning and Architecture overview? Thank you. On Monday, 14 May 2018, 07:57:38 GMT-7, Nitan Kainth wrote: Hi Lucas, I am not able to download. can

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Nitan Kainth
Hi Lucas, I am not able to download. can you share as attachment in email? Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g Certified On Mon, May 14, 2018 at 9:12 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Dear community, > >

Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Dear community, I want to tell you about my paper published in a conference in March. The title is " NoSQL Database Performance Tuning for IoT Data - Cassandra Case Study" and it is available (not for free) in http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0006782702770284 . TWC