Path to UCS being default our compaction strategy

2024-12-08 Thread Jordan West
Splitting this out from the other thread. It seems like there is broad support for eventually moving towards UCS as our default compaction strategy. What do we think needs to be completed ahead of that change. What I've heard so far: * Time / more reports of use in production - In particular for m

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Paulo Motta
I think this would beneficial since we have a loose agreement that UCS is a promising option as new default. I plan to summarize the views expressed in this thread to propose a plan to make compactions usability smoother to new users in Cassandra, if there are any short term actions we can agree t

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Jordan West
While we continue the discussion here on short term defaults do we all feel it would be beneficial to start a new thread on what is required to get UCS over the line as a default? So we can have both discussions going at once? On Sun, Dec 8, 2024 at 8:44 AM Paulo Motta wrote: > > Hi Dave, > > I

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Paulo Motta
Hi Dave, I appreciate these performance/cost considerations and I believe these should be taken into account when evaluating default changes. I am trying to frame this as an usability issue with the database by shipping with STCS by default. I think it's possible to classify workloads into two t

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Dave Herrington
…the analysis I describe would need to be weighted by table size. I have several representative production cluster tablestats analyses that show r:w ratio by table, including table size. I can check to see how this analysis plays out on a few of these. -Dave David A. Herrington II President and

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Dave Herrington
Paulo, I understand your perspective. Short of waiting for UCS to prove itself out, I guess it comes down to the assertion that a strong majority of Cassandra use cases would benefit from using LCS vs. STCS. The conventional wisdom is that workloads need to be read-heavy to make the extra resour

Re: Planet Cassandra meetup organizer opportunity

2024-12-08 Thread Aaron
Melissa, I would be happy to help, as well. Thanks, Aaron On Fri, Dec 6, 2024 at 11:56 PM Soheil Rahsaz wrote: > Hello Mellisa > > I am also eager to volunteer and excited to help. I have previously given > talks about Cassandra. > > Regards, > Soheil > > On Sat, Dec 7, 2024 at 1:11 AM Melis

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Paulo Motta
> I feel it could be maddening to customers if LCS started showing up in schemas after an upgrade just because the default changed. Fwiw I’m not proposing changing the default for existing users or clusters, but just for new tables in new clusters. Existing clusters would keep the legacy default a

Re: Re-evaluate compaction defaults in 5.1/trunk

2024-12-08 Thread Paulo Motta
Hi Dave, I'm also in the field and my experience is different. I have seen new users shooting themselves in the foot with the default compaction strategy STCS on a regular basis over the past few years and have been recommending them to switch to LCS and they no longer encounter issues after maki