Re: [DISCUSS] Improve Commitlog write path

2022-09-21 Thread Branimir Lambov
. Now it is clear that what are some benefits of this > patch. I will send it for review once it is ready and hopefully it gets > accepted. > > > > Thanks, > > Amit > > > > *From:* Bowen Song via dev > *Sent:* Tuesday, July 26, 2022 5:36 PM > *To:* dev@cassand

RE: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Pawar, Amit
: dev@cassandra.apache.org<mailto:dev@cassandra.apache.org> Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Hi Amit, The compaction bottleneck is not an instantly visible limitation. It in effect limits the total size of writes over a fairly long period of time, bec

Re: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Bowen Song via dev
es for too long. With lower throughput large system can ingest more data. Does it make sense ? Thanks, Amit *From:* Bowen Song via dev *Sent:* Friday, July 22, 2022 4:37 PM *To:* dev@cassandra.apache.org *Subject:* Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Hi

RE: [DISCUSS] Improve Commitlog write path

2022-07-26 Thread Pawar, Amit
ficial for workloads where data is not kept/left on nodes for too long. With lower throughput large system can ingest more data. Does it make sense ? Thanks, Amit From: Bowen Song via dev Sent: Friday, July 22, 2022 4:37 PM To: dev@cassandra.apache.org Subject: Re: [DISCUSS] Improve Commitlog write path

Re: [DISCUSS] Improve Commitlog write path

2022-07-25 Thread Elliott Sims
July 22, 2022 10:24 PM > *To:* dev@cassandra.apache.org > *Cc:* Bowen Song ; Raghavendra, Prakash < > prakash.raghaven...@amd.com> > *Subject:* Re: [DISCUSS] Improve Commitlog write path > > > > [CAUTION: External Email] > > Amit, welcome and thank you for cont

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] Amit, welcome and thank you for contributing the results from your test and opening this discussion. I don’t think anyone is arguing that the database shouldn’t take advantage of available hardware. A few things

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread C. Scott Andreas
:56 PM To: dev@cassandra.apache.org Cc: Bowen Song ; Raghavendra, Prakash Subject: Re: [DISCUSS] Improve Commitlog write path   [CAUTION: External Email] Hi Amit,   I am inclined to agree with Bowen Song, in that benchmarks from an initially empty cluster tend to lean more heavily on

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
ia dev mailto:dev@cassandra.apache.org>> Sent: Wednesday, July 20, 2022 4:13 PM To: dev@cassandra.apache.org<mailto:dev@cassandra.apache.org> Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] From my past experience, the bottleneck for insert heavy workloa

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Brad
. > > > > Thanks, > > Amit > > > > *From:* Bowen Song via dev > *Sent:* Wednesday, July 20, 2022 4:13 PM > *To:* dev@cassandra.apache.org > *Subject:* Re: [DISCUSS] Improve Commitlog write path > > > > [CAUTION: External Email] > > From m

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Bowen Song via dev
reflecting in score. Do you think multi-threading is good to have now ? else please suggest if I need to test further. Thanks, Amit *From:* Bowen Song via dev *Sent:* Wednesday, July 20, 2022 4:13 PM *To:* dev@cassandra.apache.org *Subject:* Re: [DISCUSS] Improve Commitlog write path [CAUTI

Re: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Benedict
rom: Bowen Song via dev > Sent: Wednesday, July 20, 2022 4:13 PM > To: dev@cassandra.apache.org > Subject: Re: [DISCUSS] Improve Commitlog write path > > [CAUTION: External Email] > From my past experience, the bottleneck for insert heavy workload is likely > to be com

RE: [DISCUSS] Improve Commitlog write path

2022-07-22 Thread Pawar, Amit
test further. Thanks, Amit From: Bowen Song via dev Sent: Wednesday, July 20, 2022 4:13 PM To: dev@cassandra.apache.org Subject: Re: [DISCUSS] Improve Commitlog write path [CAUTION: External Email] >From my past experience, the bottleneck for insert heavy workload is likely to >be comp

Re: [DISCUSS] Improve Commitlog write path

2022-07-20 Thread Bowen Song via dev
From my past experience, the bottleneck for insert heavy workload is likely to be compaction, not commit log. You initially may see commit log as the bottleneck when the table size is relatively small, but as the table size increases, compaction will likely take its place and become the new bot