Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Zenaan Harkness
- Forwarded message - ‐‐‐ Original Message ‐‐‐ On Wednesday, July 8, 2020 7:53 AM, Zenaan Harkness wrote: > Anyone here able to answer this annoying buffer issue on bulk copies? [ paraphrasing: page cache gets swamped by bulk copy, driving interactive desktop applications to he

Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Greg Wooledge
On Thu, Jul 09, 2020 at 12:02:39AM +1000, Zenaan Harkness wrote: > What I imagine, and surely hope is that this softlimit program works as > advertised. It's hardly unique. You could do the same thing with a shell script wrapper that calls ulimit and then exec's the target program. > [stuff abou

Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Zenaan Harkness
On Wed, Jul 08, 2020 at 08:05:23AM -0400, Greg Wooledge wrote: > On Wed, Jul 08, 2020 at 08:00:38AM -0400, Dan Ritter wrote: > > Zenaan Harkness wrote: > > > > > > Seriously, is there a way to stop bulk copies from eternally flushing my > > > $Desktop's cached pages down the drain minute after bl

Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Greg Wooledge
On Wed, Jul 08, 2020 at 08:00:38AM -0400, Dan Ritter wrote: > Zenaan Harkness wrote: > > > > Seriously, is there a way to stop bulk copies from eternally flushing my > > $Desktop's cached pages down the drain minute after blessful minute, > > hour after gratitude filled hour? > > softlimit is pa

Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Dan Ritter
Zenaan Harkness wrote: > > Seriously, is there a way to stop bulk copies from eternally flushing my > $Desktop's cached pages down the drain minute after blessful minute, > hour after gratitude filled hour? softlimit is packaged in daemontools. NAME softlimit - runs another program with

Re: minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Reco
Hi. On Wed, Jul 08, 2020 at 05:51:54PM +1000, Zenaan Harkness wrote: > What needs to happen ™©® > > What is needed is an option somewhere, strictly abided by, where "For > the following command" only say 1MiB of buffer and Page Cache, in TOTAL, > is able to be used by that command ever, u

minimizing buffer size (i.e. page cache) for bulk copy/rsync -- Re: Swappiness in Buster

2020-07-08 Thread Zenaan Harkness
On Wed, Jul 08, 2020 at 08:26:18AM +0200, Martin Reissner wrote: > For the sake of completeness, I seem to have solved it after some more > research and it turned out to be systemd, as following bug that was > reported for Centos7 seems to be applying to Debian Buster as well: > > https://github.c

Re: Swappiness in Buster

2020-07-07 Thread Martin Reissner
For the sake of completeness, I seem to have solved it after some more research and it turned out to be systemd, as following bug that was reported for Centos7 seems to be applying to Debian Buster as well: https://github.com/systemd/systemd/issues/9276 Luckily the workaround mentioned in: https

Re: Swappiness in Buster

2020-07-07 Thread Martin Reissner
On 06/07/2020 23:27, deloptes wrote: > May be look deeper in documentation - I recall asking few years ago and was > answered that now it would cache whatever it can and will free on demand. > swap is done only if memory is really insufficient. > > I don't recall when or where I asked read this >

Re: Swappiness in Buster

2020-07-06 Thread deloptes
Martin Reissner wrote: > Yeah, only talking about server and mostly database applications. I > usually set it to 1, but even tried 0 which disabled swap completely on > Stretch but on Buster it didn't make a difference at all, the setting > seems to be ignored while using default swappiness (60?)

Re: Swappiness in Buster

2020-07-06 Thread Martin Reissner
On 06/07/2020 18:11, songbird wrote: > Martin Reissner wrote: > >> Hello, >> >> ever since upgrading machines to Buster the vm.swappiness sysctl >> parameter doesn't seem to do anything anymore and regardless on how I >> set it via sysctl or directly in /proc the system behaves as it would >> have

Re: Swappiness in Buster

2020-07-06 Thread songbird
Martin Reissner wrote: > Hello, > > ever since upgrading machines to Buster the vm.swappiness sysctl > parameter doesn't seem to do anything anymore and regardless on how I > set it via sysctl or directly in /proc the system behaves as it would > have a pretty high swappiness and thus is swapping

Swappiness in Buster

2020-07-06 Thread Martin Reissner
Hello, ever since upgrading machines to Buster the vm.swappiness sysctl parameter doesn't seem to do anything anymore and regardless on how I set it via sysctl or directly in /proc the system behaves as it would have a pretty high swappiness and thus is swapping out quite a bit under load, using t