On Wed, Aug 26, 2020 at 12:48:27PM +0100, Stuart Henderson wrote: > This updates rsync to 3.2.3, which amongst other things includes > https://github.com/WayneD/rsync/commit/9375a8c4c2b79a9d44ceae00de7284b77d79033c > which greatly reduces maxrss (https://github.com/WayneD/rsync/issues/81). > > Also adds a patch for the --rsh problem I ran into (issue open upstream). > > OK?
Okay. > Not included in the diff, but also I would like to reopen the discussion > about dependencies. In order to lower resource use for CVS repository > mirrors (7.3G of data across 450K files) I would like to have xxhash > and lz4 enabled in the default ports build. > > xxhash and lz4 are nearly self-contained ports, they use the base > compiler, they use gmake but otherwise add no build dependencies above > what's already needed for rsync, and are available on all archs we > build packages for. > > xxhash is a single C file, takes ~10 seconds to build, the package > weighs in at 200K. > > lz4 is a little larger, 4 C files in the library, and there are tools > too so it takes more like 45 seconds to build, the package is 300K. > > These are not onerous requirements. > > zstd is a bit different, it uses "COMPILER=base-clang ports-gcc". > Seems this is needed for -Wvla which is used in the Makefile (easily > patched), and maybe for something related to atomics on certain archs > (hppa and powerpc are the usual suspects for this). It would be nice > to have zstd as well (it's an excellent compression tool and nicely > licensed) but that wants more work first so I am not proposing that at > this point. I don't think we'll be able to make it default, Theo will object. If you want it, you have to convince *him*, not me. The problem is not onerousness, but rather Theo being scared of more compression algorithms, which tend to be rife with overflows... rsync is cheap enough that more flavors is not really an issue.
