Hello again Antonio. Antonio Diaz Diaz wrote in <[email protected]>: |Steffen Nurpmeso wrote: |> #?0|kent:plzip-1.11$ cp /x/balls/gcc-13.2.0.tar.xz X1 |> #?0|kent:plzip-1.11$ cp X1 X2 |> [...] |> -rw-r----- 1 steffen steffen 89049959 May 7 22:14 X1.lz |> -rw-r----- 1 steffen steffen 89079463 May 7 22:14 X2.lz | |Note that if you use uncompressible files as input, you'll always obtain |similar compressed sizes, no matter the compression level or the diction\ |ary |size. Try the test with gcc-13.2.0.tar and you'll see the difference. \ |(As in |your other test with /x/doc/coding/austin-group/202x_d4.txt). | |> I think dynamically scalling according to the processors, talking |> into account the dictionary size, as you said above, is the sane |> approach for "saturating" with plzip, in the above job there are |> quite a lot of files, of varying size (the spam DB being very |> large), and one recipe is not good for them all. | |Maybe there is a better way (almost optimal for many files) to compress \ |the |spam DB that does not require a parallel compressor, but uses all the
That was only an example, that is a single bogofilter lmdb text dump, perfect for your default algorithm. |processors in your machine. (And, as a bonus, achieves maximum compression |on files of any size and produces reproducible files). | | ls | xargs -n1 -P4 lzip -9 | |The command above should produce better results than a saturated plzip. | |'ls' may be replaced by any way to generate a list of the files to be |compressed. See |http://www.gnu.org/software/findutils/manual/html_node/find_html/xargs-o\ |ptions.html Yes, thank you.. but no, then i would simply ()&, save away the $!'s and wait(1) for them, in this case. I find the adaption compression of (p)lzip still very satisfying (all this started up with gzip quite long ago, i think (arj back in the 90s on 4DOS / Windows 95B, in fact)). |Hope this helps, |Antonio. Oh, i very much like your plzip! Thank you very much. lzlib too but for the malloc()s 8-) --End of <[email protected]> I wish you a good time, dear Antonio. Ciao from Germany, --steffen | |Der Kragenbaer, The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt)
