On Sun, Jan 28, 2018 at 02:45:42AM +0100, Ole Tange wrote:
> --pipe keeps one block per process in memory, so the above should use
> around 25 GB of RAM.
>
> You can see the reason for this design by imagining jobs that reads
> very slowly: You will want all 5 of these to be running, but you would
Hi Ole,
I give some comments about the Parallel Book
Title
Maybe remove "2018", next years will come sooner than expected.
Suggestion: "The GNU Parallel Book"
About the reading levels : 5 levels looks too much,
just 2 or 3 levels at max is simpler for the reader and for you the writer.
* level
On Sun, Jan 28, 2018 at 02:45:42AM +0100, Ole Tange wrote:
> On Thu, Jan 25, 2018 at 4:33 PM, hubert depesz lubaczewski
> You can also use --cat:
>
> tar cf - /some/directory | parallel -j 5 --pipe --block 5G --cat
> --recend '' 'cat {} | ./handle-single-part.sh {#}'
>
> This way each block is
