callback on joblog

2014-07-23 Thread Rob Sargent
I would like to react to each job's completion. I need to accumulate the data from each run and decide whether or not it's worth while to continue with the remaining jobs. I don't think pipe is what I want, but maybe I'm misunderstanding that feature. Given that parallel is writing joblog (whic

Too much memory being used with "find" and parallel

2014-07-23 Thread Nelson A. de Oliveira
Hi! I have about 3 million PNG files across some directories and I would like to optimize them. I did a shell script with this function: optimize () { pngquant --force --speed 1 --ext .png 16 $1 optipng -o7 -quiet $1 } And I am (trying) to run it against all the PNGs with this: