Re: Spreading parallel across nodes on HPC system

2022-11-12 Thread Ken Mankoff
Dear Ole, I do not have the error messages in front of me at the moment, but parallel reported that it could not detect CPUs on remote host, and was only spawning 1 job. The solution was documented here https://curc.readthedocs.io/en/iaasce-954_grouper/software/GNUParallel.html I use sbatch

How to parallelize find|while read do; ffprobe, grep and get the filenames?

2022-11-12 Thread D
Hello, I'm trying to parallelize my Bash shell script: find . -type f -iname "*.flac" -print0 | while read -d $'\0' FILENAME; do     INFOS=$(ffprobe -hide_banner "$FILENAME" 2>&1)     URL=$("$INFOS"|& grep -i 'http\|www')     if [ "$URL" != "" ]; then    echo -e "$FILENAME\t$URL"     fi don

Re: How to parallelize find|while read do; ffprobe, grep and get the filenames?

2022-11-12 Thread Ole Tange
On Sat, Nov 12, 2022 at 2:55 PM D wrote: > > Hello, > > I'm trying to parallelize my Bash shell script: > > find . -type f -iname "*.flac" -print0 | while read -d $'\0' FILENAME; do > INFOS=$(ffprobe -hide_banner "$FILENAME" 2>&1) > URL=$("$INFOS"|& grep -i 'http\|www') > if [ "$URL

Re: How to parallelize find|while read do; ffprobe, grep and get the filenames?

2022-11-12 Thread D
Hi, I figured it out myself (from some stackoverflow "FILE_BASENAME"-post) (but was gaming and didn't come to the `column` part yet), but thanks for `parallel` and reply :) func() {     FILENAME=$1 #    FILE_BASENAME=`echo ${FILENAME##*/}` #    echo $FILE_BASENAME     URL=$(ffprobe -hide_banner "