Re: [slurm-users] Managing Multiple Dependencies

2021-03-03 Thread Jason Simms
Dear Mike and Jan, Thank you for your suggestions. Mike, your script was close to what I had in mind, though way more elegant. So I appreciate it! Also Jan, thank you for pointing out snakemake. Apparently people do use it with Slurm, so I'm looking into it. Probably overkill at this point for mo

Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Jan van der Laan
Snakemake is a tool to manage job dependencies. I don't have experience using this in a slurm context, but I have used Snakemake to manage complex depencies in workflows in other contexts. Snakemake should support slurm. HTH, Jan On 02-03-2021 20:16, Jason Simms wrote: Hello all, I am r

Re: [slurm-users] Managing Multiple Dependencies

2021-03-02 Thread Renfro, Michael
There may be prettier ways, but this gets the job done. Captures the output from each sbatch command to get a job ID, colon separates the ones in the second group, and removes the trailing colon before submitting the last job: #!/bin/bash JOB1=$(sbatch job1.sh | awk '{print $NF}') echo "Submitt