Re: [slurm-users] How to run a job at the end of a set of jobs

2022-05-09 Thread West, Matthew
Hi David, I would recommend using one of the many workflow management systems (WMS) that can define job dependencies programmatically rather than fuss with base Slurm commands. Some examples I have used or have been recommended to me: - https://pegasus.isi.edu/ - https://cylc.github.io/ - http:

Re: [slurm-users] How to run a job at the end of a set of jobs

2022-05-09 Thread mercan
Instead of the using the epilog script, You can use the -d ( --dependency) feature of the sbatch: https://slurm.schedmd.com/sbatch.html It supports to run a job after finished multiple jobs. Regards; Ahmet M. 10.05.2022 00:50 tarihinde David Henkemeyer yazdı: Prologue is a feature whereby

[slurm-users] How to run a job at the end of a set of jobs

2022-05-09 Thread David Henkemeyer
Prologue is a feature whereby I can run something after a single job. Is there a best practice for running a job after a set of jobs? We submit a bunch of jobs to a bunch of nodes, and after all the jobs are done, we would like to submit a "utility job" on each node, but it has to be the last job

Re: [slurm-users] Slurm 21.08.8-2 upgrade

2022-05-09 Thread Mark Dixon
On Thu, 5 May 2022, Legato, John (NIH/NHLBI) [E] wrote: ... We are in the process of upgrading from Slurm 21.08.6 to Slurm 21.08.8-2. We’ve upgraded the controller and a few partitions worth of nodes. We notice the nodes are losing contact with the controller but slurmd is still up. We thought

[slurm-users] Partition dedicated to batch jobs only

2022-05-09 Thread Moshe Mergy
Hi all, How could I define a partition dedicated to batch jobs only, i.e. to use with sbatch only, not permitting to run srun/interactive jobs on it? Using Slurm options ? Using a Lua script blocking srun ? (though I don't understand much in Lua scripts) I currently use Slurm 20.02 Thanks a lot