On 7/19/22 00:45, gphipps wrote:
Hi

Everyone so often one of our users accidentally writes a “fork-bomb” that submits thousands of sbatch and srun requests per second. It is a giant DDOS attack on our scheduler. Is there a way of rate limiting these requests before they reach the daemon? I could imagine writing a shim in front of sbatch/srun, but I was hoping there was an official way to do this

Perhaps setting MaxSubmitJobs and MaxJobs on associations and QOSes would do the trick?

You may also want to increase the default MaxJobCount in slurm.conf.

See my Wiki page for the details: https://wiki.fysik.dtu.dk/niflheim/Slurm_configuration#maxjobcount-limit

/Ole

Reply via email to