Re: [slurm-users] sreport User Utilisation Over 300%

2022-07-29 Thread Benson Muite
On 7/29/22 11:59, mshubham wrote: Dear All, I am facing an issue in SLURM(20.11.8), in which sreport cluster utilization is 100%, and when I run sreport cluster userutilizationbyaccount, Some user utilisation is greater than 100%, three users including root showing utilisation over 250%, makin

Re: [slurm-users] slurmctld hanging

2022-07-29 Thread Loris Bennett
byron writes: > Yep, the question of how he has the job set up is an ongoing conversation, > but for now it is staying like this and I have to make do. Wow, your user must have friends in high places, if he gets to do some thing as goofy as starting a one-second job every second. > Even with a

Re: [slurm-users] slurmctld hanging

2022-07-29 Thread Maciej Pawlik
Hi Byron, does the slurmctld recover by itself or does It require a manual restart of the service? We had some deadlock issues related to MCS handling just after doing the 19->20->21 upgrades. I don't recall what fixed the issue but disabling MCS might be a good place to start if you are using it.

Re: [slurm-users] slurmctld hanging

2022-07-29 Thread byron
Yep, the question of how he has the job set up is an ongoing conversation, but for now it is staying like this and I have to make do. Even with all the traffic he is generating though (at worst 1 a second over the course of a day) I would still have though that slurm was capable of managing that.

[slurm-users] sreport User Utilisation Over 300%

2022-07-29 Thread mshubham
Dear All, I am facing an issue in SLURM(20.11.8), in which sreport cluster utilization is 100%, and when I run sreport cluster userutilizationbyaccount, Some user utilisation is greater than 100%, three users including root showing utilisation over 250%, making overall utilisation 500% (though user