Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-29 Thread Ole Holm Nielsen
On 28-04-2023 18:28, Hoot Thompson wrote: I’m somewhat confused by your statement "This would only occur if you lower the GrpTRESMins limit after a job has started.”. My test case had the limits established before job submittal and the job was terminated when the threshold was crossed. Accord

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-28 Thread Hoot Thompson
I’m somewhat confused by your statement "This would only occur if you lower the GrpTRESMins limit after a job has started.”. My test case had the limits established before job submittal and the job was terminated when the threshold was crossed. Hoot > On Apr 28, 2023, at 6:43 AM, Ole Holm Niel

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-28 Thread Ole Holm Nielsen
Hi Hoot, I'm glad that you have figured out that GrpTRESMins is working as documented and kills running jobs when the limit is exceeded. This would only occur if you lower the GrpTRESMins limit after a job has started. /Ole On 4/27/23 22:39, Hoot Thompson wrote: I have GrpTRESMins working

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-27 Thread Hoot Thompson
I have GrpTRESMins working and terminating jobs as expected. I was working under the belief that the limit “current value” was only updated upon job completion. That is not the case, it’s actually updated every 5 minutes it appears. If and when the limit/threshold is crossed, jobs are in fact ca

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-25 Thread Hoot Thompson
So Ole, any thoughts on the config info I sent? I’m still not certain if terminating a running job based on GrpTRESMins is even possible or supposed to work. Hoot > On Apr 24, 2023, at 3:21 PM, Hoot Thompson wrote: > > See below…... > >> On Apr 24, 2023, at 1:55 PM, Ole Holm Nielsen >> w

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-24 Thread Hoot Thompson
See below…... > On Apr 24, 2023, at 1:55 PM, Ole Holm Nielsen > wrote: > > On 24-04-2023 18:33, Hoot Thompson wrote: >> In my reading of the Slurm documentation, it seems that exceeding the limits >> set in GrpTRESMins should result in terminating a running job. However, in >> testing this, T

Re: [slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-24 Thread Ole Holm Nielsen
On 24-04-2023 18:33, Hoot Thompson wrote: In my reading of the Slurm documentation, it seems that exceeding the limits set in GrpTRESMins should result in terminating a running job. However, in testing this, The ‘current value’ of the GrpTRESMins only updates upon job completion and is not upda

[slurm-users] Terminating Jobs based on GrpTRESMins

2023-04-24 Thread Hoot Thompson
In my reading of the Slurm documentation, it seems that exceeding the limits set in GrpTRESMins should result in terminating a running job. However, in testing this, The ‘current value’ of the GrpTRESMins only updates upon job completion and is not updated as the job progresses. Therefore jobs a