[slurm-users] How to find the average downtime of compute nodes in a cluster?

Like any node is *down* state (not drng or drain or IDLE or ALLOC) -- Thanks & Regards, Sudeep Narayan Banerjee System Analyst | Scientist B Information System Technology Facility Academic Block 5 | Room 110 Indian Institute of Technology Gandhinagar Palaj, Gujarat 382355 INDIA

Re: [slurm-users] How to get the Average number of CPU cores used by jobs per day?

Dear Steven: Yes, but am unable to get the desired data. Not sure which flags to use. Thanks & Regards, Sudeep Narayan Banerjee On 03/04/20 10:42 am, Steven Dick wrote: Have you looked at sreport? On Fri, Apr 3, 2020 at 1:09 AM Sudeep Narayan Banerjee wrote: How to get the Average number of

Re: [slurm-users] Executing slurm command from Lua job_submit script?

Hi Chansup, could you provde a code snippet? Best Marcus Am 02.04.2020 um 19:43 schrieb CB: Hi, I'm running Slurm 19.05. I'm trying to execute some Slurm commands from the Lua job_submit script for a certain condition. But, I found that it's not executed and return nothing. For example, I

Re: [slurm-users] How to get the Average number of CPU cores used by jobs per day?

Have you looked at sreport? On Fri, Apr 3, 2020 at 1:09 AM Sudeep Narayan Banerjee wrote: > > How to get the Average number of CPU cores used by jobs per day by a > particular group? > > By group means: say faculty group1, group2 etc. all those groups are having a > certain number of students >

[slurm-users] How to get the Average number of CPU cores used by jobs per day?

How to get the Average number of CPU cores used by jobs per day by a particular group? By group means: say faculty group1, group2 etc. all those groups are having a certain number of students -- Thanks & Regards, Sudeep Narayan Banerjee System Analyst | Scientist B Information System Technolo

[slurm-users] Monitoring Preempted Jobs

Hi, What's the best way(s) of monitoring jobs that are pre-empted? We can see various messages written out to the slurmctld and slurmd logs, but I can't find a variation of any of the commands that will list all jobs that have been preempted? Nor can I see a persistent state within the database

[slurm-users] Executing slurm command from Lua job_submit script?

Hi, I'm running Slurm 19.05. I'm trying to execute some Slurm commands from the Lua job_submit script for a certain condition. But, I found that it's not executed and return nothing. For example, I tried to execute a "sinfo" command from an external shell script but it didn't work. Does Slurm pr

[slurm-users] Interaction between suspension/preemption and core affinity

Hello everyone, I have setup slurm (19.05) to use suspension to be able to pre-empt jobs in a lower priority queue by a higher priority queue. However, jobs aren't resuming as I would expect. If a higher priority job completes and frees up resources for the lower priority jobs, often the suspended

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

Ok, this sacct command lists all jobs that were running on a single day: DAY=2020-03-09 sacct -a -S${DAY}T00:00:00 -E${DAY}T23:59:59 -X -o user --state=running -n Total number of jobs active that day: | wc -l Total number of unique users: | sort -u | wc -l /Peter On Thu, 2 Apr 2020 18:01:1

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

I would recommend setting up XDMoD as it will calculate this, plus a variety of other useful facts: https://open.xdmod.org/8.5/index.html Also if you like grafana you can use this: https://github.com/fasrc/slurm-diamond-collector -Paul Edmon- On 4/2/2020 8:31 AM, Sudeep Narayan Banerjee wro

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

Dear Peter: I am trying with *sacct* and multiple flags.. but am not getting the desired output as per the query... Thanks & Regards, Sudeep Narayan Banerjee On 02/04/20 5:23 pm, Peter Kjellström wrote: On Thu, 2 Apr 2020 16:57:46 +0530 Sudeep Narayan Banerjee wrote: any help in getting the

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

On 02-04-2020 14:16, Sudeep Narayan Banerjee wrote: Well I am looking for, How many users ran jobs on each day on an average (day average) with at least one job running? Exactly! The NEXT_JOB_ID increases by 1 for every job submitted. You may simply read and store this number every day at 00:0

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

Well I am looking for, How many users ran jobs on each day on an average (day average) with at least one job running? Thanks & Regards, Sudeep Narayan Banerjee On 02/04/20 5:34 pm, Ole Holm Nielsen wrote: On 02-04-2020 13:27, Sudeep Narayan Banerjee wrote: any help in getting the right flags

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

On 02-04-2020 13:27, Sudeep Narayan Banerjee wrote: any help in getting the right flags ? The question is not well-defined. If you just want to know the JobID number in the cluster, you could run this command every day and watch the NEXT_JOB_ID increase: # scontrol show config | grep NEXT_

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

Dear Peter: Thank you for your response. Well I am looking for, How many users ran jobs on each day on an average (day average) with at least one job running? Thanks & Regards, Sudeep Narayan Banerjee System Analyst | Scientist B Information System Technology Facility Academic Block 5 | Room 1

Re: [slurm-users] How many users are running jobs per day on average in slurm ?

On Thu, 2 Apr 2020 16:57:46 +0530 Sudeep Narayan Banerjee wrote: > any help in getting the right flags ? You may need to clarify that question a bit... How many users ran jobs on each day? (weekly, monthly average?) How many jobs/per day did each user run? (weekly, monthly average?) And what

[slurm-users] How many users are running jobs per day on average in slurm ?

any help in getting the right flags ? -- Thanks & Regards, Sudeep Narayan Banerjee System Analyst | Scientist B Information System Technology Facility Academic Block 5 | Room 110 Indian Institute of Technology Gandhinagar Palaj, Gujarat 382355 INDIA