Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-11-04 Thread Marcus Wagner
Hi Christopher, I didn't want to ask, if I need the jobacct_gather/cgroup plugin, but I wanted to say, that if one wants to use the jobacct_gather/cgroup plugin (instead of the jobacct_gather/linux plugin) you need cgroups and therefore the aforementioned ProctrackType and TaskPlugin settings.

Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-29 Thread Christopher Benjamin Coffey
Hi Marcus, yes we are talking about the jobacct_gather/cgroup plugin. Yes, if you want cgroups you need: ProctrackType=proctrack/cgroup TaskPlugin=task/cgroup,task/affinity But that doesn't mean you have to run the jobacct_gather/cgroup plugin, you have the option to use jobacct_gather/linux in

Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-25 Thread Marcus Wagner
Aren't we here talking about the job accounting gather plugin? I would say, you have to use cgroups, together with ProctrackType=proctrack/cgroup and TaskPlugin=task/cgroup if you want ot use the jobacct_gather/cgroup plugin, because elsewise SLURMdoes not pack the jobs into cgroups. Best Ma

Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-24 Thread Brian Andrus
IIRC, the big difference is if you want to use cgroups on the nodes. You must use the cgroup plugin. Brian Andrus On 10/24/2019 3:54 PM, Christopher Benjamin Coffey wrote: Hi Juergen, From what I see so far, there is nothing missing from the jobacct_gather/linux plugin vs the cgroup version

Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-24 Thread Christopher Benjamin Coffey
Hi Juergen, From what I see so far, there is nothing missing from the jobacct_gather/linux plugin vs the cgroup version. In fact, the extern step now has data where as it is empty when using the cgroup version. Anyone know the differences? Best, Chris -- Christopher Coffey High-Performance

Re: [slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-22 Thread Juergen Salk
Dear Chris, I could not find this warning in the slurm.conf man page. So I googled it and found a reference in the Slurm developers documentation: https://slurm.schedmd.com/jobacct_gatherplugins.html However, this web page says in its footer: "Last modified 27 March 2015". So maybe (means: hop

[slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

2019-10-22 Thread Christopher Benjamin Coffey
Hi, We've been using jobacct_gather/cgroup for quite some time and haven't had any issues (I think). We do see some lengthy job cleanup times when there are lots of small jobs completing at once, maybe that is due to the cgroup plugin. At SLUG19 a slurm dev presented information that the jobacc