Re: [slurm-users] Problem with assigning user to partition

2018-04-19 Thread Mahmood Naderan
To be honest, yes that is confusing me! sacctmgr shows the system user name under User column. I specified that name for the AllowAccounts parameter in the parts file. Is that wrong? Is AllowAccounts the same as Account column in sacctmgr? Then I see local only [root@rocks7 ~]# sacctmgr list assoc

Re: [slurm-users] Slurm overhead

2018-04-19 Thread Loris Bennett
Hi Mahmood, Mahmood Naderan writes: > Hi, > I have installed a program on all nodes since it is an rpm. Therefore, > when the program is running, it won't use the shared file system and > it just use its own /usr/local/program files. > > I also set a scratch path in the bashrc which is actually

Re: [slurm-users] Problem with assigning user to partition

2018-04-19 Thread Mahmood Naderan
I think the problem is that the system user name is not bound to the sacctmgr [root@rocks7 ~]# sacctmgr list association format=account,user,partition Account User Partition -- -- -- root root root local localmahmood [root@rocks7 ~]

Re: [slurm-users] Problem with assigning user to partition

2018-04-19 Thread Loris Bennett
Hi Mahmood, Mahmood Naderan writes: > Hi, > I have assigned user/group to a partition I also have set --partition > correctly in the sbatch script. However, the jobs remains pending with > the reason AccountNotAllowed. Any idea about that? > > > > [mahmood@rocks7 g]$ scontrol show partitions > .

Re: [slurm-users] Problem with assigning user to partition

2018-04-19 Thread Mahmood Naderan
[root@rocks7 ~]# cat /etc/slurm/parts PartitionName=WHEEL RootOnly=yes Priority=1000 Nodes=ALL PartitionName=MONTHLY1 AllowAccounts=mahmood AllowGroups=mahmood Nodes=compute-0-0 Please note that if I replace the user name "mahmood" with "ALL", then there is no problem. Regards, Mahmood On Fr

Re: [slurm-users] Problem with assigning user to partition

2018-04-19 Thread Ing. Gonzalo E. Arroyo
Could you share your configuration files from slurm El jue., 19 abr. 2018 17:13, Mahmood Naderan escribió: > Hi, > I have assigned user/group to a partition I also have set --partition > correctly in the sbatch script. However, the jobs remains pending with > the reason AccountNotAllowed. Any id

[slurm-users] Problem with assigning user to partition

2018-04-19 Thread Mahmood Naderan
Hi, I have assigned user/group to a partition I also have set --partition correctly in the sbatch script. However, the jobs remains pending with the reason AccountNotAllowed. Any idea about that? [mahmood@rocks7 g]$ scontrol show partitions PartitionName=MONTHLY1 AllowGroups=mahmood Allo

[slurm-users] Slurm overhead

2018-04-19 Thread Mahmood Naderan
Hi, I have installed a program on all nodes since it is an rpm. Therefore, when the program is running, it won't use the shared file system and it just use its own /usr/local/program files. I also set a scratch path in the bashrc which is actually the path on the running node. For example, I set T

Re: [slurm-users] Revisit: Split a GPU cluster into GPU cores and shared cores

2018-04-19 Thread Barry Moore
Chris, > We do have the issue where the four free cores are on one socket, > rather than being equally distributed across the sockets. When I > solicited advice from SchedMD for our config it seems they are > doing some work in this area that may hopefully surface in the next > major release (thou

Re: [slurm-users] Reporting time in minutes

2018-04-19 Thread Simon Flood
Hi Mahmood, On 18/04/18 16:55, Mahmood Naderan wrote: Is there any way to report the time columns only in minutes and not the auto mode? I mean $ sacct -a -X -j 56 --format=elapsed,cputime ElapsedCPUTime -- -- 1-01:07:36 33-12:03:12 means 1 day, 1 hour, 7 minutes and

Re: [slurm-users] slurm jobs are pending but resources are available

2018-04-19 Thread Marius.Cetateanu
> Date: Mon, 16 Apr 2018 12:50:57 -0400 > From: Michael Di Domenico > To: Slurm User Community List > Subject: Re: [slurm-users] slurm jobs are pending but resources are > available > Message-ID: > > Content-Type: text/plain; charset="UTF-8" > perhaps i missed something in the emai