Re: [slurm-users] Running pyMPI on several nodes

2019-08-12 Thread Pär Lundö
Hi Benson! Yeah, it was via an NFS-share. Best regards, Pälle On 2019-08-13 08:30, Benson Muite wrote: Hi Pälle! Great. It would be helpful to know how they shared the etc directory? NFS? Benson On 8/13/19 9:25 AM, Pär Lundö wrote: Hi! I have now had the chance to look into to this matt

Re: [slurm-users] sacctmgr dump question - how can I dump entities other than cluster?

2019-08-12 Thread Daniel Letai
The cluster config doesn't contain qos rules definitions. It only contains mappings of qos to users/accounts. Currently it is impossible to dump and edit qos rules, although it is possible to add and remove defined qos from/to users. Regards, --Dani_L.

Re: [slurm-users] Running pyMPI on several nodes

2019-08-12 Thread Benson Muite
Hi Pälle! Great. It would be helpful to know how they shared the etc directory? NFS? Benson On 8/13/19 9:25 AM, Pär Lundö wrote: Hi! I have now had the chance to look into to this matter more thoroughly and it seems that the problem was due to the fact that the nodes are diskless and share

Re: [slurm-users] Running pyMPI on several nodes

2019-08-12 Thread Pär Lundö
Hi! I have now had the chance to look into to this matter more thoroughly and it seems that the problem was due to the fact that the nodes are diskless and shared some data (e.g. "etc"-dir). I removed that dependency and mounted each node to a unique set of folders, which resolved the issue.

Re: [slurm-users] 19.05 and GPUs vs GRES

2019-08-12 Thread Chris Samuel
On Monday, 12 August 2019 11:42:48 AM PDT Christopher Benjamin Coffey wrote: > Excuse me if this has been explained somewhere, I did some searching. With > 19.05, is there any reason to have gres.conf on the GPU nodes? Is slurm > smart enough to enumerate the /dev/nvidia* devices? We are moving t

[slurm-users] Registration for 2019 Slurm User Group Meeting - ENDING SOON

2019-08-12 Thread Jacob Jenson
Just a reminder that registration for the 2019 Slurm User Group meeting is ending soon. You can register at https://slug19.eventbrite.com/ The meeting will be held on 17-18 September 2019 in Salt Lake City at the University of Utah - *Standard registration* - ENDS August 15 - $375 U

[slurm-users] 19.05 and GPUs vs GRES

2019-08-12 Thread Christopher Benjamin Coffey
Hi, Excuse me if this has been explained somewhere, I did some searching. With 19.05, is there any reason to have gres.conf on the GPU nodes? Is slurm smart enough to enumerate the /dev/nvidia* devices? We are moving to 19.05 shortly, any gotchas with GRES and GPUs? Also, I'm guessing now, the