Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
users *On Behalf Of > *Avery Grieve > *Sent:* Thursday, December 10, 2020 10:18 AM > *To:* Slurm User Community List > *Subject:* Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation > > > > *External email: Use caution opening links or attachments* > >

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Gennaro Oliva
Hi Avery, On Thu, Dec 10, 2020 at 10:51:34AM -0500, Avery Grieve wrote: > Not the case, unfortunately as slurm doesn't have any idea what pmix_v3 > means without being compiled against it I guess. I have also attempted to > compile openmpi from source with the --with-pmi option but the slurm-wlm >

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
behalf of > Avery Grieve > *Sent:* Thursday, December 10, 2020 11:38 AM > *To:* Slurm User Community List > *Subject:* Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation > > Oop, sorry I meant to also include the following: > > # srun --mpi=list > s

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
help because it shows how to build > recent slurm on recent ubuntu/Debian: > https://github.com/NVIDIA/nephele-packages/tree/master/slurm > > > > *From:* slurm-users *On Behalf Of > *Avery Grieve > *Sent:* Thursday, December 10, 2020 10:18 AM > *To:* Slurm User

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Luke Yeager
master/slurm From: slurm-users On Behalf Of Avery Grieve Sent: Thursday, December 10, 2020 10:18 AM To: Slurm User Community List Subject: Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation External email: Use caution opening links or attachments Hey Luke, Thanks for the respo

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
Hey Luke, Thanks for the response. I should have mentioned I'm on debian. What's the name of the ubuntu package for pmix? I'll see if I can track down the debian equivalent. When you build slurm from scratch you have to place the .service files into /etc/init.d and the daemon files in /etc/system

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Luke Yeager
Hi Avery, * pmix: we just use the standard Ubuntu packages on 20.04. Unfortunately the standard packages on 18.04 are too out of date for us. * openmpi: we build our own, using ./configure --with-pmix=internal … * slurm: we build our own, using ./configure --with-pmix=PATH … (see he

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Christopher J Cawley
vices 223 Aquia Building, Ffx, MSN: 1B5 George Mason University Phone: (703) 993-6397 Email: ccawl...@gmu.edu ​ From: slurm-users on behalf of Avery Grieve Sent: Thursday, December 10, 2020 11:38 AM To: Slurm User Community List Subject: Re: [slurm-users]

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
Oop, sorry I meant to also include the following: # srun --mpi=list srun: MPI types are... srun: none srun: pmi2 srun: openmpi running srun with --mpi=openmpi gives the same errors as with MpiDefault=none. ~Avery Grieve They/Them/Theirs please! University of Michigan On Thu, Dec 10, 2020 at 11

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Avery Grieve
Hi Chris, Thank you for the offer. Here's some quick information on my system: All nodes on Debian 10 (armbian buster converted to DietPi v6.33.3). sinfo --version: slurm-wlm 18.08.5-2 With MpiDefault=pmix I get the following srun errors: srun: error: Couldn't find the specified plugin name for

Re: [slurm-users] slurm-wlm package OpenMPI PMIx implementation

2020-12-10 Thread Christopher J Cawley
I have a 7 node jetson nano cluster running at home. Send me what you want me to take a look at . If it's not a big deal, then I can let you know. Ubuntu 18 / slurm Thanks Chris Christopher J. Cawley Systems Engineer/Linux Engineer, Information Technology Services 223 Aquia Building, Ffx,