Re: [slurm-users] Environment modules

On 22/11/19 9:37 am, Mariano.Maluf wrote: The cluster is operational but I need to install and configure environment modules. If you use Easybuild to install your HPC software then it can take care of the modules too for you. I'd also echo the recommendation from others to use Lmod. Websi

Re: [slurm-users] Array jobs vs. many jobs

Hi Ryan, On 11/22/19 12:18 PM, Ryan Novosielski wrote: Quick question that I'm not sure how to find the answer to otherwise: do array jobs have less impact on the scheduler in any way than a whole long list of jobs run the more traditional way? Less startup overhead, anything like that? Slu

Re: [slurm-users] Array jobs vs. many jobs

Jan-Albert van Ree | Linux System Administrator | Digital Services MARIN | T +31 317 49 35 48 | mailto:j.a.v@marin.nl | http://www.marin.nl It helps a lot indeed ; we run arrays up to 100k elements and more. If you submit 100k separate jobs, the scheduler will definately grind to a halt.

[slurm-users] Array jobs vs. many jobs

Hi there, Quick question that I'm not sure how to find the answer to otherwise: do array jobs have less impact on the scheduler in any way than a whole long list of jobs run the more traditional way? Less startup overhead, anything like that? Thanks! (we run 17.11 on CentOS 7, but I'm not sure

Re: [slurm-users] Environment modules

Jan-Albert van Ree | Linux System Administrator | Digital Services MARIN | T +31 317 49 35 48 | mailto:j.a.v@marin.nl | http://www.marin.nl Just install the default CentOS RPM package environment-modules and play with it. If you're at home in bash you'll pick it up in minutes. All default

Re: [slurm-users] Environment modules

On Fri, Nov 22, 2019 at 6:37 PM Mariano.Maluf wrote: > Hi all > > I am setting up for the first time a cluster with Slurm in Centos7 with > 1 headnode and 12 nodes. > > The cluster is operational but I need to install and configure > environment modules. > > Could you advise me some documentation

Re: [slurm-users] Environment modules

We use TACC's lmod system. It is pretty straightforward to setup and reasonably well documented: https://www.tacc.utexas.edu/research-development/tacc-projects/lmod Paul. > On Nov 22, 2019, at 12:37 PM, Mariano.Maluf wrote: > > Hi all > > I am setting up for the first time a cluster with S

[slurm-users] Environment modules

Hi all I am setting up for the first time a cluster with Slurm in Centos7 with 1 headnode and 12 nodes. The cluster is operational but I need to install and configure environment modules. Could you advise me some documentation about it? Thanks in advance. Regards, Mariano. -- Lic. Marian

Re: [slurm-users] Slurm configuration, Weight Parameter

Can't you just set the usage priority to be higher for the 2GB machines? This way, if the requested memory is less than 2GB those machines will be used first, and larger jobs skip to the higher memory machines. On 11/21/19 9:44 AM, Jim Prewett wrote: > > Hi Sistemas, > > I could be mista

[slurm-users] nss_slurm not passing groups

Ok, so I wanted to test nss_slurm more after hitting the BoF yesterday. I have it running, but it does not seem to pass groups. >From a simple interactive bash session: [andrubr@gen-b2-03 ~]$ getent -s slurm passwd andrubr:x:43871:11513:Andrus, Brian:/home/andrubr:/bin/bash [andrubr@gen-b2-03 ~]