[slurm-announce] Slurm version 17.11.0rc3 available

2017-11-09 Thread Tim Wickberg
We are pleased to announce the availability of Slurm version 17.11.0-0rc3 (release candidate 3). The release candidate series reflects the end of feature development for each release, the finalization of the RPC layer, and will - except for bug fixes developed during the RC time frame - will b

Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun

2017-11-09 Thread John Hearns
Renat, I know that this is not going to be helpful. I can understand that perhaps if you are using NFS storage then 20(*) processes might not be able to open files at the same time. I would consider the following: a) looking at your storage. This is why HPC systems have high performance and pa

Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun

2017-11-09 Thread Gennaro Oliva
Hi Renat, On Thu, Nov 09, 2017 at 03:46:23PM +0100, Yakupov, Renat /DZNE wrote: > I tried that. It doesnt even queue the job with an error: > sbatch: unrecognized option '--array=1-24' > sbatch: error: Try help for more information. what version of slurm are you using? Regards -- Gennaro Oliva

Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun

2017-11-09 Thread Yakupov, Renat /DZNE
Hi Gennaro, I tried that. It doesnt even queue the job with an error: sbatch: unrecognized option '--array=1-24' sbatch: error: Try help for more information. Best, Renat. From: slurm-users [slurm-users-boun...@lists.schedmd.com] On Behalf Of Gennaro Oli

Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun

2017-11-09 Thread Gennaro Oliva
Hi Renat, On Thu, Nov 09, 2017 at 03:09:17PM +0100, Yakupov, Renat /DZNE wrote: > I would like some suggestions on how to spread out in time the start > of multiple parallel jobs with srun. I would use: sbatch --array=... As far as I know srun doesn't support arrays. > Is there a way to get a

Re: [slurm-users] Limit size submission script

2017-11-09 Thread sysadmin.caos
Researcher uses python for generating a submission script and, then, she submits that new script... I don't know more... but before Brian wrote about "max_script_size", I had rewritten 8MB script (from a python execution) in a easy 250 Kb script (with 2 "for" ;) ) El 09/11/2017 a las 15:22, Lo

Re: [slurm-users] Limit size submission script

2017-11-09 Thread sysadmin.caos
Thanks I didn't about that parameter!!! El 09/11/2017 a las 14:45, Brian W. Johanson escribió: man slurm.conf    SchedulerParameters   The interpretation of this parameter varies by SchedulerType.  Multiple options may be comma separated.   max_script_size=#  

Re: [slurm-users] Limit size submission script

2017-11-09 Thread Loris Bennett
Hi, I'd be interested to know in what circumstances a multiple-MB-sized batch script would be sensible and/or necessary. Cheers, Loris "Brian W. Johanson" writes: > man slurm.conf > >    SchedulerParameters >   The interpretation of this parameter varies by SchedulerType.  > M

Re: [slurm-users] Limit size submission script

2017-11-09 Thread Alexandre Strube
Bon dia Dani! You can always educate the student :-) But as Brian said, you can change the ScheduleParameters. You can check it with: scontrol show conf | grep max_script_size 2017-11-09 9:56 GMT+01:00 sysadmin.caos : > Hello, > > A researcher that is using a SLURM cluster (version 17.02.7) ha

[slurm-users] introduce short delay starting multiple parallel jobs with srun

2017-11-09 Thread Yakupov, Renat /DZNE
Dear SLURM users, I would like some suggestions on how to spread out in time the start of multiple parallel jobs with srun. I have a very basic script which specifies number of nodes and tasks with just one command: srun myjob. The problem is that 10-20 tasks start accessing files at the same t

Re: [slurm-users] Limit size submission script

2017-11-09 Thread Brian W. Johanson
man slurm.conf    SchedulerParameters   The interpretation of this parameter varies by SchedulerType.  Multiple options may be comma separated.   max_script_size=# Specify the maximum size of a batch script, in bytes.  The default value is 4 me

[slurm-users] Wiki2 interface

2017-11-09 Thread Sergei Leonenkov
Hello! We use SLURM on Lomonosov and Lomonosov-2 supercomputers. For the scheduling process we have created our own external scheduler based on wiki2 interface. However, since this year wiki2 is no longer supported. Why was it deleted from the current build? What should we do in this situation? I

[slurm-users] FeaturesAvail=(null) FeaturesActive=(null)

2017-11-09 Thread petitbois . jean
Hello i have problem with my features. i declared in my slurm.conf the features but when i run slurmd compute node i have this problem in my log : FeaturesAvail=(null) FeaturesActive=(null) And the problem is that slurmd not start my function node_features_p_node_set and i can not get my feat

Re: [slurm-users] FeaturesAvail=(null) FeaturesActive=(null)

2017-11-09 Thread petitbois . jean
Hello i have problem with my features. i declared in my slurm.conf the features but when i run slurmd compute node i have this problem in my log : FeaturesAvail=(null) FeaturesActive=(null) And the problem is that slurmd not start my function node_features_p_node_set and i can not get my feat

Re: [slurm-users] Error running jobs with srun

2017-11-09 Thread Elisabetta Falivene
I'll surely produce documentation as soon as I understand how all the cluster is working. (It was something kinda "Here it is the root password and the key to the room. You don't need anything else, don't you?" :) ) Thank to your precious suggestions I was able to get that the common shared space

[slurm-users] Limit size submission script

2017-11-09 Thread sysadmin.caos
Hello, A researcher that is using a SLURM cluster (version 17.02.7) has created a submit script whose size is 8 MB (yeah!!). I have read SLURM has a limit size in 4MB... This limit, can be changed? Thanks.

Re: [slurm-users] [slurm-dev] Re: Installing SLURM locally on Ubuntu 16.04

2017-11-09 Thread Raymond Wan
Hi Will, On Thu, Nov 9, 2017 at 11:01 AM, Will L wrote: > > Thanks for the suggestions. Munge seems to be working just fine. At one point > I tried to build SLURM from the source, but when I could not make it work, I > `sudo make uninstall`ed it and opted for the pre-built apt version all over