Re: [slurm-users] maximum size of array jobs

2019-02-26 Thread Marcus Wagner
Hi Jeffrey, thanks for the hint regarding scontrol reconfig. That one drove me nuts again. I changed it to MaxArraySize=10. I restartet slurmctld, since i also changed some features of the nodes. I soon realized, that I only could submit --array=1-9, I then already myself increased

Re: [slurm-users] maximum size of array jobs

2019-02-26 Thread Marcus Wagner
Hi Merlin, thanks for the answer, but our user is not in need of a high index, but in fact in need of 100k taskids. Best Marcus On 2/26/19 3:50 PM, Merlin Hartley wrote: *max_array_tasks* Specify the maximum number of tasks that be included in a job array. The default limit is MaxA

Re: [slurm-users] maximum size of array jobs

2019-02-26 Thread Merlin Hartley
max_array_tasks Specify the maximum number of tasks that be included in a job array. The default limit is MaxArraySize, but this option can be used to set a lower limit. For example, max_array_tasks=1000 and MaxArraySize=11 would permit a maximum task ID of 10, but limit the number of ta

Re: [slurm-users] maximum size of array jobs

2019-02-26 Thread Jeffrey Frey
Also see "https://slurm.schedmd.com/slurm.conf.html"; for MaxArraySize/MaxJobCount. We just went through a user-requested adjustment to MaxArraySize to bump it from 1000 to 1; as the documentation states, since each index of an array job is essentially "a job," you must be sure to also adju

Re: [slurm-users] maximum size of array jobs

2019-02-26 Thread Ole Holm Nielsen
On 2/26/19 9:07 AM, Marcus Wagner wrote: Does anyone know, why per default the number of array elements is limited to 1000? We have one user, who would like to have 100k array elements! What is more difficult for the scheduler, one array job with 100k elements or 100k non-array jobs? Where

[slurm-users] maximum size of array jobs

2019-02-26 Thread Marcus Wagner
Hello everyone, I have another question ;) Does anyone know, why per default the number of array elements is limited to 1000? We have one user, who would like to have 100k array elements! What is more difficult for the scheduler, one array job with 100k elements or 100k non-array jobs?