Re: [slurm-users] Submitting hybrid OpenMPI and OpenMP Jobs

2023-09-25 Thread Selch, Brigitte (FIDD)
ndet: Freitag, 22. September 2023 14:25 An: slurm-users@lists.schedmd.com Betreff: Re: [slurm-users] Submitting hybrid OpenMPI and OpenMP Jobs Hello, for this setup it typically helps to disable MPI process binding with "mpirun --bind-to none ..." (or similar) so that OpenMP can use al

Re: [slurm-users] Submitting hybrid OpenMPI and OpenMP Jobs

2023-09-22 Thread Paul Edmon
You might also try swapping to use srun instead of mpiexec as that way slurm can give more direction as to what cores have been allocated to what. I've found it in the past that mpiexec will ignore what Slurm tells it. -Paul Edmon- On 9/22/23 8:24 AM, Lambers, Martin wrote: Hello, for this

Re: [slurm-users] Submitting hybrid OpenMPI and OpenMP Jobs

2023-09-22 Thread Lambers, Martin
Hello, for this setup it typically helps to disable MPI process binding with "mpirun --bind-to none ..." (or similar) so that OpenMP can use all cores. Best, Martin On 22/09/2023 13:57, Selch, Brigitte (FIDD) wrote: Hello, one of our applications need hybrid OpenMPI and OpenMP Job-Submit.

[slurm-users] Submitting hybrid OpenMPI and OpenMP Jobs

2023-09-22 Thread Selch, Brigitte (FIDD)
Hello, one of our applications need hybrid OpenMPI and OpenMP Job-Submit. Only one task is allowed on one node, but this task should use all cores of the node. So, for example I made: #!/bin/bash #SBATCH --nodes=5 #SBATCH --ntasks=5 #SBATCH --cpus-per-task=44 #SBATCH --export=ALL export OMP_NU