Re: [slurm-users] Slurm does not set CUDA_VISIBLE_DEVICES

2018-05-21 Thread Vladimir Goy
Dear, Miguel >Do you have --gres=gpu:0 on your job script? Is gres.conf properly configured? No. gres.conf worked weel on the Slurm 17.02.2. It is my job file. #!/bin/bash # #SBATCH --job-name=GPU #SBATCH --partition=gpu # #SBATCH --ntasks=1 #SBATCH --mem=100 #SBATCH --time=10 #SBATCH --gres=gpu

Re: [slurm-users] Slurm does not set CUDA_VISIBLE_DEVICES

2018-05-21 Thread Miguel Gila
Vova, Do you have --gres=gpu:0 on your job script? Is gres.conf properly configured? I think this is what sets the variable: https://github.com/SchedMD/slurm/blob/bcdd09d3386f4b4038ae9263b0e69d4d742988b2/src/plugins/gres/gpu/gres_gpu.c#L96 Cheers, Miguel > On 21 May 2018, at 08:28, Vladimir

[slurm-users] Slurm does not set CUDA_VISIBLE_DEVICES

2018-05-20 Thread Vladimir Goy
Hello, Please, help me, I would like to ask you about the next bug. Why slurm does not set CUDA_VISIBLE_DEVICES variabels before runs user aplication? This bug I observe after update slurm 17.02.2 -> 17.11.6 . Who/How can fix this problem? Version 17.02.2 works well, but now I can not downgrate, b