[slurm-users] How to get an estimate of job completion for planned maintenance?

2021-11-05 Thread Ahmad Khalifa
If I plan maintenance on a certain day, how long before that day should I set the queue to drain mode?! Is there a way to estimate the completion date / time of current running jobs?! Regards.

Re: [slurm-users] Specify a gpu ID

2021-06-04 Thread Ahmad Khalifa
> accordingly. Again, I believe you are trying to solve a problem that should > not be yours to solve. Sorry if this irritates you. > > JLS > > On Fri, Jun 4, 2021 at 2:17 PM Ahmad Khalifa > wrote: > >> I can't make hardware changes, but I still want to make

Re: [slurm-users] Specify a gpu ID

2021-06-04 Thread Ahmad Khalifa
On Fri, Jun 4, 2021 at 2:07 PM Ahmad Khalifa > wrote: > >> Because there are failing GPUs that I'm trying to avoid. >> >> On Fri, Jun 4, 2021 at 5:04 AM Stephan Roth >> wrote: >> >>> On 03.06.21 07:11, Ahmad Khalifa wrote: >>> > How to send

Re: [slurm-users] Specify a gpu ID

2021-06-04 Thread Ahmad Khalifa
Because there are failing GPUs that I'm trying to avoid. On Fri, Jun 4, 2021 at 5:04 AM Stephan Roth wrote: > On 03.06.21 07:11, Ahmad Khalifa wrote: > > How to send a job to a particular gpu card using its ID (0,1,2...etc)? > > Why do you need to access a GPU based on i

[slurm-users] Specify a gpu ID

2021-06-02 Thread Ahmad Khalifa
How to send a job to a particular gpu card using its ID (0,1,2...etc)?

[slurm-users] Running gpu and cpu jobs on the same node

2020-09-30 Thread Ahmad Khalifa
I have a machine with 4 rtx2080ti and a core i9. I submit jobs to it through MPI PMI2 (from Relion). If I use 5 MPI and 4 threads, then basically I'm using all 4 GPUs and 20 threads of my cpu. My question is, my current configuration allows submitting jobs to the same node, but with a different p