Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Analabha Roy
--- > Sean McGrath > Senior Systems Administrator, IT Services > > -- > *From:* slurm-users on behalf of > Analabha Roy > *Sent:* Tuesday 7 February 2023 12:14 > *To:* Slurm User Community List > *Subject:* Re: [slurm-users] [External] Hibernatin

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Sean Mc Grath
labha Roy Sent: Tuesday 7 February 2023 12:14 To: Slurm User Community List Subject: Re: [slurm-users] [External] Hibernating a whole cluster Hi Sean, Thanks for your awesome suggestion! I'm going through the reservation docs now. At first glance, it seems like a daily reservation would turn

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Diego Zuccato
il.com> <mailto:hariseldo...@gmail.com <mailto:hariseldo...@gmail.com>>> >     *Sent:* Tuesday 7 February 2023 10:05 >     *To:* Slurm User Community List mailto:slurm-users@lists.schedmd.com> >     <mailto:slurm-users@lists.sche

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Analabha Roy
---------------------- > > *From:* slurm-users > <mailto:slurm-users-boun...@lists.schedmd.com>> on behalf of > > Analabha Roy mailto:hariseldo...@gmail.com > >> > > *Sent:* Tuesday 7 February

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Diego Zuccato
s mailto:slurm-users-boun...@lists.schedmd.com>> on behalf of Analabha Roy mailto:hariseldo...@gmail.com>> *Sent:* Tuesday 7 February 2023 10:05 *To:* Slurm User Community List mailto:slurm-users@lists.schedmd.com>> *Subject:* Re: [slurm-users] [External] Hibernating a

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Analabha Roy
on behalf of > Analabha Roy > *Sent:* Tuesday 7 February 2023 10:05 > *To:* Slurm User Community List > *Subject:* Re: [slurm-users] [External] Hibernating a whole cluster > > Hi, > > Thanks. I had read the Slurm Power Saving Guide before. I believe the > configs enable

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Sean Mc Grath
T Services From: slurm-users on behalf of Analabha Roy Sent: Tuesday 7 February 2023 10:05 To: Slurm User Community List Subject: Re: [slurm-users] [External] Hibernating a whole cluster Hi, Thanks. I had read the Slurm Power Saving Guide before. I believe the configs enable slurmctl

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-07 Thread Analabha Roy
Hi, Thanks. I had read the Slurm Power Saving Guide before. I believe the configs enable slurmctld to check other nodes for idleness and suspend/resume them. Slurmctld must run on a separate, always-on server for this to work, right? My issue might be a little different. I literally have only one

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-06 Thread Ole Holm Nielsen
I would agree with Florian about using the Slurm power_save method. In the Wiki page https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_cloud_bursting/#configuring-slurm-conf-for-power-saving there are additional details and scripts for performing node suspend and resume. You would need the ser

Re: [slurm-users] [External] Hibernating a whole cluster

2023-02-06 Thread Florian Zillner
Hi, follow this guide: https://slurm.schedmd.com/power_save.html Create poweroff / poweron scripts and configure slurm to do the poweroff after X minutes. Works well for us. Make sure to set an appropriate time (ResumeTimeout) to allow the node to come back to service. Note that we did not achi