Re: [slurm-users] Use cases for "include" in slurm.conf?

2022-09-21 Thread Bas van der Vlies
On 21/09/2022 10:56, Bjørn-Helge Mevik wrote: Ole Holm Nielsen writes: Can anyone shed light on the use cases for "include" in slurm.conf? Until we switched to configless mode, we used to have all partition and node definitions in a separate file, with an include in slurm.conf. The idea

Re: [slurm-users] job_time_limit: inactivity time limit reached ...

2022-09-21 Thread Ole Holm Nielsen
Hi Paul, Interesting observation on the execution time and the pipe! How do you ensure that you have enough disk space for the uncompressed database dump? Maybe using /dev/shmem? The lbzip2 mentioned in the link below is significantly faster than bzip2. Best regards, Ole On 9/21/22 14:38,

Re: [slurm-users] job_time_limit: inactivity time limit reached ...

2022-09-21 Thread Paul Raines
Almost all the 5 min+ time was in the bzip2. The mysqldump by itself was about 16 seconds. So I moved the bzip2 to its own separate line so the tables are only locked for the ~16 seconds -- Paul Raines (http://help.nmr.mgh.harvard.edu) On Wed, 21 Sep 2022 3:49am, Ole Holm Nielsen wrote:

Re: [slurm-users] Use cases for "include" in slurm.conf?

2022-09-21 Thread Kevin Buckley
On 2022/09/21 16:03, Ole Holm Nielsen wrote: Can anyone shed light on the use cases for "include" in slurm.conf? Bit of a corner case, but, on our Cray XCs, the SlurmctldHost=sdb(IP.AD.DR.ES) is found at two different IP address, depending on whether you are "in the box" or on an external l

Re: [slurm-users] Use cases for "include" in slurm.conf?

2022-09-21 Thread Bjørn-Helge Mevik
Ole Holm Nielsen writes: > Can anyone shed light on the use cases for "include" in slurm.conf? Until we switched to configless mode, we used to have all partition and node definitions in a separate file, with an include in slurm.conf. The idea was to keep the things that most frequently was cha

[slurm-users] Use cases for "include" in slurm.conf?

2022-09-21 Thread Ole Holm Nielsen
In the SLUG'22 presentation https://slurm.schedmd.com/SLUG22/Dynamic_Nodes.pdf Nate Rini said on slide 21: Include file configuration now pushed along with other Slurm conf files Makes cloud configurations easier, especially hybrid! Right now the slurm.conf is either baked into the image or on

Re: [slurm-users] job_time_limit: inactivity time limit reached ...

2022-09-21 Thread Ole Holm Nielsen
Hi Paul, IMHO, using logrotate is the most convenient method for making daily database backup dumps and keep a number of backup versions, see the notes in https://wiki.fysik.dtu.dk/niflheim/Slurm_database#backup-script-with-logrotate Using --single-transaction is recommended by SchedMD to avoi