Hi Sidiney,
not tested, but shouldn't
SelectTypeParameters = CR_CPU_MEMORY
do the trick?
Best
Marcus
On 12/07/2018 12:12 PM, Sidiney Crescencio wrote:
Hello All,
I'm facing some issues to use the HT on my compute nodes, I'm running
slurm 17.02.7
SelectTypeParameters = CR_CORE_MEMORY
cgroup.conf
CgroupAutomount=yes
CgroupReleaseAgentDir="/etc/slurm/cgroup"
# cpuset subsystem
ConstrainCores=yes
TaskAffinity=no
# memory subsystem
ConstrainRAMSpace=yes
ConstrainSwapSpace=yes
# device subsystem
ConstrainDevices=yes
If I try to allocate the 80 CPUs it will not work, I couldn't find why
this doesn't work. Do you guys have any ideas or could cause this
issue? I've been playing with several different parameters on the node
definition, also using --threads-per-core, etc.. but still I should be
able to allocate the 80 cpus.
Thanks in advance.
srun --reservation=test_ht -p defq -n 80 sleep 100
srun: error: Unable to allocate resources: Requested node
configuration is not available
--------------
[root@csk007 ~]# slurmd -C
NodeName=csk007 CPUs=80 Boards=1 SocketsPerBoard=2 CoresPerSocket=20
ThreadsPerCore=2 RealMemory=385630 TmpDisk=217043
UpTime=84-00:36:44
[root@csk007 ~]# scontrol show node csk007
NodeName=csk007 Arch=x86_64 CoresPerSocket=20
CPUAlloc=0 CPUErr=0 CPUTot=80 CPULoad=4.03
AvailableFeatures=(null)
ActiveFeatures=(null)
Gres=(null)
NodeAddr=csk007 NodeHostName=csk007 Version=17.02
OS=Linux RealMemory=380000 AllocMem=0 FreeMem=338487 Sockets=2 Boards=1
State=RESERVED ThreadsPerCore=2 TmpDisk=0 Weight=1 Owner=N/A
MCS_label=N/A
Partitions=defq
BootTime=2018-09-14T12:31:05 SlurmdStartTime=2018-11-29T15:25:03
CfgTRES=cpu=80,mem=380000M
AllocTRES=
CapWatts=n/a
CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
-----------------------
--
Best Regards,
Sidiney
--
Marcus Wagner, Dipl.-Inf.
IT Center
Abteilung: Systeme und Betrieb
RWTH Aachen University
Seffenter Weg 23
52074 Aachen
Tel: +49 241 80-24383
Fax: +49 241 80-624383
wag...@itc.rwth-aachen.de
www.itc.rwth-aachen.de
