Hi Chagai,
there isn't, no. As far as I can tell, SLURM only knows share-tree, it
doesn't have functional share like SGE/UGE.
(I'm pretty sure what Chagai wants to happen is this:
There's a share policy on the cluster that only ever operates in the
moment (i.e. per scheduling run). No history, no nothing.
The cluster has 12 slots.
If there are only jobs from group A in the queue, they all get run.
If there are only jobs from group B in the queue, they all get run.
If there are jobs from both group A and group B in the queue, at all
times, regardless of prior use, make it so that A and B use the same
number of slots.)
Tina
On 12/04/2022 14:52, Chagai Nota wrote:
Wow thanks for your detailed answer.
I'm coming from SGE, and I thought that there will be simple way to make it
behave like SGE.
As you said hard limits will be waste of resources so it's not good option.
-----Original Message-----
From: slurm-users <slurm-users-boun...@lists.schedmd.com> On Behalf Of Paul
Edmon
Sent: Tuesday, April 12, 2022 4:31 PM
To: slurm-users@lists.schedmd.com
Subject: Re: [slurm-users] non-historical scheduling
CAUTION: This email originated from outside of the organization. Do not click
links or open attachments unless you can confirm the sender and know the
content is safe.
So you want a purely fractional usage of the cluster. That's hard to do via
fairshare or with out fairshare as the scheduler will usually fill up all the
nodes with the top priority job. If you don't have fairshare running or any
historical data it will revert to FIFO. So which ever user got in first will
go first, no matter how many jobs there are.
Fairshare can accomplish what you want above but it takes time for it to settle
into a steady state due to behavior above. If you chart the usage over time
with fairshare you will see it even out, but at any given immediate time you
will have one user dominating over another one.
You could probably achieve a pure fractional usage model by utilizing hard
limits for each user in terms of number of cores. The problem is that you will
leave parts of the cluster open and idle. If that is fine then I recommend
setting hard limits for each user.
-Paul Edmon-
On 4/12/2022 8:55 AM, Chagai Nota wrote:
Hi Loris
Thanks for your answer.
I tired to configure it and I didn't get desired results.
This is my configuration:
PriorityType=priority/multifactor
PriorityDecayHalfLife=0
PriorityUsageResetPeriod=DAILY
PriorityFavorSmall=yes
PriorityWeightFairshare=100000
PriorityWeightAge=0
PriorityWeightPartition=0
PriorityWeightJobSize=100000
PriorityMaxAge=1-0
PriorityCalcPeriod=1
The desired result its that when 2 users A and B send jobs they will have equal
number of jobs to each of them.
Lets say all grid have 12 slots so user A and B each one of them will
get 6, but when happen that user A get 12 and after sometime user B
get 12
-----Original Message-----
From: slurm-users <slurm-users-boun...@lists.schedmd.com> On Behalf Of
Loris Bennett
Sent: Tuesday, April 12, 2022 12:06 PM
To: Slurm User Community List <slurm-users@lists.schedmd.com>
Subject: Re: [slurm-users] non-historical scheduling
CAUTION: This email originated from outside of the organization. Do not click
links or open attachments unless you can confirm the sender and know the
content is safe.
Hi Chagai,
Chagai Nota
<https://urldefense.proofpoint.com/v2/url?u=http-3A__chagai.nota-40altair-2Dsemi.com&d=DwIFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=mC6-yDte_BkF_egdAiZhLfKbIi-zhwylR5b6AOgnfEo&s=aOWXcTJqFuopg_IznzSJXY_GKgxYv-0FAFrZrQBDpyA&e=>
writes:
Hi
I would like to ask if there is any option that slurm scheduler will consider
only running jobs and not historical data.
We don't care about how many jobs users was running in the past but only the
current usage.
Look at
https://urldefense.proofpoint.com/v2/url?u=https-3A__slurm.schedmd.com
_priority-5Fmultifactor.html&d=DwIFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5
A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=mC6-yDte
_BkF_egdAiZhLfKbIi-zhwylR5b6AOgnfEo&s=ez1DlsO7KAqb6GyBvfk6PoSMDxjckA26
SrtvBRwOPtc&e=
You probably need to set
PriorityDecayHalfLife=0
and then, say,
PriorityUsageResetPeriod=DAILY
Cheers,
Loris
Thanks
Chagai Nota
---------------------------------------------------------------------
-
---------------------------------------------------------------------
-
---------------------------------------------------------------------
-
------------------------
Important Notice: This email message and any attachments thereto are
confidential and/or privileged and/or subject to privacy laws and are
intended only for use by the addressee(s) named above. If you are not the
intended addressee, you are hereby kindly notified that any dissemination,
distribution, copying or use of this email and any attachments thereto is
strictly prohibited. If you have received this email in error, kindly delete it
from your computer system and notify us at the telephone number or email
address appearing above. The writer asserts in respect of this message and
attachments all rights for confidentiality, privilege or privacy to the fullest
extent permitted by law.
--
Dr. Loris Bennett (Herr/Mr)
ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
----------
This email has been scanned for spam and viruses by Proofpoint Essentials.
Visit the following link to report this email as spam:
https://urldefense.proofpoint.com/v2/url?u=https-3A__eur02.safelinks.p
rotection.outlook.com_-3Furl-3Dhttps-253A-252F-252Feu1.proofpointessen
tials.com-252Findex01.php-253Fmod-5Fid-253D11-2526mod-5Foption-253Dlog
item-2526mail-5Fid-253D1649754490-2DsOxgKUMnXxFb-2526r-5Faddress-253Dc
hagai.nota-252540altair-2Dsemi.com-2526report-253D1-26amp-3Bdata-3D04-
257C01-257C-257Cd5bb86cab5754f0b297008da1c63f87f-257Cd97b0f906803449a9
23b749ca7eedb2b-257C0-257C0-257C637853512947856000-257CUnknown-257CTWF
pbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6M
n0-253D-257C3000-26amp-3Bsdata-3DI-252FKmvMAweaHTndtIydlYiBJqyylKa58Jl
SOYCXSzJnI-253D-26amp-3Breserved-3D0&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jX
rwqOf-v5A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=
YdiNqiQVEipLlNaWLx4jrE3yjyqxpl8R9ZjqpFSLrlE&s=t69ftM8kYj0Z9v55mJ6qc382
8am44URzJytiPMrrsH4&e=
________________________________
Important Notice: This email message and any attachments thereto are
confidential and/or privileged and/or subject to privacy laws and are intended
only for use by the addressee(s) named above. If you are not the intended
addressee, you are hereby kindly notified that any dissemination, distribution,
copying or use of this email and any attachments thereto is strictly
prohibited. If you have received this email in error, kindly delete it from
your computer system and notify us at the telephone number or email address
appearing above. The writer asserts in respect of this message and attachments
all rights for confidentiality, privilege or privacy to the fullest extent
permitted by law.
----------
This email has been scanned for spam and viruses by Proofpoint Essentials.
Visit the following link to report this email as spam:
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Feu1.proofpointessentials.com%2Findex01.php%3Fmod_id%3D11%26mod_option%3Dlogitem%26mail_id%3D1649770346-k9C-drGQbaj1%26r_address%3Dchagai.nota%2540altair-semi.com%26report%3D1&data=04%7C01%7C%7C7b5fea1f24154e6b948908da1c88e394%7Cd97b0f906803449a923b749ca7eedb2b%7C0%7C0%7C637853671506866135%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ojjMUODNoPgCKJB79FD9iApqMULP1KQspmI60HNMbbc%3D&reserved=0
________________________________
Important Notice: This email message and any attachments thereto are
confidential and/or privileged and/or subject to privacy laws and are intended
only for use by the addressee(s) named above. If you are not the intended
addressee, you are hereby kindly notified that any dissemination, distribution,
copying or use of this email and any attachments thereto is strictly
prohibited. If you have received this email in error, kindly delete it from
your computer system and notify us at the telephone number or email address
appearing above. The writer asserts in respect of this message and attachments
all rights for confidentiality, privilege or privacy to the fullest extent
permitted by law.
--
Tina Friedrich, Advanced Research Computing Snr HPC Systems Administrator
Research Computing and Support Services
IT Services, University of Oxford
http://www.arc.ox.ac.uk http://www.it.ox.ac.uk
