Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Ole Holm Nielsen
Hi Markus, I had to install additionally this RPM from the Intel OPA software suite (I disable the CentOS 7.4 RPMs): IntelOPA-Tools.RHEL74-x86_64.10.6.1.0.2/RPMS/x86_64/opa-opa-libopamgt-devel-10.6.1.0-2.el7.x86_64.rpm I also had to edit the CMakeLists.txt to replace SLURM_PREFIX /usr/local

Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Marcus Wagner
Hi Jeffrey, yes I installed from rpm, but this is a self built rpm. The whole slurm installation resides in /opt/slurm. /opt/slurm/bin /opt/slurm/conf /opt/slurm/include /opt/slurm/lib /opt/slurm/lib64 /opt/slurm/log /opt/slurm/MM_BAK /opt/slurm/sbin /opt/slurm/share /opt/slurm/var But it s

Re: [slurm-users] Checking memory requirements in job_submit.lua

2018-06-14 Thread Hendryk Bockelmann
Hi, based on information given in job_submit_lua.c we decided not to use pn_min_memory any more. The comment in src says: /* * FIXME: Remove this in the future, lua can't handle 64bit * numbers!!!. Use min_mem_per_node|cpu instead. */ Instead we check in job_submit.lua for s,th, like if

Re: [slurm-users] additional variable to the struct job_desc_msg_t

2018-06-14 Thread Rajiv Nishtala
Bump. > On 14-Jun-2018, at 9:38 AM, Rajiv Nishtala wrote: > > Hi, > > > I started working with SLURM some days ago, and one of the first things I aim > to do is adding an additional variable to the job_script file via the > structure job_desc_msg_t. > Specifically, via the function slurm_sub

Re: [slurm-users] Checking memory requirements in job_submit.lua

2018-06-14 Thread Prentice Bisbal
On 06/13/2018 01:59 PM, Prentice Bisbal wrote: In my environment, we have several partitions that are 'general access', with each partition providing different hardware resources (IB, large mem, etc). Then there are other partitions that are for specific departments/projects. Most of this con

Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Jeffrey Frey
I'll preface this by saying that I'm no expert in CMake, so there may be better ways to construct the CMakeLists.txt in this instance. Anyone who is, in fact, better-versed in CMake authoring should feel free to fork and eventually send a pull request for a CMake redo. That being said, I went

Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Jeffrey Frey
> Thanks Jeffrey for that tool, for me it is working. I changed a little bit > the CMakeLists.txt such that slurm can be found also in non standard install > paths ;) > > replaced > SET (SLURM_PREFIX "/usr/local" CACHE PATH "Directory in which SLURM is > installed.") > with > FIND_PATH(SLURM_PR

Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Marcus Wagner
Hi Ole, hi Jeffrey. Thanks Jeffrey for that tool, for me it is working. I changed a little bit the CMakeLists.txt such that slurm can be found also in non standard install paths ;) replaced SET (SLURM_PREFIX "/usr/local" CACHE PATH "Directory in which SLURM is installed.") with FIND_PATH(SL

[slurm-users] additional variable to the struct job_desc_msg_t

2018-06-14 Thread Rajiv Nishtala
Hi, I started working with SLURM some days ago, and one of the first things I aim to do is adding an additional variable to the job_script file via the structure job_desc_msg_t. Specifically, via the function slurm_submit_batch_job in submit.c The data provided to the job_script via the job_

Re: [slurm-users] Generating OPA topology.conf

2018-06-14 Thread Ole Holm Nielsen
Hi Jeffrey, On 06/13/2018 10:35 PM, Jeffrey Frey wrote: Intel's OPA doesn't include the old IB net discovery library/API; instead, they have their own library to enumerate nodes, links, etc.  I've started a rewrite of ye olde "ib2slurm" utility to make use of Intel's new enumeration library.