Hi Steve, we are running a jupyterhub that uses our cluster as a backend. You need to be able to submit jobs from the hub node, ie you need to configure slurm and have the slurm binaries. You don't need to run slurmd. We are using the batchspawner to launch the jobs on the cluster. Regards magnus
On Sat, 2023-08-26 at 23:17 -0700, Steven Swanson wrote: > Can I submit jobs with a computer/docker container that is not part > of the slurm cluster? > > I'm trying to set up slurm as the backend for a system with Jupyter > Notebook-based front end. > > The jupyter notebooks are running in containers managed by Jupyter > Hub, which is a mostly turnkey system for providing docker containers > that users can access via jupyter. > > I would like the jupyter containers to be able to submit jobs to > slurm, but making them part of the cluster doesn't seem to make sense > because: > > 1. They are dynamically created and don't have known hostnames. > 2. They aren't supposed to run jobs. > > Is there a way to do this? I tried just running slurmd in the > jupyter containers, but it complained about not being able to figure > out its name (I think because the container's hostname is not listed > in slurm.conf). > > My fall back solution is to use ssh to connect to the slurm head node > and run jobs there, but that seems kludgy. > > -steve -- Magnus Hagdorn Charité – Universitätsmedizin Berlin Geschäftsbereich IT | Scientific Computing Campus Charité Virchow Klinikum Forum 4 | Ebene 02 | Raum 2.020 Augustenburger Platz 1 13353 Berlin magnus.hagd...@charite.de https://www.charite.de HPC Helpdesk: sc-hpc-helpd...@charite.de
smime.p7s
Description: S/MIME cryptographic signature
