Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-19 Thread Ellestad, Erik
only create a TMPDIR with all jobs, or only if a job requests –tmp? Erik -- Erik Ellestad Wynton Cluster SysAdmin UCSF From: slurm-users On Behalf Of Greg Wickham Sent: Monday, May 18, 2020 11:59 PM To: Slurm User Community List Subject: Re: [slurm-users] Reset TMPDIR for All Jobs Hi Erik, We

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-19 Thread Greg Wickham
Hi Erik, We use a private fork of https://github.com/hpc2n/spank-private-tmp It has worked quite well for us - jobs (or steps) don’t share a /tmp and during the prolog all files created for the job/step are deleted. Users absolutely cannot see each others temporary files so there’s no issue ev

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-13 Thread Marcus Wagner
be give an example? https://slurm.schedmd.com/prolog_epilog.html Just a thought, Erik -- Erik Ellestad Wynton Cluster SysAdmin UCSF -Original Message- From: slurm-users On Behalf Of Marcus Wagner Sent: Tuesday, May 12, 2020 10:08 PM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-us

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-13 Thread Ellestad, Erik
Admin UCSF -Original Message- From: slurm-users On Behalf Of Marcus Wagner Sent: Tuesday, May 12, 2020 10:08 PM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Reset TMPDIR for All Jobs Hi Erik, the output of task-prolog is sourced/evaluated (not really sure, how) in th

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Marcus Wagner
Hi Erik, the output of task-prolog is sourced/evaluated (not really sure, how) in the job environment. Thus you don't have to export a variable in task-prolog, but echo the export, e.g. echo export TMPDIR=/scratch/$SLURM_JOB_ID The variable will then be set in job environment. Best Marcu

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Brian Andrus
when I run a job. Erik -- Erik Ellestad Wynton Cluster SysAdmin UCSF *From:* slurm-users *On Behalf Of *Roger Moye *Sent:* Tuesday, May 12, 2020 9:12 AM *To:* Slurm User Community List *Subject:* Re: [slurm-users] Reset TMPDIR for All Jobs We had issues getting TMPDIR to work as well.  We

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Ellestad, Erik
2020 9:12 AM To: Slurm User Community List Subject: Re: [slurm-users] Reset TMPDIR for All Jobs We had issues getting TMPDIR to work as well. We finally did this in our prolog: export SLURM_TMPDIR="/tmp/slurm/${SLURM_JOB_ID}" This works. -Roger From: slurm-users mailto:s

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Roger Moye
We had issues getting TMPDIR to work as well. We finally did this in our prolog: export SLURM_TMPDIR="/tmp/slurm/${SLURM_JOB_ID}" This works. -Roger From: slurm-users On Behalf Of Ellestad, Erik Sent: Tuesday, May 12, 2020 10:40 AM To: slurm-users@lists.schedmd.com Subject: [slurm-users] R