Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-19 Thread Ellestad, Erik
only create a TMPDIR with all jobs, or only if a job requests –tmp? Erik -- Erik Ellestad Wynton Cluster SysAdmin UCSF From: slurm-users On Behalf Of Greg Wickham Sent: Monday, May 18, 2020 11:59 PM To: Slurm User Community List Subject: Re: [slurm-users] Reset TMPDIR for All Jobs Hi Erik, We

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-19 Thread Greg Wickham
Hi Erik, We use a private fork of https://github.com/hpc2n/spank-private-tmp It has worked quite well for us - jobs (or steps) don’t share a /tmp and during the prolog all files created for the job/step are deleted. Users absolutely cannot see each others temporary files so there’s no issue ev

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-13 Thread Marcus Wagner
ers] Reset TMPDIR for All Jobs Hi Erik, the output of task-prolog is sourced/evaluated (not really sure, how) in the job environment. Thus you don't have to export a variable in task-prolog, but echo the export, e.g. echo export TMPDIR=/scratch/$SLURM_JOB_ID The variable will the

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-13 Thread Ellestad, Erik
Admin UCSF -Original Message- From: slurm-users On Behalf Of Marcus Wagner Sent: Tuesday, May 12, 2020 10:08 PM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Reset TMPDIR for All Jobs Hi Erik, the output of task-prolog is sourced/evaluated (not really sure, how) in th

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Marcus Wagner
Hi Erik, the output of task-prolog is sourced/evaluated (not really sure, how) in the job environment. Thus you don't have to export a variable in task-prolog, but echo the export, e.g. echo export TMPDIR=/scratch/$SLURM_JOB_ID The variable will then be set in job environment. Best Marcu

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Brian Andrus
when I run a job. Erik -- Erik Ellestad Wynton Cluster SysAdmin UCSF *From:* slurm-users *On Behalf Of *Roger Moye *Sent:* Tuesday, May 12, 2020 9:12 AM *To:* Slurm User Community List *Subject:* Re: [slurm-users] Reset TMPDIR for All Jobs We had issues getting TMPDIR to work as well.  We

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Ellestad, Erik
2020 9:12 AM To: Slurm User Community List Subject: Re: [slurm-users] Reset TMPDIR for All Jobs We had issues getting TMPDIR to work as well. We finally did this in our prolog: export SLURM_TMPDIR="/tmp/slurm/${SLURM_JOB_ID}" This works. -Roger From: slurm-users mailto:s

Re: [slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Roger Moye
lurm-users] Reset TMPDIR for All Jobs I was wanted to set TMPDIR from /tmp to a per job directory I create in local /scratch/$SLURM_JOB_ID (for example) This bug suggests I should be able to do this in a task-prolog. https://bugs.schedmd.com/show_bug.cgi?id=2664 However adding the following to t

[slurm-users] Reset TMPDIR for All Jobs

2020-05-12 Thread Ellestad, Erik
I was wanted to set TMPDIR from /tmp to a per job directory I create in local /scratch/$SLURM_JOB_ID (for example) This bug suggests I should be able to do this in a task-prolog. https://bugs.schedmd.com/show_bug.cgi?id=2664 However adding the following to task-prolog doesn't seem to affect the