Re: [slurm-users] Slurm and shared file systems

2020-06-19 Thread Alex Chekholko
Hi David, There are several approaches to have a shared filesystem namespace without an actual shared filesystem. One issue you will have to contend with is how to handle any kind of filesystem caching (how much room to allocate for local cache, how to handle cache inconsistencies). examples: gcs

Re: [slurm-users] Slurm and shared file systems

2020-06-19 Thread Brian Andrus
It sounds like you are asking if there should be a shared /home, which you do not need. You do need to ensure a user can access the environment for the node (a home directory, ssh keys, etc). If you are asking about the job binary and the data it will be processing, again, you do not. You cou

Re: [slurm-users] Slurm and shared file systems

2020-06-19 Thread Steven Dick
f > David Baker > Sent: Friday, June 19, 2020 8:05 AM > To: Slurm User Community List > Subject: [slurm-users] Slurm and shared file systems > > > > Hello, > > > > We are currently helping a research group to set up their own Slurm cluster. > They have asked a very

Re: [slurm-users] Slurm and shared file systems

2020-06-19 Thread Riebs, Andy
Community List Subject: [slurm-users] Slurm and shared file systems Hello, We are currently helping a research group to set up their own Slurm cluster. They have asked a very interesting question about Slurm and file systems. That is, they are posing the question -- do you need a shared user

[slurm-users] Slurm and shared file systems

2020-06-19 Thread David Baker
Hello, We are currently helping a research group to set up their own Slurm cluster. They have asked a very interesting question about Slurm and file systems. That is, they are posing the question -- do you need a shared user file store on a Slurm cluster? So, in the extreme case where this is