If you've got other fast storage in limited supply that can be used for data that can be staged, then by all means use it, but consider whether you want batch cpu cores tied up with the wall time of transferring the data. This could easily be done on a time-shared frontend login node from which the users could then submit (via script) jobs after the data was staged. Most of the transfer wallclock is in network wait, so don't waste dedicated cores for it.
- [slurm-users] Staging data on the nodes one will be proce... Will Dennis
- Re: [slurm-users] Staging data on the nodes one will... Fulcomer, Samuel
- Re: [slurm-users] Staging data on the nodes one ... Will Dennis
- Re: [slurm-users] Staging data on the nodes ... Fulcomer, Samuel
- Re: [slurm-users] Staging data on the no... Will Dennis
- Re: [slurm-users] Staging data on t... Will Dennis
- Re: [slurm-users] Staging data ... Fulcomer, Samuel
- Re: [slurm-users] [External... Prentice Bisbal