Re: [slurm-users] Burst to AWS cloud

2020-12-15 Thread Alex Chekholko
Hey Sajesh, Each public cloud vendor provides a standard way to create a virtual private network in their infrastructure and connect that private network to your existing private network for your cluster. The devil is in the networking details. So in that case, you can just treat it as a new rac

Re: [slurm-users] Burst to AWS cloud

2020-12-15 Thread Sajesh Singh
Brian, Thank you for the info. Will definitely keep you recommendations handy while putting this together. -SS- From: slurm-users On Behalf Of Brian Andrus Sent: Tuesday, December 15, 2020 3:14 PM To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Burst to AWS cloud EXTERNAL

Re: [slurm-users] Burst to AWS cloud

2020-12-15 Thread Brian Andrus
I have done that for several clients. 1. Staging data is a pain. The simplest thing was to have it as part of the job script, or have the job itself be dependent upon a separate staging job. Where bandwidth is an issue, we have implemented bbcp 2. Depending on size and connectivity, you can