Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread Chris Samuel
On 29/6/20 5:09 pm, Jörg Saßmannshausen wrote: we are currently planning a new cluster and this time around the idea was to use OpenStack for the HPC part of the cluster as well. I was wondering if somebody has some first hand experiences on the list here. At $JOB-2 I helped a group set up a

Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread John Hearns
Jorg, I would back up what Matt Wallis says. What benefits would Openstack bring you ? Do you need to set up a flexible infrastructure where clusters can be created on demand for specific projects? Regarding Infiniband the concept is SR-IOV. This article is worth reading: https://docs.openstack.or

Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread INKozin via Beowulf
Hi Jörg, you may want to talk to Kenneth Tan @ https://www.sardinasystems.com/ In any case, he should be able to clarify your question regarding IB. Happy to provide his email address. Best Igor On Tue, 30 Jun 2020 at 12:22, Jörg Saßmannshausen < sassy-w...@sassy.formativ.net> wrote: > Dear all,

Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread John Hearns
The video is here. From 04:00 onwards https://fosdem.org/2020/schedule/event/magic_castle/ "OK your cluster will be available in about 20 minutes" On Tue, 30 Jun 2020 at 14:27, INKozin wrote: > And that's how you deploy an HPC cluster! > > On Tue, 30 Jun 2020 at 14:21, John Hearns wrote: > >>

Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread John Hearns
I saw Magic Castle being demonstrated lve at FOSDEM this year. It is more a Terraform/ansible setup for configuring clusters on demand. The person demonstrating it called a Google Home assistant with a voice command and asked it to build and deploy a cluster - which it did! On Tue, 30 Jun 2020 at

Re: [Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread Matt Wallis
Hi Jörg > On 30 Jun 2020, at 10:09 am, Jörg Saßmannshausen > wrote: > > Dear all, > > we are currently planning a new cluster and this time around the idea was to > use OpenStack for the HPC part of the cluster as well. > > I was wondering if somebody has some first hand experiences on the

[Beowulf] experience with HPC running on OpenStack

2020-06-30 Thread Jörg Saßmannshausen
Dear all, we are currently planning a new cluster and this time around the idea was to use OpenStack for the HPC part of the cluster as well. I was wondering if somebody has some first hand experiences on the list here. One of the things we currently are not so sure about it is InfiniBand (or