Re: [Beowulf] Containers in HPC

2019-05-22 Thread Lance Wilson via Beowulf
Hi Brian, For single node jobs MPI can be run with the MPI binary from the container with native performance for the shared memory type messages. This has worked without issue since the very early days of Singularity. The only tricky part has been multi-node and multi-container. Cheers, Lance --

Re: [Beowulf] Containers in HPC

2019-05-22 Thread David Mathog
On 22-May-2019 12:00, Gerald Henriksen wrote Paper on arXiv that may be of interest to some as it may be where HPC is heading even for private clusters: Evalutation of Docker Containers for Scientific Workloads in the Cloud https://arxiv.org/abs/1905.08415 Docker is fine so long as the progra

Re: [Beowulf] Containers in HPC

2019-05-22 Thread Brian Dobbins
Thanks, Gerald - I'll be reading this shortly. And to add to any discussion, here's the Blue Waters container paper that I like to point people towards - from the same conference, in fact: https://arxiv.org/pdf/1808.00556.pdf The key thing here is achieving *native* network performance through th

[Beowulf] Containers in HPC

2019-05-22 Thread Gerald Henriksen
Paper on arXiv that may be of interest to some as it may be where HPC is heading even for private clusters: Evalutation of Docker Containers for Scientific Workloads in the Cloud https://arxiv.org/abs/1905.08415 ___ Beowulf mailing list, Beowulf@beowulf.