Re: [Beowulf] What is rdma, ofed, verbs, psm etc?

2017-09-20 Thread Jon Tegner
What about RoCE? Is this something that is commonly used (I would guess no since I have not found much)? Are there other protocols that are worth considering (like "gamma" which doesn't seem to be developed anymore)? My impression is that with RoCE you have to use specialized hardware (unlike

[Beowulf] Administrivia: List admin away at Slurm User Group next week

2017-09-20 Thread Christopher Samuel
Hi folks, In a few hours I'm going to be travelling to the Slurm User Group at NERSC (Berkeley, CA, USA) and then taking a little personal time afterwards and so I won't be back in Australia until 3rd October (in body at least, uncertain when my brain will catch up with me). Whilst I'm at SLUG I

Re: [Beowulf] What is rdma, ofed, verbs, psm etc?

2017-09-20 Thread Christopher Samuel
On 21/09/17 01:03, Faraz Hussain wrote: > Thanks Peter for the high level overview! A few followup questions. What > if I am using a non-Infiniband cluster, i.e something with 10gigE.  Or > even slower like at my home I have a raspbery pi cluster with 100 Mbps > ethernet. Is ofed/psm/verbs all irr

Re: [Beowulf] What is rdma, ofed, verbs, psm etc?

2017-09-20 Thread Faraz Hussain
Thanks Peter for the high level overview! A few followup questions. What if I am using a non-Infiniband cluster, i.e something with 10gigE. Or even slower like at my home I have a raspbery pi cluster with 100 Mbps ethernet. Is ofed/psm/verbs all irrelevant? If so, what would their equivale