Re: [Beowulf] Dual IB Cards in a Single Box

2019-05-10 Thread Kilian Cavalotti
Hi Paul, We do heavily rely on LNet routers to connect our clusters to our storage systems, some suing FDR, some using EDR, and mixing up different IB generations in the same host is not an issue. HDR kind of requires PCIe Gen4 though (or 2x PCI Gen3 ports, but...), so that could be a limiting fa

Re: [Beowulf] Dual IB Cards in a Single Box

2019-05-10 Thread Prentice Bisbal via Beowulf
I have a cluster with Dell blades. The Chassis has FDR, but the TOR IB switches are only QDR. No problems On 5/10/19 1:44 PM, Jörg Saßmannshausen wrote: Hi Paul, if that is a Mellanox network I would have thought that putting in a single, dual port HDR InfiniBand card would do the trick as wel

Re: [Beowulf] Dual IB Cards in a Single Box

2019-05-10 Thread Jörg Saßmannshausen
Hi Paul, if that is a Mellanox network I would have thought that putting in a single, dual port HDR InfiniBand card would do the trick as well. From what I understand, the HDR will use the slower FDR speed when the other end is only EDR. I done a similar setup with a mixed network where the sw

Re: [Beowulf] Dual IB Cards in a Single Box

2019-05-10 Thread Michael Di Domenico
i don't have HDR, but i do have FDR/QDR/EDR/10Gb all in the same server acting as an lnet router. seems to work fine On Fri, May 10, 2019 at 12:14 PM Paul Edmon wrote: > > We are looking to bridge our FDR fabric to our HDR fabric via LNET and > we had a question about whether a single machine ca

[Beowulf] Dual IB Cards in a Single Box

2019-05-10 Thread Paul Edmon
We are looking to bridge our FDR fabric to our HDR fabric via LNET and we had a question about whether a single machine can have 2 different IB cards simultaneously. Does anyone have any experience with that or know if there are any hitches with having a single box with a FDR card and a HDR car