Re: [Beowulf] Scaling issues on Xeon E5-2680

2016-02-29 Thread Prentice Bisbal
As others have said, there's a million things that could be going on here. What InfiniBand software stack are you using? Are you using the RPMs that come with CentOS 7, or are you using the lated version of OFED downloaded directly from Mellanox. For the past year or so, I've been hearing tha

Re: [Beowulf] Scaling issues on Xeon E5-2680

2016-02-29 Thread Jon Tegner
Found out what was wrong... Turned out the hardware was delivered with 15 of the 16 memory slots populated No wonder we had performance issues! Anyway, thanks a a lot, all who answered! /jon On 02/29/2016 06:48 PM, Josef Weidendorfer wrote: Am 28.02.2016 um 16:27 schrieb Jon Tegner: F

Re: [Beowulf] Scaling issues on Xeon E5-2680

2016-02-29 Thread Josef Weidendorfer
Am 28.02.2016 um 16:27 schrieb Jon Tegner: > For one of our applications (CFD/OpenFOAM) we have noticed that the > calculation runs faster using 12 cores on 4 nodes compared to when using > 24 cores on 4 nodes. If this is OpenMP within each node... This may be an effect of first touch going wrong