On Thu, Mar 02, 2006 at 12:32:40PM -0800, Konstantin Kudin wrote:

>  By the way, any idea why gigE on Opterons with Broadcom chokes so
> easily with different flavours of "alltoall" operation, such as if done
> via "isend+irecv"? If functioning flawlessly, the scaling would have
> been not too bad, but there seem to be issues of some sort ...

Congestion. Ethernet switches are the guilty party, not the Broadcom
nics. MPI can makes this better by avoiding, for example, having
everyone send first to process 0, then to 1, etc. So MPICH, for
example, has rank R send to R+1, R+2, etc.

-- greg

_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org
To change your subscription (digest mode or unsubscribe) visit 
http://www.beowulf.org/mailman/listinfo/beowulf

Reply via email to