Hi all, I bumped on your that emial on the list http://archives.neohapsis.com/archives/openbsd/2005-06/1679.html about testing the bandwidth between obsd <> obsd , obsd <> linux and thorugh router linux <> bsd <> linux boxes. Im using dell 1425SC boxes witch 1GB em0 nics and my machine with openbsd 3.9 routes packets only with max around 680Mbits/s for one connection using iperf , window from 64k - 256k or up to 800Mbits/s for 2 or more connections using iperf , window 64k-256k , the best results i got with window 128k ,direct connections to openbsd box with one conn from iperf are 40Mbits/s ??!! and a few connection the speed is multiply how many connection you do 2 so speed is 80Mbits/s??!!.These are parameters i have on my obsd box and command i used to test.
net.inet.tcp.sendspace=131072 net.inet.tcp.recvspace=131072 not sure that it has any affection on speed net.inet.tcp.sackholelimit=65536 i increased it net.bpf.bufsize=65536 commands i used: <linux1> iperf -s -p 10000 -w 128k <obsd> router <linux2> iperf -c <linux1> -p 10000 -w 128k [ for pararell -P 2 ] [EMAIL PROTECTED]:~$ iperf -c 192.168.0.10 -p 10000 -w 64k -P 2 ------------------------------------------------------------ Client connecting to 192.168.0.10, TCP port 10000 TCP window size: 128 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 3] local 192.168.10.6 port 46006 connected with 192.168.0.10 port 10000 [ 4] local 192.168.10.6 port 46007 connected with 192.168.0.10 port 10000 [ 3] 0.0-10.0 sec 485 MBytes 407 Mbits/sec [ 4] 0.0-10.0 sec 483 MBytes 405 Mbits/sec [SUM] 0.0-10.0 sec 968 MBytes 812 Mbits/sec [EMAIL PROTECTED]:~$ iperf -c 192.168.0.10 -p 10000 -w 64k -P 1 ------------------------------------------------------------ Client connecting to 192.168.0.10, TCP port 10000 TCP window size: 128 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 3] local 192.168.10.6 port 46008 connected with 192.168.0.10 port 10000 [ 3] 0.0-10.0 sec 718 MBytes 602 Mbits/sec <linux> iperf -c <obsd> -p 10000 -w 128k [ for pararell -P 2 ] <obsd> iperf -s -p 10000 -w 128k [EMAIL PROTECTED]:~$ iperf -c 192.168.0.6 -p 10000 -w 64k ------------------------------------------------------------ Client connecting to 192.168.0.6, TCP port 10000 TCP window size: 128 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 3] local 192.168.0.10 port 48851 connected with 192.168.0.6 port 10000 [ 3] 0.0-10.0 sec 46.1 MBytes 38.6 Mbits/sec [EMAIL PROTECTED]:~$ iperf -c 192.168.0.6 -p 10000 -w 64k -P 2 ------------------------------------------------------------ Client connecting to 192.168.0.6, TCP port 10000 TCP window size: 128 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 4] local 192.168.0.10 port 48853 connected with 192.168.0.6 port 10000 [ 3] local 192.168.0.10 port 48852 connected with 192.168.0.6 port 10000 [ 4] 0.0-10.0 sec 46.9 MBytes 39.3 Mbits/sec [ 3] 0.0-10.0 sec 42.1 MBytes 35.3 Mbits/sec [SUM] 0.0-10.0 sec 89.0 MBytes 74.5 Mbits/sec [EMAIL PROTECTED]:~$ iperf -c 192.168.0.6 -p 10000 -w 64k -P 10 ------------------------------------------------------------ Client connecting to 192.168.0.6, TCP port 10000 TCP window size: 128 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 5] local 192.168.0.10 port 52513 connected with 192.168.0.6 port 10000 [ 7] local 192.168.0.10 port 52515 connected with 192.168.0.6 port 10000 [ 12] local 192.168.0.10 port 52520 connected with 192.168.0.6 port 10000 [ 10] local 192.168.0.10 port 52518 connected with 192.168.0.6 port 10000 [ 8] local 192.168.0.10 port 52516 connected with 192.168.0.6 port 10000 [ 6] local 192.168.0.10 port 52514 connected with 192.168.0.6 port 10000 [ 9] local 192.168.0.10 port 52517 connected with 192.168.0.6 port 10000 [ 4] local 192.168.0.10 port 52512 connected with 192.168.0.6 port 10000 [ 11] local 192.168.0.10 port 52519 connected with 192.168.0.6 port 10000 [ 3] local 192.168.0.10 port 52511 connected with 192.168.0.6 port 10000 [ 5] 0.0-10.0 sec 42.0 MBytes 35.2 Mbits/sec [ 6] 0.0-10.0 sec 42.0 MBytes 35.2 Mbits/sec [ 4] 0.0-10.0 sec 48.3 MBytes 40.5 Mbits/sec [ 7] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 12] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 10] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 8] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 9] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 11] 0.0-10.0 sec 42.0 MBytes 35.1 Mbits/sec [ 3] 0.0-10.0 sec 42.1 MBytes 35.2 Mbits/sec [SUM] 0.0-10.0 sec 426 MBytes 357 Mbits/sec <linux> iperf -s -p 10000 -w 128k [ in pararell -P 2] <obsd> iperf -c -p 10000 -w 128k cio$iperf -c 192.168.0.10 -p 10000 -w 128k -P 1 ------------------------------------------------------------ Client connecting to 192.168.0.10 , TCP port 10000 TCP window size: 128 KByte ------------------------------------------------------------ [ 5] local 192.168.0.6 port 35793 connected with 192.168.0.10 port 10000 [ 5] 0.0-10.0 sec 535 MBytes 449 Mbits/sec cio$iperf -c 192.168.0.10 -p 10000 -w 128k -P 2 ------------------------------------------------------------ Client connecting to 192.168.0.10, TCP port 10000 TCP window size: 128 KByte ------------------------------------------------------------ [ 6] local 192.168.0.6 port 12876 connected with 192.168.0.10 port 10000 [ 5] local 192.168.0.6 port 26400 connected with 192.168.0.10 port 10000 [ 6] 0.0-10.0 sec 355 MBytes 297 Mbits/sec [ 5] 0.0-10.0 sec 365 MBytes 306 Mbits/sec [SUM] 0.0-10.0 sec 720 MBytes 603 Mbits/sec I was playing a bit with sysctl tcp option and bpf but no success.Perhapsyou found soulution for these strange behavior , i would be greatful for any response , thanks in advance , i can attach dmesg/pf.conf if it can help Regards Jacek
