On Thu, 15 Dec 2005, Stephen Hemminger wrote:
> On Fri, 16 Dec 2005 03:26:31 +0100
> Andi Kleen <[EMAIL PROTECTED]> wrote:
>
> > On Thu, Dec 15, 2005 at 08:35:32PM -0500, Bill Fink wrote:
> > > On Fri, 16 Dec 2005, Andi Kleen wrote:
> > >
> > > > > It appears that it is getting CPU starved for some reason (note the
> > > > > 43%/40% transmitter CPU usage versus the 99%/99% CPU usage for the
> > > > > 2.6.12.6 case).
> > > >
> > > > What happens when you turn off tso in ethtool?
> > >
> > > Thanks!!! That did the trick.
> >
> > TSO is still a bit of work in progress. The old 2.6.12 TSO code
> > actually ignored the congestion window and was illegal in benchmarks etc
> > (and might have even been dangerous to the internet). That was fixed,
> > but performance still didn't fully recover. It's a tricky problem.
>
> And it wasn't till 2.6.15 that we got the fix in to correctly
> increase cwnd with TSO.
Update:
I just now tested with 2.6.15-rc7 and it seems to work fine with
TSO enabled.
chance% cat /proc/version
Linux version 2.6.15-rc7-bf-smp ([EMAIL PROTECTED]) (gcc version 3.2 20020903
(Red Hat Linux 8.0 3.2-7)) #1 SMP Wed Dec 28 19:35:55 EST 2005
[EMAIL PROTECTED] ethtool -k eth0
Offload parameters for eth0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp segmentation offload: on
chance% nuttcp -w2m 192.168.88.8
6054.1250 MB / 10.01 sec = 5073.1546 Mbps 100 %TX 72 %RX
chance% nuttcp -r -w2m 192.168.88.8
6090.4375 MB / 10.01 sec = 5103.6174 Mbps 100 %TX 70 %RX
That's expected TCP performance levels of slightly over 5 Gbps,
although I thought I might get some CPU back with TSO enabled
(note the transmitter is still pegged at 100%).
Would the following patch be at all useful for the 2.6.14.x stable
series, since enabling TSO there causes a 40% or greater TCP performance
penalty, or is 2.6.15 final so imminenent that it wouldn't be
considered useful?
Signed-off-by: Bill Fink <[EMAIL PROTECTED]>
--- linux-2.6.14.3.orig/drivers/net/ixgb/ixgb_main.c 2005-11-24
17:10:21.000000000 -0500
+++ linux-2.6.14.3/drivers/net/ixgb/ixgb_main.c 2005-12-28 01:06:05.000000000
-0500
@@ -445,7 +445,8 @@
NETIF_F_HW_VLAN_RX |
NETIF_F_HW_VLAN_FILTER;
#ifdef NETIF_F_TSO
- netdev->features |= NETIF_F_TSO;
+ /* TSO not performant at present - disable by default */
+ netdev->features &= ~NETIF_F_TSO;
#endif
if(pci_using_dac)
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to [EMAIL PROTECTED]
More majordomo info at http://vger.kernel.org/majordomo-info.html