On 19.04.2012 22:46, Luigi Rizzo wrote:
On Thu, Apr 19, 2012 at 10:05:37PM +0200, Andre Oppermann wrote:
On 19.04.2012 15:30, Luigi Rizzo wrote:
I have been running some performance tests on UDP sockets,
using the netsend program in tools/tools/netrate/netsend
and instrumenting the source code and the kernel do return in
various points of the path. Here are some results which
I hope you find interesting.
- another big bottleneck is the route lookup in ip_output()
   (between entries 51 and 56). Not only it eats another
   100ns+ on an empty routing table, but it also
   causes huge contentions when multiple cores
   are involved.

This is indeed a big problem.  I'm working (rough edges remain) on
changing the routing table locking to an rmlock (read-mostly) which

i was wondering, is there a way (and/or any advantage) to use the
fastforward code to look up the route for locally sourced packets ?

I've completed the updating of the routing table rmlock patch.  There
are two steps.  Step one is just changing the rwlock to an rmlock.
Step two streamlines the route lookup in ip_output and ip_fastfwd by
copying out the relevant data while only holding the rmlock instead
of obtaining a reference to the route.

Would be very interesting to see how your benchmark/profiling changes
with these patches applied.

http://svn.freebsd.org/changeset/base/234649
Log:
  Change the radix head lock to an rmlock (read mostly lock).

  There is some header pollution going on because rmlock's are
  not entirely abstracted and need per-CPU structures.

  A comment in _rmlock.h says this can be hidden if there were
  per-cpu linker magic/support.  I don't know if we have that
  already.

http://svn.freebsd.org/changeset/base/234650
Log:
  Add a function rtlookup() that copies out the relevant information
  from an rtentry instead of returning the rtentry.  This avoids the
  need to lock the rtentry and to increase the refcount on it.

  Convert ip_output() to use rtlookup() in a simplistic way.  Certain
  seldom used functionality may not work anymore and the flowtable
  isn't available at the moment.

  Convert ip_fastfwd() to use rtlookup().

  This code is meant to be used for profiling and to be experimented
  with further to determine which locking strategy returns the best
  results.

Make sure to apply this one as well:
http://svn.freebsd.org/changeset/base/234648
Log:
  Add INVARIANT and WITNESS support to rm_lock locks and optimize the
  synchronization path by replacing a LIST of active readers with a
  TAILQ.

  Obtained from:        Isilon
  Submitted by: mlaier

--
Andre
_______________________________________________
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Reply via email to