Please only offer links that lead to something. lynx -dump -listonly shows that there already is some discrimination done in. Now all you need to do is tighten up the algorithm a little more to not offer links to things that indeed it is already known to not exist.
A further example is * http://bugs.debian.org/cgi-bin/bugreport.cgi?msg=14;bug=638388 * http://bugs.debian.org/cgi-bin/bugreport.cgi?msg=15;bug=638388 The former has a link to "View this message in rfc822 format" which is guaranteed to be 0 bytes. The latter has no such spurious link. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
