Package: lists.debian.org
Severity: wishlist

This is occurred to me while searching the archives via google, and it
applies to all search engines that spider lists.debian.org

A large number of entries in the google results from the list are useless
because they are the 'debian-user Jun 2006 by thread/author/whatever'
monthly summaries.

Because each monthly summary is simply a list of the thread titles, it
leads to false hits for the search keywords, for instance 'dvd mplayer menu'
hits all the monthly summaries, even when there isn't actually a msg
referencing dvds and menus and mplayer.

Judicious use of the robots.txt file on the mail archive server would be a
simple way to remove the summaries from the search engines, for instance
something like:

Disallow: /**/threads.html

in the robots.txt file in the root of the website would probably do it.

For more info, see http://www.robotstxt.org/


--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]

Reply via email to