On Thu, 03 Jan 2008, Jason Spiro wrote: > Please allow search engines to index http://bugs.debian.org. This can > be done by deleting the file http://bugs.debian.org/robots.txt.
Just for the record, the reasons why we disallow indexing are because the robots.txt specification isn't complete enough to specify a maximum scan rate for specific portions of the site sufficient to allow us to actually allow bots to access the site without degrading performance for other users of the site. There are already mirrors which allow indexing, and you can use the BTS's own search engine which is far superior to gooogle (or any other search engine which doesn't have access to internal metadata) in this regard. Don Armstrong -- Nearly all men can stand adversity, but if you really want to test his character, give him power. -- Abraham Lincoln http://www.donarmstrong.com http://rzlab.ucr.edu -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
