On Tuesday 29 August 2006 22:57, Ian Holsman wrote:
> FWIW.. there is a rouge bot going round in Australia
Since bots don't normally have colours, I'm guessing that must mean a
Communist bot. No doubt it's part of some international plan to
undermine capitalism, those pesky Communists at it
The source IP would be useful as well.
other things which *may* be useful might be the auth_user_id and
session_key of the request record.
FWIW.. there is a rouge bot going round in Australia which 'guesses'
URLs based on what it sees in javascript.
and i've also seen some spam bots guessing
On 8/29/06, Luke Plant <[EMAIL PROTECTED]> wrote:
> I'm currently getting tons of 'Broken INTERNAL link' e-mails from my
> live site, but they are incorrect -- sometimes the 'Referrer' URL
> doesn't even exist. I suspect it is some rather broken bot making all
> kinds of random requests, so I'd l
I'm currently getting tons of 'Broken INTERNAL link' e-mails from my
live site, but they are incorrect -- sometimes the 'Referrer' URL
doesn't even exist. I suspect it is some rather broken bot making all
kinds of random requests, so I'd like to add 'User agent' to the
information that is sen
Hi,
Django's check for internal/external links (via the HTTP_REFERER header)
is pretty naïve, and it means I'm currently getting tons of e-mails
telling me I have broken *internal* links, when actually they are
external links from Google's cache, which happens to contain the
