Re: Broken internal links e-mails

2006-08-29 Thread Luke Plant
On Tuesday 29 August 2006 22:57, Ian Holsman wrote: > FWIW.. there is a rouge bot going round in Australia Since bots don't normally have colours, I'm guessing that must mean a Communist bot. No doubt it's part of some international plan to undermine capitalism, those pesky Communists at it

Re: Broken internal links e-mails

2006-08-29 Thread Ian Holsman
The source IP would be useful as well. other things which *may* be useful might be the auth_user_id and session_key of the request record. FWIW.. there is a rouge bot going round in Australia which 'guesses' URLs based on what it sees in javascript. and i've also seen some spam bots guessing

Re: Broken internal links e-mails

2006-08-29 Thread Adrian Holovaty
On 8/29/06, Luke Plant <[EMAIL PROTECTED]> wrote: > I'm currently getting tons of 'Broken INTERNAL link' e-mails from my > live site, but they are incorrect -- sometimes the 'Referrer' URL > doesn't even exist. I suspect it is some rather broken bot making all > kinds of random requests, so I'd l

Broken internal links e-mails

2006-08-29 Thread Luke Plant
I'm currently getting tons of 'Broken INTERNAL link' e-mails from my live site, but they are incorrect -- sometimes the 'Referrer' URL doesn't even exist. I suspect it is some rather broken bot making all kinds of random requests, so I'd like to add 'User agent' to the information that is sen