On Sun, Oct 12, 2008 at 7:26 PM, <[EMAIL PROTECTED]> wrote:
>
>Taskinoor> im a novice python programmer. i have made two changes to
>Taskinoor> robotparser.py. i apologize if this is the wrong list to post
>Taskinoor> this mail.
>
> Thanks for the message. Can you please file a bug re
Taskinoor> im a novice python programmer. i have made two changes to
Taskinoor> robotparser.py. i apologize if this is the wrong list to post
Taskinoor> this mail.
Thanks for the message. Can you please file a bug report at
http://bugs.python.org though?
Skip
___
im a novice python programmer. i have made two changes to robotparser.py. i
apologize if this is the wrong list to post this mail.
1. some sites /* specially wikipedia */ returns 403 when default User-Agent
is used. so i have changed the code to use urllib2 and added a
set_user_agent method. this
