- "Mark Montague" wrote:
> On January 4, 2011 22:32 , Carlos S wrote:
> > Recently I was trying to download a package using wget, but the
> > website prevented access to it. I tried --user-agent option but it
> > didn't work either. So I was curious to know what strategy this web
> > admin
On January 4, 2011 22:32 , Carlos S wrote:
Recently I was trying to download a package using wget, but the
website prevented access to it. I tried --user-agent option but it
didn't work either. So I was curious to know what strategy this web
admin must have implemented.
Without an example UR
Thanks for the links Mark and Doug. The webscrapers thing looks interesting..
I had looked at mod_rewrite and User-Agent header solution.
Recently I was trying to download a package using wget, but the
website prevented access to it. I tried --user-agent option but it
didn't work either. So I wa
At 18:19 -0500 1/4/11, Mark Montague wrote:
>Follow the example below, but use only the user agent condition, omit the IP
>condition, and suitably adjust the RewriteRule regular expression to match the
>URL(s) you wish to block:
>
>http://httpd.apache.org/docs/2.2/rewrite/rewrite_guide.html#block
On January 4, 2011 18:03 , Carlos S wrote:
Is there any way to disable download/traffic from wget-like user
agents? Can this be done using user-agent string? Any documentation
link or example will be really helpful.
Follow the example below, but use only the user agent condition, omit
the IP
Is there any way to disable download/traffic from wget-like user
agents? Can this be done using user-agent string? Any documentation
link or example will be really helpful.
--
cs.
-
The official User-To-User support forum of the
