On Friday 01 November 2019 13:43:04 to...@tuxteam.de wrote: > On Fri, Nov 01, 2019 at 01:12:46PM -0400, Gene Heskett wrote: > > On Friday 01 November 2019 12:42:21 to...@tuxteam.de wrote: > > [...] > > > > https://en.wikipedia.org/wiki/Robots.txt > > > > Did that, blanket Disallow for all didn't stop them. But they are > > spacing out the requests now, so the average traffic is very low. I > > can tolerate that. > > You can block by user agent, that's more drastic. > > If I've been paying attention, you are on apache. Then this might > be relevant: > > > https://httpd.apache.org/docs/2.4/rewrite/access.html#blocking-of-robo >ts > Unfortunately its starts with a very fuzzy explanation of where to put all those examples. I suspect thats because I probably don't have near all of apache2 installed.
> Cheers > -- t Cheers, Gene Heskett -- "There are four boxes to be used in defense of liberty: soap, ballot, jury, and ammo. Please use in that order." -Ed Howdershelt (Author) If we desire respect for the law, we must first make the law respectable. - Louis D. Brandeis Genes Web page <http://geneslinuxbox.net:6309/gene>
