-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 <to...@tuxteam.de> wrote: > On Fri, Nov 01, 2019 at 04:29:38PM -0000, Dan Purgert wrote: >> Gene Heskett wrote: >>> [...] >>> Humm. in /var/log/httpd/other_vhosts_access.log, is looks as if both >>> www.yandex.com/bots and www.semrush.com/bot.html are trying to >>> download all of my nitros9 stuff, which is a unix like OS for the >>> trs-80 color computer. >> >> Sounds like you might want a robots.txt file in there, to keep them from >> grabbing it. > > https://en.wikipedia.org/wiki/Robots.txt
Whoops, could've sworn I had the link in there too. Curse telemarketers. -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEBcqaUD8uEzVNxUrujhHd8xJ5ooEFAl28Yt8ACgkQjhHd8xJ5 ooGoIwf+OR+RDKsR4YJ5UKnhCVceJWfM96h7oaszbQISfj7RMWa/h2pn0tvx633a ufVG4WQKc02CKccUgtZbt2CXRNT60WGBy8FJe/65+wyOSTbUlkfyCD+UzZotABJx 3qojwcOKG8kPHf8992wirbzg6OOEOvPlnV5T0wWqmJSIwzlIA5KUKl924QcZuwg2 mDkGj3AaAqnLhB+5kLfFY9eVeDHLck4Jvja6dRZ/QHWz8614ai12T4Hf/Qa+AJDP SpSfizYC68jSTVVFVTFbWEAvJk7I6/BDQsKNSOEgoHC0iNFOs9QfgjIcGfISdcFt jR+WeF4GVh69dy8xxRTc/U/SkPWplQ== =f5Am -----END PGP SIGNATURE----- -- |_|O|_| |_|_|O| Github: https://github.com/dpurgert |O|O|O| PGP: 05CA 9A50 3F2E 1335 4DC5 4AEE 8E11 DDF3 1279 A281
