Package: wnpp Severity: wishlist * Package name : anubis Version : v1.15.2 Upstream Contact: Xe Iaso <m...@xeiaso.net> * URL : https://anubis.techaro.lol/ * License : MIT License Programming Lang: GO, js. Description : Weigh the soul of incoming HTTP requests using proof-of-work to stop AI crawlers
Upstream's description: | Anubis weighs the soul of your connection using a sha256 proof-of-work | challenge in order to protect upstream resources from scraper bots. | | Installing and using this will likely result in your website not being indexed | by some search engines. This is considered a feature of Anubis, not a bug. | | This is a bit of a nuclear response, but AI scraper bots scraping so | aggressively have forced my hand. I hate that I have to do this, but this is | what we get for the modern Internet because bots don't conform to standards | like robots.txt, even when they claim to. | | In most cases, you should not need this and can probably get by using | Cloudflare to protect a given origin. However, for circumstances where you | can't or won't use Cloudflare, Anubis is there for you. This looks usefull in order to reduce load for instance on git like frontends (gitlab, gitea, cgit,…) where the bots crawl every autogenerated link for no reason. This proof-of-work is handled by browser's javascript and by passing the user (browser) gets a cookie and cann access further content by presenting this cookie. There is a demo -> https://anubis.techaro.lol/ Can this be picked up by go team? Is any help required? Sebastian
