Although cgit is more efficient than gitweb it still is not great for bots to go through it. --- htdocs/robots.txt | 1 + 1 file changed, 1 insertion(+)
diff --git a/htdocs/robots.txt b/htdocs/robots.txt index c650057b..b9fc830d 100644 --- a/htdocs/robots.txt +++ b/htdocs/robots.txt @@ -6,6 +6,7 @@ User-agent: * Disallow: /viewvc/ Disallow: /viewcvs Disallow: /git/ +Disallow: /cgit/ Disallow: /svn Disallow: /cgi-bin/ Disallow: /bugzilla/buglist.cgi -- 2.39.3
