https://bugs.documentfoundation.org/show_bug.cgi?id=152366

--- Comment #5 from [email protected] ---
from 
https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt#syntax

"A page that's disallowed in robots.txt can still be indexed if linked to from
other sites.
While Google won't crawl or index the content blocked by a robots.txt file, we
might still find and index a disallowed URL if it is linked from other places
on the web. As a result, the URL address and, potentially, other publicly
available information such as anchor text in links to the page can still appear
in Google search results. To properly prevent your URL from appearing in Google
search results, password-protect the files on your server, use the noindex meta
tag or response header, or remove the page entirely. "


since old versions are not updated(?), would be easy to add 
  <meta name="robots" content="noindex">
add also a sort of banner in the content.


Q: what's the process to do/publish these changes ?

-- 
You are receiving this mail because:
You are the assignee for the bug.

Reply via email to