I've been trying to get this working for the last year. Basically our issue is that the htaccess files do not add the right X-Robots-Tag header for old ref guide pages.
https://github.com/apache/solr-site/blob/main/themes/solr/templates/htaccess.ref-guide-old#L1 This works locally, but in the actual Solr site, the headers are not returned. I have no idea why. Would love some help though, as I also hate seeing the old ref guide in the google results. - Houston On Thu, Sep 21, 2023 at 11:30 AM Walter Underwood <wun...@wunderwood.org> wrote: > When I get web search results that include the Solr Reference Guide, I > often get older versions (6.6, 7.4) in the results. I would prefer to > always get the latest reference ( > https://solr.apache.org/guide/solr/latest/index.html). > > I think we can list the URLs for that in a sitemap.xml file with a higher > priority to suggest to the crawlers that these are the preferred pages. > > I don’t see a sitemap.xml or sitemap.xml.gz at https://solr.apached.org < > https://solr.apached.org/>. > > Should we prefer the latest manual? How do we build/deploy a sitemap? See: > https://www.sitemaps.org/ > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > >
