Re: [users@httpd] Redirect search robots onto a dedicated cluster machine

2013-07-02 Thread john gale
You should be able to use a rewrite rule that redirects to another server / port / worker. https://www.google.com/search?q=apache+redirect+based+on+useragent ~ john On Jul 2, 2013, at 2:39 AM, Pete Jones wrote: > Hello > > We have a small cluster of machines serving a wiki website.

[users@httpd] Redirect search robots onto a dedicated cluster machine

2013-07-02 Thread Pete Jones
Hello We have a small cluster of machines serving a wiki website. Search engine robots are allowed in to index the website and these create a lot of traffic that can affect the service. I would like to redirect all http requests from these robots to one of the machines in the cluster. Any ideas