You should be able to use a rewrite rule that redirects to another server /
port / worker.
https://www.google.com/search?q=apache+redirect+based+on+useragent
~ john
On Jul 2, 2013, at 2:39 AM, Pete Jones wrote:
> Hello
>
> We have a small cluster of machines serving a wiki website.
Hello
We have a small cluster of machines serving a wiki website. Search engine
robots are allowed in to index the website and these create a lot of traffic
that can affect the service. I would like to redirect all http requests from
these robots to one of the machines in the cluster.
Any ideas