On 05/16/2011 02:32 PM, Michael Matz wrote: > > On Mon, 16 May 2011, Andrew Haley wrote: > >>> It routinely is. bugzilla performance is terrible most of the time >>> for me (up to the point of five timeouts in sequence), svn speed is >>> mediocre at best, and people with access to gcc.gnu.org often observe >>> loads > 25, mostly due to I/O . >> >> And how have you concluded that is due to web crawlers? > > httpd being in the top-10 always, fiddling with bugzilla URLs? > (Note, I don't have access to gcc.gnu.org, I'm relaying info from multiple > instances of discussion on #gcc and richi poking on it; that said, it > still might not be web crawlers, that's right, but I'll happily accept > _any_ load improvement on gcc.gnu.org, how unfounded they might seem)
Well, we have to be sensible. If blocking crawlers only results in a small load reduction that isn't, IMHO, a good deal for our users. Andrew.
