Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-18 Thread Tom Wijsman
On Sat, 18 Jan 2014 05:02:56 + "Robin H. Johnson" wrote: > FYI: The following repos appeared to be empty: > ... > dev/tomwij.git > ... Not empty, has app-office/taskjuggler and dev-java/jetty-*; did a check against my local clone, and `git ls-tree --full-tree -r HEAD | sha1sum` reports the s

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-18 Thread Markos Chandras
On 01/18/2014 12:59 PM, Alex Legler wrote: > On 18.01.2014 06:23, Kent Fredric wrote: >> >> On 18 January 2014 18:02, Robin H. Johnson > > wrote: >> >> - More people need to use the infra-status page to learn about the state >> of Gentoo services. >> >> >> >> A

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-18 Thread Alex Legler
On 18.01.2014 06:23, Kent Fredric wrote: > > On 18 January 2014 18:02, Robin H. Johnson > wrote: > > - More people need to use the infra-status page to learn about the state > of Gentoo services. > > > > A service middle layer like fastly or cloudflare whi

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-18 Thread Alan McKinnon
On 18/01/2014 09:49, Alec Warner wrote: > On Fri, Jan 17, 2014 at 11:10 PM, Alan McKinnon > wrote: > > On 18/01/2014 09:04, Patrick Lauer wrote: > >> which could link to the > >> > infra page would be good here perhaps, so when an outage > occurred

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 11:10 PM, Alan McKinnon wrote: > On 18/01/2014 09:04, Patrick Lauer wrote: > >> which could link to the > >> > infra page would be good here perhaps, so when an outage occurred ( at > >> > least on the web side ) appropriate links to infra could be given. > > The more sane

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alan McKinnon
On 18/01/2014 09:04, Patrick Lauer wrote: >> which could link to the >> > infra page would be good here perhaps, so when an outage occurred ( at >> > least on the web side ) appropriate links to infra could be given. > The more sane fix would be low DNS TTL and rotating DNS to a different > IP if t

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Patrick Lauer
On 01/18/2014 01:23 PM, Kent Fredric wrote: > > On 18 January 2014 18:02, Robin H. Johnson > wrote: > > - More people need to use the infra-status page to learn about the state > of Gentoo services. > > > > A service middle layer like fastly or cloudflare

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 9:02 PM, Robin H. Johnson wrote: > overlays.gentoo.org service has been restored on a new system. > Some statistics and a post-mortem follow. > > Special thanks to antarus and a3li for all their interactions with our > sponsor, > and managing most of the details. I just did

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 9:23 PM, Kent Fredric wrote: > > On 18 January 2014 18:02, Robin H. Johnson wrote: > >> - More people need to use the infra-status page to learn about the state >> of Gentoo services. >> > > > A service middle layer like fastly or cloudflare which could link to the > in

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Kent Fredric
On 18 January 2014 18:02, Robin H. Johnson wrote: > - More people need to use the infra-status page to learn about the state > of Gentoo services. > A service middle layer like fastly or cloudflare which could link to the infra page would be good here perhaps, so when an outage occurred ( at

[gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Robin H. Johnson
overlays.gentoo.org service has been restored on a new system. Some statistics and a post-mortem follow. Special thanks to antarus and a3li for all their interactions with our sponsor, and managing most of the details. I just did the final data recovery and this writeup. Please resume using the