Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 11:10 PM, Alan McKinnon wrote: > On 18/01/2014 09:04, Patrick Lauer wrote: > >> which could link to the > >> > infra page would be good here perhaps, so when an outage occurred ( at > >> > least on the web side ) appropriate links to infra could be given. > > The more sane

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alan McKinnon
On 18/01/2014 09:04, Patrick Lauer wrote: >> which could link to the >> > infra page would be good here perhaps, so when an outage occurred ( at >> > least on the web side ) appropriate links to infra could be given. > The more sane fix would be low DNS TTL and rotating DNS to a different > IP if t

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Patrick Lauer
On 01/18/2014 01:23 PM, Kent Fredric wrote: > > On 18 January 2014 18:02, Robin H. Johnson > wrote: > > - More people need to use the infra-status page to learn about the state > of Gentoo services. > > > > A service middle layer like fastly or cloudflare

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 9:02 PM, Robin H. Johnson wrote: > overlays.gentoo.org service has been restored on a new system. > Some statistics and a post-mortem follow. > > Special thanks to antarus and a3li for all their interactions with our > sponsor, > and managing most of the details. I just did

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 9:23 PM, Kent Fredric wrote: > > On 18 January 2014 18:02, Robin H. Johnson wrote: > >> - More people need to use the infra-status page to learn about the state >> of Gentoo services. >> > > > A service middle layer like fastly or cloudflare which could link to the > in

Re: [gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Kent Fredric
On 18 January 2014 18:02, Robin H. Johnson wrote: > - More people need to use the infra-status page to learn about the state > of Gentoo services. > A service middle layer like fastly or cloudflare which could link to the infra page would be good here perhaps, so when an outage occurred ( at

[gentoo-dev] overlays.gentoo.org restoration & post-mortem

2014-01-17 Thread Robin H. Johnson
overlays.gentoo.org service has been restored on a new system. Some statistics and a post-mortem follow. Special thanks to antarus and a3li for all their interactions with our sponsor, and managing most of the details. I just did the final data recovery and this writeup. Please resume using the

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread heroxbd
Alex Xu writes: > This doesn't really help. Consider that deltas require both a *start* > and *end*. It's not as simple as adding it all up, since you would need > a 19-3d, then 3-1d, then 1-0d. In this case, 19-18d, 18-16d, 16-0d, instead. The largest delta is always used for the most recent. T

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread William Hubbs
On Fri, Jan 17, 2014 at 04:02:27PM +0100, Michał Górny wrote: > Dnia 2014-01-17, o godz. 14:02:51 > gro...@gentoo.org napisał(a): > > > Maybe, a good solution is to introduce a special arch, "noarch", for such > > packages (similar to what's done in the rpm world). Then, if a package is > > ~noa

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Alex Xu
On 17/01/14 08:08 PM, hero...@gentoo.org wrote: > Michał Górny writes: > >> However, it may be actually beneficial to provide other durations, like >> weekly deltas. In my tests, the daily updates for this week summed up >> to almost 50M while the weekly was barely 20M. > > Is there a way to mer

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Thomas D.
Hi, Michał Górny wrote: > Now, does anyone have an old portage-YYZZ.tar.{bz2,xz} snapshot? I > need the official one from our mirrors, preferably 3-4 months old.

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread heroxbd
Michał Górny writes: > However, it may be actually beneficial to provide other durations, like > weekly deltas. In my tests, the daily updates for this week summed up > to almost 50M while the weekly was barely 20M. Is there a way to merge the deltas without the original squashfs? how fast is th

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Manuel Rüger
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 01/17/2014 06:08 PM, gro...@gentoo.org wrote: > On Fri, 17 Jan 2014, Tom Wijsman wrote: >> On Fri, 17 Jan 2014 16:31:54 +0100 Ulrich Mueller >> wrote: On Fri, 17 Jan 2014, grozin wrote: Maybe, a good solution is to introduce a spec

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Tom Wijsman
On Fri, 17 Jan 2014 18:28:41 + Ciaran McCreesh wrote: > On Fri, 17 Jan 2014 17:47:58 +0100 > Tom Wijsman wrote: > > Maybe we can let the package managers only perceive it as keyworded > > or stable if all of its dependencies are keyworded or stable on the > > architecture that the user runs.

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Michał Górny
Dnia 2014-01-17, o godz. 23:31:32 Duncan <1i5t5.dun...@cox.net> napisał(a): > Michał Górny posted on Fri, 17 Jan 2014 20:30:00 +0100 as excerpted: > > > Dnia 2014-01-17, o godz. 19:19:14 Duncan <1i5t5.dun...@cox.net> > > napisał(a): > > > >> Michał Górny posted on Fri, 17 Jan 2014 17:27:30 +0100

[gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Duncan
Michał Górny posted on Fri, 17 Jan 2014 20:30:00 +0100 as excerpted: > Dnia 2014-01-17, o godz. 19:19:14 Duncan <1i5t5.dun...@cox.net> > napisał(a): > >> Michał Górny posted on Fri, 17 Jan 2014 17:27:30 +0100 as excerpted: >> >> > 96Mportage-20140108.sqfs >> > For deltas [...] >> > >>

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Maciej Mrozowski
On Friday 17 of January 2014 13:06:22 gro...@gentoo.org wrote: | dev-util/kdevelop-php-docs While of course it doesn't invalidate your entire idea, this particular example is a kdevelop plugin written in C++ that provides php API documentation integration. This tells however that decision to "au

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Markos Chandras
On 01/17/2014 04:27 PM, Michał Górny wrote: > Hello, all. > > I'm using squashfs to hold my Gentoo repositories on all of my systems > for some time. As you probably know, this allows me to save space while > keeping portage fast. However, it makes updating the tree quite > burdensome and time-con

Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Michał Górny
Dnia 2014-01-17, o godz. 19:19:14 Duncan <1i5t5.dun...@cox.net> napisał(a): > Michał Górny posted on Fri, 17 Jan 2014 17:27:30 +0100 as excerpted: > > > Now some numbers. I did some tests 'converting' late gx86 daily tarballs > > to squashfs. I've used squashfs 4.2 with LZO compression since it's

[gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Duncan
Michał Górny posted on Fri, 17 Jan 2014 17:27:30 +0100 as excerpted: > Now some numbers. I did some tests 'converting' late gx86 daily tarballs > to squashfs. I've used squashfs 4.2 with LZO compression since it's > quite good and very fast. > > 96M portage-20140108.sqfs [...] > 97M portage-2

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Michał Górny
Dnia 2014-01-17, o godz. 10:18:58 Alec Warner napisał(a): > On Fri, Jan 17, 2014 at 8:27 AM, Michał Górny wrote: > > > Hello, all. > > > > I'm using squashfs to hold my Gentoo repositories on all of my systems > > for some time. As you probably know, this allows me to save space while > > keepi

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Ciaran McCreesh
On Fri, 17 Jan 2014 17:47:58 +0100 Tom Wijsman wrote: > Maybe we can let the package managers only perceive it as keyworded or > stable if all of its dependencies are keyworded or stable on the > architecture that the user runs. Then we can have repoman just ignore > checking dependencies' keyword

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Alec Warner
On Fri, Jan 17, 2014 at 8:27 AM, Michał Górny wrote: > Hello, all. > > I'm using squashfs to hold my Gentoo repositories on all of my systems > for some time. As you probably know, this allows me to save space while > keeping portage fast. However, it makes updating the tree quite > burdensome an

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread viv...@gmail.com
On 01/17/14 17:27, Michał Górny wrote: > Hello, all. > > I'm using squashfs to hold my Gentoo repositories on all of my systems > for some time. As you probably know, this allows me to save space while > keeping portage fast. However, it makes updating the tree quite > burdensome and time-consuming

noarch packages, was Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread grozin
On Fri, 17 Jan 2014, Ulrich Mueller wrote: On Fri, 17 Jan 2014, grozin wrote: Maybe, a good solution is to introduce a special arch, "noarch", for such packages (similar to what's done in the rpm world). Then, if a package is ~noarch, it is automatically considered ~arch for all arches. Similar

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread grozin
On Fri, 17 Jan 2014, Tom Wijsman wrote: On Fri, 17 Jan 2014 16:31:54 +0100 Ulrich Mueller wrote: On Fri, 17 Jan 2014, grozin wrote: Maybe, a good solution is to introduce a special arch, "noarch", for such packages (similar to what's done in the rpm world). Then, if a package is ~noarch, it i

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Peter Stuge
Michał Górny wrote: > > > What do you think? > > > > Excellent. I think it could quickly become the prefered protage > > storage format, although a loopback mount is needed. > > You can use sys-fs/squashfuse :). > > Though honestly I'd prefer if portage was able to take squashfs image > path in

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Michał Górny
Dnia 2014-01-17, o godz. 17:51:41 Peter Stuge napisał(a): > Michał Górny wrote: > > What do you think? > > Excellent. I think it could quickly become the prefered protage > storage format, although a loopback mount is needed. You can use sys-fs/squashfuse :). Though honestly I'd prefer if port

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Peter Stuge
Michał Górny wrote: > What do you think? Excellent. I think it could quickly become the prefered protage storage format, although a loopback mount is needed. //Peter pgpZaqbTCHide.pgp Description: PGP signature

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Tom Wijsman
On Fri, 17 Jan 2014 16:31:54 +0100 Ulrich Mueller wrote: > > On Fri, 17 Jan 2014, grozin wrote: > > > Maybe, a good solution is to introduce a special arch, "noarch", for > > such packages (similar to what's done in the rpm world). Then, if a > > package is ~noarch, it is automatically cons

Re: [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Ian Stakenvicius
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 17/01/14 11:27 AM, Michał Górny wrote: > Hello, all. > > I'm using squashfs to hold my Gentoo repositories on all of my > systems for some time. As you probably know, this allows me to save > space while keeping portage fast. However, it makes up

[gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas

2014-01-17 Thread Michał Górny
Hello, all. I'm using squashfs to hold my Gentoo repositories on all of my systems for some time. As you probably know, this allows me to save space while keeping portage fast. However, it makes updating the tree quite burdensome and time-consuming. We're already hosting daily gx86 tarballs on ou

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Ulrich Mueller
> On Fri, 17 Jan 2014, grozin wrote: > Maybe, a good solution is to introduce a special arch, "noarch", for > such packages (similar to what's done in the rpm world). Then, if a > package is ~noarch, it is automatically considered ~arch for all > arches. Similar for stable. The maintainer sho

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Michał Górny
Dnia 2014-01-17, o godz. 14:02:51 gro...@gentoo.org napisał(a): > Maybe, a good solution is to introduce a special arch, "noarch", for such > packages (similar to what's done in the rpm world). Then, if a package is > ~noarch, it is automatically considered ~arch for all arches. Similar for > s

Re: [gentoo-dev] rfc: revisiting our stabilization policy

2014-01-17 Thread Rich Freeman
On Fri, Jan 17, 2014 at 2:58 AM, Matt Turner wrote: > On Thu, Jan 16, 2014 at 11:02 PM, wrote: >> Maybe, a good solution is to introduce a special arch, "noarch", for such >> packages (similar to what's done in the rpm world). Then, if a package is >> ~noarch, it is automatically considered ~arc