Re: [Development] Our CI is suffering from malfunctions currently

2020-06-24 Thread Volker Hilsheimer
Recent agent failures on Ubuntu suggest that something is still borked. Cheers, Volker From: Tony Sarajärvi Sent: Wednesday, June 24, 2020 3:02:04 PM To: Qt development mailing list Subject: RE: Our CI is suffering from malfunctions currently Hi all The sys

Re: [Development] Our CI is suffering from malfunctions currently

2020-06-24 Thread Tony Sarajärvi
Hi all The system _might_ be up. All tier2 images were lost, and we’ve had some problems with tier1 images as well. But the only way to be sure things work are to start the systems and see what happens. So cross your fingers, here we go! Btrfs, when it breaks down, it surely does it properly.

Re: [Development] Our CI is suffering from malfunctions currently

2020-06-24 Thread Tony Sarajärvi
We don't have tier1 or tier2 images available for the hosts, so they can't do much currently. It was a close call that would have lost them permanently as well, but luckily it seems that btrfs restore can still read them. We really need to have tier1 images stored somewhere else as well. The NFS

Re: [Development] Our CI is suffering from malfunctions currently

2020-06-24 Thread Volker Hilsheimer
Hi Tony, Thanks for the update, and good luck with the fixing! What are the implications? Should we not stage anything until you give the all-clear? Cheers, Volker > On 24 Jun 2020, at 09:30, Tony Sarajärvi wrote: > > Seems the BTRFS file system is permanently busted. We have to recreate th

Re: [Development] Our CI is suffering from malfunctions currently

2020-06-24 Thread Tony Sarajärvi
Seems the BTRFS file system is permanently busted. We have to recreate the thing and I estimate it taking the rest of the day. Sorry! -T From: Tony Sarajärvi Sent: Wednesday, June 24, 2020 8:13 AM To: Qt development mailing list Subject: Our CI is suffering from malfunctions currently Hi Yest

[Development] Our CI is suffering from malfunctions currently

2020-06-23 Thread Tony Sarajärvi
Hi Yesterday our NFS server’s root partition got filled up by logs apparently. As we got everything fixed, it did not take long for it to start filling up again. Within ours it got filled up again. So, the CI is currently down until we fix things… Bear with us -Tony ___