Re: CI Utilisation and system efficiency

2025-04-22 Thread Maciej Jesionowski
Yes, that is a full clean build after the build directory is configured from scratch. The dependencies are prepared before that, and this is just the time to run ninja which lists 4900 build steps or so (I can't remember). I mean, the build isn't exactly very fast even on a reasonably high-end syst

Re: CI Utilisation and system efficiency

2025-04-22 Thread Maciej Jesionowski
Hi, Are these servers running multiple builds at a time, or is a Windows build given the full host resources, i.e. 8c/16t and 64GB of RAM? If you can monitor the resources in real time, it would be interesting to confirm if indeed the CPU utilization is significantly lower than 100%, meaning someth

Re: CI Utilisation and system efficiency

2025-04-22 Thread Dmitry Kazakov
>> Another point that requires extra build time for Krita is an inappropriate timeout on 100 minutes. A lot of our windows builds are terminated at around 95% completion because of this timeout, so we have to rerun them and, effectively, consume more and more CI time. >Have you got a list of these

Re: CI Utilisation and system efficiency

2025-04-22 Thread Dmitry Kazakov
> This is probably at least in part due to Windows on Docker having extremely poor file system performance even vs. straight NTFS (which isn't great to begin with). Well, Krita builds on a normal Windows system are also quite slow (at least much slower than on Linux). Though they are still much fa

Re: CI Utilisation and system efficiency

2025-04-22 Thread Konstantin Kharlamov
On Tue, 2025-04-22 at 07:15 +1200, Ben Cooksley wrote: > On Tue, Apr 22, 2025 at 5:57 AM Dmitry Kazakov > wrote: > > Hi, Ben! > > > > > Hey Dmitry, >   > > > > As for Krita, most of CI time is spent on the Windows pipeline, > > which build extremely slowly due to done obscure filesystem issues

Re: CI Utilisation and system efficiency

2025-04-22 Thread Dmitry Kazakov
Hi, Ben! As for Krita, most of CI time is spent on the Windows pipeline, which build extremely slowly due to done obscure filesystem issues (searching includes is extremely slow). I personally don't know how to fix it. I tried: 1) PCH builds, 2) relative includes, 3) split debug info (dwo). The on

Re: CI Utilisation and system efficiency

2025-04-22 Thread Ben Cooksley
On Tue, Apr 22, 2025 at 10:53 PM Maciej Jesionowski wrote: > Yes, that is a full clean build after the build directory is configured > from scratch. The dependencies are prepared before that, and this is just > the time to run ninja which lists 4900 build steps or so (I can't > remember). I mean,

Re: CI Utilisation and system efficiency

2025-04-22 Thread Ben Cooksley
On Tue, Apr 22, 2025 at 10:44 PM Konstantin Kharlamov wrote: > On Tue, 2025-04-22 at 07:15 +1200, Ben Cooksley wrote: > > On Tue, Apr 22, 2025 at 5:57 AM Dmitry Kazakov > > wrote: > > > Hi, Ben! > > > > > > > > > Hey Dmitry, > > > > > > > > As for Krita, most of CI time is spent on the Windows p

Re: CI Utilisation and system efficiency

2025-04-22 Thread Ben Cooksley
On Tue, Apr 22, 2025 at 9:53 AM Maciej Jesionowski wrote: > Hi, > Hi Maciej, > Are these servers running multiple builds at a time, or is a Windows build > given the full host resources, i.e. 8c/16t and 64GB of RAM? If you can > monitor the resources in real time, it would be interesting to co