Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Thiago Macieira
On Friday, 26 May 2017 08:48:59 PDT Simon Hausmann wrote: > Hi, > > > Is it possible that you're looking for the "ci" keyword in the exclusion > files? > > > Tor Arne implemented it for https://bugreports.qt.io/browse/QTBUG-59564 That's exactly what I wanted. But it looks like I'm not the only

Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Simon Hausmann
7 8:45:28 AM To: development@qt-project.org Subject: [Development] Blacklisting: CI vs non-CI I've seen some blacklists, in the past, that were real flaky tests: things that would be unstable on any machine, given the proper conditions. But most of the recent blacklists, and certainly all the BP

Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Thiago Macieira
On Friday, 26 May 2017 03:12:30 PDT Konstantin Tokarev wrote: > If problem is that tests just don't have enough time to complete in CI > environment, it would be a good idea to mark such tests as "slow" so they > get higher timeout settings. The problem is not the full test timeout. It's intermedi

Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Allan Sandfeld Jensen
On Friday 26 May 2017, Konstantin Tokarev wrote: > 26.05.2017, 09:45, "Thiago Macieira" : > > I've seen some blacklists, in the past, that were real flaky tests: > > things that would be unstable on any machine, given the proper > > conditions. > > > > But most of the recent blacklists, and certai

Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Konstantin Tokarev
26.05.2017, 09:45, "Thiago Macieira" : > I've seen some blacklists, in the past, that were real flaky tests: things > that > would be unstable on any machine, given the proper conditions. > > But most of the recent blacklists, and certainly all the BPASS I see when I > run tests, are due to the

Re: [Development] Blacklisting: CI vs non-CI

2017-05-26 Thread Allan Sandfeld Jensen
On Friday 26 May 2017, Thiago Macieira wrote: > I've seen some blacklists, in the past, that were real flaky tests: things > that would be unstable on any machine, given the proper conditions. > > But most of the recent blacklists, and certainly all the BPASS I see when I > run tests, are due to t

[Development] Blacklisting: CI vs non-CI

2017-05-25 Thread Thiago Macieira
I've seen some blacklists, in the past, that were real flaky tests: things that would be unstable on any machine, given the proper conditions. But most of the recent blacklists, and certainly all the BPASS I see when I run tests, are due to the tests being run in an environment that runs 300x s