Good suggestion here- I have seen so many cases where a simple fix/disabled/unknown/needswork just do not describe it. Let me work on a few new tags given that we have 248 bugs to date.
I am thinking maybe [stockwell turnedoff] - where the job is turned off- we could also ensure one of the last comments indicates this. also [stockwell fix] -> [stockwell testfix], [stockwell bandaid] (for those requestLongerTimeouts(), etc.), [stockwell productfix], and [stockwell reneabled]. we have [stockwell unknown] for tests that stop failing as frequently, this could be: [stockwell reduced], [stockwell wrongbug], [stockwell unknown] <- for real unknown Just tracking what we disable vs fix is a big step towards keeping track of this problem. I know there are other tests which are disabled outside of the view of stockwell, but we catch most of them. In fact, there have been cases where we have waited a few weeks and finally had a patch r+ to disable and waiting one more day and in that day we saw a fix land (including one today!) I would like to think we are patient- making sure that we consider a longer timeout is the type of data I want to hear- possibly there are other things we could do to help narrow down or bandaid the test along. -Joel On Tue, Mar 7, 2017 at 2:23 PM, Marco Bonardo <mbona...@mozilla.com> wrote: > On Tue, Mar 7, 2017 at 8:11 PM, <jma...@mozilla.com> wrote: > >> Thanks for checking up on this- there are 6 specific bugs that have this >> signature in the disabled set- in this case they are all linux32-debug >> devtools tests- we disabled devtools on linux32-debug because the runtime >> was exceeding in many cases 90 seconds for a test >> > > Disabling on a single platform sounds OK, but how I can tell from just > the [stockwell disabled] annotation? It may be important to distinguish > the case where it's globally disabled from the case where it's only > disabled on a single case. > Maybe the whiteboard annotation could be expanded a little bit, so we > don't have to read the whole bug to figure that out. > Btw I didn't want to sound accusing, I'm very glad and happy you are > looking into this. > > _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
