Re: Support for annotating intermittent tests with multiple statuses

2019-07-25 Thread James Graham
On 25/07/2019 20:39, Andrew Halberstadt wrote: Excellent work Nikki! This will give us more tools to help with the war on orange. Are there plans (or at least bugs on file) to support other harnesses? I'll file some bugs. On Thu, Jul 25, 2019 at 2:47 PM James Graham

Re: Support for annotating intermittent tests with multiple statuses

2019-07-25 Thread Andrew Halberstadt
Excellent work Nikki! This will give us more tools to help with the war on orange. Are there plans (or at least bugs on file) to support other harnesses? On Thu, Jul 25, 2019 at 2:47 PM James Graham wrote: > In general the order of priority is: > * First try to fix the underlying issue > * If th

Support for annotating intermittent tests with multiple statuses

2019-07-25 Thread James Graham
Thanks to the amazing work of Outreachy participant Nikki Sharpley, our test result logging infrastructure now supports marking tests as having multiple expected statuses. This can be used instead of disabling tests where the results are intermittent. Harness-level support is currently availabl