On 15/10/2014 22:15, Trevor Saunders wrote:
However I think that was a mistake, it treated those tests as tier 1 when they pretty clearly do not meet the requirements in https://wiki.mozilla.org/Sheriffing/Job_Visibility_Policy
...
The visibility rules exist in part to make sure that tier 1 tests can be easily reproduced and confirmed to work
Just to add to the points that Ryan made, I should clarify that the visibility policy above doesn't apply here, so any discussion as to whether this case should have resulted in a backout is orthogonal to the policy itself.
Whilst the requirements on that page have the added benefit of improving the rigour of our testing & the ease by which developers can debug issues that resulted in a backout - they aren't its primary purpose. ie: The policy states the requirements for a job being visible (and thus impacting sheriffs & devs day in, day out), not the bar that always has to be met before a backout is performed.
Best wishes, Ed _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
