We discussed this at the Xen Summit. What I do here is immediate retry the jobs with regressions, and then reanalyse the original full flight. If the retries showed the failures were heisenbugs, this will let them though.
This should reduce the negative impact on development, of heisenbugs, but it won't do anything to help keep them out of the tree. I think this approach was basically already agreed, but I'm CCing the committers here for form's sake. README.dev | 9 +++---- cr-daily-branch | 58 ++++++++++++++++++++++++++++++++++++++++++--- cr-disk-report | 2 +- cr-try-bisect-adhoc | 2 +- cri-args-hostlists | 28 +++++++++++++++------- cs-bisection-step | 4 ++-- sg-report-flight | 35 +++++++++++++++++++++++---- sg-run-job | 9 ++++++- 8 files changed, 121 insertions(+), 26 deletions(-) -- 2.20.1
