One large difference I see between autoland and mozilla-inbound is that on autoland we have many single commits/push whereas mozilla-inbound it is fewer. I see the Futurama data showing pushes and the sheriff report showing total commits. Possibly there are some more data mining opportunities :)
On Tue, Mar 7, 2017 at 6:23 AM, David Burns <dbu...@mozilla.com> wrote: > One thing that we have also noticed is that the backout rate on autoland > is lower than inbound. > > In the last 7 days backout rate is averaging (merges have been removed): > > - Autoland 6%.(24 backouts out of 381 pushes) > - Inbound 12% (30 backouts out of 251 pushes) > > I don't have graphs to show this but when I look at > https://futurama.theautomatedtester.co.uk/ each week I have seen this > result consistenly for about a month. > > David > > > On 7 March 2017 at 09:03, Carsten Book <cb...@mozilla.com> wrote: > >> Hi Lawrence, >> >> most (i would say 95 %) of the backouts are for Code issues - this >> include bustages and test failures. >> >> From this Code Issues i would guess its about 2/3 for breaking tests and >> 1/3 Build Bustages. >> >> The other backout reasons are merge conflicts / backout requests for >> changes causes new regressions out of our test suites / backout requests >> from developers etc - >> >> In February the backout rate was (excluding the servo merge with 8315 >> changesets from the 13242) = 297 in 4927 changesets = ~ 6 % >> In January the backout rate = 302 backouts in 4121 changesets = 7 % >> >> We had a much higher backout rate in the past i think - so it stabilized >> now with this 6-7 % backout rate in the last months, >> >> If you think its useful, i can provide for the next monthly report a more >> detailed analysis like x % = backouts because builds bustages, y %= >> backouts for test failures etc . >> >> Cheers, >> -Tomcat >> >> >> On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel <lman...@mozilla.com> >> wrote: >> >>> Hi Tomcat, >>> >>> Do you have any more details about the reasons why the 297 changesets >>> needed to be backed out? >>> >>> Thanks, >>> >>> Lawrence >>> >>> On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <cb...@mozilla.com> wrote: >>> >>>> Hi, >>>> >>>> We will be more active in 2017 and inform more about whats happening in >>>> Sheriffing and since its already March.... :) >>>> >>>> In February we had about 13242 changesets landed on mozilla-central >>>> monitored by Sheriffs. >>>> >>>> (The high number of changes is because of the merge from servo to >>>> mozilla-central with about 8315 changesets). >>>> >>>> 297 changesets were backed out in February. >>>> >>>> Beside this Sheriffs took park in doing uplifts and checkin-needed bugs. >>>> >>>> The Current Orangefactor is 10.43 (7250 test failures failures in 695 >>>> pushes in the last 7 days). >>>> You can find the list of top Intermittent failure bugs here >>>> https://brasstacks.mozilla.com/orangefactor/ >>>> >>>> You can find more statistics here: https://futurama.theautomatedt >>>> ester.co.uk/ >>>> >>>> A big thanks to the Team especially our Community Sheriffs for handling >>>> the new Tier 2 Stylo Build on integration trees and mozilla-central and >>>> the teamwork with the Developers! >>>> >>>> If you want also to be a Community Sheriffs, as part of more blogging >>>> about Sheriffing i published a blog post about it : >>>> https://blog.mozilla.org/tomcat/2017/02/27/community-sheriffs/ >>>> >>>> Let us know when you have any Question or Feedback about Sheriffing. >>>> >>>> Cheers, >>>> -Tomcat >>>> >>> >>> >> > _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
