On Wed, Apr 03, 2013 at 08:55:36PM -0400, Ehsan Akhgari wrote:
> On 2013-04-03 7:44 PM, Joshua Cranmer 🐧 wrote:
> >On 4/3/2013 5:36 PM, L. David Baron wrote:
> >>On Wednesday 2013-04-03 17:31 -0400, Kartikaya Gupta wrote:
> >Instead of running {mochitest-*,reftest,crashtest,xpcshell,marionette}
> >on every single desktop platform on every inbound checkin, run them
> >round-robin. A given push would trigger mochitest on Linux, reftest on
> >mac, and then the next test would run reftest on Linux and mochitest on
> >Mac. Each push would still end up running the full testsuite (modulo
> >some tests that are only run on some platforms) on some platform, and we
> >would be using fewer test resources to achieve that coverage. If most
> >actual test bustage is not platform-specific, this would give us
> >generally sufficiently good coverage for most checkins. I am not
> >qualified to say, however, if this is the case.
>
> Wouldn't this make the current problems caused by coalescing test
> runs even worse? This will make it much harder to deal with
> bustage: when mochitest-1 on Linux goes orange, nobody knows what
> broke it because the last time it ran was N pushes ago, N being a
> much larger number than it is today as a result of coalescing.
maybe, maybe not, it depends on how frequently linux 32 debug
mochitest-1 breaks vs mochitest-1 breaks as the result of a patch, and
the number of patches mochitest-1 linux 32 debug jobs that we currently
coalesce.
Trev
>
> Cheers,
> Ehsan
>
> _______________________________________________
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
