On Thursday, March 12, 2015 at 6:51:26 PM UTC-4, Jonathan Griffin wrote: > The quintessential use case here is making it easy to reproduce a try run > locally, without a local build, using a syntax something like: > > * runtests --try 2844bc3a9227 > > Ideally, this would download the appropriate build and tests.zip package, > bootstrap the test environment, and run the tests using the exact same > arguments as are used on try, optionally running it through an appropriate > debugger. You would be able to substitute a local build and/or local > tests.zip package if desired.
I think this would be a *huge* help - the hardest part for me is just reproducing the stuff that happens on try. The platform I usually have the most trouble with is Fennec, because running things locally (when it works) never gives me the same results as the tryserver. There's some mention in this thread seem of getting rr recordings of stuff, and I think that would help with intermittents. However rr is limited to Linux (where it's relatively straightforward to run the same test locally) so I'm not convinced that spending resources getting rr support *at the expense of other things* is the best idea. If you have somebody sitting around with nothing to do, then great. If not, I think bringing some of the less-easy-to-work-with platforms (B2G and Fennec) up to the same level as the desktop platforms would provide better value. kats _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
