Supporting a "--headless" flag for the web platform tests would be great. I think we should keep running all the tests in a real environment but try to get all of them running in headless as well. Most of the failures will be fixed by some work I did in the windows support bug[1]. I'll look into it and potentially uplift some of those changes. I've filed bug to track this[2].
[1] = https://bugzilla.mozilla.org/show_bug.cgi?id=1355150 [2] = https://bugzilla.mozilla.org/show_bug.cgi?id=1373739 On Thu, Jun 15, 2017 at 11:45 PM, James Graham <ja...@hoppipolla.co.uk> wrote: > On 15/06/17 21:51, Ben Kelly wrote: > >> On Thu, Jun 15, 2017 at 4:37 PM, Nathan Froyd <nfr...@mozilla.com> wrote: >> >> On Thu, Jun 15, 2017 at 2:02 PM, Brendan Dahl <bd...@mozilla.com> wrote: >>> >>>> Headless will run less of the platform specific widget code and I don't >>>> recommend using it for platform specific testing. It is targeted more at >>>> web developers and testing regular content pages. There definitely will >>>> >>> be >>> >>>> cases where regular pages will need to exercise code that would vary per >>>> platform (such as fullscreen), but hopefully we can provide good enough >>>> emulation in headless and work to have a consistent enough behavior >>>> >>> across >>> >>>> platforms that it won't matter. >>>> >>> >>> Would it be feasible to use headless mode for mochitests (or reftests, >>> etc. etc.)? I know there are probably some mochitests which care >>> about the cases you mention above (e.g. fullscreen), but if that could >>> be taken care of in the headless code itself or we could annotate the >>> tests somehow, it would be a huge boon for running mochitests locally, >>> or even in parallel. (We already have some support for running >>> reftests/crashtests in parallel.) >>> >>> >> There are some tests which fail if the "screen" is not a particular size. >> Those might be a problem as well. >> > > FWIW [1] is a try run of web-platform-tests in headless mode. There are > clearly some tests that are broken. If people thought it was high value I > could add a --headless command line argument with support for running most > tests in headless and specially annotated tests in a real window. But it > wouldn't be possible to keep that annotation data up to date automatically > with new imports, so it would be a best-effort solution. > > [1] https://treeherder.mozilla.org/#/jobs?repo=try&revision=e428 > 2575210badf4ab3a072d5ceab51ee2384e11&filter-searchStr=linux > > _______________________________________________ > dev-platform mailing list > dev-platform@lists.mozilla.org > https://lists.mozilla.org/listinfo/dev-platform > _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
