On Wednesday, November 16, 2016 at 5:23:58 AM UTC-8, Ted Mielczarek wrote: > Gratian, > > One of my coworkers reminded me of something that might be an option for > you--we have scripts that would allow you to provide a Firefox build > that you generated (at a publicly accessible URL) and trigger test jobs > on that build in our CI infrastructure. If that's something that sounds > useful to you we can definitely make that happen. > > You'd have to produce a Firefox build, run the `mach package` and `mach > package-tests` targets, upload a few zip files from the $objdir/dist > directory to somewhere accessible via public HTTP and then run a Python > script to schedule test jobs against those files. > > -Ted
Hi Ted, Thanks a lot for your help! Using Windows 7 or 8 to do the tests should be fine - I actually don't see any reason it shouldn't be OK to also do other builds and tests on them when not used for Firefox. The idea of testing on your infrastructure is tempting, but probably would consume too many resources, since this new testing system is intended to be used both overnight against the latest good compiler build, but also by every developer on its own while working on new features - this would be quite a lot of people. Doing a test build now would still be a good idea, though, at least to see if everything passes in the right environment. I have a few more questions about running the tests: 1. How exactly should the build artifacts be copied to the test machine? Something like ./mach package? After copying over, running the tests with ./mach is going to pick the binaries after copying, or is some ./mach "unpack" needed? I assume the entire mozilla-central enlistment is also required. 2. Can I see on Treeherder the exact command line that was used to launch the test suite? I looked over the log files and didn't find anything like that. I'm going to try again with Update 3, I might have used instead the most recent build, which can indeed show some new errors, the frontend team do a lot of changes. Thanks, Gratian _______________________________________________ dev-builds mailing list dev-builds@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-builds
