On Wednesday, November 16, 2016 at 3:27:45 AM UTC-5, Gratian Lup wrote: > Hello, > > *I posted this on multiple mailing lists, I'm not sure which is the right > place for these questions. > > I'm a developer on the Microsoft Visual C++ compiler (code optimizer) and I'm > looking into extending our test suite with popular open-source projects. This > helps us to find bugs earlier, ensuring that these projects are not broken > by frontend or backend changes. It also helps the projects themselves, by > making upgrades to the never compiler easier - ideally without any problems. > > I have several questions about building Firefox on Windows and especially > about running the correctness tests: > > 1. What is the latest version of Visual Studio that should be used? I tried > first VS2015 Update 3 and there seems to be a C++ error about "constexpr". > Next I tried Update 2 and that one finishes the build. > > 2. What are the tests that should be run to test correctness? The idea here > is to ensure that new optimizations don't introduce new bugs, which should be > exposed by new test failures in Firefox. I looked over the QA Automated > testing page and there seem to be a lot of different test suites - running > all is probably not feasible. Is there a subset that is run when a checkin is > done, for example? > > 3. What Windows OS do you use for testing? Window 10, Windows 8, etc? Any > other configuration work needed, such as disabling the antivirus/firewall? > > After the build completed, I tried to run a few of the tests and there seem > to be many failures even with a debug build. I assume that the checked in > tests are supposed to pass, so it's likely a Windows config problem or > failure to access extra files from the Web. > > For example, ./mach reftests had about 700 failures. ./mach gtest, > jsapi-tests, jsbrowsertest had none. The tests were run under Windows 10 > Anniversary update with the AV disabled. > > Thanks, > Gratian Lup > Microsoft Visual C++ team
FYI, setting --enable-js-shell will get you js.exe as part of your Firefox build. _______________________________________________ dev-builds mailing list dev-builds@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-builds