Hi all,
IT and RelEng are working on creating a new test infrastructure to make
obsolete our current Rev3 machines. To better meet our needs, we want
to make sure that we test Firefox 32-bit on the right set of platforms.
Mozilla currently has continuous integration running (on tbpl.mozilla.org)
for unit tests and talos for the 32-bit versions of Windows XP and Windows 7.
We currently do not run tests on the 64-bit version of these platforms [1].
We now are planning on adding the 64-bit version of Windows 8 to our continuous
integration matrix. The proposal is to run Firefox 32-bit on Windows XP 32-bit,
Windows 7 32-bit and Windows 8 64-bit.
We would like to know if there are any reasons to also run tests on
Windows 8 *32-bit*. This does not mean that Mozilla would not qualify that
Firefox *32-bit* works properly on Windows 8 *32-bit* through various manual
QA and testing methods; it means we would not run automated tests per developer
checkin on this platform. The main reason for skipping Windows 8 32-bit is to
avoid the costs of maintaining another two hundred machines for our continuous
integration for this platform.
In our testing and due diligence phase, we believe that we will not lack any
coverage by only testing on *64-bit* windows 8. If this is an incorrect
assessment please let us know. We're aware that there might be edge cases where
some tests would not catch things for Windows 8 *32-bit*. This is a risk that
we are willing to take the same way that we have been comfortable with only
running tests on Win7 *32-bit* and not on Win7 *64-bit* version (not that past
decisions should blind us).
I hope this makes sense and please let us know if there are any gotchas or you
have any questions.
Best regards,
Armen Zambrano
Mozilla's Release Engineering
PS = Creating a new test infrastructure for Linux is also coming but it is off
topic for this thread.
PPS = This post is not about changing our system requirements [2].
[1] We also have five Windows 7 64-bit machines which were left around just in
case Firefox *64-bit* became important again and we would not need to start
from scratch.
[2] http://www.mozilla.org/en-US/firefox/system-requirements.html
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
