On 2011-08-03 02:22 PDT, Ludovic Hirlimann wrote: > I know, by reading various bug comments, that NSS as some machines > dedicated to testing somewhere. And from what I read It seems that these > tests suites are started manually.
You have been misinformed. For NSS, there is a collection of machines that continuously build and run automated regression tests against it. See them at http://tinderbox.mozilla.org/showbuilds.cgi?tree=NSS The current set of regression tests is quite large and takes a LONG time to run to completion. The top-most script may be seen at http://mxr.mozilla.org/security/source/security/nss/tests/all.sh Any person who builds NSS can run all.sh himself, if he has the patience. Regardless, there are shortcomings in the test coverage and the addition of more tests to the existing set would be welcome if it added coverage and did not add too much to execution time. I'm skeptical about test "frameworks". In my direct experience with an NSS test development team in the past, test developers LOVE to develop frameworks, but hate to develop tests that use those frameworks. So, after literally man-years of framework development, we had a monster framework and not a single test that ran in that framework. When the framework was developed, and all that remained to be done was writing any tests that run in it, the framework developers quit. IMO, we don't need another framework. NSS needs real tests. Shell scripts make a fine framework. NSS testing needs people who're willing to write code that actually calls NSS API functions. -- dev-tech-crypto mailing list dev-tech-crypto@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-tech-crypto
