On 3/4/13 9:36 AM, Gregory Szorc wrote:

If all your tests are declared the same way, then presumably the test
running code would be similar and capturing performance data would
require a single implementation affecting all test suites instead of N
1-off solutions.

We've talked about this before (perhaps in this very newsgroup), as a cheap (?) way to get extra perf measurements beyond our current limited set of tests, and to avoid having to add a new test suite/framework whenever someone wants a metric... E.G. measure the run time of each existing test, use scripts to figure out which ones are fairly stable over time, then watch for regressions. A chance to begin again in a orange land of opportunity and adventure!

But I'd also take the general ability to add a new test as a microbenchmark.

We should unify our test running code as much as possible.

Oh god yes please.

Justin

_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Reply via email to