In bug 1256408 I've landed code to allow adding *in-tree* platform
micro-benchmarks for XUL code in less than 10 lines. These are just GTest
where the execution time is reported to perfherder. This makes it easy to
add low level platform micro-benchmarks for testing things that Talos is
not well suited for. Maybe a bit too easy in fact so please keep in mind
that there is a cost to collecting perf data and particularly monitoring
the alerts so try to use sparingly.

You can find more information on this here:
https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/GTest#MozGTestBench

A big caveat is that we're rolling this out, at the moment, as part of the
GTest job which doesn't run on a stable hardware configuration like the
Talos job. If the results are too noisy we might look into fixing this.
However since we're running micro-benchmarks we also lose a lot of the
noise that Talos has to deal with like the event queue, GC, paint
scheduling etc...

Here's an example of micro-benchmarks for nsRegion And()/Or() performance
which is critical for layout and graphics performance and basic headless
compositing:
https://treeherder.allizom.org/perf.html#/graphs?series=%5Bmozilla-inbound,db7b8908a950b105f475ead838f8f472c89b20ad,1%5D&series=%5Bmozilla-inbound,ad41ac00e3191623cd89ed0c7df7464a5faf86c2,1%5D&series=%5Bmozilla-inbound,feded2f5510c634c95b0810fb35e7f633ffa6443,1%5D
<https://treeherder.allizom.org/perf.html#/graphs?series=%5Btry,ad41ac00e3191623cd89ed0c7df7464a5faf86c2,1%5D&selected=%5Btry,ad41ac00e3191623cd89ed0c7df7464a5faf86c2,69922,18676584%5D>
<https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/GTest#MozGTestBench>

Alert will be posted here [1]. I should mention that micro-benchmark
regressions shouldn't and wont be treated the same way a Talos regression.
More details here:
https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Build_Instructions/GTest#Sheriffing_policy

Changes should be deployed to treeherder.mozilla.org next week.

[1] https://treeherder.allizom.org/perf.html#/alerts?status=0&framework=6
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Reply via email to