I haven't posted in a while, but I wanted to let everyone know what is new with Talos and Performance Sheriffing.
I have a few blog posts outlining more details- in total we have 1127 different perf metrics we track per commit and for Firefox 55, 56, and 57 >=50 regressions files/release [1] Most of this work is done by Ionut [2] who started as a full time Performance Sheriff and Tool hacker earlier this year. also in the last 6 months we have added or significantly edited 10+ Talos tests [3] along with many updates for new measurements to collect or methods to run tests. Going forward we have plans for some upcoming work: 1) new hardware by end of Q1 (linux/windows - testing linux hardware this week). This will be new machines in a new datacenter with Intel graphics cards 2) more changes in tests and updated benchmarks 3) cleaning up and sheriffing AWFY alerts (we have a lot, we just ignore them) 4) a pass at making running and debugging Firefox easier within Talos 5) some proposals and prototypes of making AWFY easier to maintain and run via Try (custom hardware test coverage) 6) revisiting webextensions, heavy profiles, mitmproxy tools, tp6 pageset and actions, and checking in on collecting the hero element. And as a bonus, we have an elective session at the upcoming Mozilla All Hands in Austin regarding hacking on Talos which is a great time to come and learn about what tools exist, how to add a new test, ask those nagging questions about why things are named funny or how to interpret results. Thanks to many people who have contributed to improving our performance tests and tooling over the last 6 months. [1] https://elvis314.wordpress.com/2017/11/01/keeping-an-eye-on-performance-alerts/ [2] https://elvis314.wordpress.com/2017/10/18/a-formal-introduction-to-ionut-goldan-mozillas-new-performance-sheriff-and-tool-hacker/ [3] _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
