Bug 1289249 just landed on the autoland repository. It refactors most (but
not all) build related TaskCluster tasks to use `run-task` and `hg
robustcheckout` for managing the version control checkout.

This means:

* All lines in task output will now be prefixed with timestamps, making it
easier to see where time is going
* Mercurial cloning and checkout is now using the best practices that `hg
robustcheckout` employs

The user-impacting win here is the VCS interaction improvements yield
quicker task execution. Before, tc-vcs was downloading a tarball snapshot
of the repository on every task. This incurred ~2 GB of network traffic and
I/O and this typically took well over a minute. With `hg robustcheckout`,
hg storage is intelligently "pooled" and cached on the workers. This means
subsequent tasks on the workers have to perform significantly less work to
obtain a checkout than with the tc-vcs model. This translates to subsequent
tasks running 1+ minutes faster. For example, [1] is an artifact build task
completing in 230s.

What's more, now that we're using vanilla Mercurial for source control
management, we'll be able to leverage upstream improvements to clone and
checkout more easily. This includes employing shallow and narrow clone and
sparse checkout. Lots of potential room for even more drastic efficiency
wins...

[1]
https://public-artifacts.taskcluster.net/CSIOY8V2QH6Ywr0WdckTiA/0/public/logs/live_backing.log
_______________________________________________
dev-builds mailing list
dev-builds@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-builds

Reply via email to