On 02/06/15 18:59, James Graham wrote:
If you need to update expectation data in order to get a PR landed the
best approach is to use the raw log files from buildbot as input for the
|mach css-update| command. These are visible on the waterfall page [1]
as wpt_raw.log links, but note that you need to add /text to the url to
get a plain text version. For example, one might update the metadata like:
curl
http://build.servo.org/builders/linux2/builds/1914/steps/shell_1/logs/wpt_raw.log/text
> linux.log
curl
http://build.servo.org/builders/mac3/builds/76/steps/shell/logs/wpt_raw.log/text
> osx.log
Oh, and whilst I remember, I have a version of the gecko reftest
analyzer, adapted for this log format at [1]. So you can upload the logs
there and investigate the reason for the unexpected result by comparing
screenshots down to the pixel level.
The tool will show all tests that fail, not just those where the result
was unexpected; the latter are marked with a "!". This means it's also
useful for investigating failures when working on layout code; just run
the tests like
mach test-css --log-raw test.log
tests/wpt/css-tests/css21_dev/html/some-feature-*.htm
and upload the resulting log file.
[1] http://hoppipolla.co.uk/410/reftest-analyser-structured.xhtml
_______________________________________________
dev-servo mailing list
dev-servo@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-servo
