I've made a couple of changes to the processing of benchmark results.

The server now automatically tabulates the raw results like:
 
http://ex.seabright.co.nz/benchmarks/gcc-linaro-4.7+bzr114974/logs/armv7l-natty-cbuild292-tcpanda02-cortexa9r1/benchmarks.txt

diffbench[1] can now take a URL instead of a local file such as:
 python diffbench.py \
    
http://ex.seabright.co.nz/benchmarks/gcc-linaro-4.7+bzr114974/logs/armv7l-natty-cbuild292-tcpanda02-cortexa9r1/benchmarks.txt
\
    
http://ex.seabright.co.nz/benchmarks/gcc-linaro-4.7+bzr114977~uweigand~mov-vld1.64-4.7/logs/armv7l-natty-cbuild292-tcpanda06-cortexa9r1/benchmarks.txt

You'll need to put the username and password from
https://wiki.linaro.org/Internal/ToolChain into ~/.netrc to
authenticate.

diffbench now tries to pull a readable name from the results to make
the results easier to understand.  Running the above command now
shows:

Significant differences
-----------------------
 * bzr114977 scored xx.yy % (t=38.9) against bzr114974 on popular
embedded benchmark rgbcmykv2data3
 ...

All other results
-----------------
======== ============== ========= ========= ========================
testname subname        bzr114974 bzr114977 improvement in bzr114977
======== ============== ========= ========= ========================
coremark                 2xxx.096  2xxx.653                    100.0
...

-- Michael
[1] http://code.launchpad.net/linaro-toolchain-benchmarks scripts/diffbench.py

_______________________________________________
linaro-toolchain mailing list
linaro-toolchain@lists.linaro.org
http://lists.linaro.org/mailman/listinfo/linaro-toolchain

Reply via email to