On Wednesday 29 June 2011, Stefano Lattarini wrote:
> Reference:
>  <http://lists.gnu.org/archive/html/automake-patches/2011-06/msg00199.html>
> 
> The new code for parsing the testsuite-generated `.log' files,
> as introduced in commit `v1.11-872-gc96b881', considers each
> `:test-result:' field anywhere in a `.log' file as a declaration
> of a test result, and accounts for it as such in the testsuite
> summary.  Unfortunately this could easily cause spurious test
> failures being reported in the testsuite summary.  This happened
> in practice with the Automake's own testsuite; for example:
> 
>   $ make check TESTS='check12-p.test'; echo exit: $?
>   ...
>   PASS: check12-p.test
>   =====================================
>   4 of 5 tests failed
>   See tests/test-suite.log
>   Please report to bug-autom...@gnu.org
>   =====================================
>   make[2]: *** [test-suite.log] Error 1
>   make: *** [check-am] Error 2
>   exit: 2
> 
> This change introduces a new special `:test-result:' "END", that,
> when seen, prevents the rest of the log file from being parsed.
> 
> OK for the 'test-protocols' branch?
> 
> Regards,
>   Stefano
> 
For the moment, since I need to write more patches on the top of this,
I've pushed this patch to a new temporary public branch:
 - GSoC/experimental/test-results-work
Notice that this branch is bound to be amended and rebased, and finally
deleted (it won't be merged in the 'test-protocols' branch, rather its
changes will be re-applied on the top of that).  As usual, reviews are
welcome.
 
Regards,
  Stefano

Reply via email to