[PATCH 4/5] {test-protocols} tests defs: new auxiliary function 'count_test_results'

2011-07-14 Thread Stefano Lattarini
* tests/defs (count_test_results): New function. * tests/check11.test: Use it. * tests/test-driver-custom-multitest.test: Likewise. * tests/test-driver-custom-multitest-recheck.test: Likewise. * tests/test-driver-custom-multitest-recheck2.test: Likewise. * tests/parallel-tests-log-override-recheck.

[PATCH 2/5] {test-protocols} parallel-tests: new recognized test result 'ERROR'

2011-07-14 Thread Stefano Lattarini
* lib/am/check.am ($(TEST_SUITE_LOG)): Recognize a new test result `ERROR'. Use it when encountering unreadable test logs (previously a simple `FAIL' was used in this situations). * lib/test-driver: Set the global test result to `ERROR' when the test exit status is 99. When doing colorized output

[PATCH 1/5] {test-protocols} parallel-tests: make parsing of test results safer

2011-07-14 Thread Stefano Lattarini
The new code for parsing the testsuite-generated `.log' files, as introduced in commit `v1.11-872-gc96b881', considers each `:test-result:' field anywhere in a `.log' file as a declaration of a test result, and accounts for it as such in the testsuite summary. Unfortunately this could easily cause

[GSoC] Some patches for testsuite harness improvements and TAP support introduction

2011-07-14 Thread Stefano Lattarini
The patches I'm going to post in this thread have already been applied to the 'GSoC/experimental/test-results-work' temporary branch, but now I think they are mature enough to be moved to the "official" branch 'test-protocols'; fixlets and improvements can be done with follow-up patches (I even thi