bug#20693: SKIP not counted in TAP

2015-05-29 Thread Arthur Schwarz
-Original Message-In a way, because... > skip > ok > PASS: test2.tap 1 > not ok > FAIL: test2.tap 2 > 1..2 ... it is your program's output that does not follow the specification. There are two basic styles of skipping in TAP. You can skip a single test result: ok 1 # skip reason o

bug#20693: SKIP not counted in TAP

2015-05-29 Thread Arthur Schwarz
Thanks Nick; But doesn't this mean that tap-driver.sh didn't report a violation to the TAP standard? And why is my output intermixed in the .trs file? If 'skip' below is illegal, why isn't it tagged? (I think that multiline comments need leading whitespace?) As another issue, I looked at the awk

bug#20693: SKIP not counted in TAP

2015-05-29 Thread Nick Bowler
On 2015-05-29 08:15 -0700, Arthur Schwarz wrote: > skip causes the following issues: > 1: It is not reported. > 2: It is not summarized. > 3: It must be subtracted from the plan (tests run), and > 4: The .log file has TAP generated output and the test data intermixed. > > I think this is against t

bug#20693: SKIP not counted in TAP

2015-05-29 Thread Arthur Schwarz
I think this is an error. skip causes the following issues: 1: It is not reported. 2: It is not summarized. 3: It must be subtracted from the plan (tests run), and 4: The .log file has TAP generated output and the test data intermixed. I think this is against the TAP definition? ===