https://gcc.gnu.org/bugzilla/show_bug.cgi?id=88002

            Bug ID: 88002
           Summary: libbacktrace and libiberty tests don't use dejagnu
           Product: gcc
           Version: 8.2.1
            Status: UNCONFIRMED
          Severity: normal
          Priority: P3
         Component: testsuite
          Assignee: unassigned at gcc dot gnu.org
          Reporter: vries at gcc dot gnu.org
  Target Milestone: ---

When grepping "make check" output, we find a number of passes:
...
$ grep ^PASS CHECKLOG
PASS: test-expandargv-0.
PASS: test-expandargv-1.
PASS: test-expandargv-2.
PASS: test-expandargv-3.
PASS: test-expandargv-4.
PASS: test-expandargv-5.
PASS: test-expandargv-6.
PASS: test-strtol-0.
PASS: test-strtol-1.
PASS: test-strtol-2.
PASS: test-strtol-3.
PASS: test-strtol-4.
PASS: test-strtol-5.
PASS: test-strtol-6.
PASS: test-strtol-7.
PASS: test-strtol-8.
PASS: test-strtol-9.
PASS: test-strtol-10.
PASS: test-strtol-11.
PASS: test-strtol-12.
PASS: test-strtol-13.
PASS: test-strtol-14.
PASS: test-strtol-15.
PASS: test-strtol-16.
PASS: test-strtol-17.
PASS: test-strtol-18.
PASS: test-strtol-19.
PASS: test-strtol-20.
PASS: btest
PASS: edtest
PASS: stest
PASS: ctestg
PASS: ctesta
PASS: dtest
PASS: ttest
PASS: btest
PASS: stest
PASS: ztest
PASS: edtest
PASS: ztest
PASS: ctestg
PASS: ttest
PASS: ctesta
...

The passes come from the test suites of libiberty and libbacktrace, which are
not using dejagnu.

Consequently the PASS/FAILs are not included in any .sum files, so when
comparing test results using .sum files, a regression in these tests will go
unnoticed.

Also, a consequence of not using dejagnu is that RUNTESTFLAGS are ignored.

[ Btw, note that the libbacktrace tests (btest etc) are run twice, once for
build/libbacktrace and once for build/<target>/libbacktrace. ]

Reply via email to