Since a few months, I'm having a lot of trouble comparing test results
using contrib/compare_tests because there are duplicated test results
when using parallel make check.
make -k -j10 check RUNTESTFLAGS=--target_board=unix/\{-m32,-m64\}
will sometimes run:
Executing on host:
/home/manuel/test3/224844M/build/gcc/testsuite/g++2/../../xg++
-B/home/manuel/test3/224844M/build/gcc/testsuite/g++2/../../
/home/manuel/test3/src/gcc/testsuite/c-c++-common/torture/pr42834.c
-fno-diagnostics-show-caret -fdiagnostics-color=never -nostdinc++
-I/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/libstdc++-v3/include/x86_64-unknown-linux-gnu
-I/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/libstdc++-v3/include
-I/home/manuel/test3/src/libstdc++-v3/libsupc++
-I/home/manuel/test3/src/libstdc++-v3/include/backward
-I/home/manuel/test3/src/libstdc++-v3/testsuite/util
-fmessage-length=0 -O0
-L/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-B/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-L/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-lm -m64 -o ./pr42834.exe (timeout = 300)
Executing on host:
/home/manuel/test3/224844M/build/gcc/testsuite/g++1/../../xg++
-B/home/manuel/test3/224844M/build/gcc/testsuite/g++1/../../
/home/manuel/test3/src/gcc/testsuite/c-c++-common/torture/pr42834.c
-fno-diagnostics-show-caret -fdiagnostics-color=never -nostdinc++
-I/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/libstdc++-v3/include/x86_64-unknown-linux-gnu
-I/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/libstdc++-v3/include
-I/home/manuel/test3/src/libstdc++-v3/libsupc++
-I/home/manuel/test3/src/libstdc++-v3/include/backward
-I/home/manuel/test3/src/libstdc++-v3/testsuite/util
-fmessage-length=0 -O0
-L/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-B/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-L/home/manuel/test3/224844M/build/x86_64-unknown-linux-gnu/./libstdc++-v3/src/.libs
-lm -m64 -o ./pr42834.exe (timeout = 300)
These two are exactly the same tests. But if the same duplication does
not happen in the reference results given to compare_tests, then it
will report it as a new test that PASS. I get dozens of this all the
time.
Is nobody seeing this? Is it a known problem with parallel make check?
If so, can we work-around it in compare_tests?
Cheers,
Manuel.
