Hi, On Sun, Jul 16, 2023 at 09:50:24AM +0200, FX Coudert via Gcc wrote: > > Which is why people should just compare testsuite results from earlier run > > on the same configuration to watch for regressions, especially in the > > guality testsuite. > > All this gives the idea of a test framework that is too rigid, or > tests that are too fragile. I mean, The accumulation of noise just > decreases the value of the the test results.
Note that one way to analyze whether tests are too fragile is to look at the collected bunsen results: https://builder.sourceware.org/testruns/?has_keyvalue_k=testrun.git_describe&has_keyvalue_op=glob&has_keyvalue_v=*gcc* As far as I can see you are right that there are ~100 FAILs (out of ~4700) in guality.exp on all arches/configs. (CC Frank, the fedrawhide builder doesn't seem to include guality.exp, do you know why?) Cheers, Mark
