slachiewicz opened a new issue, #3623: URL: https://github.com/apache/maven-surefire/issues/3623
Affected version: master at d7c7e359e. `TestSetRunListener.addTestMethodStats` (maven-surefire-common/src/main/java/org/apache/maven/plugin/surefire/report/TestSetRunListener.java:320) appends one `TestMethodStats` per report entry without deduplicating by `testRunId`. `DefaultReporterFactory.getTestResultType` (maven-surefire-common/src/main/java/org/apache/maven/plugin/surefire/report/DefaultReporterFactory.java:232) maps a [FAILURE, SUCCESS] history to FLAKE when `rerunFailingTestsCount > 0`, and flakes do not fail the build. Consequently, a duplicate success frame for a test that actually failed can change the recorded result from FAILURE to FLAKE and remove the failure from the build gate. This may be related to the broader reporting roadmap in #3231, but the concrete missing deduplication seems worth tracking on its own. Expected behavior: deduplicate by testRunId (or reject a second terminal result for the same execution) before computing the result type. A regression test can feed a failure followed by a duplicate success with reruns enabled and assert the aggregated result is still FAILURE. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
