rajatsharma2393 opened a new issue, #857: URL: https://github.com/apache/maven-surefire/issues/857
### Affected version 3.5.3 ### Bug description ## Summary Failsafe plugin version **3.5.3** does not correctly register or report Cucumber integration test failures. Even when Cucumber tests fail (via `AssertionError` or `RuntimeException`), `mvn clean install` completes with: Tests run: 0, Failures: 0, Errors: 0 BUILD SUCCESS This works correctly in version **3.5.2**, where failing scenarios cause a build failure and test metrics are visible. --- ## Reproduction Repo: https://github.com/johnlpage/MongoEnterpriseMicroserviceExamples Changed version (3.5.3 does not work): https://github.com/johnlpage/MongoEnterpriseMicroserviceExamples/commit/c10d484cfe8080efaf32cde1dfee6a23ed76dc35 To reproduce `Success scenario with Tests run: 0, Failures: 0, Errors: 0`: 1. Clone the above repo 2. Run: `mvn clean install` 3. Observe: BUILD succeeds (`Tests run: 0`) To reproduce `Failure scenario with Tests run: 0, Failures: 0, Errors: 0 BUILD succeeds`: 1. Clone the above repo 2. In `InspectionSteps` file, change `assertNotNull` to `assertNull` to deliberately fail a test. 3. Run: `mvn clean install` 4. Observe: tests fails but BUILD succeeds (`Tests run: 0`) --- ## Environment - Maven: 3.9.x - Java: 17 - OS: macOS with Apple Silicon (M2 Pro) - Cucumber: 7.22.2 - Spring Boot: 3.4.6 - Failsafe plugin: 3.5.3 (❌) vs 3.5.2 (✅) --- ## Notes - Integration tests are run using `@Suite` and `@IncludeEngines("cucumber")` via `junit-platform-suite` - Downgrading to `3.5.2` resolves the issue — test results are logged and BUILD fails --- Thanks in advance for looking into this! Happy to provide further details if needed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@maven.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
