Zoltan Haindrich created SUREFIRE-2241:
------------------------------------------

             Summary: Junitparams based parameterized test may cause test 
execution to silently pass
                 Key: SUREFIRE-2241
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-2241
             Project: Maven Surefire
          Issue Type: Bug
          Components: JUnit 5.x support
            Reporter: Zoltan Haindrich



* junit5 vintage
* testcase with junitparams
   * 1 failing / 1 passing / 1 assumeviolated case
* test reruns enabled
* maven 3.9.x
   * not sure why but 3.8.8 works correctly

impact:
* failing test is not reported at all 
* followup tests are not run
* exit code 0

{code}
 [INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.druid.sql.calcite.CalciteJoinQueryTest
[INFO] Running org.apache.druid.sql.calcite.CalciteQueryTest
[INFO] Running org.apache.druid.sql.calcite.CalciteJoinQueryTest
Warning:  ForkStarter IOException: Element name cannot be empty
Element name cannot be empty
Element name cannot be empty. See the dump file 
/home/runner/work/junitparams-junit5-rerun-issue/junitparams-junit5-rerun-issue/target/surefire-reports/2024-03-07T13-29-58_925-jvmRun1.dumpstream
[INFO] 
[INFO] Results:
{code}


made a repro project:
https://github.com/kgyrtkirk/junitparams-junit5-rerun-issue




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to