Known bug should not break the build
------------------------------------

                 Key: MSUREFIRE-178
                 URL: http://jira.codehaus.org/browse/MSUREFIRE-178
             Project: Maven 2.x Surefire Plugin
          Issue Type: Improvement
          Components: Junit 3.x support
    Affects Versions: 2.2
         Environment: Maven 2.0.4
            Reporter: J-C Walmetz
            Priority: Minor


With surefire plugin we can exclude a test, Ignore failures or skip tests.

- If I exclude a test, test is not in surefire report

- If I ignore failures, it ignore all the failures. Report contains all the 
tests but I not able to know is tests in failure where expectedc or not.

- If I skip test, I have no more report.

Sometimes we discover a bug in our source code but don't know how to fix it. If 
this bug is acceptable, it is a known bug. In order not to forget it, I'd like 
to implement a testcase that have to be in the final report. This bug is known 
and accepted, so it sould not break the build. It would be great to be able to 
add in plugin configuration a list of know test failure. If a tests included in 
this list failed, it does not break the build but as test has been executed it 
will be display in the report. If another tests failed, it is an unknown bug, 
it should break the build.

Config may looks like:

    <plugin>
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-surefire-plugin</artifactId>
        <configuration>
          <knownFailures>
            < knownFailure >
              <test>com.mytest.MyBugTestCase</test>
              <exception>java.lang.NullPointerException</test>
            </knownFailure >
          </knownFailures >
        </configuration>
      </plugin>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to