aslakhellesoy commented on pull request #348:
URL: https://github.com/apache/maven-surefire/pull/348#issuecomment-1075176203


   > the capability for Surefire to order test methods is already implemented
   
   @winglam your implementation of test method ordering can order tests within 
the same class, but it cannot order them globally. 
   
   For example, if you specify `-Dtest=testing.Y#a,testing.X#c,testing.Y#b`, 
then the execution order will not be what you specified. It will be:
   
   * `testing.Y#a`
   * `testing.Y#b`
   * `testing.X#c`
   
   This is because Surefire runs one test class at a time. Supporting a global 
ordering of test methods would require such a significant refactoring that I'm 
not sure it's realistic to attempt it. The JUnit 5 team has said they won't 
support it: https://github.com/junit-team/junit5/discussions/2857
   
   As I have described in 
[SUREFIRE-2041](https://issues.apache.org/jira/browse/SUREFIRE-2041) I think 
the best we can do is an explicit class ordering.
   
   I have implemented class ordering in 
https://github.com/apache/maven-surefire/pull/495, inspired from this PR but 
with a different implementation. I'm waiting for @Tibor17 to approve the 
running of the GitHub Action in that PR, and also to review the code.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@maven.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to