[
https://issues.apache.org/jira/browse/SUREFIRE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410763#comment-16410763
]
ASF GitHub Bot commented on SUREFIRE-1372:
------------------------------------------
adarshkv commented on issue #150: SUREFIRE-1372 Filter tests to be rerun by
description
URL: https://github.com/apache/maven-surefire/pull/150#issuecomment-375536168
Hi All.. with the new version of maven-surefire 2.21.0 and cucumber-jvm
2.4.0 (io.cucucmber)... we are able to perform rerun's successfully.
However, I am facing a new issue with regards to reporting... in our project
we have integrated our reports with VSTS i.e. after I perform parallel
execution (using docker container) all the reports are getting generated with
TEST-.(*).xml and VSTS then consolidates all the .xml files to give us a single
report after parallel execution. But in the XML the testcase names are missing
i.e. we are not able to view each step definitions (step-step names Given When
Then) rather I am seeing only the scenario name as a result.. is anyone aware
why we are having this ? and how we can resolve this issue?
**Below is my XML file if i am using info.cukes as group ID for execution
(cucumber-jvm v 1.2.5) -- Rerun doesnt work here but test case name is
available.**
<property name="sun.io.unicode.encoding" value="UnicodeLittle"/>
<property name="java.class.version" value="52.0"/>
</properties>
**<testcase name="Given I am on the xxxx home page" classname="Scenario:
Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is
Left Blank" time="0"/>
<testcase name="When I click on Login Profile on home page"
classname="Scenario: Sign Up Verify That Error Message Is Shown If Any Of The
Mandatory Field Is Left Blank" time="0"/>
<testcase name="And I click on sign up in login page" classname="Scenario:
Sign Up Verify That Error Message Is Shown If Any Of The Mandatory Field Is
Left Blank" time="0"/>
<testcase name="Then I click on Sign Up" classname="Scenario: Sign Up
Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank"
time="0"/>
<testcase name="And I should see the valid message "The sign up was
not successful." and "There are 6 field(s) that require your
attention."" classname="Scenario: Sign Up Verify That Error Message Is
Shown If Any Of The Mandatory Field Is Left Blank" time="0"/>
<testcase name="And I should see error message for first name "First
name is required."" classname="Scenario: Sign Up Verify That Error Message
Is Shown If Any Of The Mandatory Field Is Left Blank" time="0.008"/>
<testcase name="And I should see error message for last name "Last
name is required."" classname="Scenario: Sign Up Verify That Error Message
Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/>
<testcase name="And I should see error message for email address
"Email address is required."" classname="Scenario: Sign Up Verify
That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank"
time="0"/>
<testcase name="And I should see error message for password "Password
is required."" classname="Scenario: Sign Up Verify That Error Message Is
Shown If Any Of The Mandatory Field Is Left Blank" time="0"/>
<testcase name="And I should see error message for preferred contact
number "Phone number is required."" classname="Scenario: Sign Up
Verify That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank"
time="0"/>
<testcase name="And I should see error message for delivery address
"Address is required."" classname="Scenario: Sign Up Verify That
Error Message Is Shown If Any Of The Mandatory Field Is Left Blank" time="0"/>
<testcase name="Scenario: Sign Up Verify That Error Message Is Shown If
Any Of The Mandatory Field Is Left Blank" classname="Scenario: Sign Up Verify
That Error Message Is Shown If Any Of The Mandatory Field Is Left Blank"
time="1.288"/>**
</testsuite>
**Below is the my XML file if I am using io.cucumber as group id for
execution (cucumber-jvm v 2.4.0) --- Rerun works perfectly fine but testcase
name is missing**
<property name="sun.io.unicode.encoding" value="UnicodeLittle"/>
<property name="java.class.version" value="52.0"/>
</properties>
**<testcase name="Sign Up Verify That Error Message Is Shown If Any Of The
Mandatory Field Is Left Blank" classname="Sign Up Verify That Error Message Is
Shown If Any Of The Mandatory Field Is Left Blank" time="18.391"/>**
</testsuite>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Rerunning failing tests fails in combination with
> Description#createSuiteDescription
> ------------------------------------------------------------------------------------
>
> Key: SUREFIRE-1372
> URL: https://issues.apache.org/jira/browse/SUREFIRE-1372
> Project: Maven Surefire
> Issue Type: Bug
> Components: Maven Surefire Plugin
> Affects Versions: 2.20
> Reporter: M.P. Korstanje
> Assignee: Tibor Digana
> Priority: Major
> Fix For: 2.21.0
>
>
> When using surefire to rerun failing tests created by a Runner that uses
> {noformat}Description#createSuiteDescription{noformat} with a human readable
> name rather then a class name the following stack trace occurs:
> {code}
> org.apache.maven.surefire.testset.TestSetFailedException: Unable to create
> test class 'Scenario: Fail when running'
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeFailedMethod(JUnit4Provider.java:385)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:292)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161)
> Caused by: java.lang.ClassNotFoundException: Scenario: Fail when running
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeFailedMethod(JUnit4Provider.java:379)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:292)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)