• Type: Bug
• Resolution: Unresolved
• Priority: Major
• Component/s: junit-plugin
• Labels:

  • junit
  • plugin
  • reporting
  • results
• Environment:

  Jenkins ver. 1.619
  JUnit Plugin ver. 1.9

[JENKINS-31187] Not all failure cases reported in JUnit test result report

Adam Beben created issue - 2015-10-27 14:04

Adam Beben made changes - 2015-10-27 14:06

Description

Original: Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: {code} ...   <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">     <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace... </failure>     <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace... </failure>   </testcase> ... {code} From above snippet only "Some error 1 message" will be reported, junitResults.xml: {code}         <case>           <duration>7.718</duration>           <className>com.SomeTestClass</className>           <testName>someTestName</testName>           <skipped>false</skipped>           <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message at Some failure 1 stack trace... </errorStackTrace>           <errorDetails>Some error 1 message</errorDetails>           <failedSince>0</failedSince>         </case> {code} Is it possible for JUnit Plugin to report all failures?

New: Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: {code} ...   <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">     <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace... </failure>     <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace... </failure>   </testcase> ... {code} From above snippet only "Some error 1 message" will be reported, junitResults.xml: {code} <case>   <duration>7.718</duration>   <className>com.SomeTestClass</className>   <testName>someTestName</testName>   <skipped>false</skipped>   <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace...   </errorStackTrace>   <errorDetails>Some error 1 message</errorDetails>   <failedSince>0</failedSince> </case> {code} Is it possible for JUnit Plugin to report all failures?

Adam Beben made changes - 2015-10-27 14:08

Description

Original: Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: {code} ...   <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">     <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace... </failure>     <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace... </failure>   </testcase> ... {code} From above snippet only "Some error 1 message" will be reported, junitResults.xml: {code} <case>   <duration>7.718</duration>   <className>com.SomeTestClass</className>   <testName>someTestName</testName>   <skipped>false</skipped>   <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace...   </errorStackTrace>   <errorDetails>Some error 1 message</errorDetails>   <failedSince>0</failedSince> </case> {code} Is it possible for JUnit Plugin to report all failures?

New: Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: {code} ... <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">   <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace...   </failure>   <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace...   </failure> </testcase> ... {code} From above snippet only "Some error 1 message" will be reported, junitResults.xml: {code} ... <case>   <duration>7.718</duration>   <className>com.SomeTestClass</className>   <testName>someTestName</testName>   <skipped>false</skipped>   <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace...   </errorStackTrace>   <errorDetails>Some error 1 message</errorDetails>   <failedSince>0</failedSince> </case> .. {code} Is it possible for JUnit Plugin to report all failures?

R. Tyler Croy made changes - 2016-07-25 23:52

Workflow

Original: JNJira [ 166370 ]

New: JNJira + In-Review [ 182375 ]

Ming Li made changes - 2017-04-28 22:29

Priority

Original: Minor [ 4 ]

New: Major [ 3 ]