Details
-
Type:
Bug
-
Status: Resolved (View Workflow)
-
Priority:
Major
-
Resolution: Fixed
-
Component/s: xunit-plugin
-
Labels:None
-
Environment:xunit-plugin 2.2.3
nunit3-console.exe 3.7.0
-
Similar Issues:
Description
We are running `nunit3-console -result:TestResult.xml;format=nunit2` to produce NUnit2 compatible test reports with the NUnit3 runner.
With the earlier xunit-plugin 1.102 version this worked just fine. Now with xunit-plugin 2.2.3, if we have errors / failures in the test results, these are not reported as failures anymore. Even worse, they are reported as success!
TestResults.xml report file says:
Jenkins / xunit-plugin 2.2.3 says:
See the full example XML report attached
Attachments
Activity
Field | Original Value | New Value |
---|---|---|
Attachment | Nunit3-in-nunit2-format-with-failures-TestReport.xml [ 43819 ] |
Attachment | Nunit3-in-nunit2-format-with-failures-TestReport.xml [ 43820 ] |
Attachment | screenshot-1.png [ 43821 ] |
Attachment | screenshot-2.png [ 43822 ] |
Description |
We are running `nunit3-console -result:TestResult.xml;format=nunit2` to produce NUnit2 compatible test reports with the NUnit3 runner. With the earlier xunit-plugin 1.102 version this worked just fine. Now with xunit-plugin 2.2.3, if we have errors / failures in the test results, these are not reported anymore. See the example XML report attached |
We are running `nunit3-console -result:TestResult.xml;format=nunit2` to produce NUnit2 compatible test reports with the NUnit3 runner. With the earlier xunit-plugin 1.102 version this worked just fine. Now with xunit-plugin 2.2.3, if we have errors / failures in the test results, these are not reported as failures anymore. Even worse, they are reported as success! TestResults.xml report file says: !screenshot-2.png|thumbnail! Jenkins / xunit-plugin 2.2.3 says: !screenshot-1.png|thumbnail! See the full example XML report attached |
Summary | Test Failures not reported when using nunit3-console with nunit2 output formatter | Test Failures reported as Success when using nunit3-console with nunit2 output formatter |
Issue Type | Improvement [ 4 ] | Bug [ 1 ] |
Priority | Minor [ 4 ] | Major [ 3 ] |
Summary | Test Failures reported as Success when using nunit3-console with nunit2 output formatter | NUnit 2.x test cases with result Error are reported as Success |
Status | Open [ 1 ] | In Progress [ 3 ] |
Resolution | Fixed [ 1 ] | |
Status | In Progress [ 3 ] | Fixed but Unreleased [ 10203 ] |
Status | Fixed but Unreleased [ 10203 ] | Resolved [ 5 ] |
Nikolas Falco my first impression was that the "nunit-version" field (which is set to "3.5.0.0" in the attached example) might get interpreted. However, I manually changed this to "2.5.0.0" but still the same issue, failures were not reported correctly
Note: we use "NUnitJunitHudsonTestType" assuming this will handle the NUnit2 format correctly (which it did in the xunit-plugin 1.102 version at least)