Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-29316

MSTEST : inconclusive tests are reported as 'failed' instead of 'skipped'

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved (View Workflow)
    • Minor
    • Resolution: Fixed
    • mstest-plugin
    • None
    • jenkins 1.598 / MSTest plugin 0.18

    Description

      since update from 0.11 plugin version, 'inconclusive' tests status has changed from 'success' to 'fail' whereas right status is actually 'skipped'.

      Job is 'UNSTABLE' and not 'FAILED' which is correct and contradictory with detailed results where inconclusive are in 'failed tests' section.

      Is it possible to fix this please ?

      Attachments

        Activity

          splashnenen Alexandre Aubert created issue -

          job status 'STABLE/SUCCESS' with inconclusive tests as 'skipped' tests would be perfect and reflecting well the reality

          splashnenen Alexandre Aubert added a comment - job status 'STABLE/SUCCESS' with inconclusive tests as 'skipped' tests would be perfect and reflecting well the reality

          Alexandre, would you please send me an example TRX, in order to add it to the unit test material?

          nilleb Ivo Bellin Salarin added a comment - Alexandre, would you please send me an example TRX, in order to add it to the unit test material?

          Sorry for the late reply, here is the requested file. You may check that there are 116 failed tests and 6 inconclusive. Jenkins displays '122 failed' as build result. (instead of 116 failed, 6 skipped)
          Thanks for your help on that

          splashnenen Alexandre Aubert added a comment - Sorry for the late reply, here is the requested file. You may check that there are 116 failed tests and 6 inconclusive. Jenkins displays '122 failed' as build result. (instead of 116 failed, 6 skipped) Thanks for your help on that
          splashnenen Alexandre Aubert made changes -
          Field Original Value New Value
          Attachment DATAFEED.Tests.trx [ 30221 ]

          Code changed in jenkins
          User: nilleb
          Path:
          src/main/resources/hudson/plugins/mstest/mstest-to-junit.xsl
          src/test/java/hudson/plugins/mstest/MSTestReportConverterTest.java
          src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.trx
          src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.xml
          http://jenkins-ci.org/commit/mstest-plugin/11249bc882314d8f1daa4a76099b499ad7608e85
          Log:
          JENKINS-29316 mark inconclusive tests as 'skipped'

          Compare: https://github.com/jenkinsci/mstest-plugin/compare/9414e939465a...11249bc88231

          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: nilleb Path: src/main/resources/hudson/plugins/mstest/mstest-to-junit.xsl src/test/java/hudson/plugins/mstest/MSTestReportConverterTest.java src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.trx src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.xml http://jenkins-ci.org/commit/mstest-plugin/11249bc882314d8f1daa4a76099b499ad7608e85 Log: JENKINS-29316 mark inconclusive tests as 'skipped' Compare: https://github.com/jenkinsci/mstest-plugin/compare/9414e939465a...11249bc88231

          Do you have an estimate for next release of the plugin ?
          Thanks

          splashnenen Alexandre Aubert added a comment - Do you have an estimate for next release of the plugin ? Thanks

          This has been fixed in the 0.19 version of the plugin (published 2015/09/01)

          nilleb Ivo Bellin Salarin added a comment - This has been fixed in the 0.19 version of the plugin (published 2015/09/01)
          nilleb Ivo Bellin Salarin made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 164189 ] JNJira + In-Review [ 197442 ]

          People

            nilleb Ivo Bellin Salarin
            splashnenen Alexandre Aubert
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: