• Icon: Improvement Improvement
    • Resolution: Fixed
    • Icon: Major Major
    • junit-plugin
    • None

      JUnit report XML can contain a message for skipped tests, which often contains information regarding why the test is being skipped. It would be very useful if this message could be output in the test results in a similar way to how the failure are shown.

      I've attached an example JUnit style report with a skipped test.

          [JENKINS-8713] Display skipped test messages in results

          Dave Hunt created issue -

          Gregory Nofi added a comment - - edited

          The issue type is Improvement but I think this might be a bug because this used to work quite well.

          Any skipped tests were listed as such in the Test Report, and the number of skipped tests was represented by a nice yellow color in the Test Result Trend chart. Even now the Test Result still has a column for number of Skipped tests, but it is always set to 0 in each row even when there are skipped tests in the JUnit report.

          One theory: this may have started happening to our team after the Performance Plugin was installed, which I think has its own JUnit parser. However, we have this problem even in jobs that aren't using the Performance Plugin.

          Update: Skipped tests started showing up again in the Test Result Trend Chart for us again. Please disregard my comment, which should have been logged as a separate, new bug report instead.

          Gregory Nofi added a comment - - edited The issue type is Improvement but I think this might be a bug because this used to work quite well. Any skipped tests were listed as such in the Test Report, and the number of skipped tests was represented by a nice yellow color in the Test Result Trend chart. Even now the Test Result still has a column for number of Skipped tests, but it is always set to 0 in each row even when there are skipped tests in the JUnit report. One theory: this may have started happening to our team after the Performance Plugin was installed, which I think has its own JUnit parser. However, we have this problem even in jobs that aren't using the Performance Plugin. Update: Skipped tests started showing up again in the Test Result Trend Chart for us again. Please disregard my comment, which should have been logged as a separate, new bug report instead.

          redsolo added a comment -

          Hi gregory, this issue should be marked as an improvement as it describes a feature that does not yet exist. Your problem sounds like a bug in an existing feature, so please create a new bug-report describing the problem and what plugins you are using (and version). Plus if you can, add a sample report that contains skipped tests to make easy to reproduce the issue.

          redsolo added a comment - Hi gregory, this issue should be marked as an improvement as it describes a feature that does not yet exist. Your problem sounds like a bug in an existing feature, so please create a new bug-report describing the problem and what plugins you are using (and version). Plus if you can, add a sample report that contains skipped tests to make easy to reproduce the issue.

          Ignas Vyšnu added a comment -

          Bumping this and would like to clear some confusion: skipped tests are counted and the total number is displayed, I think there is no "bug" here, but the feature improvement would be to actually list/display (or at least have an option to do so) the skipped tests the same way failed tests are being listed under Test Result view.

          Ignas Vyšnu added a comment - Bumping this and would like to clear some confusion: skipped tests are counted and the total number is displayed, I think there is no "bug" here, but the feature improvement would be to actually list/display (or at least have an option to do so) the skipped tests the same way failed tests are being listed under Test Result view.
          Michael Clarke made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]
          Michael Clarke made changes -
          Assignee New: Michael Clarke [ mc1arke ]

          Code changed in jenkins
          User: Michael Clarke
          Path:
          core/src/main/java/hudson/tasks/junit/CaseResult.java
          core/src/main/resources/hudson/tasks/junit/CaseResult/index.jelly
          http://jenkins-ci.org/commit/jenkins/3b58cd294f8266f2e4dc80356bf172c37769030e
          Log:
          [FIXED JENKINS-8713] Display test skipped messages in test results

          SCM/JIRA link daemon added a comment - Code changed in jenkins User: Michael Clarke Path: core/src/main/java/hudson/tasks/junit/CaseResult.java core/src/main/resources/hudson/tasks/junit/CaseResult/index.jelly http://jenkins-ci.org/commit/jenkins/3b58cd294f8266f2e4dc80356bf172c37769030e Log: [FIXED JENKINS-8713] Display test skipped messages in test results
          SCM/JIRA link daemon made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: In Progress [ 3 ] New: Resolved [ 5 ]

          Code changed in jenkins
          User: Michael Clarke
          Path:
          changelog.html
          http://jenkins-ci.org/commit/jenkins/2aa0293858d50b064128a9a74f4d25d3f5c4a5c8
          Log:
          JENKINS-8713 Add changelog entry

          Compare: https://github.com/jenkinsci/jenkins/compare/fe9f67602877...2aa0293858d5


          You received this message because you are subscribed to the Google Groups "Jenkins Commits" group.
          To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-commits+unsubscribe@googlegroups.com.
          For more options, visit https://groups.google.com/groups/opt_out.

          SCM/JIRA link daemon added a comment - Code changed in jenkins User: Michael Clarke Path: changelog.html http://jenkins-ci.org/commit/jenkins/2aa0293858d50b064128a9a74f4d25d3f5c4a5c8 Log: JENKINS-8713 Add changelog entry Compare: https://github.com/jenkinsci/jenkins/compare/fe9f67602877...2aa0293858d5 – You received this message because you are subscribed to the Google Groups "Jenkins Commits" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-commits+unsubscribe@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out .

          dogfood added a comment -

          Integrated in jenkins_main_trunk #2369
          [FIXED JENKINS-8713] Display test skipped messages in test results (Revision 3b58cd294f8266f2e4dc80356bf172c37769030e)
          JENKINS-8713 Add changelog entry (Revision 2aa0293858d50b064128a9a74f4d25d3f5c4a5c8)

          Result = UNSTABLE
          michael.m.clarke : 3b58cd294f8266f2e4dc80356bf172c37769030e
          Files :

          • core/src/main/java/hudson/tasks/junit/CaseResult.java
          • core/src/main/resources/hudson/tasks/junit/CaseResult/index.jelly

          michael.m.clarke : 2aa0293858d50b064128a9a74f4d25d3f5c4a5c8
          Files :

          • changelog.html

          dogfood added a comment - Integrated in jenkins_main_trunk #2369 [FIXED JENKINS-8713] Display test skipped messages in test results (Revision 3b58cd294f8266f2e4dc80356bf172c37769030e) JENKINS-8713 Add changelog entry (Revision 2aa0293858d50b064128a9a74f4d25d3f5c4a5c8) Result = UNSTABLE michael.m.clarke : 3b58cd294f8266f2e4dc80356bf172c37769030e Files : core/src/main/java/hudson/tasks/junit/CaseResult.java core/src/main/resources/hudson/tasks/junit/CaseResult/index.jelly michael.m.clarke : 2aa0293858d50b064128a9a74f4d25d3f5c4a5c8 Files : changelog.html

            mc1arke Michael Clarke
            davehunt Dave Hunt
            Votes:
            10 Vote for this issue
            Watchers:
            14 Start watching this issue

              Created:
              Updated:
              Resolved: