Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-16640

Mark in Jenkins build with "NOT RUN" Test Cases and display in the UI (with colours, etc)

XMLWordPrintable

      • Get automated test cases from Testlink
      • Find the TAP files after test cases complete
      • For each found automated test case result (TAP) then update Testlink
      • For each not found automated test case (NOT RUN in fact), mark in Jenkins build and display in the UI (with colours, etc)

      What I want is to get the statistic information shown on the Jenkins Testlink ReportSummary Page, please find the attachment for the screenshot. There are 5 test cases to be executed, you can see 3 passed 1 skipped 1 failed, but sometimes one of the test case is not executed at all because the pre-condition of the test case is wrong. In this case, the result of this test case should be shown as "NOT EXECUTED" or "NOT RUN".

        1. TestlinkStatInfoPage.png
          TestlinkStatInfoPage.png
          29 kB

          [JENKINS-16640] Mark in Jenkins build with "NOT RUN" Test Cases and display in the UI (with colours, etc)

          Yinghua Wang created issue -

          Bruno P. Kinoshita added a comment -

          From your description it does make sense. Will try to implement it to see if there's no reason for not doing this way. Thanks!

          Bruno P. Kinoshita added a comment - From your description it does make sense. Will try to implement it to see if there's no reason for not doing this way. Thanks!
          Bruno P. Kinoshita made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]
          Bruno P. Kinoshita made changes -
          Description Original:
          - Get automated test cases from Testlink
          - Find the TAP files after test cases complete
          - For each found automated test case result (TAP) then update Testlink
          - For each not found automated test case (NOT RUN in fact), mark in Jenkins build and display in the UI (with colours, etc)

          What I want is to get the statistic information shown on the Jenkins Testlink ReportSummary Page, please find the attachment for the screenshot. There are 5 test cases to be executed, you can see 3 passed 1 skipped 1 failed, but sometimes one of the test case is not executed at all because the pre-condition of the test case is wrong. In this case, the result of this test case should be shown as "NOT EXECUTED" or "NOT RUN".           		New: - Get automated test cases from Testlink
          - Find the TAP files after test cases complete
          - For each found automated test case result (TAP) then update Testlink
          - For each not found automated test case (NOT RUN in fact), mark in Jenkins build and display in the UI (with colours, etc)

          What I want is to get the statistic information shown on the Jenkins Testlink ReportSummary Page, please find the attachment for the screenshot. There are 5 test cases to be executed, you can see 3 passed 1 skipped 1 failed, but sometimes one of the test case is not executed at all because the pre-condition of the test case is wrong. In this case, the result of this test case should be shown as "NOT EXECUTED" or "NOT RUN".
          Priority Original: Major [ 3 ] New: Minor [ 4 ]

          SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Bruno P. Kinoshita
          Path:
          src/main/java/hudson/plugins/testlink/AbstractTestLinkBuilder.java
          src/main/java/hudson/plugins/testlink/Report.java
          src/main/java/hudson/plugins/testlink/TestLinkBuilder.java
          src/main/java/hudson/plugins/testlink/TestLinkSite.java
          http://jenkins-ci.org/commit/testlink-plugin/40f8ce3bfb502af2933343814578ff6374d74e40
          Log:
          [FIXED JENKINS-16640] Adding not run test cases to report

          SCM/JIRA link daemon added a comment - Code changed in jenkins User: Bruno P. Kinoshita Path: src/main/java/hudson/plugins/testlink/AbstractTestLinkBuilder.java src/main/java/hudson/plugins/testlink/Report.java src/main/java/hudson/plugins/testlink/TestLinkBuilder.java src/main/java/hudson/plugins/testlink/TestLinkSite.java http://jenkins-ci.org/commit/testlink-plugin/40f8ce3bfb502af2933343814578ff6374d74e40 Log: [FIXED JENKINS-16640] Adding not run test cases to report
          SCM/JIRA link daemon made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: In Progress [ 3 ] New: Resolved [ 5 ]

          Bruno P. Kinoshita added a comment -

          Fixed in 3.5

          Bruno P. Kinoshita added a comment - Fixed in 3.5
          Bruno P. Kinoshita made changes -
          Status Original: Resolved [ 5 ] New: Closed [ 6 ]

          Andrew Sim added a comment -

          But even with not run status , the build should also mark as failed unless there is some option to turn off check for test status

          Andrew Sim added a comment - But even with not run status , the build should also mark as failed unless there is some option to turn off check for test status
          Andrew Sim made changes -
          Resolution Original: Fixed [ 1 ]
          Status Original: Closed [ 6 ] New: Reopened [ 4 ]

            kinow Bruno P. Kinoshita
            yhwang Yinghua Wang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: