Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-20039

TestLink plugin indicates test case as "not run" and TestLink is not updated with build status

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • testlink-plugin
    • None

      Hi,

      I've installed the TAP and TestLink plugins in Jenkins, and configured a build following the same logic as many people here (I can post details if needed).

      My build seems to run fine in Jenkins, but the problems are after:
      1. The build indicates "Not Run" as execution state.
      2. The tests status is not updated in TestLink.

      I have attached 2 screenshots: ss1.jpg which shows the build status, and ss2.jpg showing the TAP Extended Test Results screen.

      Could you please help me finding what's wrong? Thank you in advance.

        1. testlink.jpg
          testlink.jpg
          128 kB
        2. ss1.jpg
          ss1.jpg
          54 kB
        3. ss2.jpg
          ss2.jpg
          32 kB

          [JENKINS-20039] TestLink plugin indicates test case as "not run" and TestLink is not updated with build status

          Garden Dwarf created issue -

          Hi Garden, the plug-ins treat TAP file differently.

          In the tap-plugin, each test result within a tap test stream is a "test result" for Jenkins.

          However, for the testlink-plugin, you only have one strategy that uses the tap file name.

          Bruno P. Kinoshita added a comment - Hi Garden, the plug-ins treat TAP file differently. In the tap-plugin, each test result within a tap test stream is a "test result" for Jenkins. However, for the testlink-plugin, you only have one strategy that uses the tap file name.

          Post your testlink job settings and we will see why it's marked as not run :o)

          Bruno P. Kinoshita added a comment - Post your testlink job settings and we will see why it's marked as not run :o)
          Bruno P. Kinoshita made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]

          Garden Dwarf added a comment -

          Hi,
          I re-executed the build in Jenkins. But here is what I have on TestLink side regarding the build (please note that the last build's date hasn't changed since the last time I manually changed the status in TestLink):

          Garden Dwarf added a comment - Hi, I re-executed the build in Jenkins. But here is what I have on TestLink side regarding the build (please note that the last build's date hasn't changed since the last time I manually changed the status in TestLink):
          Garden Dwarf made changes -
          Attachment New: testlink.jpg [ 24567 ]
          Bruno P. Kinoshita made changes -
          Status Original: In Progress [ 3 ] New: Open [ 1 ]

          Hi Garden, I still can't understand what's wrong. For some reason your test has not been executed in Jenkins (or the plug-in couldn't find its output).

          The execution status displayed in the Jenkins UI doesn't reflect the latest execution status of the test in TestLink, but only the latest execution status in that build.

          HTH,
          Bruno

          Bruno P. Kinoshita added a comment - Hi Garden, I still can't understand what's wrong. For some reason your test has not been executed in Jenkins (or the plug-in couldn't find its output). The execution status displayed in the Jenkins UI doesn't reflect the latest execution status of the test in TestLink, but only the latest execution status in that build. HTH, Bruno

          Garden Dwarf added a comment -

          Hi Bruno,
          In the screenshots I posted, it was clear to me that Jenkins finds the results. What I didn't understand is how to reflect those results in Testlink (i.e. transfer of results from Jenkins to Testlink).
          If you tell me that Jenkins is not seeing the results, then I do not understand what is going wrong either. Jenkins just executes a scripts which create the result file (status hardcoded, just for test purposes).
          Could you please provide help to understand where something is going wrong? Thank you in advance.

          Garden Dwarf added a comment - Hi Bruno, In the screenshots I posted, it was clear to me that Jenkins finds the results. What I didn't understand is how to reflect those results in Testlink (i.e. transfer of results from Jenkins to Testlink). If you tell me that Jenkins is not seeing the results, then I do not understand what is going wrong either. Jenkins just executes a scripts which create the result file (status hardcoded, just for test purposes). Could you please provide help to understand where something is going wrong? Thank you in advance.

          make sure your tap filename is the same name than your "Key Custom Field" value (in jenkins)
          e.g.
          testlink custom field name: MY_CUSTOM_FIELD, value = test1
          jenkins Key Custom Field: MY_CUSTOM_FIELD

          jenkins tap filename: test1.tap

          Franck Derunes added a comment - make sure your tap filename is the same name than your "Key Custom Field" value (in jenkins) e.g. testlink custom field name: MY_CUSTOM_FIELD, value = test1 jenkins Key Custom Field: MY_CUSTOM_FIELD jenkins tap filename: test1.tap

            kinow Bruno P. Kinoshita
            gardendwarf Garden Dwarf
            Votes:
            2 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated: