Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-29716

Incorrect Execution Results when using TestNG class name results seeking strategy

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • testlink-plugin
    • None
    • Jenkins ver. 1.585, Testlink 1.9.13, Google Chrome 44.0.2403.107(64bit)

      I have a configured the Testlink plugin on Jenkins. After I run my TestNG test cases, I proceed to update the results in Testlink.
      The test cases are displayed correctly, but all of them are updated as "Passed"

      TestLink build ID: 282

      TestLink build name: build_2015-07-27_09-40-21

      Total of 4 tests. Where 4 (+4) passed, 0 failed, 0 were blocked and 0 were not executed.

      List of test cases and execution result status

      Test case ID Test case external ID Version Name Test project ID Execution status
      87555 SOL-10503 1 Add Provider Credential Policy 67109 Passed
      87557 SOL-10504 1 Assign Prov Credential Policy to Provider Admin 67109 Passed
      87559 SOL-10505 1 Add Customer Credential Policy 67109 Passed
      87561 SOL-10506 1 Assign Cust Credential Policy to Customer Admin 67109 Passed

      In my test cases TestNG result, 2 of the test cases have failed.

      TestNG Results
      Total Tests: 4 (+4)
      Failed Tests: 2 (+2)
      com.company.abc.def.auto.applicationtest.test.GenericTest.testAdd
      com.company.abc.def.auto.applicationtest.test.GenericTest.testAdd
      Skipped Tests: 0 (±0)
      Failed Configurations: 0 (±0)
      Skipped Configurations: 0 (±0)

      I have a suspicion it might be related to my Test result seeking strategy definition :
      I use :
      TestNG class name
      Include Pattern -> output/testng-results.xml
      Key Custom Field -> TL-Jenkins

      I am using : TestLink 1.9.13 (Stormbringer)
      Jenkins ver. 1.585
      Testlink Plugin 3.10

      http://mantis.testlink.org/view.php?id=7204

        1. generic-testng-results.xml
          38 kB
          voss qa
        2. TestingResultsXml.png
          42 kB
          Arne Wohletz
        3. Testlink_Java Class.png
          26 kB
          Arne Wohletz

            kinow Bruno P. Kinoshita
            vossqa voss qa
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: