Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-13821

When test uses DataProvider it mark in TestLink only by last result

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • testlink-plugin
    • None
    • win7, Jenkins ver. 1.452, TestLink 1.9.3, Jenkins TestLink Plugin 3.1.2

    Description

      I have such test

      @Test(dataProvider = "validateFieldBase", dataProviderClass = CampaignData.class)
      public void validateNameField(String campaignName)

      { ... }

      and such DataProvider for it

      @DataProvider
      public static Object[][] validateFieldBase() {
      Object[][] word = {

      {"<script language='JavaScript'> alert('Hello') </script>"}

      ,

      {"ASDGFFLKLKLKlddvddsghdsh"}

      ,

      {"12344557688008853"}

      ,

      {":!@#$%^&*()_."}

      ,

      {"ASDASDasdas-123123211212&^%&^%"}

      ,
      };
      return(word);
      }

      And I have test cause in TestLink mapped by Test Result Seeking Strategies - TestNG Method Name.

      Problem: test cause in TestLink marks failed or passed by the last DataProvider result (in example by value "ASDASDasdas-123123211212&%&%")

      Expected result: if all DataProvider values passed than test cause in Testlink should mark as passed,
      if even one DataProvider value is failed than test cause in Testlink should mark as failed.

      may be its not a bug, but I think it will be a really nice feature.

      P.S. : I tried to use successPercentage=100 but it's uncertainly for me when and for what it should be used.

      Attachments

        Activity

          kasheylm Denis Veselovskiy created issue -
          kinow Bruno P. Kinoshita made changes -
          Field Original Value New Value
          Component/s testng [ 15801 ]
          kinow Bruno P. Kinoshita made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          scm_issue_link SCM/JIRA link daemon made changes -
          Resolution Fixed [ 1 ]
          Status In Progress [ 3 ] Resolved [ 5 ]
          kinow Bruno P. Kinoshita made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 144289 ] JNJira + In-Review [ 205865 ]

          People

            kinow Bruno P. Kinoshita
            kasheylm Denis Veselovskiy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: