Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17146

Test link plugin is not looking trough my suite name options in testNG

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Postponed
    • Component/s: testlink-plugin
    • Labels:
      None
    • Environment:
      Test Link plugin 3.1.8, Jenkins Jenkins ver. 1.480.2
    • Similar Issues:

      Description

      I am using TestNG with suite name descriptions on Jenkins CI.

      I used all search strategies on /testng-results.xml result file

      I am usually using method strategy and that's works fine but we need a customized report on our build so I created an suite that includes other suites.
      The testng result file contains all the suites that I added but the testlink is not able to execute my tests. The custom field is set in testlink with the name of the suite. Please correct me if I am doing something wrong.

      This is the log:

      Preparing TestLink client API.
      Using TestLink URL: something/xmlrpc.php

      Found 6 automated test cases in TestLink.

      Sorting automated test cases by TestLink test plan execution order.

      Executing single Build Steps.

      Executing iterative Build Steps.

      Looking for the test results of TestLink test cases.

      Looking for test results in TestNG suites by its name.

      Looking for test results in TestNG suites by its name.

      Looking for test results in TestNG methods by its name.

      Looking for test results in TestNG methods by its name and data provider name.

      Found 0 test result(s).

        Attachments

          Activity

          Hide
          cwa Charles Agnello added a comment -

          I'm having the same issue with the Result Seeking strategy for Junit method name.

          Show
          cwa Charles Agnello added a comment - I'm having the same issue with the Result Seeking strategy for Junit method name.
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi @Paul, can you attach a sample XML with your multiple suites, please? I'll run it through testng-parser [1] and will try to fix the issue in the plug-in. Thanks in advance.

          [1] http://search.maven.org/#artifactdetails%7Ccom.tupilabs%7Ctestng-parser%7C0.1%7Cjar

          Show
          kinow Bruno P. Kinoshita added a comment - Hi @Paul, can you attach a sample XML with your multiple suites, please? I'll run it through testng-parser [1] and will try to fix the issue in the plug-in. Thanks in advance. [1] http://search.maven.org/#artifactdetails%7Ccom.tupilabs%7Ctestng-parser%7C0.1%7Cjar
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Cutting a new release tomorrow night. Postponing this issue for 3.4.

          Show
          kinow Bruno P. Kinoshita added a comment - Cutting a new release tomorrow night. Postponing this issue for 3.4.
          Hide
          paul8620 Paul Horvath added a comment -

          <?xml version='1.0' encoding='UTF-8'?>
          <maven2-moduleset plugin="maven-plugin@1.505">
          <actions/>
          <description>Production report test</description>
          <logRotator class="hudson.tasks.LogRotator">
          <daysToKeep>-1</daysToKeep>
          <numToKeep>15</numToKeep>
          <artifactDaysToKeep>-1</artifactDaysToKeep>
          <artifactNumToKeep>-1</artifactNumToKeep>
          </logRotator>
          <keepDependencies>false</keepDependencies>
          <properties/>
          <scm class="hudson.plugins.git.GitSCM" plugin="git@1.2.0">
          <configVersion>2</configVersion>
          <userRemoteConfigs>
          <hudson.plugins.git.UserRemoteConfig>
          <name></name>
          <refspec></refspec>
          <url>git@github.com:lolaent/g4-test-scripts.git</url>
          </hudson.plugins.git.UserRemoteConfig>
          </userRemoteConfigs>
          <branches>
          <hudson.plugins.git.BranchSpec>
          <name>master</name>
          </hudson.plugins.git.BranchSpec>
          </branches>
          <disableSubmodules>false</disableSubmodules>
          <recursiveSubmodules>false</recursiveSubmodules>
          <doGenerateSubmoduleConfigurations>false</doGenerateSubmoduleConfigurations>
          <authorOrCommitter>false</authorOrCommitter>
          <clean>false</clean>
          <wipeOutWorkspace>false</wipeOutWorkspace>
          <pruneBranches>false</pruneBranches>
          <remotePoll>false</remotePoll>
          <ignoreNotifyCommit>false</ignoreNotifyCommit>
          <useShallowClone>false</useShallowClone>
          <buildChooser class="hudson.plugins.git.util.DefaultBuildChooser"/>
          <gitTool>Default</gitTool>
          <submoduleCfg class="list"/>
          <relativeTargetDir></relativeTargetDir>
          <reference></reference>
          <excludedRegions></excludedRegions>
          <excludedUsers></excludedUsers>
          <gitConfigName></gitConfigName>
          <gitConfigEmail></gitConfigEmail>
          <skipTag>false</skipTag>
          <includedRegions></includedRegions>
          <scmName></scmName>
          </scm>
          <canRoam>true</canRoam>
          <disabled>false</disabled>
          <blockBuildWhenDownstreamBuilding>false</blockBuildWhenDownstreamBuilding>
          <blockBuildWhenUpstreamBuilding>false</blockBuildWhenUpstreamBuilding>
          <triggers class="vector"/>
          <concurrentBuild>false</concurrentBuild>
          <rootModule>
          <groupId>AutomationTesting</groupId>
          <artifactId>AutomationTesting</artifactId>
          </rootModule>
          <rootPOM>webdriver/AutomationTesting/pom.xml</rootPOM>
          <goals>clean install -DtestXml=testSuiteProd.xml -Denv=production -Dbro=firefox -Dais=AIS_DRUPAL_QA -Dmaven.test.failure.ignore=true</goals>
          <aggregatorStyleBuild>true</aggregatorStyleBuild>
          <incrementalBuild>false</incrementalBuild>
          <perModuleEmail>true</perModuleEmail>
          <ignoreUpstremChanges>true</ignoreUpstremChanges>
          <archivingDisabled>false</archivingDisabled>
          <resolveDependencies>false</resolveDependencies>
          <processPlugins>false</processPlugins>
          <mavenValidationLevel>-1</mavenValidationLevel>
          <runHeadless>false</runHeadless>
          <disableTriggerDownstreamProjects>false</disableTriggerDownstreamProjects>
          <settings class="jenkins.mvn.DefaultSettingsProvider"/>
          <globalSettings class="jenkins.mvn.DefaultGlobalSettingsProvider"/>
          <reporters/>
          <publishers>
          <hudson.tasks.ArtifactArchiver>
          <artifacts>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</artifacts>
          <latestOnly>false</latestOnly>
          </hudson.tasks.ArtifactArchiver>
          <hudson.plugins.testng.Publisher plugin="testng-plugin@1.1">
          <reportFilenamePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</reportFilenamePattern>
          <escapeTestDescp>true</escapeTestDescp>
          <escapeExceptionMsg>true</escapeExceptionMsg>
          </hudson.plugins.testng.Publisher>
          </publishers>
          <buildWrappers>
          <org.jenkinsci.plugins.xvfb.XvfbBuildWrapper plugin="xvfb@1.0.7">
          <installationName>Xvfb-default</installationName>
          <screen>1024x768x24</screen>
          <debug>false</debug>
          <timeout>0</timeout>
          <displayNameOffset>1</displayNameOffset>
          <additionalOptions></additionalOptions>
          <shutdownWithBuild>false</shutdownWithBuild>
          </org.jenkinsci.plugins.xvfb.XvfbBuildWrapper>
          </buildWrappers>
          <prebuilders/>
          <postbuilders>
          <hudson.plugins.testlink.TestLinkBuilder plugin="testlink@3.1.8">
          <testLinkName>Test Link G5</testLinkName>
          <testProjectName>G4</testProjectName>
          <testPlanName>G4 - ProdSuite</testPlanName>
          <buildName>41 Charlie</buildName>
          <customFields>Java Class</customFields>
          <transactional>false</transactional>
          <failedTestsMarkBuildAsFailure>false</failedTestsMarkBuildAsFailure>
          <failIfNoResults>false</failIfNoResults>
          <executionOrderComparator/>
          <failure>false</failure>
          <resultSeekers>
          <hudson.plugins.testlink.result.TestNGClassNameResultSeeker>
          <includePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</includePattern>
          <keyCustomField>Java Class</keyCustomField>
          <includeNotes>false</includeNotes>
          <parser/>
          <attachTestNGXML>false</attachTestNGXML>
          <markSkippedTestAsBlocked>false</markSkippedTestAsBlocked>
          </hudson.plugins.testlink.result.TestNGClassNameResultSeeker>
          </resultSeekers>
          </hudson.plugins.testlink.TestLinkBuilder>
          </postbuilders>
          <runPostStepsIfResult>
          <name>FAILURE</name>
          <ordinal>2</ordinal>
          <color>RED</color>
          </runPostStepsIfResult>

          Show
          paul8620 Paul Horvath added a comment - <?xml version='1.0' encoding='UTF-8'?> <maven2-moduleset plugin="maven-plugin@1.505"> <actions/> <description>Production report test</description> <logRotator class="hudson.tasks.LogRotator"> <daysToKeep>-1</daysToKeep> <numToKeep>15</numToKeep> <artifactDaysToKeep>-1</artifactDaysToKeep> <artifactNumToKeep>-1</artifactNumToKeep> </logRotator> <keepDependencies>false</keepDependencies> <properties/> <scm class="hudson.plugins.git.GitSCM" plugin="git@1.2.0"> <configVersion>2</configVersion> <userRemoteConfigs> <hudson.plugins.git.UserRemoteConfig> <name></name> <refspec></refspec> <url>git@github.com:lolaent/g4-test-scripts.git</url> </hudson.plugins.git.UserRemoteConfig> </userRemoteConfigs> <branches> <hudson.plugins.git.BranchSpec> <name>master</name> </hudson.plugins.git.BranchSpec> </branches> <disableSubmodules>false</disableSubmodules> <recursiveSubmodules>false</recursiveSubmodules> <doGenerateSubmoduleConfigurations>false</doGenerateSubmoduleConfigurations> <authorOrCommitter>false</authorOrCommitter> <clean>false</clean> <wipeOutWorkspace>false</wipeOutWorkspace> <pruneBranches>false</pruneBranches> <remotePoll>false</remotePoll> <ignoreNotifyCommit>false</ignoreNotifyCommit> <useShallowClone>false</useShallowClone> <buildChooser class="hudson.plugins.git.util.DefaultBuildChooser"/> <gitTool>Default</gitTool> <submoduleCfg class="list"/> <relativeTargetDir></relativeTargetDir> <reference></reference> <excludedRegions></excludedRegions> <excludedUsers></excludedUsers> <gitConfigName></gitConfigName> <gitConfigEmail></gitConfigEmail> <skipTag>false</skipTag> <includedRegions></includedRegions> <scmName></scmName> </scm> <canRoam>true</canRoam> <disabled>false</disabled> <blockBuildWhenDownstreamBuilding>false</blockBuildWhenDownstreamBuilding> <blockBuildWhenUpstreamBuilding>false</blockBuildWhenUpstreamBuilding> <triggers class="vector"/> <concurrentBuild>false</concurrentBuild> <rootModule> <groupId>AutomationTesting</groupId> <artifactId>AutomationTesting</artifactId> </rootModule> <rootPOM>webdriver/AutomationTesting/pom.xml</rootPOM> <goals>clean install -DtestXml=testSuiteProd.xml -Denv=production -Dbro=firefox -Dais=AIS_DRUPAL_QA -Dmaven.test.failure.ignore=true</goals> <aggregatorStyleBuild>true</aggregatorStyleBuild> <incrementalBuild>false</incrementalBuild> <perModuleEmail>true</perModuleEmail> <ignoreUpstremChanges>true</ignoreUpstremChanges> <archivingDisabled>false</archivingDisabled> <resolveDependencies>false</resolveDependencies> <processPlugins>false</processPlugins> <mavenValidationLevel>-1</mavenValidationLevel> <runHeadless>false</runHeadless> <disableTriggerDownstreamProjects>false</disableTriggerDownstreamProjects> <settings class="jenkins.mvn.DefaultSettingsProvider"/> <globalSettings class="jenkins.mvn.DefaultGlobalSettingsProvider"/> <reporters/> <publishers> <hudson.tasks.ArtifactArchiver> <artifacts>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</artifacts> <latestOnly>false</latestOnly> </hudson.tasks.ArtifactArchiver> <hudson.plugins.testng.Publisher plugin="testng-plugin@1.1"> <reportFilenamePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</reportFilenamePattern> <escapeTestDescp>true</escapeTestDescp> <escapeExceptionMsg>true</escapeExceptionMsg> </hudson.plugins.testng.Publisher> </publishers> <buildWrappers> <org.jenkinsci.plugins.xvfb.XvfbBuildWrapper plugin="xvfb@1.0.7"> <installationName>Xvfb-default</installationName> <screen>1024x768x24</screen> <debug>false</debug> <timeout>0</timeout> <displayNameOffset>1</displayNameOffset> <additionalOptions></additionalOptions> <shutdownWithBuild>false</shutdownWithBuild> </org.jenkinsci.plugins.xvfb.XvfbBuildWrapper> </buildWrappers> <prebuilders/> <postbuilders> <hudson.plugins.testlink.TestLinkBuilder plugin="testlink@3.1.8"> <testLinkName>Test Link G5</testLinkName> <testProjectName>G4</testProjectName> <testPlanName>G4 - ProdSuite</testPlanName> <buildName>41 Charlie</buildName> <customFields>Java Class</customFields> <transactional>false</transactional> <failedTestsMarkBuildAsFailure>false</failedTestsMarkBuildAsFailure> <failIfNoResults>false</failIfNoResults> <executionOrderComparator/> <failure>false</failure> <resultSeekers> <hudson.plugins.testlink.result.TestNGClassNameResultSeeker> <includePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</includePattern> <keyCustomField>Java Class</keyCustomField> <includeNotes>false</includeNotes> <parser/> <attachTestNGXML>false</attachTestNGXML> <markSkippedTestAsBlocked>false</markSkippedTestAsBlocked> </hudson.plugins.testlink.result.TestNGClassNameResultSeeker> </resultSeekers> </hudson.plugins.testlink.TestLinkBuilder> </postbuilders> <runPostStepsIfResult> <name>FAILURE</name> <ordinal>2</ordinal> <color>RED</color> </runPostStepsIfResult>
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi Paul,

          Thanks for including your build.xml content. Could you provide your testng-results.xml and, if possible, some screenshots with your TL and Jenkins configuration (custom field definition, build settings, etc).

          Thanks again!
          Bruno

          Show
          kinow Bruno P. Kinoshita added a comment - Hi Paul, Thanks for including your build.xml content. Could you provide your testng-results.xml and, if possible, some screenshots with your TL and Jenkins configuration (custom field definition, build settings, etc). Thanks again! Bruno
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Bump?

          Show
          kinow Bruno P. Kinoshita added a comment - Bump?
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi! I'm preparing a new release and postponing this issue due to the need of more information to continue. Feel free to reopen it later, and we will work on this issue again. Thanks!

          Show
          kinow Bruno P. Kinoshita added a comment - Hi! I'm preparing a new release and postponing this issue due to the need of more information to continue. Feel free to reopen it later, and we will work on this issue again. Thanks!

            People

            Assignee:
            kinow Bruno P. Kinoshita
            Reporter:
            paul8620 Paul Horvath
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: