Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17146

Test link plugin is not looking trough my suite name options in testNG

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Postponed
    • testlink-plugin
    • None
    • Test Link plugin 3.1.8, Jenkins Jenkins ver. 1.480.2

    Description

      I am using TestNG with suite name descriptions on Jenkins CI.

      I used all search strategies on /testng-results.xml result file

      I am usually using method strategy and that's works fine but we need a customized report on our build so I created an suite that includes other suites.
      The testng result file contains all the suites that I added but the testlink is not able to execute my tests. The custom field is set in testlink with the name of the suite. Please correct me if I am doing something wrong.

      This is the log:

      Preparing TestLink client API.
      Using TestLink URL: something/xmlrpc.php

      Found 6 automated test cases in TestLink.

      Sorting automated test cases by TestLink test plan execution order.

      Executing single Build Steps.

      Executing iterative Build Steps.

      Looking for the test results of TestLink test cases.

      Looking for test results in TestNG suites by its name.

      Looking for test results in TestNG suites by its name.

      Looking for test results in TestNG methods by its name.

      Looking for test results in TestNG methods by its name and data provider name.

      Found 0 test result(s).

      Attachments

        Activity

          I'm having the same issue with the Result Seeking strategy for Junit method name.

          cwa Charles Agnello added a comment - I'm having the same issue with the Result Seeking strategy for Junit method name.

          Hi @Paul, can you attach a sample XML with your multiple suites, please? I'll run it through testng-parser [1] and will try to fix the issue in the plug-in. Thanks in advance.

          [1] http://search.maven.org/#artifactdetails%7Ccom.tupilabs%7Ctestng-parser%7C0.1%7Cjar

          kinow Bruno P. Kinoshita added a comment - Hi @Paul, can you attach a sample XML with your multiple suites, please? I'll run it through testng-parser [1] and will try to fix the issue in the plug-in. Thanks in advance. [1] http://search.maven.org/#artifactdetails%7Ccom.tupilabs%7Ctestng-parser%7C0.1%7Cjar

          Cutting a new release tomorrow night. Postponing this issue for 3.4.

          kinow Bruno P. Kinoshita added a comment - Cutting a new release tomorrow night. Postponing this issue for 3.4.
          paul8620 Paul Horvath added a comment -

          <?xml version='1.0' encoding='UTF-8'?>
          <maven2-moduleset plugin="maven-plugin@1.505">
          <actions/>
          <description>Production report test</description>
          <logRotator class="hudson.tasks.LogRotator">
          <daysToKeep>-1</daysToKeep>
          <numToKeep>15</numToKeep>
          <artifactDaysToKeep>-1</artifactDaysToKeep>
          <artifactNumToKeep>-1</artifactNumToKeep>
          </logRotator>
          <keepDependencies>false</keepDependencies>
          <properties/>
          <scm class="hudson.plugins.git.GitSCM" plugin="git@1.2.0">
          <configVersion>2</configVersion>
          <userRemoteConfigs>
          <hudson.plugins.git.UserRemoteConfig>
          <name></name>
          <refspec></refspec>
          <url>git@github.com:lolaent/g4-test-scripts.git</url>
          </hudson.plugins.git.UserRemoteConfig>
          </userRemoteConfigs>
          <branches>
          <hudson.plugins.git.BranchSpec>
          <name>master</name>
          </hudson.plugins.git.BranchSpec>
          </branches>
          <disableSubmodules>false</disableSubmodules>
          <recursiveSubmodules>false</recursiveSubmodules>
          <doGenerateSubmoduleConfigurations>false</doGenerateSubmoduleConfigurations>
          <authorOrCommitter>false</authorOrCommitter>
          <clean>false</clean>
          <wipeOutWorkspace>false</wipeOutWorkspace>
          <pruneBranches>false</pruneBranches>
          <remotePoll>false</remotePoll>
          <ignoreNotifyCommit>false</ignoreNotifyCommit>
          <useShallowClone>false</useShallowClone>
          <buildChooser class="hudson.plugins.git.util.DefaultBuildChooser"/>
          <gitTool>Default</gitTool>
          <submoduleCfg class="list"/>
          <relativeTargetDir></relativeTargetDir>
          <reference></reference>
          <excludedRegions></excludedRegions>
          <excludedUsers></excludedUsers>
          <gitConfigName></gitConfigName>
          <gitConfigEmail></gitConfigEmail>
          <skipTag>false</skipTag>
          <includedRegions></includedRegions>
          <scmName></scmName>
          </scm>
          <canRoam>true</canRoam>
          <disabled>false</disabled>
          <blockBuildWhenDownstreamBuilding>false</blockBuildWhenDownstreamBuilding>
          <blockBuildWhenUpstreamBuilding>false</blockBuildWhenUpstreamBuilding>
          <triggers class="vector"/>
          <concurrentBuild>false</concurrentBuild>
          <rootModule>
          <groupId>AutomationTesting</groupId>
          <artifactId>AutomationTesting</artifactId>
          </rootModule>
          <rootPOM>webdriver/AutomationTesting/pom.xml</rootPOM>
          <goals>clean install -DtestXml=testSuiteProd.xml -Denv=production -Dbro=firefox -Dais=AIS_DRUPAL_QA -Dmaven.test.failure.ignore=true</goals>
          <aggregatorStyleBuild>true</aggregatorStyleBuild>
          <incrementalBuild>false</incrementalBuild>
          <perModuleEmail>true</perModuleEmail>
          <ignoreUpstremChanges>true</ignoreUpstremChanges>
          <archivingDisabled>false</archivingDisabled>
          <resolveDependencies>false</resolveDependencies>
          <processPlugins>false</processPlugins>
          <mavenValidationLevel>-1</mavenValidationLevel>
          <runHeadless>false</runHeadless>
          <disableTriggerDownstreamProjects>false</disableTriggerDownstreamProjects>
          <settings class="jenkins.mvn.DefaultSettingsProvider"/>
          <globalSettings class="jenkins.mvn.DefaultGlobalSettingsProvider"/>
          <reporters/>
          <publishers>
          <hudson.tasks.ArtifactArchiver>
          <artifacts>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</artifacts>
          <latestOnly>false</latestOnly>
          </hudson.tasks.ArtifactArchiver>
          <hudson.plugins.testng.Publisher plugin="testng-plugin@1.1">
          <reportFilenamePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</reportFilenamePattern>
          <escapeTestDescp>true</escapeTestDescp>
          <escapeExceptionMsg>true</escapeExceptionMsg>
          </hudson.plugins.testng.Publisher>
          </publishers>
          <buildWrappers>
          <org.jenkinsci.plugins.xvfb.XvfbBuildWrapper plugin="xvfb@1.0.7">
          <installationName>Xvfb-default</installationName>
          <screen>1024x768x24</screen>
          <debug>false</debug>
          <timeout>0</timeout>
          <displayNameOffset>1</displayNameOffset>
          <additionalOptions></additionalOptions>
          <shutdownWithBuild>false</shutdownWithBuild>
          </org.jenkinsci.plugins.xvfb.XvfbBuildWrapper>
          </buildWrappers>
          <prebuilders/>
          <postbuilders>
          <hudson.plugins.testlink.TestLinkBuilder plugin="testlink@3.1.8">
          <testLinkName>Test Link G5</testLinkName>
          <testProjectName>G4</testProjectName>
          <testPlanName>G4 - ProdSuite</testPlanName>
          <buildName>41 Charlie</buildName>
          <customFields>Java Class</customFields>
          <transactional>false</transactional>
          <failedTestsMarkBuildAsFailure>false</failedTestsMarkBuildAsFailure>
          <failIfNoResults>false</failIfNoResults>
          <executionOrderComparator/>
          <failure>false</failure>
          <resultSeekers>
          <hudson.plugins.testlink.result.TestNGClassNameResultSeeker>
          <includePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</includePattern>
          <keyCustomField>Java Class</keyCustomField>
          <includeNotes>false</includeNotes>
          <parser/>
          <attachTestNGXML>false</attachTestNGXML>
          <markSkippedTestAsBlocked>false</markSkippedTestAsBlocked>
          </hudson.plugins.testlink.result.TestNGClassNameResultSeeker>
          </resultSeekers>
          </hudson.plugins.testlink.TestLinkBuilder>
          </postbuilders>
          <runPostStepsIfResult>
          <name>FAILURE</name>
          <ordinal>2</ordinal>
          <color>RED</color>
          </runPostStepsIfResult>

          paul8620 Paul Horvath added a comment - <?xml version='1.0' encoding='UTF-8'?> <maven2-moduleset plugin="maven-plugin@1.505"> <actions/> <description>Production report test</description> <logRotator class="hudson.tasks.LogRotator"> <daysToKeep>-1</daysToKeep> <numToKeep>15</numToKeep> <artifactDaysToKeep>-1</artifactDaysToKeep> <artifactNumToKeep>-1</artifactNumToKeep> </logRotator> <keepDependencies>false</keepDependencies> <properties/> <scm class="hudson.plugins.git.GitSCM" plugin="git@1.2.0"> <configVersion>2</configVersion> <userRemoteConfigs> <hudson.plugins.git.UserRemoteConfig> <name></name> <refspec></refspec> <url>git@github.com:lolaent/g4-test-scripts.git</url> </hudson.plugins.git.UserRemoteConfig> </userRemoteConfigs> <branches> <hudson.plugins.git.BranchSpec> <name>master</name> </hudson.plugins.git.BranchSpec> </branches> <disableSubmodules>false</disableSubmodules> <recursiveSubmodules>false</recursiveSubmodules> <doGenerateSubmoduleConfigurations>false</doGenerateSubmoduleConfigurations> <authorOrCommitter>false</authorOrCommitter> <clean>false</clean> <wipeOutWorkspace>false</wipeOutWorkspace> <pruneBranches>false</pruneBranches> <remotePoll>false</remotePoll> <ignoreNotifyCommit>false</ignoreNotifyCommit> <useShallowClone>false</useShallowClone> <buildChooser class="hudson.plugins.git.util.DefaultBuildChooser"/> <gitTool>Default</gitTool> <submoduleCfg class="list"/> <relativeTargetDir></relativeTargetDir> <reference></reference> <excludedRegions></excludedRegions> <excludedUsers></excludedUsers> <gitConfigName></gitConfigName> <gitConfigEmail></gitConfigEmail> <skipTag>false</skipTag> <includedRegions></includedRegions> <scmName></scmName> </scm> <canRoam>true</canRoam> <disabled>false</disabled> <blockBuildWhenDownstreamBuilding>false</blockBuildWhenDownstreamBuilding> <blockBuildWhenUpstreamBuilding>false</blockBuildWhenUpstreamBuilding> <triggers class="vector"/> <concurrentBuild>false</concurrentBuild> <rootModule> <groupId>AutomationTesting</groupId> <artifactId>AutomationTesting</artifactId> </rootModule> <rootPOM>webdriver/AutomationTesting/pom.xml</rootPOM> <goals>clean install -DtestXml=testSuiteProd.xml -Denv=production -Dbro=firefox -Dais=AIS_DRUPAL_QA -Dmaven.test.failure.ignore=true</goals> <aggregatorStyleBuild>true</aggregatorStyleBuild> <incrementalBuild>false</incrementalBuild> <perModuleEmail>true</perModuleEmail> <ignoreUpstremChanges>true</ignoreUpstremChanges> <archivingDisabled>false</archivingDisabled> <resolveDependencies>false</resolveDependencies> <processPlugins>false</processPlugins> <mavenValidationLevel>-1</mavenValidationLevel> <runHeadless>false</runHeadless> <disableTriggerDownstreamProjects>false</disableTriggerDownstreamProjects> <settings class="jenkins.mvn.DefaultSettingsProvider"/> <globalSettings class="jenkins.mvn.DefaultGlobalSettingsProvider"/> <reporters/> <publishers> <hudson.tasks.ArtifactArchiver> <artifacts>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</artifacts> <latestOnly>false</latestOnly> </hudson.tasks.ArtifactArchiver> <hudson.plugins.testng.Publisher plugin="testng-plugin@1.1"> <reportFilenamePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</reportFilenamePattern> <escapeTestDescp>true</escapeTestDescp> <escapeExceptionMsg>true</escapeExceptionMsg> </hudson.plugins.testng.Publisher> </publishers> <buildWrappers> <org.jenkinsci.plugins.xvfb.XvfbBuildWrapper plugin="xvfb@1.0.7"> <installationName>Xvfb-default</installationName> <screen>1024x768x24</screen> <debug>false</debug> <timeout>0</timeout> <displayNameOffset>1</displayNameOffset> <additionalOptions></additionalOptions> <shutdownWithBuild>false</shutdownWithBuild> </org.jenkinsci.plugins.xvfb.XvfbBuildWrapper> </buildWrappers> <prebuilders/> <postbuilders> <hudson.plugins.testlink.TestLinkBuilder plugin="testlink@3.1.8"> <testLinkName>Test Link G5</testLinkName> <testProjectName>G4</testProjectName> <testPlanName>G4 - ProdSuite</testPlanName> <buildName>41 Charlie</buildName> <customFields>Java Class</customFields> <transactional>false</transactional> <failedTestsMarkBuildAsFailure>false</failedTestsMarkBuildAsFailure> <failIfNoResults>false</failIfNoResults> <executionOrderComparator/> <failure>false</failure> <resultSeekers> <hudson.plugins.testlink.result.TestNGClassNameResultSeeker> <includePattern>webdriver/AutomationTesting/target/surefire-reports/testng-results.xml</includePattern> <keyCustomField>Java Class</keyCustomField> <includeNotes>false</includeNotes> <parser/> <attachTestNGXML>false</attachTestNGXML> <markSkippedTestAsBlocked>false</markSkippedTestAsBlocked> </hudson.plugins.testlink.result.TestNGClassNameResultSeeker> </resultSeekers> </hudson.plugins.testlink.TestLinkBuilder> </postbuilders> <runPostStepsIfResult> <name>FAILURE</name> <ordinal>2</ordinal> <color>RED</color> </runPostStepsIfResult>

          Hi Paul,

          Thanks for including your build.xml content. Could you provide your testng-results.xml and, if possible, some screenshots with your TL and Jenkins configuration (custom field definition, build settings, etc).

          Thanks again!
          Bruno

          kinow Bruno P. Kinoshita added a comment - Hi Paul, Thanks for including your build.xml content. Could you provide your testng-results.xml and, if possible, some screenshots with your TL and Jenkins configuration (custom field definition, build settings, etc). Thanks again! Bruno

          Bump?

          kinow Bruno P. Kinoshita added a comment - Bump?

          Hi! I'm preparing a new release and postponing this issue due to the need of more information to continue. Feel free to reopen it later, and we will work on this issue again. Thanks!

          kinow Bruno P. Kinoshita added a comment - Hi! I'm preparing a new release and postponing this issue due to the need of more information to continue. Feel free to reopen it later, and we will work on this issue again. Thanks!

          People

            kinow Bruno P. Kinoshita
            paul8620 Paul Horvath
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: