Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-14263

TestLink Plugin: Jenkins reports build failure when test case is failed

    • Icon: Patch Patch
    • Resolution: Not A Defect
    • Icon: Major Major
    • testlink-plugin
    • Found on Windows; it may be found in other platforms as well

      I'm building QA environment where test cases can be managed in TestLink and automated tests can be executed using Jenkins.

      I have followed instructions in 'Jenkins TestLink Plug-in Tutorial' to execute automated tests.

      http://tupilabs.com/books/jenkins-testlink-plugin-tutorial/en/

      Jenkins successfully exectuted 'Test Current time' test case and its status is marked as 'Passed' in TestLink

      When 'Test Current time' fails, it results in build failure (see Jenkins console output below) and failure is not reported to TestLink.

      -------------------------------------------------------
      T E S T S
      -------------------------------------------------------
      Running jenkins.plugins.testlink.examples.TestCurrentTime
      Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.563 sec <<< FAILURE!

      Results :

      Failed tests: testCurrentTime(jenkins.plugins.testlink.examples.TestCurrentTime): expected:<true> but was:<false>

      Tests run: 1, Failures: 1, Errors: 0, Skipped: 0

      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 53.719s
      [INFO] Finished at: Thu Jun 21 16:31:01 EDT 2012
      [INFO] Final Memory: 124M/247M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project jenkins-testlink-plugin-tutorial: There are test failures.
      [ERROR]
      [ERROR] Please refer to C:\Jenkin\jobs\testMaven\workspace\target\surefire-reports for the individual test results.
      [ERROR] -> [Help 1]
      [ERROR]
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR]
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
      Build step 'Invoke top-level Maven targets' marked build as failure
      Finished: FAILURE

          [JENKINS-14263] TestLink Plugin: Jenkins reports build failure when test case is failed

          The "jenkins-plugin-runtime" component is unrelated to TestLink Plugin - it's a runtime for running Ruby plugins in Jenkins. Removing component and setting assignee to "automatic".

          Jørgen Tjernø added a comment - The "jenkins-plugin-runtime" component is unrelated to TestLink Plugin - it's a runtime for running Ruby plugins in Jenkins. Removing component and setting assignee to "automatic".

          Hi Karthik,

          Could you share more about your job configuration, please? Are you using "clean test" as top level maven build step? It would be useful if you could post some pictures of your job and testlink configuration, or detailed configuration

          Thanks
          -B

          Bruno P. Kinoshita added a comment - Hi Karthik, Could you share more about your job configuration, please? Are you using "clean test" as top level maven build step? It would be useful if you could post some pictures of your job and testlink configuration, or detailed configuration Thanks -B

          Hi Karthik! Now I've noticed that the build is failing and not the tests. Failed tests don't mark the build as FAILURE (unless you say so, under advanced settings). Try reviewing your settings in your build, and let me know if there is any outdated information in the plug-in tutorial.

          Cheers, B

          Bruno P. Kinoshita added a comment - Hi Karthik! Now I've noticed that the build is failing and not the tests. Failed tests don't mark the build as FAILURE (unless you say so, under advanced settings). Try reviewing your settings in your build, and let me know if there is any outdated information in the plug-in tutorial. Cheers, B

          Fixed in 3.1.7 (available from update-center in the next hours)

          Bruno P. Kinoshita added a comment - Fixed in 3.1.7 (available from update-center in the next hours)

            kinow Bruno P. Kinoshita
            thenna Karthik T
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: