Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-32933

No TestNG results should mark build as Failure

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • testng-plugin
    • None

      In case of No Tests were run, or All Tests were Skipped, TestNG Plugin recognizes it as:
      "Found matching files but did not find any TestNG results."
      and treats the build as Success - whereas it should be marked as failure.

      Here's an example:

      ...
      TestNG Reports Processing: START
      Looking for TestNG results report in workspace using pattern: **/testng-results.xml
      Saving reports...
      Processing 'C:\Jenkins\jobs\Automation_Matrix_New\configurations\axis-BROWSER\FIREFOX\axis-SERVER\AUTOJEN1\axis-XML_Test_File\test_suites_QA_Trails.xml\builds\523\testng\testng-results.xml'
      Found matching files but did not find any TestNG results.
      Started calculate disk usage of build
      Finished Calculation of disk usage of build in 0 seconds
      Started calculate disk usage of workspace
      Finished Calculation of disk usage of workspace in 0 seconds
      Finished: SUCCESS

          [JENKINS-32933] No TestNG results should mark build as Failure

          Is there any updated on this , since I am also facing this issue .
          Build is marked as 'Success' in case of having only configuration failures (setup/teardown) and while all main tests get skipped
          So testng-results.xml would be like

          <testng-results skipped="11" failed="0" total="11" passed="0">
          <reporter-output></reporter-output>
          ----
          -----
          ----
          </testng-results>
          

          Sameer Jethvani added a comment - Is there any updated on this , since I am also facing this issue . Build is marked as 'Success' in case of having only configuration failures (setup/teardown) and while all main tests get skipped So testng-results.xml would be like <testng-results skipped= "11" failed= "0" total= "11" passed= "0" > <reporter-output></reporter-output> ---- ----- ---- </testng-results>

          This is something related to this
          JENKINS-20985

          You have to update config of jenkins job such that

          Sameer Jethvani added a comment - This is something related to this JENKINS-20985 You have to update config of jenkins job such that

            Unassigned Unassigned
            nmanos Noam Manos
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: