Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-20985

TestNG plugin should has a possibility to use thresholds for failed tests

    • Icon: New Feature New Feature
    • Resolution: Fixed
    • Icon: Major Major
    • testng-plugin
    • None

      Current version of TestNG plugin does not have a possibility to use threshold values for failed and skipped tests. If some build has at least one failed test, then this build will be marked as unstable.
      Maybe it would be better to have some mechanism to mark build as successfull instead of unstable with using a threshold value for failed tests.

          [JENKINS-20985] TestNG plugin should has a possibility to use thresholds for failed tests

          Nikolay Driuchatyi created issue -
          Nikolay Driuchatyi made changes -
          Description Original: Current version of TestNG plugin does not have a possibility to use thresholds values for failed and skipped tests. If some build has at least one skipped or failed test then this build will be marked as unstable.
          I suppose that would be good to have some mechanism to leave build as successfully instead of unstable with using of threshold values for skipped/failed tests.
          New: Current version of TestNG plugin does not have a possibility to use threshold values for failed and skipped tests. If some build has at least one failed test, then this build will be marked as unstable.
          Maybe it would be better to have some mechanism to mark build as successfull instead of unstable with using a threshold value for failed tests.
          Nikolay Driuchatyi made changes -
          Summary Original: TestNG plugin should has a possibility to use thresholds for failed/skipped tests New: TestNG plugin should has a possibility to use thresholds for failed tests
          Gavin Gray made changes -
          Assignee Original: Nalin Makar [ nullin ] New: Gavin Gray [ gavingray ]
          Gavin Gray made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]
          Gavin Gray made changes -
          Assignee Original: Gavin Gray [ gavingray ] New: Nalin Makar [ nullin ]
          Gavin Gray made changes -
          Attachment New: Screen Shot 2014-01-10 at 12.00.38 PM.png [ 24986 ]
          Assignee Original: Nalin Makar [ nullin ] New: Gavin Gray [ gavingray ]
          Nalin Makar made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: In Progress [ 3 ] New: Resolved [ 5 ]
          Cam Spencer made changes -
          Link New: This issue is related to JENKINS-34822 [ JENKINS-34822 ]
          James Theisen made changes -
          Resolution Original: Fixed [ 1 ]
          Status Original: Resolved [ 5 ] New: Reopened [ 4 ]
          Nalin Makar made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: Reopened [ 4 ] New: Resolved [ 5 ]

            gavingray Gavin Gray
            ndriuchatyi Nikolay Driuchatyi
            Votes:
            3 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: