Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-66032

${ROBOT_PASSPERCENTAGE} for test suite

XMLWordPrintable

    • Icon: New Feature New Feature
    • Resolution: Fixed
    • Icon: Critical Critical
    • robot-plugin
    • None

      Hello,

      Is it possible to have the same variable '${ROBOT_PASSPERCENTAGE}' but working with test suites and not tests cases ? 

      We are running alot of tests suites behind the same tag, so we need to know the % of success of tests suites during a run.

          [JENKINS-66032] ${ROBOT_PASSPERCENTAGE} for test suite

          Aleksi Simell added a comment -

          Hi chenry35,

          How do you determine whether a suite has passed? If you have 1000 tests where 1 failed is the whole suite counted as a failure? And then you have another suite with 3 tests which all pass is your suite pass percentage then 50% even though 1002/1003 tests pass?

          Not trying to dunk on the proposal, just trying to figure out the logic how this should be implemented. At first glance this doesn't look like a too big of a task, but currently there is no such concept as suite pass percentage, so that should be implemented as well.

          Aleksi Simell added a comment - Hi chenry35 , How do you determine whether a suite has passed? If you have 1000 tests where 1 failed is the whole suite counted as a failure? And then you have another suite with 3 tests which all pass is your suite pass percentage then 50% even though 1002/1003 tests pass? Not trying to dunk on the proposal, just trying to figure out the logic how this should be implemented. At first glance this doesn't look like a too big of a task, but currently there is no such concept as suite pass percentage, so that should be implemented as well.

          Aleksi Simell added a comment -

          We decided not to add this functionality to the plugin because of lack of specification.

          Aleksi Simell added a comment - We decided not to add this functionality to the plugin because of lack of specification.

            aleksisimell Aleksi Simell
            chenry35 Christophe
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: