Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-66032

${ROBOT_PASSPERCENTAGE} for test suite

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open (View Workflow)
    • Priority: Critical
    • Resolution: Unresolved
    • Component/s: robot-plugin
    • Labels:
      None
    • Similar Issues:

      Description

      Hello,

      Is it possible to have the same variable '${ROBOT_PASSPERCENTAGE}' but working with test suites and not tests cases ? 

      We are running alot of tests suites behind the same tag, so we need to know the % of success of tests suites during a run.

        Attachments

          Activity

          Hide
          aleksisimell Aleksi Simell added a comment -

          Hi Christophe,

          How do you determine whether a suite has passed? If you have 1000 tests where 1 failed is the whole suite counted as a failure? And then you have another suite with 3 tests which all pass is your suite pass percentage then 50% even though 1002/1003 tests pass?

          Not trying to dunk on the proposal, just trying to figure out the logic how this should be implemented. At first glance this doesn't look like a too big of a task, but currently there is no such concept as suite pass percentage, so that should be implemented as well.

          Show
          aleksisimell Aleksi Simell added a comment - Hi Christophe , How do you determine whether a suite has passed? If you have 1000 tests where 1 failed is the whole suite counted as a failure? And then you have another suite with 3 tests which all pass is your suite pass percentage then 50% even though 1002/1003 tests pass? Not trying to dunk on the proposal, just trying to figure out the logic how this should be implemented. At first glance this doesn't look like a too big of a task, but currently there is no such concept as suite pass percentage, so that should be implemented as well.

            People

            Assignee:
            aleksisimell Aleksi Simell
            Reporter:
            chenry35 Christophe
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: