Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-72538

Allow 'SKIP' status in Robot Framework plugin to be configurable

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Minor Minor
    • robot-plugin
    • None

      In Robot Framework plugin. 'SKIP' are not taken under statistical consideration:

      Since this test has been skipped and not run. I had expected the pass rate to be: 33% in the above example.

      I understand why it's like that right now and I read your statement about the 'SKIP' situation. but in my case, it's essential to be like I mentioned.

      Is it possible to let the user decide whether to insert it into the pass rate or not?

      I suggest adding a flag for that:

                          step(
                                  [
                                          $class              : 'RobotPublisher',
                                          outputPath          : artifacts_src,
                                          outputFileName      : unite_log + "output.xml",
                                          reportFileName      : unite_log + 'report.html',
                                          logFileName         : unite_log + 'log.html',
                                          passThreshold       : env.use_pass_threshold,
                                          unstableThreshold   : env.use_unstable_threshold,
                                          disableArchiveOutput: false,
                                          otherFiles          : other_files,

                                          considreSkipUnderPassRate: true
                                  ]
                          )

      which:  considreSkiPUnderPassRate will be the new flag.

      I look inside the code: https://github.com/jenkinsci/robot-plugin/blob/master/src/main/java/hudson/plugins/robot/model/RobotResult.java

      And the change will be very small.

      In case the flag is true. change the variable in line 203 form: 'total = getOverallTotal() - getOverallSkipped()' to 'total = getOverallTotal()

      Many thanks in advance!

       

            aleksisimell Aleksi Simell
            noamla Noam
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: