-
Improvement
-
Resolution: Fixed
-
Minor
-
None
-
-
5.0.0
In Robot Framework plugin. 'SKIP' are not taken under statistical consideration:
Since this test has been skipped and not run. I had expected the pass rate to be: 33% in the above example.
I understand why it's like that right now and I read your statement about the 'SKIP' situation. but in my case, it's essential to be like I mentioned.
Is it possible to let the user decide whether to insert it into the pass rate or not?
I suggest adding a flag for that:
step(
[
$class : 'RobotPublisher',
outputPath : artifacts_src,
outputFileName : unite_log + "output.xml",
reportFileName : unite_log + 'report.html',
logFileName : unite_log + 'log.html',
passThreshold : env.use_pass_threshold,
unstableThreshold : env.use_unstable_threshold,
disableArchiveOutput: false,
otherFiles : other_files,
considreSkipUnderPassRate: true
]
)
which: considreSkiPUnderPassRate will be the new flag.
I look inside the code: https://github.com/jenkinsci/robot-plugin/blob/master/src/main/java/hudson/plugins/robot/model/RobotResult.java
And the change will be very small.
In case the flag is true. change the variable in line 203 form: 'total = getOverallTotal() - getOverallSkipped()' to 'total = getOverallTotal()'
Many thanks in advance!
- is related to
-
JENKINS-71249 Remove support for Robot Framework 3.x
- Open