-
Bug
-
Resolution: Not A Defect
-
Minor
-
None
-
robot-plugin 3.1.0
RobotFramework 4.0
The `onlyCritical` parameter of RobotPublisher does not work correctly because criticality has been obsolete since RobotFramework 4.0.
If you set `onlyCritical: true`, all the tests are considered non-critical thus the step will always be success status.
Since RobotFramework 4.0, the criticality of tests is removed and does not output the "critical" attribute in output.xml.
As a result, the critical attribute can no longer be retrieved when parsing ouput.xml, and all tests are determined to be non-critical.
(https://github.com/robotframework/robotframework/issues/3624)
Other changes include removing the critical attribute from test elements in output.xml and changes to the result related APIs.
It does work properly and as intended as explained in the plugin documentation.
Because criticality was removed in Robot Framework 4.0, having the Use thresholds for critical tests only checkbox checked will always result in a passing step (because pass percentage is always considered to be 100% when there are 0 tests). In order to have set build status correctly, you must uncheck the checkbox or use onlyCritical: false in your pipeline when you call robot.