Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-64525

In BlueOcean, checkError is always green even if the wrapped test failed

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      While developing a matrix test for https://github.com/networkupstools/nut/pull/947 I found that it is inconvenient to have the whole crossplatform test suite fail while we are cleaning it up vs. new linters.

      So I wrapped the tests into `checkError()

      {...}` closures to still have a verdict on every individual test. And saw that everything came up green... except the overall result is red (as anticipated) – nut-jenkinsfile-869-screenshot-catchError-redAllGreens.png

      I began looking into individual Blue Ocean test results and found many failures (that were expected). In fact, not only the BO circles are green for those failed tests, but also the hovering tooltips are green despite the test step log being correctly failed and red – nut-jenkinsfile-869-screenshot-catchError-cropped.png

      Finally, changing the code block wrapping into `warnError() {...}

      ` did highlight the individual tests (icons and tooltips) as unstable, and marked the overall build unstable – nut-jenkinsfile-869-screenshot-warnError-unstable.png for overall and nut-jenkinsfile-869-screenshot-warnError.png for the failed test's red log.

        Attachments

          Activity

          jimklimov Jim Klimov created issue -

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            jimklimov Jim Klimov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: