Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-46193

New test failures are reported as both new test failures and existing test failures.

    XMLWordPrintable

    Details

    • Similar Issues:
    • Epic Link:
    • Sprint:
      Blue Ocean - Candidates
    • Released As:
      1.15.0

      Description

      BlueOcean reports new test failures as both new test failures and existing test failures.

      Example

      Test pipeline and runs here -
      https://ci.blueocean.io/blue/organizations/jenkins/scratch%2Fbwalding%2F3-minute-avocados/detail/3-minute-avocados/12/tests

      Reproduction

      Consider a job with 2 builds

      Build 1, test A fails
      Build 2, test A / B fails

      Expected

      When displaying Build 2 test results, BlueOcean should report the following

      # New Failures - 1
Test B
# Existing Failures - 1
Test A

      Actual

      However BlueOcean actually displays

      # New Failures - 1
Test B
# Existing Failures - 1
Test B
Test A

      This seems redundant (and probably wrong) to me. Also note - the count is correct, but the display is wrong.

        Attachments

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          seanwhyte Sean Whyte added a comment - - edited

          This is happening to me team too. 

          In addition to this, we sometimes get a passed run followed by the new failing tests showing up in "Existing failures".

          Let me know if that seems related or should be a new separate defect.

          I am using Jenkins 2.84 with Blue Ocean 1.3.3 (also occurred in 1.3.0)

          Show
          seanwhyte Sean Whyte added a comment - - edited This is happening to me team too.  In addition to this, we sometimes get a passed run followed by the new failing tests showing up in "Existing failures". Let me know if that seems related or should be a new separate defect. I am using Jenkins 2.84 with Blue Ocean 1.3.3 (also occurred in 1.3.0)
          Hide
          Permalink
          doispi v o added a comment -

          Our team is also experiencing this problem in some of our pipelines.  Both "New failing" and "Fixed" lists are wrong. Some tests show up in these lists even if we simply re-run a build.   

          Hopefully this will be fixed soon because this feature is very useful (one of the main reasons our team is using Blue Ocean).  I am using Blue Ocean 1.4.0.

           

           

           

          Show
          doispi v o added a comment - Our team is also experiencing this problem in some of our pipelines.  Both "New failing" and "Fixed" lists are wrong. Some tests show up in these lists even if we simply re-run a build.    Hopefully this will be fixed soon because this feature is very useful (one of the main reasons our team is using Blue Ocean).  I am using Blue Ocean 1.4.0.      
          Hide
          Permalink
          borisivan boris ivan added a comment -

          Same here. I have so many people ask me about this when I send them links to that test page. For this to be the case since 2017 seems avoidable.

          Show
          borisivan boris ivan added a comment - Same here. I have so many people ask me about this when I send them links to that test page. For this to be the case since 2017 seems avoidable.
          Hide
          Permalink
          halkeye Gavin Mogan added a comment -

          https://github.com/jenkinsci/blueocean-plugin/pull/1938

          Show
          halkeye Gavin Mogan added a comment - https://github.com/jenkinsci/blueocean-plugin/pull/1938
          Hide
          Permalink
          doispi v o added a comment -

          Thanks for the update Gavin Mogan.  The issue regarding the reporting of new test failures seems to be fixed on our side. That's great.  However,  We still see problems with the list of 'Fixed' tests.   Sometimes it will list tests that were not even failing before as 'Fixed', which is confusing. 

          Show
          doispi v o added a comment - Thanks for the update Gavin Mogan .  The issue regarding the reporting of new test failures seems to be fixed on our side. That's great.  However,  We still see problems with the list of 'Fixed' tests.   Sometimes it will list tests that were not even failing before as 'Fixed', which is confusing. 

            People

            Assignee:
            halkeye Gavin Mogan
            Reporter:
            bwalding Ben Walding
            Votes:
            7 Vote for this issue
            Watchers:
            8 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: