Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-56496

use blueocean tests results as pass/fail/unstable criteria

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Minor Minor
    • blueocean-plugin
    • None

      Hi, my use case:

      in blueocean there is very nice parser that summarizes new/still failed tets from xunit test results.

      I am aware that i can use xunit thresholds to set build color(red/yellow/green) but it will be better just to use blueocean "New failing" detection.

      i will illustrate:

      i have a build that ended with 7 new failed tests.  there is some logic in blueocean that correctly detected all new faulures:

       

      I want to use this logic to set build result. is it possible?

       

      P.S: xunit parser is not sophisticated enough, and in this same build it reports:

      7 failures (+4) , 3 skipped (±0), 

      It ignores the fact that some test got fixed and some new got broken, and while in total the number went up only by 4, but 7 new tests got broken. 

       

          [JENKINS-56496] use blueocean tests results as pass/fail/unstable criteria

          Vlad Aginsky created issue -
          Vlad Aginsky made changes -
          Attachment New: image-2019-03-10-16-30-39-840.png [ 46343 ]
          Vlad Aginsky made changes -
          Description Original: Hi, my use case:

          in blueocean there is very nice parser that summarizes new/still failed tets from xunit test results.

          I am aware that i can use xunit tresholds to set build color(red/yellow/green) but it will be better just to use blueocean "New failing" detection.

          is it possible?
          New: Hi, my use case:

          in blueocean there is very nice parser that summarizes new/still failed tets from xunit test results.

          I am aware that i can use xunit thresholds to set build color(red/yellow/green) but it will be better just to use blueocean "New failing" detection.

          i will illustrate:

          i have a build that ended with 7 new failed tests.  there is some logic in blueocean that correctly detected all new faulures:

          !image-2019-03-10-16-30-39-840.png|width=740,height=211!

           

          I want to use this logic to set build result. is it possible?

           

          P.S: xunit parser is not sophisticated enough, and in this same build it reports:

          7 failures (+4) , 3 skipped (±0), 

          It ignores the fact that some test got fixed and some new got broken, and while in total the number went up only by 4, but 7 new tests got broken. 

           
          Vlad Aginsky made changes -
          Assignee New: Keith Zantow [ kzantow ]

          Vlad Aginsky added a comment -

           Keith Zantow, i saw that you have some expertise in this field(36298), so i  took liberty and assigned it to you.

          if it is not you, can you please advice who can help with this issue?

          Vlad Aginsky added a comment -  Keith Zantow, i saw that you have some expertise in this field( 36298 ), so i  took liberty and assigned it to you. if it is not you, can you please advice who can help with this issue?
          Gavin Mogan made changes -
          Assignee Original: Keith Zantow [ kzantow ]

            Unassigned Unassigned
            vladichko Vlad Aginsky
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: