Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-51392

JUnit Health report amplification factor ignored in matrix projects

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • matrix-project-plugin
    • None
    • Jenkins ver. 2.107.3
      Matrix Project Plugin 1.13
      JUnit Plugin 1.24

      When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the Health report amplification factor configured in the job.

      A factor of 0 also does not disabled test health reporting as advertised.

      Steps to reproduce

      1. Create a new Multi-Configuration Project.
      2. Add an arbitrary (e.g userdefined) axis with one or more values.
      3. Add a build step that creates a JUnit result file: 
        <?xml version="1.0" encoding="utf-8"?>
<testsuites>
   <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
      <testcase classname="test" name="success" />
      <testcase classname="test" name="failure">
         <failure>This test failed.</failure>
      </testcase>
   </testsuite>
</testsuites>
      4. Add Publish JUnit post-build action.
      5. Set Health report amplification factor to any value other than 1.0.
      6. Run the project.
      7. Observe the weather report.

          [JENKINS-51392] JUnit Health report amplification factor ignored in matrix projects

          Yoerg created issue -
          Yoerg made changes -
          Description Original: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 does not disabled test health reporting as advertised.           		New: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 does not disabled test health reporting as advertised.

          Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          <?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.
          Yoerg made changes -
          Description Original: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 does not disabled test health reporting as advertised.

          Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          <?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.           		New: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
           <?xml version="1.0" encoding="utf-8"?>
           <testsuites>
           <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
           <testcase classname="test" name="success" />
           <testcase classname="test" name="failure">
           <failure>This test failed.</failure>
           </testcase>
           </testsuite>
           </testsuites>
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.
          Yoerg made changes -
          Description Original: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
           <?xml version="1.0" encoding="utf-8"?>
           <testsuites>
           <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
           <testcase classname="test" name="success" />
           <testcase classname="test" name="failure">
           <failure>This test failed.</failure>
           </testcase>
           </testsuite>
           </testsuites>
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.           		New: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          {noformat}<?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>{noformat}
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.
          Yoerg made changes -
          Description Original: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a New Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          {noformat}<?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>{noformat}
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.           		New: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a new Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          {noformat}<?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>{noformat}
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.
          Yoerg made changes -
          Description Original: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a new Multi-Configuration Project.
           # Add a arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          {noformat}<?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>{noformat}
           # Add Publish JUnit post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.           		New: When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the _Health report amplification factor_ configured in the job.

          A factor of 0 also does not disabled test health reporting as advertised.
          h3. Steps to reproduce
           # Create a new Multi-Configuration Project.
           # Add an arbitrary (e.g userdefined) axis with one or more values.
           # Add a build step that creates a JUnit result file:
          {noformat}<?xml version="1.0" encoding="utf-8"?>
          <testsuites>
             <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
                <testcase classname="test" name="success" />
                <testcase classname="test" name="failure">
                   <failure>This test failed.</failure>
                </testcase>
             </testsuite>
          </testsuites>{noformat}
           # Add _Publish JUnit_ post-build action.
           # Set _Health report amplification factor_ to any value other than 1.0.
           # Run the project.
           # Observe the weather report.

            kohsuke Kohsuke Kawaguchi
            yoerg Yoerg
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: