Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-11217

Not all failure cases reported for UnitTest results

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      Hi,
      I'm using UnitTest 1.4 format reporting and have test cases which can contain multiple failure causes, the plugin only displays the first failure message though. Sample XML is below. Ideally each failure case would be displayed on a line, but concatenating them onto a single line would be OK. Is it possible to fix this?
      Ta
      Andy

      <?xml version="1.0" encoding="UTF-8" ?>
      <unittest-results failures="6" failedtests="3" tests="16" name="Samples" time="708" >
      <test suite="Samples" name="Animation" time="33"/>
      <test suite="Samples" name="Audio" time="40"/>
      <test suite="Samples" name="Basic" time="32">
          <failure message="FPS Metric: Got 223.391724 fps expected &gt;= 800.0 fps  " />
      </test>
      <test suite="Samples" name="CreateScene" time="34">
          <failure message="Error 329376 pixels differ (tolerance is 20)" />
          <failure message="FPS Metric: Got 60.240929 fps expected &gt;= 800.0 fps  " />
      </test>
      
      ... SNIP ...
      
      <test suite="Samples" name="ThirdPersonGameTemplate" time="92">
         <failure message="ERR_PROCESS_CRASHED  [exit(0)]" />
         <failure message="FPS Metric: Got 0.0 fps expected &gt;= 60.0 fps  " />
      </test>
      </unittest-results>
      

        Attachments

          Activity

          abigos Andy Bigos created issue -
          Hide
          gbois Gregory Boissinot added a comment -

          Unfortunately, pushing test results into Jenkins is transforming these results into JUnit results.
          JUnit only manages one failure element at the moment.

          Show
          gbois Gregory Boissinot added a comment - Unfortunately, pushing test results into Jenkins is transforming these results into JUnit results. JUnit only manages one failure element at the moment.
          gbois Gregory Boissinot made changes -
          Field Original Value New Value
          Status Open [ 1 ] In Progress [ 3 ]
          Hide
          gbois Gregory Boissinot added a comment -

          Can't fix it. A limitation of JUnit capabilities.
          It's a Jenkins JUnit core issue.

          Show
          gbois Gregory Boissinot added a comment - Can't fix it. A limitation of JUnit capabilities. It's a Jenkins JUnit core issue.
          gbois Gregory Boissinot made changes -
          Resolution Won't Fix [ 2 ]
          Status In Progress [ 3 ] Resolved [ 5 ]
          Hide
          abigos Andy Bigos added a comment -

          OK. I'll concat the results before passing to Jenkins. Thanks.

          Show
          abigos Andy Bigos added a comment - OK. I'll concat the results before passing to Jenkins. Thanks.
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 141436 ] JNJira + In-Review [ 189617 ]

            People

            Assignee:
            gbois Gregory Boissinot
            Reporter:
            abigos Andy Bigos
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: