Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-59659

XUnit plugin result displays confused by aggregation of parallel builds

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      So we use pipeline to build several platforms of our codebase, and prod/nonprod etc.  They all produce a unit test report, and the paths to the result files all contain the specific parallel branch they were built in.

      I was hoping this would be enough for it to properly identify the tests, but it seems that unless the tests have the build specific info in the test name, the graphing and result display of the tests gets very confused and will combine some tests based on race conditions which leads to a very spiky looking graph.

      I confirmed this by using the jest config in a node project we build the same way.  Jest lets you set the pattern used to build the suite name and test name. Once I set this to include the build info, the graph flattened out and remained consistent.

      In other projects we use other frameworks that you support googletest, etc.  I don't know if each of them support the option to configure the test suite/name patterns...     Could you please look at how the plugin could properly handle parallel builds for test display and graphing?

        Attachments

          Issue Links

            Activity

            ddumont Dan Dumont created issue -
            nfalco Nikolas Falco made changes -
            Field Original Value New Value
            Priority Blocker [ 1 ] Critical [ 2 ]
            nfalco Nikolas Falco made changes -
            Priority Critical [ 2 ] Trivial [ 5 ]
            nfalco Nikolas Falco made changes -
            Priority Trivial [ 5 ] Minor [ 4 ]
            nfalco Nikolas Falco made changes -
            Link This issue is caused by JENKINS-41031 [ JENKINS-41031 ]
            nfalco Nikolas Falco made changes -
            Resolution Not A Defect [ 7 ]
            Status Open [ 1 ] Closed [ 6 ]

              People

              Assignee:
              nfalco Nikolas Falco
              Reporter:
              ddumont Dan Dumont
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: