Search

Type: Bug
Resolution: Unresolved
Priority: Minor
Component/s: core, junit-plugin
Labels:
- test-statistics-graph
Environment:
Windows Server
Jenkins 2.189
Latest plugins

Similar Issues:
Powered by SuggestiMate

Show

I'm not sure if this is a problem in xUnit or pipeline multibranch plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:

stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Edgars Batna created issue - 2019-08-16 08:22

Edgars Batna made changes - 2019-08-16 08:22

Description

Original: I'm not sure if this a problem in xUnit plugin. We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

New: I'm not sure if this is a problem in xUnit plugin. We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Edgars Batna made changes - 2019-08-16 08:22

Description

Original: I'm not sure if this is a problem in xUnit plugin. We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

New: I'm not sure if this is a problem in xUnit plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Edgars Batna made changes - 2019-08-16 08:24

Description

Original: I'm not sure if this is a problem in xUnit plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

New: I'm not sure if this is a problem in xUnit plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Edgars Batna made changes - 2019-08-16 08:24

Component/s

New: multi-branch-project-plugin (not Pipeline) [ 21127 ]

Edgars Batna made changes - 2019-08-16 08:24

Description

Original: I'm not sure if this is a problem in xUnit plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

New: I'm not sure if this is a problem in xUnit or pipeline multibranch plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
      // This might fail and abort consequent stages.
    }
    finally
    { // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Nikolas Falco made changes - 2019-08-16 08:55

Component/s		New: junit-plugin [ 15499 ]
Component/s	Original: xunit-plugin [ 15636 ]

Nikolas Falco added a comment - 2019-08-16 08:56 - edited

The behavior of trend result is part of junit plugin.

Nikolas Falco added a comment - 2019-08-16 08:56 - edited The behavior of trend result is part of junit plugin.

Nikolas Falco made changes - 2019-08-16 08:56

Assignee

Original: Nikolas Falco [ nfalco ]

New: Matthew DeTullio [ mjdetullio ]

Edgars Batna added a comment - 2022-07-12 13:25

I tried to locate where the job trend chart disappears, but can't. Can someone point me at where this behavior is exactly so I can nuke it out of existence?

Edgars Batna added a comment - 2022-07-12 13:25 I tried to locate where the job trend chart disappears, but can't. Can someone point me at where this behavior is exactly so I can nuke it out of existence?

Assignee:: Unassigned

Reporter:: Edgars Batna

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Created:: 2019-08-16 08:22

Updated:: 2022-07-15 15:19

Filters

Favorite Filters

Export - CSV (All fields)

Export - CSV (Current fields)

Search

Test Result Trend chart not showing on Multibranch Pipeline branch if last build has no test results

Filters

Favorite Filters

Details

Description

Attachments

Activity

Collapse comment: Nikolas Falco added a comment - 2019-08-16 08:56, Edited by Nikolas Falco - 2019-08-16 08:57

Expand comment: Nikolas Falco added a comment - 2019-08-16 08:56, Edited by Nikolas Falco - 2019-08-16 08:57

Collapse comment: Edgars Batna added a comment - 2022-07-12 13:25

Expand comment: Edgars Batna added a comment - 2022-07-12 13:25

People

Dates