Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-25728

"latest test results" not shown in project when last build failed

    XMLWordPrintable

Details

    Description

      Keeping it here, will investigate later.

      No test reports that matches acceptance-test/build/results/test_results.js found. Configuration error?
      Build step 'Publish Cucumber test result report' changed build result to FAILURE
      

      Then project page has no "latest test results" link at all.

      Also it maybe be a good idea to print [cucumber-testresult] before this messages printed to listener like it do [htmlpublisher].

      Attachments

        Activity

          teilo James Nord added a comment -

          theres 2 issues in here (its good to have separate JIRAs per issue)

          However

          Build step 'xxxx' changed build result to FAILURE
          that comes from Jenkins not from the plugin - and is set when build.setResult(Result.xxx) is called.

          The no link - is also correct.
          There are no reports to publish so the action isn't added. As the latest build has no test results how can we link to nothing?

          teilo James Nord added a comment - theres 2 issues in here (its good to have separate JIRAs per issue) However Build step 'xxxx' changed build result to FAILURE that comes from Jenkins not from the plugin - and is set when build.setResult(Result.xxx) is called. The no link - is also correct. There are no reports to publish so the action isn't added. As the latest build has no test results how can we link to nothing?

          Maybe it just usability issue, maybe i expected to have icon on project page.

          • Coverage icon is shown even if results were not parsed for latest run.
          • xUnit has "Latest Test Result (no changes)" icon that leads to lastCompletedBuild/testReport/
          integer Kanstantsin Shautsou added a comment - Maybe it just usability issue, maybe i expected to have icon on project page. Coverage icon is shown even if results were not parsed for latest run. xUnit has "Latest Test Result (no changes)" icon that leads to lastCompletedBuild/testReport/

          Then 3 issues.
          Jenkins fails steps based on Action result. That why all reporters has "Run always" checkbox (xUnit,jUnit,...), "Fail builds if no reports"(cobertura).

          integer Kanstantsin Shautsou added a comment - Then 3 issues. Jenkins fails steps based on Action result. That why all reporters has "Run always" checkbox (xUnit,jUnit,...), "Fail builds if no reports"(cobertura).
          teilo James Nord added a comment -

          I don't understand what the latestReport page could actually show for a run that has not generated any test output

          Having no test report to parse is very different from having a test report which says no tests ran (which should be hanndled).

          To me the useabilty would be worse if there was a link that then went to an empty page?

          I could create the action without the link - but that would lead to hey I thought this was clickable a minute ago...

          teilo James Nord added a comment - I don't understand what the latestReport page could actually show for a run that has not generated any test output Having no test report to parse is very different from having a test report which says no tests ran (which should be hanndled). To me the useabilty would be worse if there was a link that then went to an empty page? I could create the action without the link - but that would lead to hey I thought this was clickable a minute ago...

          Cobertura is not the best example of this checkboxes (seems xUnit has well organized UI configuration), but idea the next: https://github.com/jenkinsci/cobertura-plugin/blob/master/src/main/java/hudson/plugins/cobertura/CoberturaPublisher.java#L358-L369

          About lastCompletedBuild/testReport will check plugins.

          integer Kanstantsin Shautsou added a comment - Cobertura is not the best example of this checkboxes (seems xUnit has well organized UI configuration), but idea the next: https://github.com/jenkinsci/cobertura-plugin/blob/master/src/main/java/hudson/plugins/cobertura/CoberturaPublisher.java#L358-L369 About lastCompletedBuild/testReport will check plugins.
          teilo James Nord added a comment -

          integer the issue you are describing is covered by JENKINS-31027.

          I'm still unsure what we can link to in "latestReport" if there is no report. Users will assume that the latest report will be for the report of the lastRun - but if I just link to the last run that generated a report then this will end up confusing the majority of users (its also not how other reporters work).

          Perhaps I should rename the latestReport to "report from latest build" and then that should make everything clearer?
          but now I am wondering what I am currently doing if a build is in flight

          teilo James Nord added a comment - integer the issue you are describing is covered by JENKINS-31027 . I'm still unsure what we can link to in "latestReport" if there is no report. Users will assume that the latest report will be for the report of the lastRun - but if I just link to the last run that generated a report then this will end up confusing the majority of users (its also not how other reporters work). Perhaps I should rename the latestReport to "report from latest build" and then that should make everything clearer? but now I am wondering what I am currently doing if a build is in flight

          Hi, i'm not using anymore it and don't remember details. So closing issue.
          PS AFAIR it has no any configurations in comparison to other publishers.

          integer Kanstantsin Shautsou added a comment - Hi, i'm not using anymore it and don't remember details. So closing issue. PS AFAIR it has no any configurations in comparison to other publishers.

          Kanstantsin Shautsou the issue you are describing is covered by JENKINS-31027.
          This issue was created in 2014 and JENKINS-31027 really later.

          integer Kanstantsin Shautsou added a comment - Kanstantsin Shautsou the issue you are describing is covered by JENKINS-31027 . This issue was created in 2014 and JENKINS-31027 really later.

          People

            Unassigned Unassigned
            integer Kanstantsin Shautsou
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: