Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-4197

better jUnit results for specified build - history/future info

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major Major
    • junit-plugin
    • None
    • Platform: All, OS: All

      When clicked on JUnit results (build/single test) for build #XYZ Hudson reports
      PASS/FAILED/IGNORED info only for "this time" = "this build". I am missing
      informations about future and past for result of a tests.

      • When they firstly failed from last build where they with pass (+ link to that
        build) = history for test
      • When they firstly pass from this build (+ link to that build) = future for
        that test

      Example:

      Lets have test1 and test2.

      Lets have builds:
      #8 both failed
      #9 test1 passed
      #10 test1 failed
      #11 test1 failed, test2 failed
      #12 build aborted - compilation failure, no test runned
      #13 test1 passed, test2 failed;
      #14 test1 passed.

      jUnit results for builds
      #14

      • test1 pass
      • test2 pass

      #13

      • test1 pass
      • test2 failed (first failed in #11)

      #12
      no results

      #11

      • test1 failed (already fixed in #13, first failed in #10)
      • test2 failed (first failed in this build)

      and so on...

      Inspiration from Teamcity, this feature is only reason in our company for
      running both Hudson (free, flexible, open source, more plugins (btw: thanks for
      Selenium and Swarm), no limits like TC) and Teamcity (better reports, QA can´t
      work without it - find where some test first failed in line of builds in Hudson
      is hardcore work (if this info even exists because of "discard old builds function")

      more at known URL
      http://www.jetbrains.com/teamcity/features/code_quality.html#Test_Count

          [JENKINS-4197] better jUnit results for specified build - history/future info

          hanys added a comment -

          Created an attachment (id=833)
          sample

          hanys added a comment - Created an attachment (id=833) sample

          hanys added a comment -

          Update:
          There is already mechanism for past/history in Hudson. Problem is, that it´s
          "too deep". On specified test result page (URL:
          MODULE_NAME/BUILD_NUBMER/testReport/PACKAGE_NAME/TEST_NAME/fullTextTitle) is
          info about "Fixed/Regression" and even "Failing for the past 1 build (Since
          Unstable#2297 )"

          But that´s the problem - in TeamCity this info is visible on agregate test
          result page, so I don´t have to click on every failing test to see how long
          "this" test is failing. So it is similar to my another usability issue - #4240

          So expected result for me is:

          a)

          On build result page, section Test results

          NOW:
          Test Result (1 failure / +1)

          • ool.manager.cms.impl.ArticleManagerDatabaseTest.getLastArticles

          FUTURE:

          Test Result (1 failure / +1)

          • (Since Unstable#2297)
            ool.manager.cms.impl.ArticleManagerDatabaseTest.getLastArticles

          b)

          Same info as two columns in table Test Result (url BUILD_NUMBER\testReport)

          hanys added a comment - Update: There is already mechanism for past/history in Hudson. Problem is, that it´s "too deep". On specified test result page (URL: MODULE_NAME/BUILD_NUBMER/testReport/PACKAGE_NAME/TEST_NAME/fullTextTitle) is info about "Fixed/Regression" and even "Failing for the past 1 build (Since Unstable#2297 )" But that´s the problem - in TeamCity this info is visible on agregate test result page, so I don´t have to click on every failing test to see how long "this" test is failing. So it is similar to my another usability issue - #4240 So expected result for me is: a) On build result page, section Test results NOW: Test Result (1 failure / +1) ool.manager.cms.impl.ArticleManagerDatabaseTest.getLastArticles FUTURE: Test Result (1 failure / +1) (Since Unstable#2297) ool.manager.cms.impl.ArticleManagerDatabaseTest.getLastArticles b) Same info as two columns in table Test Result (url BUILD_NUMBER\testReport)

            Unassigned Unassigned
            hanys hanys
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: