Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17960

Indicate if tests don't go to plan

    XMLWordPrintable

Details

    Description

      One of the major features of TAP is that you have a test plan.
      If my TAP starts 1..100, but only 5 results are recorded before something broke, then I want to know about it. Likewise, if 105 results are recorded, I want some kind of error indication.

      I suggest counting this as 95 skipped tests by default, possibly with an config option to treat them as failed instead.

      Attachments

        Activity

          Ascending order - Click to sort in descending order
          View 24 older comments
          kinow Bruno P. Kinoshita added a comment -

          Due to firewall policies in the office where I am atm I can't release an alpha version to the experimental update center

          I've attached a snapshot HPI with the latest code though, don't know if you can install it in some environment and try it. If so let me know if that works and feel free to update this issue.

          JENKINS-17960 is the only pending issue I'm waiting to cut a new release. Next release will focus in JVM crashes and memory management, and the following will be code review/smaller improvements.

          Thanks!
          Bruno

          kinow Bruno P. Kinoshita added a comment - Due to firewall policies in the office where I am atm I can't release an alpha version to the experimental update center I've attached a snapshot HPI with the latest code though, don't know if you can install it in some environment and try it. If so let me know if that works and feel free to update this issue. JENKINS-17960 is the only pending issue I'm waiting to cut a new release. Next release will focus in JVM crashes and memory management, and the following will be code review/smaller improvements. Thanks! Bruno
          kinow Bruno P. Kinoshita added a comment -

          TAP Plug-in snapshot 2014-03-12 HPI file

          kinow Bruno P. Kinoshita added a comment - TAP Plug-in snapshot 2014-03-12 HPI file
          jameshowe James Howe added a comment -

          This looks like it now works as I would expect.

          jameshowe James Howe added a comment - This looks like it now works as I would expect.
          kinow Bruno P. Kinoshita added a comment -

          Yay, thanks for testing it so quickly James. Cutting a new release this night, 1.18 should be available in the update center within hours.

          Thanks again
          Bruno

          kinow Bruno P. Kinoshita added a comment - Yay, thanks for testing it so quickly James. Cutting a new release this night, 1.18 should be available in the update center within hours. Thanks again Bruno
          kinow Bruno P. Kinoshita added a comment -

          Fixed in 1.18

          kinow Bruno P. Kinoshita added a comment - Fixed in 1.18

          People

            kinow Bruno P. Kinoshita
            jameshowe James Howe
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: