Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-15401

support TODO directive to not fail such tests

    XMLWordPrintable

Details

    Description

      Quoting
      http://testanything.org/wiki/index.php/TAP_version_13_specification#TODO_tests the spec says:

      TODO tests

      If the directive starts with # TODO, the test is counted as a todo test, and the text after TODO is the explanation.

      not ok 13 # TODO bend space and time

      Note that if the TODO has an explanation it must be separated from TODO by a space.

      These tests represent a feature to be implemented or a bug to be fixed and act as something of an executable "things to do" list. They are not expected to succeed. Should a todo test point begin succeeding, the harness should report it as a bonus. This indicates that whatever you were supposed to do has been done and you should promote this to a normal test point.

      AFAICT the TAP plugin doesn't seem to take care of the TODO directive accordingly though, therefore marking test runs as failures even though they should be fine.

      Example:

      http://michael-prokop.at/screeni/gkrellShoot_12-10-04_165641.png

      Attachments

        Activity

          mika Michael Prokop created issue -
          kinow Bruno P. Kinoshita made changes -
          Field Original Value New Value
          Status Open [ 1 ] In Progress [ 3 ]
          kinow Bruno P. Kinoshita made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          kinow Bruno P. Kinoshita made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          kinow Bruno P. Kinoshita made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 146135 ] JNJira + In-Review [ 206190 ]

          People

            kinow Bruno P. Kinoshita
            mika Michael Prokop
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: