I see other CI systems with a Quarantine feature for their JUnit testing.
      How about Jenkins keeps pace?

      Quarantine is a reporting feature. The idea of the feature is that intermittent or misbehaving tests can be quarantined. This means that they wouldn't be reported in the totals of passing/failing tests and would not affect the pass/fail status of the Jenkins job. The tests can later be removed from quarantine when they are consistently passing or otherwise behaving well.

      The quarantine feature wouldn't change whether a test executes, but rather how it is reported.

          [JENKINS-14089] JUnit report - Quarantine intermittent tests

          John Muczynski created issue -

          samuel nobs added a comment -

          does anyone know if this is eventually going to end up in jenkins, or do we need to write a plugin?

          samuel nobs added a comment - does anyone know if this is eventually going to end up in jenkins, or do we need to write a plugin?

          Let's write a plug-in. I wonder what it would take to do that.

          John Muczynski added a comment - Let's write a plug-in. I wonder what it would take to do that.

          samuel nobs added a comment -

          i think looking at the claim plugin (https://wiki.jenkins-ci.org/display/JENKINS/Claim+plugin) and then going from there would be an easy approach, but first we'd need to come up with a list of features we want

          samuel nobs added a comment - i think looking at the claim plugin ( https://wiki.jenkins-ci.org/display/JENKINS/Claim+plugin ) and then going from there would be an easy approach, but first we'd need to come up with a list of features we want

          Claim would be a good way to see how to add a new link into the UI for a new report. I've never used Claim.

          Understanding how to work with JUnit might be gotten from looking at DistTest. I've never used DistTest.
          DistTest Plugin — This plugin allows distribute JUnit tests to all slaves in a specified label for a project.

          Better still LabeledTestGroupsPublisher might be real handy to label tests as Quarantined. I've never used LabeledTestGroupsPublisher.
          LabeledTestGroupsPublisher Plugin — This plugin provides the functionality to group tests by types, such as "unit test", "smoke test", "regression test", etc.

          It might be worth mentioning:
          Test In Progress Plugin — This plugin allows you to see how the junit tests progress during a build.

          Tell me, Samuel, do you know anything about getting a plugin hosted? Because I know nothing about that aspect.

          John Muczynski added a comment - Claim would be a good way to see how to add a new link into the UI for a new report. I've never used Claim. Understanding how to work with JUnit might be gotten from looking at DistTest. I've never used DistTest. DistTest Plugin — This plugin allows distribute JUnit tests to all slaves in a specified label for a project. Better still LabeledTestGroupsPublisher might be real handy to label tests as Quarantined. I've never used LabeledTestGroupsPublisher. LabeledTestGroupsPublisher Plugin — This plugin provides the functionality to group tests by types, such as "unit test", "smoke test", "regression test", etc. It might be worth mentioning: Test In Progress Plugin — This plugin allows you to see how the junit tests progress during a build. Tell me, Samuel, do you know anything about getting a plugin hosted? Because I know nothing about that aspect.

          samuel nobs added a comment -

          i don't know anything about getting a plugin hosted, but should be easy enough to find out. my biggest problem right now is to get approval to spend time on writing the plugin during work hours...

          samuel nobs added a comment - i don't know anything about getting a plugin hosted, but should be easy enough to find out. my biggest problem right now is to get approval to spend time on writing the plugin during work hours...
          Alexey Larsky made changes -
          Link New: This issue duplicates JENKINS-16054 [ JENKINS-16054 ]

          samuel nobs added a comment -

          ki82, do you think it would be appropriate to absorb this functionality in the claim plugin?

          samuel nobs added a comment - ki82 , do you think it would be appropriate to absorb this functionality in the claim plugin?
          samuel nobs made changes -
          Labels New: junit quarantine

          Hm. That's a thought. I haven't used claim. I have the impression that you claim a BUILD. But if it were married with Quarantine, then you could claim JUnit tests, or packages full of them. Or all the new failures in a build, or just check mark half of them.

          I suppose that if the build only had one new commit, then you could automatically attribute failures to the commit owner.

          John Muczynski added a comment - Hm. That's a thought. I haven't used claim. I have the impression that you claim a BUILD. But if it were married with Quarantine, then you could claim JUnit tests, or packages full of them. Or all the new failures in a build, or just check mark half of them. I suppose that if the build only had one new commit, then you could automatically attribute failures to the commit owner.

            samsta samuel nobs
            johnstosh John Muczynski
            Votes:
            14 Vote for this issue
            Watchers:
            13 Start watching this issue

              Created:
              Updated: