Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-34292

Flaky annotation dropped if multiple junit files have tests with same classname

    XMLWordPrintable

    Details

    • Similar Issues:
    • Released As:
      flaky-test-handler-plugin-1.2.0

      Description

      Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: http://build.osrfoundation.org/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/).

        Attachments

          Activity

          scpeters Steve Peters created issue -
          scpeters Steve Peters made changes -
          Field Original Value New Value
          Description Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/job/gazebo-ci-pr_any-homebrew-amd64_flaky/15/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]). Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/view/main/view/GazeboRelease/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]).
          scpeters Steve Peters made changes -
          Assignee Qingzhou Luo [ seriousamlqz ] Steve Peters [ scpeters ]
          scpeters Steve Peters made changes -
          Description Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/view/main/view/GazeboRelease/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]). Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/view/main/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]).
          scpeters Steve Peters made changes -
          Description Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/view/main/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]). Test results are collected according to the classname specified in each testcase. If there are testcases with matching classnames from different junit files, only some of the results will be annotated with flakiness information (example: [http://build.osrfoundation.org/job/gazebo-ci-gazebo7-homebrew-amd64/48/testReport/%28root%29/PhysicsEngines_PhysicsMsgsTest/]).
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 170360 ] JNJira + In-Review [ 183871 ]
          vtintillier Vivien Tintillier made changes -
          Assignee Steve Peters [ scpeters ] vtintillier [ vtintillier ]
          Hide
          vtintillier Vivien Tintillier added a comment -

          I think I have the same issue with version 1.1.0, will try to investigate soon

          Show
          vtintillier Vivien Tintillier added a comment - I think I have the same issue with version 1.1.0, will try to investigate soon
          Hide
          svenjost Sven Jost added a comment -

          This is definitely related to JENKINS-66126 and might be fixed when JENKINS-66126 is released.

          Show
          svenjost Sven Jost added a comment - This is definitely related to JENKINS-66126 and might be fixed when JENKINS-66126 is released.
          svenjost Sven Jost made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          svenjost Sven Jost made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          svenjost Sven Jost made changes -
          Released As flaky-test-handler-plugin-1.2.0
          Assignee Vivien Tintillier [ vtintillier ] Sven Jost [ svenjost ]
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Fixed but Unreleased [ 10203 ]
          svenjost Sven Jost made changes -
          Status Fixed but Unreleased [ 10203 ] Closed [ 6 ]

            People

            Assignee:
            svenjost Sven Jost
            Reporter:
            scpeters Steve Peters
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: