Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-38500

No failure tags in test reports

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • xcode-plugin
    • None
    • Jenkins ver. 2.18
      Xcode Plugin 1.4.9

      After updating to Xcode 8 my xcode plugin test builds are all reported as success although they contain failing tests. It seems that the "<failure ..." tags in the /test-reports/*xml files are missing, perhaps that could have something to do with the problem.

      The "<testsuite .." tag does still list the number of failing tests however.

      I will update to 1.4.11 and try that one as well but since their were no mentions about Xcode 8 in the release notes I assume that the issue is still valid.

      Addition: Same problem experienced with 1.4.11

          [JENKINS-38500] No failure tags in test reports

          Daniel Pfeiffer added a comment -

          We're seeing the same issue—except it is specifically with our UI tests where failures are being marked as successes.

          Xcode 8 changed the way UI tests report failure in the console. I've opened a pull request to address this:
          https://github.com/jenkinsci/xcode-plugin/pull/75

          Daniel Pfeiffer added a comment - We're seeing the same issue—except it is specifically with our UI tests where failures are being marked as successes. Xcode 8 changed the way UI tests report failure in the console. I've opened a pull request to address this: https://github.com/jenkinsci/xcode-plugin/pull/75

          AnneTheAgile added a comment -

          bbilling are you one the new maintainer I read about ? Thank you so much for helping. Do you like dpfeiffer's PR? I have this issue as well and would love to see it merged.
          Thank you!
          Anne
          https://issues.jenkins-ci.org/browse/JENKINS-38500
          https://github.com/jenkinsci/xcode-plugin/pull/75
          https://wiki.jenkins-ci.org/display/JENKINS/Xcode+Plugin

          AnneTheAgile added a comment - bbilling are you one the new maintainer I read about ? Thank you so much for helping. Do you like dpfeiffer 's PR? I have this issue as well and would love to see it merged. Thank you! Anne https://issues.jenkins-ci.org/browse/JENKINS-38500 https://github.com/jenkinsci/xcode-plugin/pull/75 https://wiki.jenkins-ci.org/display/JENKINS/Xcode+Plugin

            Unassigned Unassigned
            mister_mango Johan Croneby
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: