Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-53663

Xcode 10 parallel builds are not supported

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Component/s: xcode-plugin
    • Labels:
      None
    • Environment:
      Xcode 10
    • Similar Issues:

      Description

      https://github.com/jenkinsci/xcode-plugin/blob/master/src/main/java/au/com/rayh/XCodeBuildOutputParser.java

      The following patterns are invalid with the new Xcode build system that allows for parallel execution of iOS text cases

      Pattern START_SUITE = Pattern.compile("Test Suite '([^/].+)'.*started at\\s+(.*)");
      Pattern END_SUITE = Pattern.compile("Test Suite '([^/].+)'.*\\S+ at\\s+(.*).");
      Pattern START_TESTCASE = Pattern.compile("Test Case '-\\[\\S+\\s+(\\S+)\\]' started.");
      Pattern END_TESTCASE = Pattern.compile("Test Case '-\\[\\S+\\s+(\\S+)\\]' passed \\((.*) seconds\\).");
      

      Here's a sample of the new output:

      16:51:22 Test suite 'MyTests' started on 'Clone 3 of iPhone 8 - MyApp.app (78101)'
      16:51:22 Test case 'MyClassTests.testBasic()' passed on 'Clone 3 of iPhone 8 - MyApp.app (78101)' (0.001 seconds)
      16:51:22 Test case 'MyClassTests.testComplicated()' passed on 'Clone 1 of iPhone 8 - MyApp.app (77847)' (3.713 seconds)
      16:51:22 Test case 'MyClassTests.testUncomplicated()' passed on 'Clone 1 of iPhone 8 - MyApp.app (77847)' (0.014 seconds)

        Attachments

          Activity

          Hide
          kazuhidet Kazuhide Takahashi added a comment - - edited

          Claus Joergensen
          I am aware of the problems you reported.
          The same problem occurs not only in the parallel execution of Xcode 10 tests but also in Xcode 9 when multiple "-destination" are specified and tested for many devices at the same time.
          Unfortunately for now retrieve the result of running the test with Xcode it is only possible from the log, and if you run multiple tests at the same time, that log can not be parsed correctly so this problem I can not solve it.

          Please tell me if anyone can come up with a smart way to solve this problem.
          We will adopt that method as soon as possible.

          Postscript
          For now, I am planning to make a modification so that it can correspond to the new log format when "Execute in parallel on simulator" is specified.
          (Or add a function to parse a ".xccovreport" ...)

          Show
          kazuhidet Kazuhide Takahashi added a comment - - edited Claus Joergensen I am aware of the problems you reported. The same problem occurs not only in the parallel execution of Xcode 10 tests but also in Xcode 9 when multiple "-destination" are specified and tested for many devices at the same time. Unfortunately for now retrieve the result of running the test with Xcode it is only possible from the log, and if you run multiple tests at the same time, that log can not be parsed correctly so this problem I can not solve it. Please tell me if anyone can come up with a smart way to solve this problem. We will adopt that method as soon as possible. Postscript For now, I am planning to make a modification so that it can correspond to the new log format when "Execute in parallel on simulator" is specified. (Or add a function to parse a ".xccovreport" ...)
          Hide
          kazuhidet Kazuhide Takahashi added a comment -

          https://issues.jenkins-ci.org/browse/JENKINS-55984

          I changed the way to obtain test results from xcodebuild to fix another problem.
          Depending on the result of that change, this problem may also be improved.

          Show
          kazuhidet Kazuhide Takahashi added a comment - https://issues.jenkins-ci.org/browse/JENKINS-55984 I changed the way to obtain test results from xcodebuild to fix another problem. Depending on the result of that change, this problem may also be improved.

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            claus_joergensen Claus Joergensen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated: