-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
Xcode 10
The following patterns are invalid with the new Xcode build system that allows for parallel execution of iOS text cases
Pattern START_SUITE = Pattern.compile("Test Suite '([^/].+)'.*started at\\s+(.*)"); Pattern END_SUITE = Pattern.compile("Test Suite '([^/].+)'.*\\S+ at\\s+(.*)."); Pattern START_TESTCASE = Pattern.compile("Test Case '-\\[\\S+\\s+(\\S+)\\]' started."); Pattern END_TESTCASE = Pattern.compile("Test Case '-\\[\\S+\\s+(\\S+)\\]' passed \\((.*) seconds\\).");
Here's a sample of the new output:
16:51:22 Test suite 'MyTests' started on 'Clone 3 of iPhone 8 - MyApp.app (78101)'
16:51:22 Test case 'MyClassTests.testBasic()' passed on 'Clone 3 of iPhone 8 - MyApp.app (78101)' (0.001 seconds)
16:51:22 Test case 'MyClassTests.testComplicated()' passed on 'Clone 1 of iPhone 8 - MyApp.app (77847)' (3.713 seconds)
16:51:22 Test case 'MyClassTests.testUncomplicated()' passed on 'Clone 1 of iPhone 8 - MyApp.app (77847)' (0.014 seconds)
[JENKINS-53663] Xcode 10 parallel builds are not supported
https://issues.jenkins-ci.org/browse/JENKINS-55984
I changed the way to obtain test results from xcodebuild to fix another problem.
Depending on the result of that change, this problem may also be improved.
claus_joergensen
I am aware of the problems you reported.
The same problem occurs not only in the parallel execution of Xcode 10 tests but also in Xcode 9 when multiple "-destination" are specified and tested for many devices at the same time.
Unfortunately for now retrieve the result of running the test with Xcode it is only possible from the log, and if you run multiple tests at the same time, that log can not be parsed correctly so this problem I can not solve it.
Please tell me if anyone can come up with a smart way to solve this problem.
We will adopt that method as soon as possible.
Postscript
For now, I am planning to make a modification so that it can correspond to the new log format when "Execute in parallel on simulator" is specified.
(Or add a function to parse a ".xccovreport" ...)