-
Bug
-
Resolution: Unresolved
-
Minor
-
None
-
Jenkins 1.656
Junit plugin 1.15
Total suite duration is shown for subgroups of tests
Steps:
- Our test tool generates XML report in the following junit-like format:
<?xml version='1.0' encoding='UTF-8' standalone='yes' ?> <testsuite errors="0" failures="0" skipped="0" tests="6"> <testcase name="test1" classname="tt.fixing.execution1.aaa1.bbb1" time="10" /> <testcase name="test2" classname="tt.fixing.execution1.aaa1.bbb2" time="10" /> <testcase name="test3" classname="tt.fixing.execution1.aaa1.bbb2" time="10" /> <testcase name="test4" classname="tt.fixing.execution1.aaa2.bbb3" time="10" /> <testcase name="test5" classname="tt.fixing.execution1.aaa2.bbb3" time="10" /> <testcase name="test6" classname="tt.fixing.execution2.ccc1.ddd1" time="10" /> <testcase name="test7" classname="tt.fixing.execution2.ccc1.ddd1" time="10" /> <testcase name="test8" classname="tt.fixing.execution2.ccc2.ddd3" time="10" /> <testcase name="test9" classname="tt.fixing.execution2.ccc2.ddd4" time="10" /> <testcase name="t1" classname="tt.other.group" time="10" /> <testcase name="t2" classname="tt.other.group" time="10" /> </testsuite>
- plugin parses it successfully
- open page like http://host/job/test-job/10/testReport -> see correct duration for tt.fixing.execution1.aaa1 package - 30s
- open page http://host/job/test-job/10/testReport/tt.fixing.execution1.aaa1/
Expected result:
See proper duration for subgroups like bbb1 and bbb2 - 10s and 20s. See before.png
Actual result:
See full suite (sum of tt.*) duration for subgroups like bbb1 and bbb2 - 1m50s and 1m50s. See after.png
Workaround:
downgrade junit plugin to 1.10 version
- is related to
-
JENKINS-34666 JUnit test durations accounted improperly
- Resolved
-
JENKINS-34274 Duration testsuite is not read from report.
- Closed
-
JENKINS-35407 Time duration of testsuites and testsuite nodes not the sum of the testcase
- Closed