When running JUnit4 tests (using buckminster in our case, but I guess this is not relevant), failing class initializations (@BeforeClass) report the initialization as a failed additional test. All test cases located in this class however are reported as "passed", while "skipped" would be more appropriate.

I'll attach

• the test job definition
• a small demo test suite which five test classes (each of them having a different behavior: success, ignored, assertionfailure, exception, exception in class setup)
• screenshots showing the test reports generated (the uploaded test suite gives produced run#27)
• the JUnit xml output generated by buckminster (calling junit) and used to produce the report (de.logiball.ci.testfailure.test_JUnit.xml)
• the junitResult.xml generated from that

The reports shown are misleading at least in case of "exception in class setup", I would guess also in case of "ignored" (while I am not sure where to report those two cases; mixing intentionally skipped tests with those skipped by an initialization error may also be a bad idea).