We're seeing the same problem, and I have an idea about what might be going on.
We have a setup that is using surefire for both unit and integration tests like retronym. In our case we
have 3 unit tests and 2 integration tests. When the unit test phase completes, Hudson seems to go look
for test results:
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
[HUDSON] Recording test results
Then, when the integration test phase completes Hudson seems to go look for test results again:
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0
[HUDSON] Recording test results
I think the results of the unit tests are being collected twice. In our total test count we see unit tests * 2
+ integration tests. The test result drill downs also show duplicate entries for the unit tests.
Test cases are also counted twice for any test coverage tool which executes
tests with instrumented class files