• Type: Bug
• Resolution: Unresolved
• Priority: Critical
• Component/s: cppunit-plugin, jenkins-cloudformation-plugin
• Labels:

  • builds
  • testng
  • unittests
• Environment:

  both unix and solaris

[JENKINS-11980] some unit test failed but build is passed

Collapse comment: Gregory Boissinot added a comment - 2011-12-12 12:14

Gregory Boissinot added a comment - 2011-12-12 12:14

Could you specify your plugins versions (xUnit, CppUnit, ...)?
Could you then attach your job configuration file (config.xml in $JENKINS_HOME/jobs/<job_name>)?
And could you also upload your CppUnit result files?
I'll try to reproduce the issue.
Thanks

Expand comment: Gregory Boissinot added a comment - 2011-12-12 12:14

Gregory Boissinot added a comment - 2011-12-12 12:14 Could you specify your plugins versions (xUnit, CppUnit, ...)? Could you then attach your job configuration file (config.xml in $JENKINS_HOME/jobs/<job_name>)? And could you also upload your CppUnit result files? I'll try to reproduce the issue. Thanks

Collapse comment: Andrey Alexeenko added a comment - 2011-12-13 08:52

Andrey Alexeenko added a comment - 2011-12-13 08:52

Our plugin versions are:
Jenkins xUnit plugin 1.32
Hudson cppunit plugin 1.10
Jenkins Cppcheck Plug-in 1.0.2

We've done some investigations and found that the problem is in xUnit plugin. Here is cut from job console:

<Statistics>
<Tests>14548</Tests>
<FailuresTotal>1</FailuresTotal>
<Errors>0</Errors>
<Failures>1</Failures>
</Statistics>
</TestRun>
[xUnit] [INFO] - Starting to record.
[xUnit] [INFO] - Processing CppUnit-1.x
[xUnit] [INFO] - [CppUnit-1.x] - 1 test report file(s) were found with the pattern '**/results.xml' relative to '<<<Project path>>>' for the testing framework 'CppUnit-1.x'.
[xUnit] [INFO] - Setting the build status to SUCCESS
[xUnit] [INFO] - Stopping recording.

as you can see xUnit sets build status to SUCCESS inspite of failed test.

Expand comment: Andrey Alexeenko added a comment - 2011-12-13 08:52

Andrey Alexeenko added a comment - 2011-12-13 08:52 Our plugin versions are: Jenkins xUnit plugin 1.32 Hudson cppunit plugin 1.10 Jenkins Cppcheck Plug-in 1.0.2 We've done some investigations and found that the problem is in xUnit plugin. Here is cut from job console: <Statistics> <Tests>14548</Tests> <FailuresTotal>1</FailuresTotal> <Errors>0</Errors> <Failures>1</Failures> </Statistics> </TestRun> [xUnit] [INFO] - Starting to record. [xUnit] [INFO] - Processing CppUnit-1.x [xUnit] [INFO] - [CppUnit-1.x] - 1 test report file(s) were found with the pattern '**/results.xml' relative to '<<<Project path>>>' for the testing framework 'CppUnit-1.x'. [xUnit] [INFO] - Setting the build status to SUCCESS [xUnit] [INFO] - Stopping recording. as you can see xUnit sets build status to SUCCESS inspite of failed test.