Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-11353

Recognize test results from eviware:maven-soapui-plugin

      maven-soap-ui plugin is capable of outputting surefire/junit style reports: http://www.soapui.org/Test-Automation/maven-2x.html

      If using freestyle project in jenkins, can specify to look in report output directory and jenkins will register the tests (test results on project show them).
      If using maven project, these tests do not show up.

      There's good info here about setting maven,soapui tests and jenkins up
      http://www.sdn.sap.com/irj/scn/weblogs?blog=/pub/wlg/22420

      In comments at the bottom, you can see that jenkins will not recognize tests by default. Workaround is to use a freestyle project, but then we lose ability to have things like the 'perform maven release' button on the job.

      Have investigated this, seems to be an issue with hudson.maven.reporters.SurefireArchiver needing to have every plugin registered that it will consider test reports from. Since it's hardcoded into the file, guess the simplest way to fix this is to patch it to include the soapui plugin.

      Seems similar to this request for failsafe plugin: https://issues.jenkins-ci.org/browse/JENKINS-4229

          [JENKINS-11353] Recognize test results from eviware:maven-soapui-plugin

          Nathan McDonald created issue -

          My attempt at adding this to SurefireArchiver.java

          patched against tagged version 1.434

          Nathan McDonald added a comment - My attempt at adding this to SurefireArchiver.java patched against tagged version 1.434
          Nathan McDonald made changes -
          Attachment New: SurefireArchiver.java.diff [ 20925 ]

          Sorry, just realised i did that last diff in the wrong direction. this is correct

          Nathan McDonald added a comment - Sorry, just realised i did that last diff in the wrong direction. this is correct
          Nathan McDonald made changes -
          Attachment New: SurefireArchiver.java.diff [ 20926 ]

          the soapui plugin config we are using is below:

          <plugin>
             <groupId>eviware</groupId>
             <artifactId>maven-soapui-plugin</artifactId>
             <version>3.6.1</version>
             
             <executions>
                <execution>
                   <id>start-soapui-mocks</id>
                   <phase>pre-integration-test</phase>
                   <goals>
                      <goal>mock</goal>
                   </goals>
                   <configuration>
                      <noBlock>true</noBlock>
                   </configuration>
                </execution>
                <execution>
                   <id>run-soapui-tests</id>
                   <phase>integration-test</phase>
                   <goals>
                      <goal>test</goal>
                   </goals>
                </execution>
             </executions>
             
             <configuration>
                <projectFile>${basedir}/test/soap-ui/${artifactId}-soapui-project.xml</projectFile>
                <outputFolder>${basedir}/target/surefire-reports</outputFolder>
                <junitReport>true</junitReport>
                <exportAll>true</exportAll>
                <printReport>true</printReport>
                <testFailIgnore>true</testFailIgnore>
             </configuration>
             
          </plugin>
          

          Nathan McDonald added a comment - the soapui plugin config we are using is below: <plugin> <groupId> eviware </groupId> <artifactId> maven-soapui-plugin </artifactId> <version> 3.6.1 </version> <executions> <execution> <id> start-soapui-mocks </id> <phase> pre-integration-test </phase> <goals> <goal> mock </goal> </goals> <configuration> <noBlock> true </noBlock> </configuration> </execution> <execution> <id> run-soapui-tests </id> <phase> integration-test </phase> <goals> <goal> test </goal> </goals> </execution> </executions> <configuration> <projectFile> ${basedir}/test/soap-ui/${artifactId}-soapui-project.xml </projectFile> <outputFolder> ${basedir}/target/surefire-reports </outputFolder> <junitReport> true </junitReport> <exportAll> true </exportAll> <printReport> true </printReport> <testFailIgnore> true </testFailIgnore> </configuration> </plugin>
          Ryan Murfitt made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]

          Ryan Murfitt added a comment -

          Ryan Murfitt added a comment - Pull request https://github.com/jenkinsci/jenkins/pull/352

          Aidan Foley added a comment - - edited

          It looks like this commit just has support for the maven-soapui-plugin. Would you be able to add support for the maven-soapui-pro-plugin as well please?

          Aidan Foley added a comment - - edited It looks like this commit just has support for the maven-soapui-plugin. Would you be able to add support for the maven-soapui-pro-plugin as well please?

          Ryan Murfitt added a comment -

          Added maven-soapui-pro-plugin support

          Ryan Murfitt added a comment - Added maven-soapui-pro-plugin support

            Unassigned Unassigned
            nathanm Nathan McDonald
            Votes:
            2 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: