Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-47367

Parameterized test cases mixed with non-parameterized are listed wrong in test summary

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • nunit-plugin
    • None
    • nunit-plugin 0.21, Jenkins 2.83 on a Windows Server 2008 R2

      Using the latest nunit plugin on latest (not LTS) stable Jenkins leads to a wrong displayed test case summary. 

      In our example the non-parameterized test cases which are mixed in one test class with parameterized test cases are referenced to a wrong class. 

      In our example the parameterized test cases are referenced to the package "Base.Tests" and the non-parameterized test cases are referenced to the package "Base" which is wrong. They are in the package "Base.Tests". You can see this in the screenshots, every test which is displayed in "Base" is wrong and belongs to "Base.Tests"

      This is our test result output xml.

       <test-suite type="TestFixture" name="CryptUtilsTests" executed="True" result="Success" success="True" time="0.308" asserts="0">
      	<results>
      	  <test-suite type="ParameterizedTest" name="ComputerSha256HashAndCompareWithExpectedResult" executed="True" result="Success" success="True" time="0.010" asserts="0">
      		<results>
      		  <test-case name="Base.Tests.CryptUtilsTests.ComputerSha256HashAndCompareWithExpectedResult(&quot;pass&quot;,&quot;D74FF0BDE50BE8F1&quot;)" executed="True" result="Success" success="True" time="0.005" asserts="1" />
      		  <test-case name="Base.Tests.CryptUtilsTests.ComputerSha256HashAndCompareWithExpectedResult(&quot;Horst&quot;,&quot;1FC1E73359247428B9855DFD&quot;)" executed="True" result="Success" success="True" time="0.000" asserts="1" />
      		  <test-case name="Base.Tests.CryptUtilsTests.ComputerSha256HashAndCompareWithExpectedResult(&quot;Hugo&quot;,&quot;D70B489BB97D74C8E69A60EA62DC8FFD&quot;)" executed="True" result="Success" success="True" time="0.001" asserts="1" />
      		  <test-case name="Base.Tests.CryptUtilsTests.ComputerSha256HashAndCompareWithExpectedResult(&quot;GeheimesPasswort!&quot;,&quot;2600F32BA82835F62D46B7&quot;)" executed="True" result="Success" success="True" time="0.000" asserts="1" />
      		</results>
      	  </test-suite>
      	  <test-case name="Base.Tests.CryptUtilsTests.ComputesSaltAndPasswordHashCorrectly" executed="True" result="Success" success="True" time="0.024" asserts="4" />
      	  <test-case name="Base.Tests.CryptUtilsTests.ComputesSaltAndPasswordHashFromDifferentTasksCorrectly" executed="True" result="Success" success="True" time="0.135" asserts="1" />
      	  <test-case name="Base.Tests.CryptUtilsTests.ComputesSaltAndPasswordHashFromDifferentThreadsCorrectly" executed="True" result="Success" success="True" time="0.095" asserts="1" />
      	  <test-case name="Base.Tests.CryptUtilsTests.EncyrptAndDecryptWindows" executed="True" result="Success" success="True" time="0.034" asserts="15" />
      	</results>
       </test-suite>

            Unassigned Unassigned
            ise Daniel Isenmann
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: