Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-51341

Suite name is not shown on the main page and method results page

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • testng-plugin
    • None

      I use TestNG for integration testing, and I happen to use the same test class/method across multiple test suites.

      That is I have lots of xml files that have different parameter values.

      The problem is current results page lists package.Class.method multiple times, and it is extremely hard to tell which suites actually failed.

      I wish the results page shown not just package, class, and method names, but test suite names (and/or "test" names that come from <test tag).

       

      Note: currently the plugin just lists all the failed methods, so if I have 10 methods across 20 suites, it would show 200 rows with repeating test names.

       

      Frankly speaking, I would like to have those 200 items grouped into something like:

      The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3":   "method1", "method2", "method3".

      That would make test results shorter, however it would "break" ordering. I'm not sure if current order "by the order in results xml file" is important or not.

       

      TL;DR:

      1) Either (preferred for me) group the tests that fail in multiple suites into a single record. For instance:

      The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3":   "method1", "method2", "method3".

      2) Or add "testsuite name" as suite name changes. For instance:

      suite1
      test1
      test2
      suite2
      test1
      test2 

       

        1. 1of3.png
          1of3.png
          176 kB
        2. 2of3.png
          2of3.png
          184 kB
        3. 3of3.png
          3of3.png
          191 kB
        4. failed_configs.png
          failed_configs.png
          254 kB
        5. failed_configs.png
          failed_configs.png
          254 kB
        6. overall.png
          overall.png
          494 kB

            nullin Nalin Makar
            vladimirsitnikov Vladimir Sitnikov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: