Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-51341

Suite name is not shown on the main page and method results page

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • testng-plugin
    • None

      I use TestNG for integration testing, and I happen to use the same test class/method across multiple test suites.

      That is I have lots of xml files that have different parameter values.

      The problem is current results page lists package.Class.method multiple times, and it is extremely hard to tell which suites actually failed.

      I wish the results page shown not just package, class, and method names, but test suite names (and/or "test" names that come from <test tag).

       

      Note: currently the plugin just lists all the failed methods, so if I have 10 methods across 20 suites, it would show 200 rows with repeating test names.

       

      Frankly speaking, I would like to have those 200 items grouped into something like:

      The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3":   "method1", "method2", "method3".

      That would make test results shorter, however it would "break" ordering. I'm not sure if current order "by the order in results xml file" is important or not.

       

      TL;DR:

      1) Either (preferred for me) group the tests that fail in multiple suites into a single record. For instance:

      The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3":   "method1", "method2", "method3".

      2) Or add "testsuite name" as suite name changes. For instance:

      suite1
      test1
      test2
      suite2
      test1
      test2 

       

        1. 1of3.png
          176 kB
          Vladimir Sitnikov
        2. 2of3.png
          184 kB
          Vladimir Sitnikov
        3. 3of3.png
          191 kB
          Vladimir Sitnikov
        4. failed_configs.png
          254 kB
          Vladimir Sitnikov
        5. failed_configs.png
          254 kB
          Vladimir Sitnikov
        6. overall.png
          494 kB
          Vladimir Sitnikov

            nullin Nalin Makar
            vladimirsitnikov Vladimir Sitnikov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: