-
Bug
-
Resolution: Fixed
-
Major
-
None
I use TestNG for integration testing, and I happen to use the same test class/method across multiple test suites.
That is I have lots of xml files that have different parameter values.
The problem is current results page lists package.Class.method multiple times, and it is extremely hard to tell which suites actually failed.
I wish the results page shown not just package, class, and method names, but test suite names (and/or "test" names that come from <test tag).
Note: currently the plugin just lists all the failed methods, so if I have 10 methods across 20 suites, it would show 200 rows with repeating test names.
Frankly speaking, I would like to have those 200 items grouped into something like:
The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3": "method1", "method2", "method3".
That would make test results shorter, however it would "break" ordering. I'm not sure if current order "by the order in results xml file" is important or not.
TL;DR:
1) Either (preferred for me) group the tests that fail in multiple suites into a single record. For instance:
The following tests are failed in "testsuite 1", "testsuite 2", and "testsuite 3": "method1", "method2", "method3".
2) Or add "testsuite name" as suite name changes. For instance:
suite1
test1
test2
suite2
test1
test2