We have jobs that produce custom tests result XMLs, but not on every run. We use the custom tool in xunit, along with a custom stylesheet to read those test files, and set skip-if-no-files to true.
Since the upgrade to plugin version 3.0.1, our jobs are failing when test result files are not found, even though "skip test if files not found" is checked.
We also noticed this issue with the JUnit tool in the xUnit plugin.
Steps to reproduce:
1> create a job that has the xunit plugin set to use junit or custom tool, and add path to some test files, doesn't matter where
2> set both failure thresholds to 100
3> ensure the "Skip if there are no test files" is checked
4> ensure the build does not produce any xunit files
job passes, because threshold is 100 but skip-if-no-files is checked
job fails, with the following in the log
FYI: We downgraded to 2.4.0, and this started working again.