I was hoping there would be a way of saying "If the number of unit tests drops by n then fail".

Something like:
passed(unstableNewThreshold: '-1', unstableThreshold: '0')

would mean that if the number of passing tests dropped by more than 1 then fail.

But there doesn't seem to be a way of doing this.

Am I missing something, or does this functionality not exist?