When the "Failed tests mark build as failure" option is activated on a job that runs on a jenkins slave, the TAP display shows a failed test
The Jenkins build itself still shows as a success however.

See attached screenshot. Notice TAP chart shows failures, but build history shows successful builds.