When parsing the following TAP result:

1..2
ok 1 suite
    1..1
    ok 1 test
        1..3
        ok 1 action 1
        ok 2 action 2
        ok 3 action 3
Bail out! error

With the following plugin configuration:

• Verbose (if checked will print a message for each TAP stream file)
• Fail the build if no test results (files) are found
• Failed tests mark build as failure
• Output TAP to console
• Enable subtests
• Discard old reports
• TODO directive fails a test
• Include comment diagnostics (#) in the results table
• Validate number of tests
• Is TAP plan required?
• Show only failures
• Strip single parents
• Flatten TAP result
• Skip if build not successful

Then the bail out disappears, which results in a green build—although there's an error. Is that intended? When I remove the flatten option, the build is yellow (as expected).