The warning text about needing to restart and the button should appear at the bottom of the page, and only after all the pending operations are completed either successfully or unsuccessfully.

I think that's a much better flow for users, although it does mean a bit more work for us to decide when to display it.

(JENKINS-3146 is the original request that resulted in this button.)