I have another use case that might or might not be common, but it certainly makes me want to have an ability to disable this feature. Not just on the level of user access - just disable it period.
I have a groovy lib that generates a pipeline dsl dynamically and then evaluates it. It is being generated in chunks that are evaluated separately. When my team (who unlike my users - are jenkins admins by design having full access to everything) click Replay - due to the dynamic dsl generation they see 10+ text boxes with parts of the dsl. Because at Replay this dsl getting called outside of the proper context - it just fails. Replay just doesn't work for me and creating more issues than it solves. Not all of my team understands the way groovy lib and CPS works in Jenkins - most of them just configure jobs and by coincidence have access to the Replay feature. I wish I could completely disable Replay for our prod Jenkins instance just because it is buggy for us in the library context.