Any commit to common library SCM repository triggers all pipeline build plans

I'm using Modern SCM repository to maintain common library functions referenced by component build plan Jenkinsfiles. Any commit to the common library code appears to trigger a re-build of all Pipeline build plans, without an option to disable this feature. I'd like to selectively re-build everything, instead of automatically triggering all builds (which will result in a lot of unnecessary builds in my case). I've tried changing the implicit loading behaviour of the library, and also the option to "Ignore on push notifications" when defining the common library in system configuration options.

Is there a way to disable auto-triggering the Pipeline build plans when committing changes to the common library repository?