Took months to find issue. Replicated Jenkins to new environment, No errors that related to this plugin were seen on Jenkins logs, hanging threads etc in monitoring area.

In the end, started uninstalling all plugins one by one until I found this plugin was the cause.

It was slowing down my Jenkins pipeline significantly. Every operation in Jenkins was running slowly when this plugin was installed.