Using Ubuntu Bionic (latest LTS), if you kill the Jenkins process such as via the script console (System.exit(0)), Jenkins shuts down, pidfile is removed. However, systemd still believes the process is running and a start command becomes a no-op.