With the latest version of Jenkins and the plugin on ci.jenkins.io, I noticed today that even when the master is "preparing to shutdown" (i.e. the queue is in read-only mode, etc), the Azure VM Agents plugin continues to provision Azure agents.

I would expect that "preparing for shutdown" would cause the agents not to provision