If you create a numbered TCP port (e.g. "9876", as opposed to a named port), then the plugin doesn't appear to actually check whether this port is free on the slave.

i.e. It only checks that no other builds are using the port.

Preferably, as with named ports, the actual availability of the port on the slave should be checked.