When saving the settings, the nickservpassword is not saved in the file "hudson.plugins.ircbot.IrcPublisher.xml". After changing the file manually, the password works fine. If you view the settings after that, the password is visible in there too. Saving those settings again will remove the password from the file.