Add a mini-CI to ease deployments. A stripped dockerized Jenkins could suffice, which is setup at the beginning of a build, automated tests are run and taken down after tests are run.