We have Pull request plugin to configured to execute builds based on keywords. However it appears that any new commit added to PR also triggers the build, which is not what we want, so it appears to be a bug.