First of all I think it should be an option of the plugin to handle this scenario, preferable optionally. Next I made an attempt to your suggestion pixman20, but that seems to not work if I do the following:
- PR build 1 is started, so passing milestone(1)
- PR build 2 is started, also passing milestone(1)
Still both PR build 1 and PR build 2 will continue, and that seems to be also in the light of what is stated in the wiki page:
> The milestone step ensures an older build will not override a newer build, so the older build will never be allowed to pass a milestone (it is aborted) if a newer build already passed it.
In the scenario I have drafted both builds actually already passed the defined milestone(). I am really interested in stopping PR build 1 as soon as PR build 2 is started as the first one is in context of PR no longer relevant.