User abort another user's build

In case users have privilege to build/cancel a job, it seems also that any user can abort the build run of any other user.

For ex: user1,2 has build/cancel priv on a job, job triggered by user1, user2 can abort the build run triggered by user1.

Is there a way that only the user who triggered the job can abort it ?