I specified two branches separately in "Branch Specifier" option as below:
Branch Specifier(blank for 'any'): */master
Branch Specifier(blank for 'any'): */develop

I also specified two Excluded users under the "Polling ignores commits from certain users' option, show as following:
Excluded Users:
James
Kobe

Then when James push his changes to either */master or */develop branches, jenkins would still trigger a build, same happened with user Kobe, which is unreasonable.

Based on my understanding, jenkins should not trigger a build since both James and Kobe are whithin the excluded user list. This is definitely a bug, hope someone will fix it soon, thank you all!