How to replicate:
1. Create freestyle job
2. Add git scm with SSH url and select ssh key for it
3. Enable SSH Agent in Build Environment section and select different key for it
Disabling SSH Agent fixes the problem.
Adding two keys to ssh agent doesn't work as expected for me. It looks like only first ssh key is used/visible.