When using an ArtifactManager plugin the user downloads artifacts directly from the remote storage instead of going through Jenkins. This is a problem because the Authorization from Jenkins doesn't apply to the remote storage. This makes authorizing users much harder.

My solution would be to allow proxying the downloads through Jenkins, so the users don't need direct access to the remote storage and Jenkins is the gatekeeper of the files.