It looks like a duplicate, but more than one year has passed:
Manually reloading defeats the purpose of automated builds. Also, in my case, I cannot rely on "waiting 5 minutes": it has to be deterministic and it cannot be based on waiting "long enough".
If a rename requires a reload from disk, then it must do so autonomously without disturbing anything else (current builds, pending builds, etc.).
The next question that comes to mind is what about dependencies? What if the job I rename is used by another job, say by the Copy the Artifact? Does the rename action take care of updating that other job too?