Jenkins gives me the option of using RVM or manually configuring the Ruby location. Unfortunately RVM doesn't work on Windows (and never will, according to the developer), and people seem to suggest using pik instead.

Problem is, Jenkins can't use pik, so I guess for now we'll be manually configuring the Ruby location.