I was using the Selenium plugin prior to Jenkins 2.0 release without any problems. When I tried to install the Selenium plugin after upgrading to Jenkins 2.0 (now on 2.1) I receive this error:

java.io.IOException: Failed to dynamically deploy this plugin
at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:1750)
at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1511)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:110)
at java.lang.Thread.run(Unknown Source)
Caused by: java.nio.file.FileSystemException: C:\Users\tdjenkins\.jenkins\plugins\selenium\WEB-INF\lib\commons-lang3-3.4.jar: The process cannot access the file because it is being used by another process.

at sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
at sun.nio.fs.WindowsFileSystemProvider.implDelete(Unknown Source)
at sun.nio.fs.AbstractFileSystemProvider.deleteIfExists(Unknown Source)
at java.nio.file.Files.deleteIfExists(Unknown Source)
at hudson.Util.deleteFile(Util.java:260)
at hudson.Util.deleteRecursive(Util.java:314)
at hudson.Util.deleteContentsRecursive(Util.java:226)
at hudson.Util.deleteRecursive(Util.java:305)
at hudson.Util.deleteContentsRecursive(Util.java:226)
at hudson.Util.deleteRecursive(Util.java:305)
at hudson.Util.deleteContentsRecursive(Util.java:226)
at hudson.Util.deleteRecursive(Util.java:305)
at hudson.ClassicPluginStrategy.explode(ClassicPluginStrategy.java:602)
at hudson.ClassicPluginStrategy.createPluginWrapper(ClassicPluginStrategy.java:173)
at hudson.PluginManager.dynamicLoad(PluginManager.java:697)
at hudson.PluginManager.dynamicLoad(PluginManager.java:663)
at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:1746)

It successfully installed in the update center (blue circle) but the plugin wasn't available after restarting. I also tried manually deleting the plugin and reinstalling it no avail.
Could you provide any insight on whether this is a bug or on how to get around this error?