I removed the slave.jar to ensure that the right one was taken for startup of the node. It seems that the problem does not appear because of outdated slave.jar

I have a similar problem when Jenkins tries to get build results (e.g. junit results) from a slave.
In our environment master and slave are both on Linux (CentOS 5.5).
I assume it's the same cause.

Jenkins version is 1.430.

Our stack trace is:
ERROR: Failed to archive test reports
hudson.util.IOException2: remote file operation failed: /jenkinsremote/workspace/OPSC_Gold_bas_dev_OZ55087 at hudson.remoting.Channel@3546f87a:jenk1
at hudson.FilePath.act(FilePath.java:754)
at hudson.FilePath.act(FilePath.java:740)
at hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:83)
at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)
at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:668)
at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:646)
at hudson.model.Build$RunnerImpl.post2(Build.java:162)
at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:615)
at hudson.model.Run.run(Run.java:1401)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:230)
Caused by: java.io.IOException: Remote call on jenk1 failed
at hudson.remoting.Channel.call(Channel.java:690)
at hudson.FilePath.act(FilePath.java:747)
... 14 more

We are seeing this with windows 2008 slave RHEL 5 master during "copy artifacts from another project" This only happens on win2k8 slaves
Jenkins version 1.430

11:32:54 hudson.util.IOException2: remote file operation failed: <file> at hudson.remoting.Channel@3f8c69d9:brcivm001cnc
11:32:54 at hudson.FilePath.act(FilePath.java:754)
11:32:54 at hudson.FilePath.act(FilePath.java:740)
11:32:54 at hudson.FilePath.touch(FilePath.java:1036)
11:32:54 at hudson.FilePath.copyToWithPermission(FilePath.java:1402)
11:32:54 at hudson.plugins.copyartifact.FilePathCopyMethod.copyOne(FilePathCopyMethod.java:58)
11:32:54 at hudson.plugins.copyartifact.CopyArtifact.perform(CopyArtifact.java:231)
11:32:54 at hudson.plugins.copyartifact.CopyArtifact.perform(CopyArtifact.java:200)
11:32:54 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
11:32:54 at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
11:32:54 at hudson.model.Build$RunnerImpl.build(Build.java:178)
11:32:54 at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
11:32:54 at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
11:32:54 at hudson.model.Run.run(Run.java:1376)
11:32:54 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
11:32:54 at hudson.model.ResourceController.execute(ResourceController.java:88)
11:32:54 at hudson.model.Executor.run(Executor.java:230)
11:32:54 Caused by: java.io.IOException: Failed to set the timestamp of <file> to 1316176887000
11:32:54 at hudson.FilePath$17.invoke(FilePath.java:1041)
11:32:54 at hudson.FilePath$17.invoke(FilePath.java:1036)
11:32:54 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1995)
11:32:54 at hudson.remoting.UserRequest.perform(UserRequest.java:118)
11:32:54 at hudson.remoting.UserRequest.perform(UserRequest.java:48)
11:32:54 at hudson.remoting.Request$2.run(Request.java:287)
11:32:54 at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
11:32:54 at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
11:32:54 at java.util.concurrent.FutureTask.run(Unknown Source)
11:32:54 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
11:32:54 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
11:32:54 at hudson.remoting.Engine$1$1.run(Engine.java:60)
11:32:54 at java.lang.Thread.run(Unknown Source)
11:32:54 Build step 'Copy artifacts from another project' marked build as failure

Same thing here with 1.433 and a MacOSX node (not on another linux/ubuntu node) :

Started by an SCM change
Building remotely on MacOSX
hudson.util.IOException2: remote file operation failed: /Users/mbjenkins/jenkins-agent/workspace/exo-mobile-ios-trunk-ci at hudson.remoting.Channel@1798a63:MacOSX
	at hudson.FilePath.act(FilePath.java:781)
	at hudson.FilePath.act(FilePath.java:767)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:732)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:676)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1193)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:566)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:454)
	at hudson.model.Run.run(Run.java:1403)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:230)
Caused by: java.io.IOException: Remote call on MacOSX failed
	at hudson.remoting.Channel.call(Channel.java:690)
	at hudson.FilePath.act(FilePath.java:774)
	... 10 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class hudson.model.Hudson
	at hudson.scm.SubversionWorkspaceSelector.syncWorkspaceFormatFromMaster(SubversionWorkspaceSelector.java:85)
	at hudson.scm.SubversionSCM.createSvnClientManager(SubversionSCM.java:809)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:752)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:739)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2022)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:287)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:680)
Retrying after 10 seconds

+1 with AIX Master and Linux RHEL 6 with java6/64 bits, 1.423.

 
hudson.util.IOException2: remote file operation failed: /iclinux/.jenkins/workspace/exigences-matrix/jdk/Java 6 64 Bits/label/linux at hudson.remoting.Channel@58065806:sv-t-vtl-ic-rhel6-1
	at hudson.FilePath.act(FilePath.java:754)
	at hudson.FilePath.act(FilePath.java:740)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:684)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:633)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1193)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:555)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:443)
	at hudson.model.Run.run(Run.java:1376)
	at hudson.matrix.MatrixRun.run(MatrixRun.java:146)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:175)
Caused by: java.io.IOException: Remote call on sv-t-vtl-ic-rhel6-1 failed
	at hudson.remoting.Channel.call(Channel.java:676)
	at hudson.FilePath.act(FilePath.java:747)
	... 10 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class hudson.model.Hudson
	at hudson.scm.SubversionWorkspaceSelector.syncWorkspaceFormatFromMaster(SubversionWorkspaceSelector.java:85)
	at hudson.scm.SubversionSCM.createSvnClientManager(SubversionSCM.java:761)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:704)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:691)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1980)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:287)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at hudson.remoting.Engine$1$1.run(Engine.java:60)
	at java.lang.Thread.run(Thread.java:662)

Bitten this morning once again, but this time, restarting slave, wiping out its .jenkins directory doesn't help :-/. So for now I'm stuck...
For the record, here's the code: https://github.com/jenkinsci/subversion-plugin/blob/svn/src/main/java/hudson/scm/SubversionWorkspaceSelector.java#L85

It's actually throwing the NoClassDefFoundError when calling Hudson.getInstance().

I would be happy to help, but I'm not sufficiently aware of what's going on in Jenkins' core to dive in...

We experienced the same issue in one of our slaves, in this case the problem seems to be the NoClassDefFoundError when initializing hudson.tasks.junit.TestResult:

Recording test results
ERROR: Failed to archive test reports
hudson.util.IOException2: remote file operation failed: /var/hudson/workspace/errorlog-no-more-hide-oom-errors at hudson.remoting.Channel@36778590:cc02
	at hudson.FilePath.act(FilePath.java:754)
	at hudson.FilePath.act(FilePath.java:740)
	at hudson.tasks.junit.JUnitParser.parse(JUnitParser.java:83)
	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:122)
	at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:134)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
	at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
	at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:668)
	at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:646)
	at hudson.model.Build$RunnerImpl.post2(Build.java:162)
	at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:615)
	at hudson.model.Run.run(Run.java:1401)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:230)
Caused by: java.io.IOException: Remote call on cc02 failed
	at hudson.remoting.Channel.call(Channel.java:690)
	at hudson.FilePath.act(FilePath.java:747)
	... 14 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class hudson.tasks.junit.TestResult
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:114)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:87)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1995)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:287)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:619)
Build step 'Publish JUnit test result report' changed build result to FAILURE

It automagically got solved by disconnecting and reconnecting the slave (setting it offline for a moment), which BTW overwrites the slave.jar.

Environment:

• Master:
  • Jenkins: v1.431
  • OS: Debian 5.0.8
  • Java: jre1.6.0_23
• Slaves:
  • OS: Debian 5.0.3
  • Java: sun-java6-jdk 6-21-0lenny1

I ran into this same issue and was finding nothing until I came across the discussion: http://stackoverflow.com/questions/6653147/jenkins-slave-throws-classloading-from-system-classloader-disabled-exception. Essentially the work around was to remove the jar file xercesImpl-2.9.1.jar from WEB-INF/lib directory of jenkins.war file. Maybe not the best solution, but it appears to be an acceptable work around.

@Bruce : Interesting.
For the record, which Jenkins version are you using?

Usually it helps to disconnect and reconnect the slave here, but it did not work this time. I had to restart the entire service. Running Jenkins 1.451 on CentOS 5.7.

hudson.util.IOException2: remote file operation failed: /tmp/jenkins-workspace/Checkout at hudson.remoting.Channel@377e66a9:svnworker
	at hudson.FilePath.act(FilePath.java:784)
	at hudson.FilePath.act(FilePath.java:770)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:742)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:684)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1195)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:576)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:465)
	at hudson.model.Run.run(Run.java:1409)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:238)
Caused by: java.io.InterruptedIOException
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:775)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:752)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2099)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:287)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.InterruptedException
	at hudson.scm.subversion.CheckoutUpdater$1.perform(CheckoutUpdater.java:87)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:136)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:144)
	at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:120)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:136)
	at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:787)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:768)
	... 11 more
Caused by: org.tmatesoft.svn.core.SVNCancelException: svn: OPTIONS /seesaw/projects/nrf4368/digital/nRF31512/atpg/trunk failed
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:294)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:283)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:271)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.exchangeCapabilities(DAVConnection.java:533)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.open(DAVConnection.java:98)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.openConnection(DAVRepository.java:1011)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.getLatestRevision(DAVRepository.java:180)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.getRevisionNumber(SVNBasicClient.java:482)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.getLocations(SVNBasicClient.java:876)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.createRepository(SVNBasicClient.java:534)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:901)
	at hudson.scm.subversion.CheckoutUpdater$1.perform(CheckoutUpdater.java:84)
	... 17 more
Caused by: org.tmatesoft.svn.core.SVNCancelException: svn: No credential to try. Authentication failed
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.cancel(SVNErrorManager.java:37)
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.cancel(SVNErrorManager.java:32)
	at org.tmatesoft.svn.core.internal.wc.DefaultSVNAuthenticationManager.getNextAuthentication(DefaultSVNAuthenticationManager.java:219)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection._request(HTTPConnection.java:584)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:292)
	... 28 more
Caused by: org.tmatesoft.svn.core.SVNErrorMessage: svn: No credential to try. Authentication failed
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:200)
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:146)
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:89)
	... 33 more

Getting the same exception.

Server Ubuntu, Jenkins various versions up until ver. 1.454
Client Ubuntu, running on EC2 provisioned with "Amazon EC2 Plugin" v 1.13 (will update to 1.14 and report back if it solves the problem)

I also have one Windows and one AIX client that connect with webstart that do not show the problem.

Before I started fiddling it presented it self only on one buildjob and then always on the checkout of the same file in the repro (other buildjobs on the same host contain the same file and worked without problems). I tried changing the memory allocation by giving the slave-jvm various -Xmx flags which moved the error to other files.

hudson.util.IOException2: remote file operation failed: /mnt/workspace/7.70_Global_Linux_build at hudson.remoting.Channel@46638f:i-6a654923
	at hudson.FilePath.act(FilePath.java:784)
	at hudson.FilePath.act(FilePath.java:770)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:735)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:677)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1195)
	at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:579)
	at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:468)
	at hudson.model.Run.run(Run.java:1408)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:238)
Caused by: java.io.IOException: Remote call on i-6a654923 failed
	at hudson.remoting.Channel.call(Channel.java:690)
	at hudson.FilePath.act(FilePath.java:777)
	... 10 more
Caused by: java.lang.OutOfMemoryError: Java heap space
	at com.sun.org.apache.xerces.internal.util.XMLStringBuffer.append(XMLStringBuffer.java:205)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.refresh(XMLDocumentScannerImpl.java:1522)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.invokeListeners(XMLEntityScanner.java:2070)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.peekChar(XMLEntityScanner.java:486)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2687)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:140)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:511)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:808)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:754)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.readData(HTTPConnection.java:719)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:216)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection._request(HTTPConnection.java:364)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:285)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:276)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:264)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:266)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.runReport(DAVRepository.java:1263)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.update(DAVRepository.java:820)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.update(SVNUpdateClient.java:564)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:401)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.handleExternalChange(SVNUpdateClient.java:1865)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.handleExternalItemChange(SVNUpdateClient.java:1725)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.handleExternals(SVNUpdateClient.java:1679)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.update(SVNUpdateClient.java:575)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doUpdate(SVNUpdateClient.java:401)
	at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:134)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:136)

This JIRA bug has comments mentioning different issues. For example, comment from [jens persson added a comment - 08/Mar/12 10:58 AM] is about OutOfMemoryError: Java heap space, which has obvious solution for.

And [Markus Hjerto added a comment - 20/Feb/12 9:00 AM] has authentication error, which also has obvious solution for.

If your stack has no [java.lang.NoClassDefFoundError], this Jira bug is not useful to you.

I have jenkins 1.456 installed on my machine hosting Ubuntu 11.04(Natty) with openjdk-6-jre.
The jobs are executed on the ec2 slaves which are configured for provisioning Ubuntu 12.04 (precise, beta) images and openjdk-6-jre.
My builds failed constantly with the following error when more than one build executed on the slave simultaneously:

Caused by: java.lang.LinkageError: loader (instance of hudson/remoting/RemoteClassLoader): attempted duplicate class definition for name: "hudson/model/AbstractProject"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at java.lang.ClassLoader.defineClass(ClassLoader.java:480)
at hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:152)
at hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:131)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
at java.lang.Class.getDeclaredMethod(Class.java:1952)
at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1396)
at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:69)
at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:455)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:430)
at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:327)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:564)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1600)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1513)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1749)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:368)
at hudson.remoting.UserRequest.deserialize(UserRequest.java:182)
at hudson.remoting.UserRequest.perform(UserRequest.java:98)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)

Relaunching the slave and executing the builds did not help. As a workaround I restricted only 1 build executor on the slave and it seem to build the jobs successfully. But this inturn leads to poor utilisation of the slaves. I would request to fix the bug at the earliest.

Hope my experience helps someone out there. I kept getting this same error due to my configuration. My configuration was a centos linux (ver 5.6) machine running jenkins (LTS 1.409) that would connect to a cloud storage service (amazon) to store all of its jobs. Once I removed the cloud storage and just put all of the data on the local machine I stopped getting this error. I believe the problem, never confirmed, was that access to the cloud storage was too slow and kept timing out.

I had a similar issue today. (Windows Master, AIX client)

AND we found the solution. The temp folder was full. After cleaning up the temp folder. Everything worked fine again.

07:49:33 Building remotely on devocnswasa
07:50:09 hudson.util.IOException2: remote file operation failed: /jenkins/Hudson/cmicci/workspace/OCNS_Deploy2WAS at hudson.remoting.Channel@6499fc:devocnswasa
07:50:09 at hudson.FilePath.act(FilePath.java:779)
07:50:09 at hudson.FilePath.act(FilePath.java:765)
07:50:09 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
07:50:09 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
07:50:09 at hudson.model.AbstractProject.checkout(AbstractProject.java:1195)
07:50:09 at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:573)
07:50:09 at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:462)
07:50:09 at hudson.model.Run.run(Run.java:1404)
07:50:09 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
07:50:09 at hudson.model.ResourceController.execute(ResourceController.java:88)
07:50:09 at hudson.model.Executor.run(Executor.java:238)
07:50:09 Caused by: java.io.IOException: Remote call on devocnswasa failed
07:50:09 at hudson.remoting.Channel.call(Channel.java:690)
07:50:09 at hudson.FilePath.act(FilePath.java:772)
07:50:09 ... 10 more
07:50:09 Caused by: java.lang.Error: Unable to load resource hudson/model/Messages.properties
07:50:09 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:202)
07:50:09 at java.lang.ClassLoader.getResource(ClassLoader.java:431)
07:50:09 at java.lang.Class.getResource(Class.java:1170)
07:50:09 at org.jvnet.localizer.ResourceBundleHolder.get(ResourceBundleHolder.java:83)
07:50:09 at org.jvnet.localizer.ResourceBundleHolder.get(ResourceBundleHolder.java:102)
07:50:09 at org.jvnet.localizer.ResourceBundleHolder.get(ResourceBundleHolder.java:102)
07:50:09 at org.jvnet.localizer.ResourceBundleHolder.format(ResourceBundleHolder.java:139)
07:50:09 at hudson.model.Messages.Node_Mode_NORMAL(Messages.java:1685)
07:50:09 at hudson.model.Node$Mode.<clinit>(Node.java:432)
07:50:09 at java.lang.J9VMInternals.initializeImpl(Native Method)
07:50:09 at java.lang.J9VMInternals.initialize(J9VMInternals.java:196)
07:50:09 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
07:50:09 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79)
07:50:09 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
07:50:09 at java.lang.reflect.Method.invoke(Method.java:618)
07:50:09 at java.lang.Class.getEnumConstants(Class.java:1755)
07:50:09 at jenkins.model.Jenkins.<clinit>(Jenkins.java:3662)
07:50:09 at java.lang.J9VMInternals.initializeImpl(Native Method)
07:50:09 at java.lang.J9VMInternals.initialize(J9VMInternals.java:196)
07:50:09 at java.lang.J9VMInternals.initialize(J9VMInternals.java:161)
07:50:09 at hudson.scm.SubversionWorkspaceSelector.syncWorkspaceFormatFromMaster(SubversionWorkspaceSelector.java:85)
07:50:09 at hudson.scm.SubversionSCM.createSvnClientManager(SubversionSCM.java:823)
07:50:09 at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:766)
07:50:09 at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:753)
07:50:09 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2030)
07:50:09 at hudson.remoting.UserRequest.perform(UserRequest.java:118)
07:50:09 at hudson.remoting.UserRequest.perform(UserRequest.java:48)
07:50:09 at hudson.remoting.Request$2.run(Request.java:287)
07:50:09 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:432)
07:50:09 at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:284)
07:50:09 at java.util.concurrent.FutureTask.run(FutureTask.java:138)
07:50:09 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:678)
07:50:09 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:703)
07:50:09 at java.lang.Thread.run(Thread.java:811)
07:50:09 Caused by: java.io.IOException: There is not enough space in the file system.
07:50:09 at java.io.FileOutputStream.write(FileOutputStream.java:277)
07:50:09 at hudson.remoting.RemoteClassLoader.makeResource(RemoteClassLoader.java:271)
07:50:09 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:198)
07:50:09 ... 33 more

===I have similar issue which could be resolved by reconnect to the slave, but it is painful since 5 out of 20 slave have this issue after restarting jenkins server everytime. The slave having problems are all on other state, so it maybe due to slow response ( I am just guessing ). it happens on linux, aix, hp-ux slaves. jenkins version is 1.451

FATAL: command execution failed
java.io.IOException: Remote call on hp88 failed
at hudson.remoting.Channel.call(Channel.java:690)
at hudson.Launcher$RemoteLauncher.launch(Launcher.java:796)
at hudson.Launcher$ProcStarter.start(Launcher.java:338)
at hudson.Launcher$ProcStarter.join(Launcher.java:345)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:82)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:700)
at hudson.model.Build$RunnerImpl.build(Build.java:178)
at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:470)
at hudson.model.Run.run(Run.java:1409)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:238)

===Also, if I use copy-to-slave plugin, it shows another crash, but I think they are from the same root cause

FATAL: java.lang.IllegalAccessError: class hudson.remoting.Pipe$ConnectCommand cannot access its superclass hudson.remoting.Command
hudson.util.IOException2: java.lang.IllegalAccessError: class hudson.remoting.Pipe$ConnectCommand cannot access its superclass hudson.remoting.Command
at com.michelin.cio.hudson.plugins.copytoslave.MyFilePath.copyRecursiveTo(MyFilePath.java:147)
at com.michelin.cio.hudson.plugins.copytoslave.CopyToSlaveBuildWrapper.setUp(CopyToSlaveBuildWrapper.java:133)
at hudson.model.Build$RunnerImpl.doRun(Build.java:133)
at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:470)
at hudson.model.Run.run(Run.java:1409)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:238)

Since updating from 1.458 to 1.463 I am also having this problem. My master is running on debian, my slave on solaris. Reconnecting the slave did not work. There is enough disk space on the machine, and I am running jenkins standalone, so deleting the xerces-lib is not applicable. Would be really grateful if someone can help.
Here is the exception in my case (the underlying NoClassDefFoundException can have other stacktraces) :

hudson.util.IOException2: remote file operation failed: /export/home/jenkins/v2010_ci at hudson.remoting.Channel@1dc5322:xxx
at hudson.FilePath.act(FilePath.java:828)
at hudson.FilePath.act(FilePath.java:814)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1218)
at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:586)
at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:475)
at hudson.model.Run.run(Run.java:1434)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:239)
Caused by: java.io.IOException: Remote call on xxx failed
at hudson.remoting.Channel.call(Channel.java:655)
at hudson.FilePath.act(FilePath.java:821)
... 10 more
Caused by: java.lang.NoClassDefFoundError
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:766)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:753)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2154)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)
at java.util.concurrent.FutureTask.run(FutureTask.java:123)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:651)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:676)
at java.lang.Thread.run(Thread.java:595)

UPDATE: I got it working. In one of my builds, the underlying exception was "bad class version" which led me to inspect which java version the slave was using. Indeed somehow the path was not set correctly on the slave. As soon as I corrected the path everything started working again. No idea why the paths got reset during this particular update.

Does anyone have a solution or a workaround for this issue ?

We always have this problem in our production environment and it's very difficult to get slaves back to their normal state after the bug occurs.

hudson.util.IOException2: remote file operation failed: /path/to/job at hudson.remoting.Channel@5e165e16:slave1
at hudson.FilePath.act(FilePath.java:754)
at hudson.FilePath.act(FilePath.java:740)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1193)
at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:555)
at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:443)
at hudson.model.Run.run(Run.java:1376)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:175)
Caused by: java.io.IOException: Remote call slave1 failed
at hudson.remoting.Channel.call(Channel.java:677)
at hudson.FilePath.act(FilePath.java:747)
... 10 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class hudson.model.Hudson
at hudson.scm.SubversionWorkspaceSelector.syncWorkspaceFormatFromMaster(SubversionWorkspaceSelector.java:85)
at hudson.scm.SubversionSCM.createSvnClientManager(SubversionSCM.java:823)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:766)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:753)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1994)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at hudson.remoting.Engine$1$1.run(Engine.java:60)
at java.lang.Thread.run(Thread.java:662)
[TASKS] Skipping publisher since build result is FAILURE
[WARNINGS] Skipping publisher since build result is FAILURE
Email was triggered for: Failure
Sending email for trigger: Failure
Sending email to: email@email.fr
Notifying upstream projects of job completion
Finished: FAILURE

Same (or similar?) issue here.

Jenkins ver. 1.478
Master: Windows Server 2008 R2 (Windows service)
Slave: Windows 2003 (x86) (Windows service)

Started by upstream project "Daily Build" build number 94
Building remotely on bis007 in workspace d:\jenkins\workspace\Driver 3.30
hudson.util.IOException2: remote file operation failed: d:\jenkins\workspace\Driver 3.30 at hudson.remoting.Channel@3120a530:bis007
at hudson.FilePath.act(FilePath.java:838)
at hudson.FilePath.act(FilePath.java:824)
at hudson.FilePath.mkdirs(FilePath.java:890)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1254)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:589)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:494)
at hudson.model.Run.execute(Run.java:1502)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:236)
Caused by: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:492)
at hudson.remoting.Request.call(Request.java:129)
at hudson.remoting.Channel.call(Channel.java:663)
at hudson.FilePath.act(FilePath.java:831)
... 10 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.FilterInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.readObject(Unknown Source)
at hudson.remoting.Command.readFrom(Command.java:90)
at hudson.remoting.ClassicCommandTransport.read(ClassicCommandTransport.java:59)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)
Finished: FAILURE

Same problem, we have Jenkins 1.447.2...

Restarted the worker and the job executed successfully...

Thoughts?

Started by user cool user
[MBA] Configuring build environment for worker my server url
[EnvInject] - Loading node environment variables.
Building remotely on (Local Worker 0)
hudson.util.IOException2: remote file operation failed: /remote fs root at hudson.remoting.Channel@55088d16:(Local Worker 0)
at hudson.FilePath.act(FilePath.java:783)
at hudson.FilePath.act(FilePath.java:769)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1195)
at hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:573)
at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:462)
at hudson.model.Run.run(Run.java:1404)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:238)
Caused by: java.io.IOException: Remote call on (Local Worker 0) failed
at hudson.remoting.Channel.call(Channel.java:690)
at hudson.FilePath.act(FilePath.java:776)
... 10 more
Caused by: java.lang.NoClassDefFoundError: jenkins.model.Jenkins
at hudson.scm.SubversionWorkspaceSelector.syncWorkspaceFormatFromMaster(SubversionWorkspaceSelector.java:85)
at hudson.scm.SubversionSCM.createSvnClientManager(SubversionSCM.java:823)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:766)
at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:753)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2048)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Recording test results
Sending e-mails to: someone@somecorp.com
Finished: FAILURE

Same problem. Cannot checkout the repo or create a script file due to the "Remote file operation failed" error. Using Jenkins 1.480.1 (LTS).

Disconnecting and reconnecting the slave usually helps. But this is a MAJOR headache as it introduces instability that seems absolutely random.
I'd say this is a CRITICAL bug.

I have that problem to once in a while. Master is Win2008 Enterprice Server. SSH Slave is AIX. Since it doesn't happen on a daily basis, it is not that critical. Disconnecting the node fixes the problem. The next time the node starts up everything is fine again. Problem is only, that the node doesn't heal itself. It needs to be disconnected and admin authority is limited to a few people. So at least a band-aid would be great - Slave node disconnected/gets disconnected when this issue happens.

Same issue:
Version: Jenkins 1.424.2
Master: Suse Enterprise Linux Enterprise 10 SP2
Slave: Windows XP SP2

+1 ... same issue here:
Jenkins: version 1.522
Host and Slaves: all on latest Java 7 x64 version, all running Windows 7 x64
The problem comes and goes, reconnecting the slave seems to help from time to time. The log usually says something like "java.lang.NoClassDefFoundError" e.g. in the subversion plugin. The slaves.jar file is up-to-date on all slaves.

Is there any way to debug this problem because this is a really annoying problem!

Also seen with git and gerrit and Jenkins master 1.509.2,

Retriggered by user ilatypov for Gerrit: http://gerrit.example.net/408143
[EnvInject] - Loading node environment variables.
Building remotely on NODE in workspace /usr/local/jenkins/workspace/PROJECT_Prebuild
Checkout:PROJECT_Prebuild / /usr/local/jenkins/workspace/PROJECT_Prebuild - hudson.remoting.Channel@123d7b31:NODE
Using strategy: Gerrit Trigger
Wiping out workspace first.
hudson.util.IOException2: remote file operation failed: /usr/local/jenkins/workspace/PROJECT_Prebuild at hudson.remoting.Channel@123d7b31:NODE
	at hudson.FilePath.act(FilePath.java:900)
	at hudson.FilePath.act(FilePath.java:877)
	at hudson.plugins.git.GitSCM.determineRevisionToBuild(GitSCM.java:942)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1108)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1367)
	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:674)
	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:579)
	at hudson.model.Run.execute(Run.java:1575)
	at hudson.matrix.MatrixBuild.run(MatrixBuild.java:304)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:237)
	at hudson.model.OneOffExecutor.run(OneOffExecutor.java:66)
Caused by: java.io.IOException: Unable to delete /usr/local/jenkins/workspace/PROJECT_Prebuild/.git/packed-refs
	at hudson.Util.deleteFile(Util.java:256)
	at hudson.Util.deleteRecursive(Util.java:308)
	at hudson.Util.deleteContentsRecursive(Util.java:205)
	at hudson.Util.deleteRecursive(Util.java:299)
	at hudson.Util.deleteContentsRecursive(Util.java:205)
	at hudson.FilePath$12.invoke(FilePath.java:1052)
	at hudson.FilePath$12.invoke(FilePath.java:1049)
	at hudson.FilePath.act(FilePath.java:904)
	at hudson.FilePath.act(FilePath.java:877)
	at hudson.FilePath.deleteContents(FilePath.java:1049)
	at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:958)
	at hudson.plugins.git.GitSCM$2.invoke(GitSCM.java:942)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2387)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:326)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:662)
Retrying after 10 seconds

The master runs jdk1.7.0_21, the node runs jdk1.6.0_31 after the master connects to it via SSH.

[08/14/13 22:27:07] [SSH] Checking java version of java
Couldn't figure out the Java version of java
bash: java: command not found

[08/14/13 22:27:07] [SSH] Checking java version of /usr/bin/java
Couldn't figure out the Java version of /usr/bin/java
bash: /usr/bin/java: No such file or directory

[08/14/13 22:27:07] [SSH] Checking java version of /usr/java/default/bin/java
[08/14/13 22:27:07] [SSH] /usr/java/default/bin/java -version returned 1.6.0_31.
[08/14/13 22:27:07] [SSH] Starting sftp client.
[08/14/13 22:27:07] [SSH] Copying latest slave.jar...
[08/14/13 22:27:07] [SSH] Copied 284,251 bytes.
Expanded the channel window size to 4MB
[08/14/13 22:27:07] [SSH] Starting slave process: cd '/usr/local/jenkins' && /usr/java/default/bin/java  -jar slave.jar
<===[JENKINS REMOTING CAPACITY]===>^@^@^@channel started
Slave.jar version: 2.23
This is a Unix slave
Copied maven-agent.jar
Copied maven3-agent.jar
Copied maven3-interceptor.jar
Copied maven-interceptor.jar
Copied maven2.1-interceptor.jar
Copied plexus-classworld.jar
Copied classworlds.jar
Evacuated stdout
just before slave NODE gets online ...
executing prepare script ...
setting up slave NODE ...
slave setup done.
Aug 14, 2013 10:27:08 PM com.youdevise.hudson.slavestatus.SlaveListener call
INFO: Slave-status listener starting
Aug 14, 2013 10:27:08 PM com.youdevise.hudson.slavestatus.SocketHTTPListener waitForConnection
INFO: Slave-status listener ready on port 3141
[StartupTrigger] - Scanning jobs for node NODE
Slave successfully connected and online
Successfully loaded native POSIX impl.
channel stopped
Connection terminated
[08/14/13 22:28:47] [SSH] Connection closed.

The "Connection closed" message in the node log came from my disconnecting the slave via the Jenkins web interface after observing IOException2.

same issue here:

hudson.util.IOException2: remote file operation failed: C:\DOCUME~1\pvadmin\LOCALS~1\Temp\hudson8254524424334557144.bat at hudson.remoting.Channel@13b42f4:vmxp3-72
at hudson.FilePath.act(FilePath.java:900)
at hudson.FilePath.act(FilePath.java:877)
at hudson.FilePath.delete(FilePath.java:1262)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:101)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:60)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:160)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:586)
at hudson.model.Run.execute(Run.java:1576)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:241)
Caused by: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:494)
at hudson.remoting.Request.call(Request.java:129)
at hudson.remoting.Channel.call(Channel.java:672)
at hudson.FilePath.act(FilePath.java:893)
... 13 more
Caused by: java.net.SocketException: socket closed
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.readObject(Unknown Source)
at hudson.remoting.Command.readFrom(Command.java:92)
at hudson.remoting.ClassicCommandTransport.read(ClassicCommandTransport.java:59)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)
FATAL: hudson.remoting.RequestAbortedException: java.net.SocketException: socket closed
hudson.remoting.RequestAbortedException: hudson.remoting.RequestAbortedException: java.net.SocketException: socket closed
at hudson.remoting.Request.call(Request.java:174)
at hudson.remoting.Channel.call(Channel.java:672)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
at $Proxy33.join(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:915)
at hudson.Launcher$ProcStarter.join(Launcher.java:360)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:91)
at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:60)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:160)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:586)
at hudson.model.Run.execute(Run.java:1576)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:241)
Caused by: hudson.remoting.RequestAbortedException: java.net.SocketException: socket closed
at hudson.remoting.Request.abort(Request.java:299)
at hudson.remoting.Channel.terminate(Channel.java:732)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:69)
Caused by: java.net.SocketException: socket closed
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source)
at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.readObject(Unknown Source)
at hudson.remoting.Command.readFrom(Command.java:92)
at hudson.remoting.ClassicCommandTransport.read(ClassicCommandTransport.java:59)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)

Don't make sense having this JIRA issue open.

Would be useful if you clarify the close reason. Do you think it's unrelated to the plugin?

oleg_nenashev Well, this JIRA was opened on 19/Aug/11. I'm trying to remove all issues related to very old environments and plugin versions. If it is necessary, the JIRA issue author can file another one provinding upgraded information.

New features: Yes.
Maintenace and bugfixing: No. It's not fun.

Crap.

lot, What version of Subversion Plugin are you using? Does the bug still continue?