The jenkins_systeminfo.txt indicates that your master node is running JDK 8 (good), but the report does not indicate what JDK version is running on the agent where the failure is reported. Is it also running JDK 8 or is it running an earlier JDK?

The jenkins_systeminfo.txt indicates that your master node is running Linux kernel 4.4.0, which probably means that you're running Ubuntu 16. Is that the operating system of the server? What operating system is running on the agent which shows the failure?

The jenkins_systeminfo.txt shows that you're running git plugin 2.5.3 and git client plugin 1.21.0. Since you're also running blue-ocean on that machine, I assume that means you're willing to experiment. Could you try installing git plugin 2.6.0 to see if it resolves the issue? I'm not aware of any reason it would resolve the issue, but it is a newer version and was specifically built to depend on git client plugin 1.21.0.

Are there any other hints you can suggest which might point to differences between the agent and the master?

The agent is running the following java version:

$ java -version
java version "1.8.0_102"
Java(TM) SE Runtime Environment (build 1.8.0_102-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.102-b14, mixed mode)

Not sure what the server is running. Agent is running Mac OS X 10.11.6 (El Capitan).

I'll install git plugin 2.6.0 and report back with whether or not the issue is resolved.

After installing git plugin 2.6.0 and restarting, the issue still occurs.

stackoverflow indicates that NoClassDefFoundError indicates a problem reading the class definition of a class which was found, and notes that is different than if the bytecode for the class could not be found. Unfortunately, I don't know what could be done with that information.

Is there a difference in JVM implementations which could be tested? For example, if you run the same operations on an agent temporarily started on the master, does the same problem occur? That would then tend to use the same JVM as the master.

So the fact that the server has JDK 1.8.0_101 and the agent has 1.8.0_102 might be the issue, you think?

The release notes don't seem to indicate that anything related to this would be different: http://www.oracle.com/technetwork/java/javase/8u102-relnotes-3021767.html

No, I don't think the difference is between JDK 8 1.101 and JDK 8 1.102. Those two versions are very, very close to one another (I believe mostly a packaging change between those two versions). I was making a wild guess that it might be a difference between the JDK 8 implementation on Linux and the JDK 8 implementation on MacOS. I must admit freely that I am making a wild guess, since I don't know how to duplicate the problem you're seeing.

I don't have ready access to a MacOS machine, so I can't run my own tests to see if it works. You might run a temporary Jenkins server on MacOS and run a temporary agent on the same MacOS machine.

Sorry that I'm making wild guesses, but I don't have other ideas to suggest...

I appreciate your help...

I have same exact remote file operation failure still on Jenkins 1.625.3.
The Jenkins master uses Oracle JDK jdk1.8.0_92 on RHEL 6 and the agent/node is on Ubuntu 14.04. Master is connecting to the slave using SSH and I set slave to run Oracle JDK 1.7.0_79.

This error often occurs and I can't pinpoint what is the problem.
The git-client plugin version is 1.19.6 and git plugin version 2.4.4

The stacktrace output:
Building remotely on sjc-bld139-lnx (cf-verify LinuxDataCenterUbuntu14.04.2) in workspace /scratch/workspace/workspace/VMS-Cloud-Deployments/deploy-vms-2.2.0-daily-P-4

Deleting project workspace... java.io.IOException: remote file operation failed: /scratch/workspace/workspace/VMS-Cloud-Deployments/deploy-vms-2.2.0-daily-P-4 at hudson.remoting.Channel@44bd60f8:sjc-bld139-lnx: java.io.IOException: Remote call on sjc-bld139-lnx failed
at hudson.FilePath.act(FilePath.java:987)
at hudson.FilePath.act(FilePath.java:969)
at org.jenkinsci.plugins.gitclient.Git.getClient(Git.java:131)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:752)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:744)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1091)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1275)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532)
at hudson.model.Run.execute(Run.java:1741)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:408)
Caused by: java.io.IOException: Remote call on sjc-bld139-lnx failed
at hudson.remoting.Channel.call(Channel.java:789)
at hudson.FilePath.act(FilePath.java:980)
... 14 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class com.sun.proxy.$Proxy8
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.reflect.Proxy.newInstance(Proxy.java:764)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:755)
at hudson.remoting.RemoteInvocationHandler.wrap(RemoteInvocationHandler.java:143)
at hudson.remoting.Channel.export(Channel.java:621)
at hudson.remoting.Channel.export(Channel.java:590)
at org.jenkinsci.plugins.gitclient.LegacyCompatibleGitAPIImpl.writeReplace(LegacyCompatibleGitAPIImpl.java:201)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at java.io.ObjectStreamClass.invokeWriteReplace(ObjectStreamClass.java:1075)
at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1134)
at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347)
at hudson.remoting.UserRequest._serialize(UserRequest.java:157)
at hudson.remoting.UserRequest.serialize(UserRequest.java:166)
at hudson.remoting.UserRequest.perform(UserRequest.java:128)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to sjc-bld139-lnx(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:220)
at hudson.remoting.Channel.call(Channel.java:781)

Is there anything I should upgrade? Should all node/agent also run Oracle JDK 1.8?
Thank you

-Indra