-
Bug
-
Resolution: Cannot Reproduce
-
Critical
-
None
-
Jenkins Server OS: Windows Server 2012(64-bit)
Jenkins Version: 2.89.4
After upgrade Jenkins to 2.98.4 LTS, we found that the slaves always disconnect from server randomly, and from the server side, we checked log info with "thread terminated", how can we know why the thread is terminated? I also checked thread dump, but there are only dump for live thread but not for killed thread. The debug info for Server and Slave see below:
Debug info from Salves:
May 23, 2018 10:33:01 AM hudson.remoting.UserRequest perform
WARNING: LinkageError while performing UserRequest:UserRPCRequest(3,join)
java.lang.LinkageError: Failed to load hudson.util.ProcessTree
at hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:387)
at hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:295)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at hudson.Proc$LocalProc.destroy(Proc.java:384)
at hudson.Proc$LocalProc.join(Proc.java:357)
at hudson.Launcher$RemoteLaunchCallable$1.join(Launcher.java:1304)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:922)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:896)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:853)
at hudson.remoting.UserRequest.perform(UserRequest.java:207)
at hudson.remoting.UserRequest.perform(UserRequest.java:53)
at hudson.remoting.Request$2.run(Request.java:358)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at hudson.remoting.Engine$1$1.run(Engine.java:98)
at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NoClassDefFoundError: hudson/util/ProcessTreeRemoting$IProcessTree
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.lang.ClassLoader.defineClass(Unknown Source)
at hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:383)
... 22 more
Caused by: java.lang.ClassNotFoundException: hudson.util.ProcessTreeRemoting$IProcessTree
at java.net.URLClassLoader.findClass(Unknown Source)
at hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:159)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
... 26 more
Debug Info from Server:
May 23, 2018 10:32:55 AM hudson.TcpSlaveAgentListener$ConnectionHandler run
INFO: Accepted JNLP4-connect connection #101,988 from /10.224.105.34:28333
May 23, 2018 10:32:57 AM jenkins.slaves.DefaultJnlpSlaveReceiver channelClosed
WARNING: IOHub#1: Worker[channel:java.nio.channels.SocketChannel[connected local=/10.224.105.17:53233 remote=avcndaevpcisrv/10.224.105.34:1655]] / Computer.threadPoolForRemoting 5173 for FTVP_CI_Slv_SSD_View terminated
java.nio.channels.ClosedChannelException
at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154)
at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:179)
at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:721)
at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
- is related to
-
JENKINS-52922 slave is getting disconnected in the middle of the job
-
- Closed
-
-
JENKINS-51854 LinkageError while performing UserRequest:hudson.scm.SubversionSCM
-
- Open
-
I hope I am not spoiling this issue, but I think we are seeing quite often the same problem (using Jenkins ver. 2.140).
Any workaround? It is breaking quite a few jobs
This is in the slave log:
WARNING: LinkageError while performing UserRequest:hudson.scm.SubversionSCM$CheckOutTask@6c161e48WARNING: LinkageError while performing UserRequest:hudson.scm.SubversionSCM$CheckOutTask@6c161e48java.lang.ExceptionInInitializerError at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:1003) at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:980) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source)Caused by: hudson.remoting.RemotingSystemException: java.lang.InterruptedException at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:299) at com.sun.proxy.$Proxy5.getResource2(Unknown Source) at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:426) at java.lang.ClassLoader.getResource(Unknown Source) at java.lang.Class.getResource(Unknown Source) at org.jvnet.localizer.ResourceBundleHolder.get(ResourceBundleHolder.java:107) at org.jvnet.localizer.Localizable.toString(Localizable.java:67) at hudson.security.PermissionGroup.<init>(PermissionGroup.java:64) at hudson.scm.SCM.<clinit>(SCM.java:719) ... 11 moreCaused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at hudson.remoting.Request.call(Request.java:177) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) ... 19 more
Sep 13, 2018 7:27:52 AM org.jenkinsci.remoting.util.AnonymousClassWarnings warnWARNING: Attempt to (de-)serialize anonymous class hudson.plugins.nunit.NUnitPublisher$1; see: https://jenkins.io/redirect/serialization-of-anonymous-classes/Sep 13, 2018 7:27:52 AM org.jenkinsci.remoting.util.AnonymousClassWarnings warnWARNING: Attempt to (de-)serialize anonymous class hudson.tasks.Ant$AntInstallation$1; see: https://jenkins.io/redirect/serialization-of-anonymous-classes/Sep 13, 2018 8:15:47 AM hudson.remoting.UserRequest performWARNING: LinkageError while performing UserRequest:hudson.scm.SubversionSCM$CheckOutTask@6be2e14bjava.lang.NoClassDefFoundError: Could not initialize class hudson.scm.SubversionSCM at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:1003) at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:980) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source)
This is console output taken from the job:
08:15:47 Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to umwintest16.eur.ad.sag
08:15:47 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
08:15:47 at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
08:15:47 at hudson.remoting.Channel.call(Channel.java:955)
08:15:47 at hudson.FilePath.act(FilePath.java:1070)
08:15:47 at hudson.FilePath.act(FilePath.java:1059)
08:15:47 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:929)
08:15:47 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:865)
08:15:47 at hudson.scm.SCM.checkout(SCM.java:504)
08:15:47 at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
08:15:47 at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
08:15:47 at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
08:15:47 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
08:15:47 at hudson.model.Run.execute(Run.java:1815)
08:15:47 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
08:15:47 at hudson.model.ResourceController.execute(ResourceController.java:97)
08:15:47 at hudson.model.Executor.run(Executor.java:429)
08:15:47 java.lang.NoClassDefFoundError: Could not initialize class hudson.scm.SubversionSCM
08:15:47 at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:1003)
08:15:47 at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:980)
08:15:47 at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
08:15:47 at hudson.remoting.UserRequest.perform(UserRequest.java:212)
08:15:47 at hudson.remoting.UserRequest.perform(UserRequest.java:54)
08:15:47 at hudson.remoting.Request$2.run(Request.java:369)
08:15:47 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
08:15:47 at java.util.concurrent.FutureTask.run(Unknown Source)
08:15:47 at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
08:15:47 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
08:15:47 at java.lang.Thread.run(Unknown Source)
08:15:47 Caused: java.io.IOException: Remote call on umwintest16.eur.ad.sag failed
08:15:47 at hudson.remoting.Channel.call(Channel.java:961)
08:15:47 at hudson.FilePath.act(FilePath.java:1070)
08:15:47 at hudson.FilePath.act(FilePath.java:1059)
08:15:47 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:929)
08:15:47 at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:865)
08:15:47 at hudson.scm.SCM.checkout(SCM.java:504)
08:15:47 at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
08:15:47 at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
08:15:47 at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
08:15:47 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
08:15:47 at hudson.model.Run.execute(Run.java:1815)
08:15:47 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
08:15:47 at hudson.model.ResourceController.execute(ResourceController.java:97)
08:15:47 at hudson.model.Executor.run(Executor.java:429)