Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-26174

jenkins slave breaks connection after build steps finishing

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Component/s: core, remoting
    • Labels:
    • Environment:
      Jenkins ver. 1.580.2, jenkins server ubuntu x64
    • Similar Issues:

      Description

      I have a matrix-job.
      Jclouds plugin creates slaves for build.
      Slaves connect to jenkins via jnlp.

      Sometimes slave breaks connection:

      14:39:55  2 failed, 214 passed, 1 skipped, 6 deselected, 1 warnings, 1 rerun in 2283.12 seconds 
      14:39:55 + true
      14:39:55 Looks like the node went offline during the build. Check the slave log for the details.
      
      14:39:55 
      
      FATAL: Remote call on win7-x86-ru-name-4a0 failed
      14:39:55 java.io.IOException: Remote call on win7-x86-ru-name-4a0 failed
      14:39:55    at hudson.remoting.Channel.call(Channel.java:760)
      14:39:55    at hudson.Launcher$RemoteLauncher.kill(Launcher.java:941)
      14:39:55    at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:556)
      14:39:55    at hudson.model.Run.execute(Run.java:1745)
      14:39:55    at hudson.matrix.MatrixRun.run(MatrixRun.java:146)
      14:39:55    at hudson.model.ResourceController.execute(ResourceController.java:89)
      14:39:55    at hudson.model.Executor.run(Executor.java:240)
      14:39:55 Caused by: java.lang.Error: Unable to load resource winp.dll
      14:39:55    at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:381)
      14:39:55    at java.lang.ClassLoader.getResource(Unknown Source)
      14:39:55    at org.jvnet.winp.Native.load(Native.java:85)
      14:39:55    at org.jvnet.winp.Native.<clinit>(Native.java:56)
      14:39:55    at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
      14:39:55    at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
      14:39:55    at hudson.util.ProcessTree.get(ProcessTree.java:328)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:121)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:49)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      14:39:55    at hudson.remoting.Engine$1$1.run(Engine.java:63)
      14:39:55    at java.lang.Thread.run(Unknown Source)
      14:39:55    at ......remote call to partners-win7-home-premium-x86-ru-name-4a0(Native Method)
      14:39:55    at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
      14:39:55    at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
      14:39:55    at hudson.remoting.Channel.call(Channel.java:752)
      14:39:55    ... 6 more
      14:39:55 Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Invalid object ID 2 iota=12
      14:39:55    at hudson.remoting.AsyncFutureImpl.get(AsyncFutureImpl.java:75)
      14:39:55    at hudson.remoting.FutureAdapter.get(FutureAdapter.java:55)
      14:39:55    at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:373)
      14:39:55    at java.lang.ClassLoader.getResource(Unknown Source)
      14:39:55    at org.jvnet.winp.Native.load(Native.java:85)
      14:39:55    at org.jvnet.winp.Native.<clinit>(Native.java:56)
      14:39:55    at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
      14:39:55    at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
      14:39:55    at hudson.util.ProcessTree.get(ProcessTree.java:328)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:121)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:49)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      14:39:55    at hudson.remoting.Engine$1$1.run(Engine.java:63)
      14:39:55    at java.lang.Thread.run(Unknown Source)
      14:39:55 Caused by: java.lang.IllegalStateException: Invalid object ID 2 iota=12
      14:39:55    at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:348)
      14:39:55    at hudson.remoting.ExportTable.get(ExportTable.java:324)
      14:39:55    at hudson.remoting.Channel.getExportedObject(Channel.java:604)
      14:39:55    at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55    at java.lang.Thread.run(Thread.java:744)
      14:39:55    at ......remote call to channel(Native Method)
      14:39:55    at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
      14:39:55    at hudson.remoting.Request.call(Request.java:171)
      14:39:55    at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:176)
      14:39:55    at com.sun.proxy.$Proxy5.writeJarTo(Unknown Source)
      14:39:55    at hudson.remoting.FileSystemJarCache.retrieve(FileSystemJarCache.java:66)
      14:39:55    at hudson.remoting.JarCacheSupport$1.run(JarCacheSupport.java:62)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:104)
      14:39:55    ... 1 more
      14:39:55 Caused by: java.lang.Exception: Object was recently deallocated
      14:39:55     #2 (ref.0) : [hudson.remoting.JarLoader]
      14:39:55       Created at Fri Dec 19 13:58:57 MSK 2014
      14:39:55        at hudson.remoting.ExportTable$Entry.<init>(ExportTable.java:93)
      14:39:55        at hudson.remoting.ExportTable.export(ExportTable.java:299)
      14:39:55        at hudson.remoting.Channel.internalExport(Channel.java:600)
      14:39:55        at hudson.remoting.Channel.export(Channel.java:591)
      14:39:55        at hudson.remoting.Channel.<init>(Channel.java:472)
      14:39:55        at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:280)
      14:39:55        at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:290)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:36)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:52)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol$Handler.jnlpConnect(JnlpSlaveAgentProtocol.java:120)
      14:39:55        at jenkins.slaves.DefaultJnlpSlaveReceiver.handle(DefaultJnlpSlaveReceiver.java:63)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol2$Handler2.run(JnlpSlaveAgentProtocol2.java:57)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol2.handle(JnlpSlaveAgentProtocol2.java:31)
      14:39:55        at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:156)
      14:39:55       Released at Fri Dec 19 13:58:57 MSK 2014
      14:39:55        at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
      14:39:55        at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
      14:39:55        at hudson.remoting.Channel.unexport(Channel.java:612)
      14:39:55        at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
      14:39:55        at hudson.remoting.Channel$2.handle(Channel.java:483)
      14:39:55        at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
      14:39:55        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55        at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
      14:39:55        at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
      14:39:55        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55        at java.lang.Thread.run(Thread.java:744)
      14:39:55     Caused by: Command hudson.remoting.UnexportCommand@14daad94 created at
      14:39:55        at hudson.remoting.Command.<init>(Command.java:67)
      14:39:55        at hudson.remoting.Command.<init>(Command.java:50)
      14:39:55        at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
      14:39:55        at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
      14:39:55        at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
      14:39:55        at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
      14:39:55        at java.lang.ref.Finalizer.access$100(Unknown Source)
      14:39:55        at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
      14:39:55    at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:341)
      14:39:55    at hudson.remoting.ExportTable.get(ExportTable.java:324)
      14:39:55    at hudson.remoting.Channel.getExportedObject(Channel.java:604)
      14:39:55    at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55    at java.lang.Thread.run(Thread.java:744)
      14:39:55 Caused by:   Released at Fri Dec 19 13:58:57 MSK 2014
      14:39:55    at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
      14:39:55    at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
      14:39:55    at hudson.remoting.Channel.unexport(Channel.java:612)
      14:39:55    at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
      14:39:55    at hudson.remoting.Channel$2.handle(Channel.java:483)
      14:39:55    at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
      14:39:55    at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
      14:39:55    at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55    ... 4 more
      14:39:55 Caused by: Command hudson.remoting.UnexportCommand@7f96d721 created at
      14:39:55    at hudson.remoting.Command.<init>(Command.java:67)
      14:39:55    at hudson.remoting.Command.<init>(Command.java:50)
      14:39:55    at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
      14:39:55    at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
      14:39:55    at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
      14:39:55    at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
      14:39:55    at java.lang.ref.Finalizer.access$100(Unknown Source)
      14:39:55    at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
      

      Stastically, ~10% of win-slaves in matrix-job break connection with this error

        Attachments

          Activity

          svchipiga Sergey Chipiga created issue -
          svchipiga Sergey Chipiga made changes -
          Field Original Value New Value
          Description I have a matrix-job.
          Jclouds plugin creates slaves for build.
          Slaves connect to jenkins via jnlp.

          Sometimes slave breaks connection:

          {code}
          14:39:55 2 failed, 214 passed, 1 skipped, 6 deselected, 1 warnings, 1 rerun in 2283.12 seconds
          14:39:55 + true
          14:39:55 Looks like the node went offline during the build. Check the slave log for the details.

          14:39:55

          FATAL: Remote call on win7-x86-ru-name-4a0 failed
          14:39:55 java.io.IOException: Remote call on win7-x86-ru-name-4a0 failed
          14:39:55 at hudson.remoting.Channel.call(Channel.java:760)
          14:39:55 at hudson.Launcher$RemoteLauncher.kill(Launcher.java:941)
          14:39:55 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:556)
          14:39:55 at hudson.model.Run.execute(Run.java:1745)
          14:39:55 at hudson.matrix.MatrixRun.run(MatrixRun.java:146)
          14:39:55 at hudson.model.ResourceController.execute(ResourceController.java:89)
          14:39:55 at hudson.model.Executor.run(Executor.java:240)
          14:39:55 Caused by: java.lang.Error: Unable to load resource winp.dll
          14:39:55 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:381)
          14:39:55 at java.lang.ClassLoader.getResource(Unknown Source)
          14:39:55 at org.jvnet.winp.Native.load(Native.java:85)
          14:39:55 at org.jvnet.winp.Native.<clinit>(Native.java:56)
          14:39:55 at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
          14:39:55 at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
          14:39:55 at hudson.util.ProcessTree.get(ProcessTree.java:328)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:121)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:49)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
          14:39:55 at hudson.remoting.Engine$1$1.run(Engine.java:63)
          14:39:55 at java.lang.Thread.run(Unknown Source)
          14:39:55 at ......remote call to partners-win7-home-premium-x86-ru-name-4a0(Native Method)
          14:39:55 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
          14:39:55 at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
          14:39:55 at hudson.remoting.Channel.call(Channel.java:752)
          14:39:55 ... 6 more
          14:39:55 Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Invalid object ID 2 iota=12
          14:39:55 at hudson.remoting.AsyncFutureImpl.get(AsyncFutureImpl.java:75)
          14:39:55 at hudson.remoting.FutureAdapter.get(FutureAdapter.java:55)
          14:39:55 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:373)
          14:39:55 at java.lang.ClassLoader.getResource(Unknown Source)
          14:39:55 at org.jvnet.winp.Native.load(Native.java:85)
          14:39:55 at org.jvnet.winp.Native.<clinit>(Native.java:56)
          14:39:55 at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
          14:39:55 at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
          14:39:55 at hudson.util.ProcessTree.get(ProcessTree.java:328)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:121)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:49)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
          14:39:55 at hudson.remoting.Engine$1$1.run(Engine.java:63)
          14:39:55 at java.lang.Thread.run(Unknown Source)
          14:39:55 Caused by: java.lang.IllegalStateException: Invalid object ID 2 iota=12
          14:39:55 at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:348)
          14:39:55 at hudson.remoting.ExportTable.get(ExportTable.java:324)
          14:39:55 at hudson.remoting.Channel.getExportedObject(Channel.java:604)
          14:39:55 at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 at ......remote call to channel(Native Method)
          14:39:55 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
          14:39:55 at hudson.remoting.Request.call(Request.java:171)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:176)
          14:39:55 at com.sun.proxy.$Proxy5.writeJarTo(Unknown Source)
          14:39:55 at hudson.remoting.FileSystemJarCache.retrieve(FileSystemJarCache.java:66)
          14:39:55 at hudson.remoting.JarCacheSupport$1.run(JarCacheSupport.java:62)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:104)
          14:39:55 ... 1 more
          14:39:55 Caused by: java.lang.Exception: Object was recently deallocated
          14:39:55 #2 (ref.0) : [hudson.remoting.JarLoader]
          14:39:55 Created at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.<init>(ExportTable.java:93)
          14:39:55 at hudson.remoting.ExportTable.export(ExportTable.java:299)
          14:39:55 at hudson.remoting.Channel.internalExport(Channel.java:600)
          14:39:55 at hudson.remoting.Channel.export(Channel.java:591)
          14:39:55 at hudson.remoting.Channel.<init>(Channel.java:472)
          14:39:55 at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:280)
          14:39:55 at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:290)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:36)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:52)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol$Handler.jnlpConnect(JnlpSlaveAgentProtocol.java:120)
          14:39:55 at jenkins.slaves.DefaultJnlpSlaveReceiver.handle(DefaultJnlpSlaveReceiver.java:63)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol2$Handler2.run(JnlpSlaveAgentProtocol2.java:57)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol2.handle(JnlpSlaveAgentProtocol2.java:31)
          14:39:55 at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:156)
          14:39:55 Released at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
          14:39:55 at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
          14:39:55 at hudson.remoting.Channel.unexport(Channel.java:612)
          14:39:55 at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
          14:39:55 at hudson.remoting.Channel$2.handle(Channel.java:483)
          14:39:55 at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
          14:39:55 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 Caused by: Command hudson.remoting.UnexportCommand@14daad94 created at
          14:39:55 at hudson.remoting.Command.<init>(Command.java:67)
          14:39:55 at hudson.remoting.Command.<init>(Command.java:50)
          14:39:55 at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
          14:39:55 at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
          14:39:55 at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer.access$100(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
          14:39:55 at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:341)
          14:39:55 at hudson.remoting.ExportTable.get(ExportTable.java:324)
          14:39:55 at hudson.remoting.Channel.getExportedObject(Channel.java:604)
          14:39:55 at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 Caused by: Released at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
          14:39:55 at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
          14:39:55 at hudson.remoting.Channel.unexport(Channel.java:612)
          14:39:55 at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
          14:39:55 at hudson.remoting.Channel$2.handle(Channel.java:483)
          14:39:55 at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
          14:39:55 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 ... 4 more
          14:39:55 Caused by: Command hudson.remoting.UnexportCommand@7f96d721 created at
          14:39:55 at hudson.remoting.Command.<init>(Command.java:67)
          14:39:55 at hudson.remoting.Command.<init>(Command.java:50)
          14:39:55 at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
          14:39:55 at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
          14:39:55 at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer.access$100(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
          {code}
          I have a matrix-job.
          Jclouds plugin creates slaves for build.
          Slaves connect to jenkins via jnlp.

          Sometimes slave breaks connection:

          {code}
          14:39:55 2 failed, 214 passed, 1 skipped, 6 deselected, 1 warnings, 1 rerun in 2283.12 seconds
          14:39:55 + true
          14:39:55 Looks like the node went offline during the build. Check the slave log for the details.

          14:39:55

          FATAL: Remote call on win7-x86-ru-name-4a0 failed
          14:39:55 java.io.IOException: Remote call on win7-x86-ru-name-4a0 failed
          14:39:55 at hudson.remoting.Channel.call(Channel.java:760)
          14:39:55 at hudson.Launcher$RemoteLauncher.kill(Launcher.java:941)
          14:39:55 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:556)
          14:39:55 at hudson.model.Run.execute(Run.java:1745)
          14:39:55 at hudson.matrix.MatrixRun.run(MatrixRun.java:146)
          14:39:55 at hudson.model.ResourceController.execute(ResourceController.java:89)
          14:39:55 at hudson.model.Executor.run(Executor.java:240)
          14:39:55 Caused by: java.lang.Error: Unable to load resource winp.dll
          14:39:55 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:381)
          14:39:55 at java.lang.ClassLoader.getResource(Unknown Source)
          14:39:55 at org.jvnet.winp.Native.load(Native.java:85)
          14:39:55 at org.jvnet.winp.Native.<clinit>(Native.java:56)
          14:39:55 at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
          14:39:55 at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
          14:39:55 at hudson.util.ProcessTree.get(ProcessTree.java:328)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:121)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:49)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
          14:39:55 at hudson.remoting.Engine$1$1.run(Engine.java:63)
          14:39:55 at java.lang.Thread.run(Unknown Source)
          14:39:55 at ......remote call to partners-win7-home-premium-x86-ru-name-4a0(Native Method)
          14:39:55 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
          14:39:55 at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
          14:39:55 at hudson.remoting.Channel.call(Channel.java:752)
          14:39:55 ... 6 more
          14:39:55 Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Invalid object ID 2 iota=12
          14:39:55 at hudson.remoting.AsyncFutureImpl.get(AsyncFutureImpl.java:75)
          14:39:55 at hudson.remoting.FutureAdapter.get(FutureAdapter.java:55)
          14:39:55 at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:373)
          14:39:55 at java.lang.ClassLoader.getResource(Unknown Source)
          14:39:55 at org.jvnet.winp.Native.load(Native.java:85)
          14:39:55 at org.jvnet.winp.Native.<clinit>(Native.java:56)
          14:39:55 at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
          14:39:55 at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
          14:39:55 at hudson.util.ProcessTree.get(ProcessTree.java:328)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
          14:39:55 at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:121)
          14:39:55 at hudson.remoting.UserRequest.perform(UserRequest.java:49)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
          14:39:55 at hudson.remoting.Engine$1$1.run(Engine.java:63)
          14:39:55 at java.lang.Thread.run(Unknown Source)
          14:39:55 Caused by: java.lang.IllegalStateException: Invalid object ID 2 iota=12
          14:39:55 at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:348)
          14:39:55 at hudson.remoting.ExportTable.get(ExportTable.java:324)
          14:39:55 at hudson.remoting.Channel.getExportedObject(Channel.java:604)
          14:39:55 at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 at ......remote call to channel(Native Method)
          14:39:55 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
          14:39:55 at hudson.remoting.Request.call(Request.java:171)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:176)
          14:39:55 at com.sun.proxy.$Proxy5.writeJarTo(Unknown Source)
          14:39:55 at hudson.remoting.FileSystemJarCache.retrieve(FileSystemJarCache.java:66)
          14:39:55 at hudson.remoting.JarCacheSupport$1.run(JarCacheSupport.java:62)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
          14:39:55 at java.util.concurrent.FutureTask.run(Unknown Source)
          14:39:55 at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:104)
          14:39:55 ... 1 more
          14:39:55 Caused by: java.lang.Exception: Object was recently deallocated
          14:39:55 #2 (ref.0) : [hudson.remoting.JarLoader]
          14:39:55 Created at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.<init>(ExportTable.java:93)
          14:39:55 at hudson.remoting.ExportTable.export(ExportTable.java:299)
          14:39:55 at hudson.remoting.Channel.internalExport(Channel.java:600)
          14:39:55 at hudson.remoting.Channel.export(Channel.java:591)
          14:39:55 at hudson.remoting.Channel.<init>(Channel.java:472)
          14:39:55 at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:280)
          14:39:55 at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:290)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:36)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:52)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol$Handler.jnlpConnect(JnlpSlaveAgentProtocol.java:120)
          14:39:55 at jenkins.slaves.DefaultJnlpSlaveReceiver.handle(DefaultJnlpSlaveReceiver.java:63)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol2$Handler2.run(JnlpSlaveAgentProtocol2.java:57)
          14:39:55 at jenkins.slaves.JnlpSlaveAgentProtocol2.handle(JnlpSlaveAgentProtocol2.java:31)
          14:39:55 at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:156)
          14:39:55 Released at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
          14:39:55 at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
          14:39:55 at hudson.remoting.Channel.unexport(Channel.java:612)
          14:39:55 at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
          14:39:55 at hudson.remoting.Channel$2.handle(Channel.java:483)
          14:39:55 at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
          14:39:55 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 Caused by: Command hudson.remoting.UnexportCommand@14daad94 created at
          14:39:55 at hudson.remoting.Command.<init>(Command.java:67)
          14:39:55 at hudson.remoting.Command.<init>(Command.java:50)
          14:39:55 at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
          14:39:55 at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
          14:39:55 at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer.access$100(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
          14:39:55 at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:341)
          14:39:55 at hudson.remoting.ExportTable.get(ExportTable.java:324)
          14:39:55 at hudson.remoting.Channel.getExportedObject(Channel.java:604)
          14:39:55 at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
          14:39:55 at hudson.remoting.Request$2.run(Request.java:324)
          14:39:55 at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
          14:39:55 at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
          14:39:55 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
          14:39:55 at java.lang.Thread.run(Thread.java:744)
          14:39:55 Caused by: Released at Fri Dec 19 13:58:57 MSK 2014
          14:39:55 at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
          14:39:55 at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
          14:39:55 at hudson.remoting.Channel.unexport(Channel.java:612)
          14:39:55 at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
          14:39:55 at hudson.remoting.Channel$2.handle(Channel.java:483)
          14:39:55 at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
          14:39:55 at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
          14:39:55 at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
          14:39:55 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
          14:39:55 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
          14:39:55 ... 4 more
          14:39:55 Caused by: Command hudson.remoting.UnexportCommand@7f96d721 created at
          14:39:55 at hudson.remoting.Command.<init>(Command.java:67)
          14:39:55 at hudson.remoting.Command.<init>(Command.java:50)
          14:39:55 at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
          14:39:55 at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
          14:39:55 at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
          14:39:55 at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer.access$100(Unknown Source)
          14:39:55 at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
          {code}

          Stastically, ~10% of win-slaves in matrix-job break connection with this error
          svchipiga Sergey Chipiga made changes -
          Labels slave
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 160165 ] JNJira + In-Review [ 180278 ]
          oleg_nenashev Oleg Nenashev made changes -
          Labels slave slave winp
          oleg_nenashev Oleg Nenashev made changes -
          Component/s remoting [ 15489 ]

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            svchipiga Sergey Chipiga
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: