Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-25305

Windows slave JVM crashes

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Fix
    • Icon: Critical Critical
    • windows-slaves-plugin
    • Master: Jenkins 1.585, SuSE11SP3
      Slave: Windows 7 Enterprise 64-bit

      I often see jobs fail with

      hudson.remoting.RequestAbortedException: hudson.remoting.RequestAbortedException: java.io.IOException: Connection reset by peer
	at hudson.remoting.RequestAbortedException.wrapForRethrow(RequestAbortedException.java:41)
	at hudson.remoting.RequestAbortedException.wrapForRethrow(RequestAbortedException.java:34)
	at hudson.remoting.Request.call(Request.java:174)
	at hudson.remoting.Channel.call(Channel.java:742)
	at hudson.Launcher$RemoteLauncher.kill(Launcher.java:940)
	at hudson.plugins.cygpath.CygpathLauncherDecorator$1.kill(CygpathLauncherDecorator.java:76)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:556)
	at hudson.model.Run.execute(Run.java:1759)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:89)
	at hudson.model.Executor.run(Executor.java:240)
Caused by: hudson.remoting.RequestAbortedException: java.io.IOException: Connection reset by peer
	at hudson.remoting.Request.abort(Request.java:299)
	at hudson.remoting.Channel.terminate(Channel.java:805)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:69)
Caused by: java.io.IOException: Connection reset by peer
	at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
	at sun.nio.ch.IOUtil.read(IOUtil.java:197)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:375)
	at hudson.remoting.SocketChannelStream$1.read(SocketChannelStream.java:35)
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:65)
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:109)
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
	at java.io.InputStream.read(InputStream.java:101)
	at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:81)
	at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:82)
	at java.io.ObjectInputStream$PeekInputStream.peek(ObjectInputStream.java:2296)
	at java.io.ObjectInputStream$BlockDataInputStream.peek(ObjectInputStream.java:2589)
	at java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2599)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1319)
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)
	at hudson.remoting.Command.readFrom(Command.java:92)
	at hudson.remoting.ClassicCommandTransport.read(ClassicCommandTransport.java:70)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)

      I attached a Java crash log I found that matches the time the above error was thrown.

        1. hs_err_pid11420.log
          27 kB

          [JENKINS-25305] Windows slave JVM crashes

          Pandu Aji added a comment -

          I'm seeing the same issue. Do we have any workaround (setting change, etc)? Is this bug confirmed?

          Pandu Aji added a comment - I'm seeing the same issue. Do we have any workaround (setting change, etc)? Is this bug confirmed?

          Brice V added a comment -

          got same issue today with Jenkins ver. 1.620
          any update ?

          Brice V added a comment - got same issue today with Jenkins ver. 1.620 any update ?

          Oleg Nenashev added a comment -

          It would be useful if somebody provides a log from the slave side

          Oleg Nenashev added a comment - It would be useful if somebody provides a log from the slave side

          Brice V added a comment -

          on my side, seems like for every jobs finishing with "IOException: Connection reset by peer" I got this slave error logs:

          Jan 22, 2016 8:56:03 AM hudson.remoting.jnlp.Main$CuiListener status
          INFO: Handshaking
          Jan 22, 2016 8:56:03 AM hudson.remoting.jnlp.Main$CuiListener error
          SEVERE: The server rejected the connection: AzureWin2012R2 is already connected to this master. Rejecting this connection.
          java.lang.Exception: The server rejected the connection: AzureWin2012R2 is already connected to this master. Rejecting this connection.
          at hudson.remoting.Engine.onConnectionRejected(Engine.java:306)
          at hudson.remoting.Engine.run(Engine.java:276)

          any hint ? a misconfig?

          Brice V added a comment - on my side, seems like for every jobs finishing with "IOException: Connection reset by peer" I got this slave error logs: Jan 22, 2016 8:56:03 AM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking Jan 22, 2016 8:56:03 AM hudson.remoting.jnlp.Main$CuiListener error SEVERE: The server rejected the connection: AzureWin2012R2 is already connected to this master. Rejecting this connection. java.lang.Exception: The server rejected the connection: AzureWin2012R2 is already connected to this master. Rejecting this connection. at hudson.remoting.Engine.onConnectionRejected(Engine.java:306) at hudson.remoting.Engine.run(Engine.java:276) any hint ? a misconfig?

          Bilel Yahia added a comment -

          We're having the same problem.

          Logs from server side:

          Connection was broken: java.io.IOException: Connection reset by peer
                at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
                at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
                at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
                at sun.nio.ch.IOUtil.read(IOUtil.java:197)
                at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
                at org.jenkinsci.remoting.nio.FifoBuffer$Pointer.receive(FifoBuffer.java:142)
                at org.jenkinsci.remoting.nio.FifoBuffer.receive(FifoBuffer.java:359)
                at org.jenkinsci.remoting.nio.NioChannelHub.run(NioChannelHub.java:564)
Caused: java.io.IOException: Connection aborted: org.jenkinsci.remoting.nio.NioChannelHub$MonoNioTransport@1ab8ef91[name=Channel to /]
                at org.jenkinsci.remoting.nio.NioChannelHub$NioTransport.abort(NioChannelHub.java:210)
                at org.jenkinsci.remoting.nio.NioChannelHub.run(NioChannelHub.java:635)
                at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
                at java.util.concurrent.FutureTask.run(FutureTask.java:266)
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
                at java.lang.Thread.run(Thread.java:745)

          Logs from slave side:

          Jun 12, 2017 7:13:17 AM hudson.remoting.SynchronousCommandTransport$ReaderThread run
SEVERE: I/O error in channel channel
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.BufferedInputStream.fill(Unknown Source)
at java.io.BufferedInputStream.read(Unknown Source)
at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:82)
at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:72)
at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:103)
at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)

Jun 12, 2017 7:13:17 AM hudson.remoting.jnlp.Main$CuiListener status
INFO: Terminated
Jun 12, 2017 7:13:27 AM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$2$1 onReconnect
INFO: Restarting agent via jenkins.slaves.restarter.WinswSlaveRestarter@63a236
Jun 12, 2017 7:13:37 AM hudson.remoting.jnlp.Main createEngine

          2017-06-12 07:13:32 - Stopping jenkinsslave-D__jenkins
2017-06-12 07:13:32 - ProcessKill 1748
2017-06-12 07:13:32 - Stopping process 1748
2017-06-12 07:13:32 - Send SIGINT 1748
2017-06-12 07:13:32 - SIGINT to1748 successful
2017-06-12 07:13:32 - Finished jenkinsslave-D__jenkins
2017-06-12 07:13:36 - Starting C:\Program Files (x86)\Java\jre1.8.0_121\bin\java.exe -Xrs -jar "D:\jenkins\slave.jar" -jnlpUrl https://jenkins/computer/jenkinsslave001/slave-agent.jnlp -secret f939a20894cb58d0e15a9269e859b7c8b2e8abf2b1ebda4a25f90f1e20ab30cf
2017-06-12 07:13:36 - Started 2656

          Bilel Yahia added a comment - We're having the same problem. Logs from server side: Connection was broken: java.io.IOException: Connection reset by peer                 at sun.nio.ch.FileDispatcherImpl.read0(Native Method)                 at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)                 at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)                 at sun.nio.ch.IOUtil.read(IOUtil.java:197)                 at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)                 at org.jenkinsci.remoting.nio.FifoBuffer$Pointer.receive(FifoBuffer.java:142)                 at org.jenkinsci.remoting.nio.FifoBuffer.receive(FifoBuffer.java:359)                 at org.jenkinsci.remoting.nio.NioChannelHub.run(NioChannelHub.java:564) Caused: java.io.IOException: Connection aborted: org.jenkinsci.remoting.nio.NioChannelHub$MonoNioTransport@1ab8ef91[name=Channel to /]                 at org.jenkinsci.remoting.nio.NioChannelHub$NioTransport.abort(NioChannelHub.java:210)                 at org.jenkinsci.remoting.nio.NioChannelHub.run(NioChannelHub.java:635)                 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)                 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)                 at java.util.concurrent.FutureTask.run(FutureTask.java:266)                 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)                 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)                 at java.lang. Thread .run( Thread .java:745) Logs from slave side: Jun 12, 2017 7:13:17 AM hudson.remoting.SynchronousCommandTransport$ReaderThread run SEVERE: I/O error in channel channel java.net.SocketException: Connection reset at java.net.SocketInputStream.read(Unknown Source) at java.net.SocketInputStream.read(Unknown Source) at java.io.BufferedInputStream.fill(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:82) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:72) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:103) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48) Jun 12, 2017 7:13:17 AM hudson.remoting.jnlp.Main$CuiListener status INFO: Terminated Jun 12, 2017 7:13:27 AM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$2$1 onReconnect INFO: Restarting agent via jenkins.slaves.restarter.WinswSlaveRestarter@63a236 Jun 12, 2017 7:13:37 AM hudson.remoting.jnlp.Main createEngine 2017-06-12 07:13:32 - Stopping jenkinsslave-D__jenkins 2017-06-12 07:13:32 - ProcessKill 1748 2017-06-12 07:13:32 - Stopping process 1748 2017-06-12 07:13:32 - Send SIGINT 1748 2017-06-12 07:13:32 - SIGINT to1748 successful 2017-06-12 07:13:32 - Finished jenkinsslave-D__jenkins 2017-06-12 07:13:36 - Starting C:\Program Files (x86)\Java\jre1.8.0_121\bin\java.exe -Xrs -jar "D:\jenkins\slave.jar" -jnlpUrl https: //jenkins/computer/jenkinsslave001/slave-agent.jnlp -secret f939a20894cb58d0e15a9269e859b7c8b2e8abf2b1ebda4a25f90f1e20ab30cf 2017-06-12 07:13:36 - Started 2656

          Mark Waite added a comment -

          Won't be fixed. See JENKINS-67604 for the details of the deprecation of agents started by WMI calls using DCOM.

          Mark Waite added a comment - Won't be fixed. See JENKINS-67604 for the details of the deprecation of agents started by WMI calls using DCOM.

            kohsuke Kohsuke Kawaguchi
            ams2990 Andy Shulman
            Votes:
            3 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: