Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-48850

Random java.io.IOException: Unexpected termination of the channel

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Minor Minor
    • remoting, ssh-slaves-plugin
    • None
    • Jenkins server/slave OS: Ubuntu 14.04.5 LTS
      Jenkins server/slave openJDK: 8u141-b15-3~14.04
      Jenkins: 2.89.2
      SSH-slave-plugin: 1.23

      Related to: JENKINS-25858 and JENKINS-48810

      Per suggestion from oleg_nenashev,
      I'm openning a separate bug ticket for further investigation.

      Jenkins Server log:

      Dec 21, 2017 12:17:09 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run
SEVERE: I/O error in channel jenkins-smoke-slave03(192.168.100.94)
java.io.IOException: Unexpected termination of the channel
        at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
Caused by: java.io.EOFException
        at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
        at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
        at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
        at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
        at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
        at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)

      Jenkins Slave log:

      Dec 21, 2017 12:15:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
INFO: rate(1min) = 381.9±905.3/sec; rate(5min) = 363.6±923.4/sec; rate(15min) = 335.3±927.4/sec; rate(total) = 100.3±521.0/sec; N = 35,086
Dec 21, 2017 12:16:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
INFO: rate(1min) = 272.0±705.3/sec; rate(5min) = 324.8±863.5/sec; rate(15min) = 322.8±905.9/sec; rate(total) = 100.3±521.0/sec; N = 35,098
Dec 21, 2017 12:17:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
INFO: rate(1min) = 321.9±768.9/sec; rate(5min) = 333.2±865.8/sec; rate(15min) = 326.3±905.0/sec; rate(total) = 100.4±521.2/sec; N = 35,110
ERROR: Connection terminated
ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.EOFException
        at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
        at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
        at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
        at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
        at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
        at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
Caused: java.io.IOException: Unexpected termination of the channel
        at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
ERROR: Socket connection to SSH server was lost
ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.IOException: Peer sent DISCONNECT message (reason code 2): Packet corrupt
        at com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:779)
        at com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
        at java.lang.Thread.run(Thread.java:748)
Slave JVM has not reported exit code before the socket was lost
[12/21/17 12:17:09] [SSH] Connection closed.

      This "Unexpected termination of the channel" has happened everyday (3 days in a roll) to any of slaves randomly since I updated the Jenkins core and all the plugins to the latest on Dec 19. 2017.

      The previous Jenkins core and plugin were updated back on April 2017:

      Jenkins Core: 2.46.2
      SSH-slave puglin: 1.16

      Due to the more than usual of the random "Unexpected termination of the channel",
      on "Dec 22. 2017" I downgraded Jenkins Core and SSH-slave plugin to:

      Jenkins Core: 2.60.3 (which remoting should be the same as 2.46.2 based on changelog)
      SSH-slave puglin: 1.16

      The issue has been eased since the downgrade,
      but the random "Unexpected termination of the channel" still happened a couple time so far.

        1. 2018-0104-jenkins.log.tgz
          872 kB
        2. 2018-0108-jenkins.log.tgz
          181 kB

          [JENKINS-48850] Random java.io.IOException: Unexpected termination of the channel

          Rick Liu created issue -
          Rick Liu made changes -
          Description Original: Related to: JENKINS-25858 and JENKINS-48810

          Per suggestion from [~oleg_nenashev],
          I'm openning a separate bug ticket for further investigation.


          h2. Jenkins Server log:
          {code}
          Dec 21, 2017 12:17:09 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run
          SEVERE: I/O error in channel jenkins-smoke-slave03(192.168.100.94)
          java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          Caused by: java.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          {code}


          h3. Jenkins Slave log:
          {code:java}
          Dec 21, 2017 12:15:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 381.9±905.3/sec; rate(5min) = 363.6±923.4/sec; rate(15min) = 335.3±927.4/sec; rate(total) = 100.3±521.0/sec; N = 35,086
          Dec 21, 2017 12:16:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 272.0±705.3/sec; rate(5min) = 324.8±863.5/sec; rate(15min) = 322.8±905.9/sec; rate(total) = 100.3±521.0/sec; N = 35,098
          Dec 21, 2017 12:17:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 321.9±768.9/sec; rate(5min) = 333.2±865.8/sec; rate(15min) = 326.3±905.0/sec; rate(total) = 100.4±521.2/sec; N = 35,110
          ERROR: Connection terminated
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          Caused: java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          ERROR: Socket connection to SSH server was lost
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.IOException: Peer sent DISCONNECT message (reason code 2): Packet corrupt
                  at com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:779)
                  at com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
                  at java.lang.Thread.run(Thread.java:748)
          Slave JVM has not reported exit code before the socket was lost
          [12/21/17 12:17:09] [SSH] Connection closed.
          {code}


          This "*Unexpected termination of the channel*" has happened everyday (3 days in a roll) to any of slaves randomly since I updated the Jenkins core and all the plugins to the latest on *Dec 19. 2017*.

          The previous Jenkins core and plugin were updated back on *April 2017*:
          {quote}
          Jenkins Core: 2.46.2
          SSH-slave puglin: 1.16
          {quote}

          Due to the more than usual of the random "*Unexpected termination of the channel*",
          I downgraded Jenkins Core and SSH-slave plugin to:
          {quote}
          Jenkins Core: 2.60.3 (which remoting should be the same as 2.46.2 based on changelog)
          SSH-slave puglin: 1.16
          {quote}


          		 New: Related to: JENKINS-25858 and JENKINS-48810

          Per suggestion from [~oleg_nenashev],
          I'm openning a separate bug ticket for further investigation.


          h2. Jenkins Server log:
          {code}
          Dec 21, 2017 12:17:09 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run
          SEVERE: I/O error in channel jenkins-smoke-slave03(192.168.100.94)
          java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          Caused by: java.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          {code}


          h3. Jenkins Slave log:
          {code:java}
          Dec 21, 2017 12:15:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 381.9±905.3/sec; rate(5min) = 363.6±923.4/sec; rate(15min) = 335.3±927.4/sec; rate(total) = 100.3±521.0/sec; N = 35,086
          Dec 21, 2017 12:16:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 272.0±705.3/sec; rate(5min) = 324.8±863.5/sec; rate(15min) = 322.8±905.9/sec; rate(total) = 100.3±521.0/sec; N = 35,098
          Dec 21, 2017 12:17:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 321.9±768.9/sec; rate(5min) = 333.2±865.8/sec; rate(15min) = 326.3±905.0/sec; rate(total) = 100.4±521.2/sec; N = 35,110
          ERROR: Connection terminated
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          Caused: java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          ERROR: Socket connection to SSH server was lost
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.IOException: Peer sent DISCONNECT message (reason code 2): Packet corrupt
                  at com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:779)
                  at com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
                  at java.lang.Thread.run(Thread.java:748)
          Slave JVM has not reported exit code before the socket was lost
          [12/21/17 12:17:09] [SSH] Connection closed.
          {code}


          This "*Unexpected termination of the channel*" has happened everyday (3 days in a roll) to any of slaves randomly since I updated the Jenkins core and all the plugins to the latest on *Dec 19. 2017*.

          The previous Jenkins core and plugin were updated back on *April 2017*:
          {quote}
          Jenkins Core: 2.46.2
          SSH-slave puglin: 1.16
          {quote}

          Due to the more than usual of the random "*Unexpected termination of the channel*",
          I downgraded Jenkins Core and SSH-slave plugin to:
          {quote}
          Jenkins Core: 2.60.3 (which remoting should be the same as 2.46.2 based on changelog)
          SSH-slave puglin: 1.16
          {quote}

          The issue has been eased since the downgrade,
          but the random "*Unexpected termination of the channel*" still happened a couple time so far.
          Rick Liu made changes -
          Description Original: Related to: JENKINS-25858 and JENKINS-48810

          Per suggestion from [~oleg_nenashev],
          I'm openning a separate bug ticket for further investigation.


          h2. Jenkins Server log:
          {code}
          Dec 21, 2017 12:17:09 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run
          SEVERE: I/O error in channel jenkins-smoke-slave03(192.168.100.94)
          java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          Caused by: java.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          {code}


          h3. Jenkins Slave log:
          {code:java}
          Dec 21, 2017 12:15:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 381.9±905.3/sec; rate(5min) = 363.6±923.4/sec; rate(15min) = 335.3±927.4/sec; rate(total) = 100.3±521.0/sec; N = 35,086
          Dec 21, 2017 12:16:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 272.0±705.3/sec; rate(5min) = 324.8±863.5/sec; rate(15min) = 322.8±905.9/sec; rate(total) = 100.3±521.0/sec; N = 35,098
          Dec 21, 2017 12:17:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 321.9±768.9/sec; rate(5min) = 333.2±865.8/sec; rate(15min) = 326.3±905.0/sec; rate(total) = 100.4±521.2/sec; N = 35,110
          ERROR: Connection terminated
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          Caused: java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          ERROR: Socket connection to SSH server was lost
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.IOException: Peer sent DISCONNECT message (reason code 2): Packet corrupt
                  at com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:779)
                  at com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
                  at java.lang.Thread.run(Thread.java:748)
          Slave JVM has not reported exit code before the socket was lost
          [12/21/17 12:17:09] [SSH] Connection closed.
          {code}


          This "*Unexpected termination of the channel*" has happened everyday (3 days in a roll) to any of slaves randomly since I updated the Jenkins core and all the plugins to the latest on *Dec 19. 2017*.

          The previous Jenkins core and plugin were updated back on *April 2017*:
          {quote}
          Jenkins Core: 2.46.2
          SSH-slave puglin: 1.16
          {quote}

          Due to the more than usual of the random "*Unexpected termination of the channel*",
          I downgraded Jenkins Core and SSH-slave plugin to:
          {quote}
          Jenkins Core: 2.60.3 (which remoting should be the same as 2.46.2 based on changelog)
          SSH-slave puglin: 1.16
          {quote}

          The issue has been eased since the downgrade,
          but the random "*Unexpected termination of the channel*" still happened a couple time so far.


          		 New: Related to: JENKINS-25858 and JENKINS-48810

          Per suggestion from [~oleg_nenashev],
          I'm openning a separate bug ticket for further investigation.


          h2. Jenkins Server log:
          {code}
          Dec 21, 2017 12:17:09 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run
          SEVERE: I/O error in channel jenkins-smoke-slave03(192.168.100.94)
          java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          Caused by: java.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          {code}


          h3. Jenkins Slave log:
          {code:java}
          Dec 21, 2017 12:15:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 381.9±905.3/sec; rate(5min) = 363.6±923.4/sec; rate(15min) = 335.3±927.4/sec; rate(total) = 100.3±521.0/sec; N = 35,086
          Dec 21, 2017 12:16:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 272.0±705.3/sec; rate(5min) = 324.8±863.5/sec; rate(15min) = 322.8±905.9/sec; rate(total) = 100.3±521.0/sec; N = 35,098
          Dec 21, 2017 12:17:09 PM hudson.remoting.RemoteInvocationHandler$Unexporter reportStats
          INFO: rate(1min) = 321.9±768.9/sec; rate(5min) = 333.2±865.8/sec; rate(15min) = 326.3±905.0/sec; rate(total) = 100.4±521.2/sec; N = 35,110
          ERROR: Connection terminated
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.EOFException
                  at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
                  at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
                  at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
                  at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
                  at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
                  at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
          Caused: java.io.IOException: Unexpected termination of the channel
                  at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
          ERROR: Socket connection to SSH server was lost
          ESC[8mha:////4Cm+u8BY/EgsbhzNlnUfOXWprV5tRETZDv4u6647BaROAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==ESC[0mjava.io.IOException: Peer sent DISCONNECT message (reason code 2): Packet corrupt
                  at com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:779)
                  at com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
                  at java.lang.Thread.run(Thread.java:748)
          Slave JVM has not reported exit code before the socket was lost
          [12/21/17 12:17:09] [SSH] Connection closed.
          {code}


          This "*Unexpected termination of the channel*" has happened everyday (3 days in a roll) to any of slaves randomly since I updated the Jenkins core and all the plugins to the latest on *Dec 19. 2017*.

          The previous Jenkins core and plugin were updated back on *April 2017*:
          {quote}
          Jenkins Core: 2.46.2
          SSH-slave puglin: 1.16
          {quote}

          Due to the more than usual of the random "*Unexpected termination of the channel*",
          on "*Dec 22. 2017*" I downgraded Jenkins Core and SSH-slave plugin to:
          {quote}
          Jenkins Core: 2.60.3 (which remoting should be the same as 2.46.2 based on changelog)
          SSH-slave puglin: 1.16
          {quote}

          The issue has been eased since the downgrade,
          but the random "*Unexpected termination of the channel*" still happened a couple time so far.
          Rick Liu made changes -
          Attachment New: 2018-0104-jenkins.log.tgz [ 41077 ]
          Rick Liu made changes -
          Attachment New: 2018-0108-jenkins.log.tgz [ 41078 ]
          Francois Aichelbaum made changes -
          Assignee Original: Oleg Nenashev [ oleg_nenashev ] New: Francois Aichelbaum [ faichelbaum ]
          Oleg Nenashev made changes -
          Link New: This issue relates to JENKINS-48810 [ JENKINS-48810 ]
          Owen Mehegan made changes -
          Assignee Original: Francois Aichelbaum [ faichelbaum ] New: Oleg Nenashev [ oleg_nenashev ]
          Owen Mehegan made changes -
          Assignee Original: Oleg Nenashev [ oleg_nenashev ] New: Jeff Thompson [ jthompson ]
          Jeff Thompson made changes -
          Resolution New: Cannot Reproduce [ 5 ]
          Status Original: Open [ 1 ] New: Closed [ 6 ]

            jthompson Jeff Thompson
            totoroliu Rick Liu
            Votes:
            5 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: