• Type: Bug
• Resolution: Duplicate
• Priority: Critical
• Component/s: ec2-plugin
• Labels:

  • connection
  • ec2
  • ec2-plugin
  • jenkins
  • plugin
  • ssh-slave

[JENKINS-38717] EC2 slave goes offline

deepanshu madan created issue - 2016-10-05 01:49

deepanshu madan made changes - 2016-10-05 02:03

Description

Original: EC2 slaves are created and connected through ssh when a build is started but it goes offline after every 9-10 minutes with this error log. {code:java} SEVERE: I/O error in channel jenkins-roadrunner-linux-builder-slave (i-9fc2c187) java.io.IOException: Unexpected termination of the channel         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException         at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2335)         at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2804)         at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:802)         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)         at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)         at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59) {code}

New: EC2 slaves are created and connected through ssh when a build is started but it goes offline after every 9-10 minutes with this error log. Jenkins - 2.7.4 *E2 slave system*: Groovy: 2.4.4 Ant: Apache Ant(TM) version 1.9.6 compiled on June 29 2015 JVM: 1.8.0_60 (Oracle Corporation 25.60-b23) OS: Linux 4.4.11-23.53.amzn1.x86_64 amd64 {code:java} SEVERE: I/O error in channel jenkins-roadrunner-linux-builder-slave (i-9fc2c187) java.io.IOException: Unexpected termination of the channel         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException         at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2335)         at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2804)         at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:802)         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)         at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)         at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59) {code}

deepanshu madan made changes - 2016-10-05 02:04

Description

Original: EC2 slaves are created and connected through ssh when a build is started but it goes offline after every 9-10 minutes with this error log. Jenkins - 2.7.4 *E2 slave system*: Groovy: 2.4.4 Ant: Apache Ant(TM) version 1.9.6 compiled on June 29 2015 JVM: 1.8.0_60 (Oracle Corporation 25.60-b23) OS: Linux 4.4.11-23.53.amzn1.x86_64 amd64 {code:java} SEVERE: I/O error in channel jenkins-roadrunner-linux-builder-slave (i-9fc2c187) java.io.IOException: Unexpected termination of the channel         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException         at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2335)         at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2804)         at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:802)         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)         at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)         at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59) {code}

New: EC2 slaves are created and connected through ssh when a build is started but it goes offline after every 9-10 minutes with this error log. Jenkins - 2.7.4 EC2 plugin 1.35 *E2 slave machine system*: Groovy: 2.4.4 Ant: Apache Ant(TM) version 1.9.6 compiled on June 29 2015 JVM: 1.8.0_60 (Oracle Corporation 25.60-b23) OS: Linux 4.4.11-23.53.amzn1.x86_64 amd64 {code:java} SEVERE: I/O error in channel jenkins-roadrunner-linux-builder-slave (i-9fc2c187) java.io.IOException: Unexpected termination of the channel         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException         at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2335)         at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2804)         at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:802)         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)         at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)         at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)         at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59) {code}

Collapse comment: Francis Upton added a comment - 2016-10-05 02:44

Francis Upton added a comment - 2016-10-05 02:44

Please try plugin version 1.36

Expand comment: Francis Upton added a comment - 2016-10-05 02:44

Francis Upton added a comment - 2016-10-05 02:44 Please try plugin version 1.36

Collapse comment: deepanshu madan added a comment - 2016-10-05 04:51

deepanshu madan added a comment - 2016-10-05 04:51

francisu it still happens with v 1.36
The gradle build stops in between with "Agent went offline during the build" and with the error above. That error is too generic, I am not able to figure what's the root cause of it.

Expand comment: deepanshu madan added a comment - 2016-10-05 04:51

deepanshu madan added a comment - 2016-10-05 04:51 francisu it still happens with v 1.36 The gradle build stops in between with "Agent went offline during the build" and with the error above. That error is too generic, I am not able to figure what's the root cause of it.

Collapse comment: deepanshu madan added a comment - 2016-10-05 06:49

deepanshu madan added a comment - 2016-10-05 06:49

and I verified its nothing with that particular build job, the ec2 slave just looses the ssh connection after around 10 minutes.

Expand comment: deepanshu madan added a comment - 2016-10-05 06:49

deepanshu madan added a comment - 2016-10-05 06:49 and I verified its nothing with that particular build job, the ec2 slave just looses the ssh connection after around 10 minutes.

deepanshu madan made changes - 2016-10-05 23:05

Resolution		New: Duplicate [ 3 ]
Status	Original: Open [ 1 ]	New: Closed [ 6 ]

Collapse comment: Sajj Farahani added a comment - 2018-05-24 08:02

Sajj Farahani added a comment - 2018-05-24 08:02

Was this ever solved deepanshu11madan? I'm having the same issue. I think it is something to do with the OS

Expand comment: Sajj Farahani added a comment - 2018-05-24 08:02

Sajj Farahani added a comment - 2018-05-24 08:02 Was this ever solved deepanshu11madan ? I'm having the same issue. I think it is something to do with the OS