[JENKINS-43516] ec2-fleet plugin can no longer connect to nodes on Jenkins version 2.54

Type: Bug
Resolution: Not A Defect
Priority: Critical
Component/s: ec2-fleet-plugin
Labels:
None
Environment:

Hide
Jenkins version 2.54 package on EC2 AMI

awt.toolkit sun.awt.X11.XToolkit
com.sun.akuma.Daemon daemonized
executable-war /usr/lib/jenkins/jenkins.war
file.encoding UTF-8
file.encoding.pkg sun.io
file.separator /
java.awt.graphicsenv sun.awt.X11GraphicsEnvironment
java.awt.headless true
java.awt.printerjob sun.print.PSPrinterJob
java.class.path /usr/lib/jenkins/jenkins.war
java.class.version 52.0
java.endorsed.dirs /opt/java/jdk1.8.0_121/jre/lib/endorsed
java.ext.dirs /opt/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext
java.home /opt/java/jdk1.8.0_121/jre
java.io.tmpdir /var/lib/jenkins/tmp
java.library.path /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
java.net.preferIPv4Stack true
java.runtime.name Java(TM) SE Runtime Environment
java.runtime.version 1.8.0_121-b13
java.specification.name Java Platform API Specification
java.specification.vendor Oracle Corporation
java.specification.version 1.8
java.vendor Oracle Corporation
java.vendor.url http://java.oracle.com/
java.vendor.url.bug http://bugreport.sun.com/bugreport/
java.version 1.8.0_121
java.vm.info mixed mode
java.vm.name Java HotSpot(TM) 64-Bit Server VM
java.vm.specification.name Java Virtual Machine Specification
java.vm.specification.vendor Oracle Corporation
java.vm.specification.version 1.8
java.vm.vendor Oracle Corporation
java.vm.version 25.121-b13
JENKINS_HOME /var/lib/jenkins
jna.loaded true
jna.platform.library.path /usr/lib64:/lib64:/usr/lib:/lib:/usr/lib64/mysql
jnidispatch.path /var/lib/jenkins/tmp/jna--1712433994/jna4771093068434555871.tmp
line.separator
mail.smtp.sendpartial true
mail.smtps.sendpartial true
org.apache.commons.jelly.tags.fmt.timeZone America/Chicago
org.eclipse.jetty.server.Request.maxFormContentSize 600000
os.arch amd64
os.name Linux
os.version 4.9.20-10.30.amzn1.x86_64
path.separator :
sun.arch.data.model 64
sun.boot.class.path /opt/java/jdk1.8.0_121/jre/lib/resources.jar:/opt/java/jdk1.8.0_121/jre/lib/rt.jar:/opt/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/opt/java/jdk1.8.0_121/jre/lib/jsse.jar:/opt/java/jdk1.8.0_121/jre/lib/jce.jar:/opt/java/jdk1.8.0_121/jre/lib/charsets.jar:/opt/java/jdk1.8.0_121/jre/lib/jfr.jar:/opt/java/jdk1.8.0_121/jre/classes
sun.boot.library.path /opt/java/jdk1.8.0_121/jre/lib/amd64
sun.cpu.endian little
sun.cpu.isalist
sun.font.fontmanager sun.awt.X11FontManager
sun.io.unicode.encoding UnicodeLittle
sun.java.command /usr/lib/jenkins/jenkins.war --logfile=/var/log/jenkins/jenkins.log --webroot=/var/cache/jenkins/war --daemon --httpPort=8090 --debug=9 --handlerCountMax=100 --handlerCountMaxIdle=20
sun.java.launcher SUN_STANDARD
sun.jnu.encoding UTF-8
sun.management.compiler HotSpot 64-Bit Tiered Compilers
sun.os.patch.level unknown
svnkit.http.methods Digest,Basic,NTLM,Negotiate
svnkit.ssh2.persistent false
user.country US
user.dir /
user.home /var/lib/jenkins
user.language en
user.name jenkins
user.timezone Etc/UTC
Environment Variables

Name ↓
Value
_ /opt/java/jdk1.8.0_121/bin/java
HOME /var/lib/jenkins
LANG en_US.UTF-8
LOGNAME jenkins
NLSPATH /usr/dt/lib/nls/msg/%L/%N.cat
PATH /sbin:/usr/sbin:/bin:/usr/bin
PWD /
SHELL /bin/bash
SHLVL 4
TERM xterm
USER jenkins
XFILESEARCHPATH /usr/dt/app-defaults/%L/Dt
Plugins

Name ↓
Version
Enabled
ace-editor 1.1 true
analysis-collector 1.50 true
analysis-core 1.86 true
ansicolor 0.5.0 true
ant 1.4 true
antisamy-markup-formatter 1.5 true
authentication-tokens 1.3 true
aws-credentials 1.19 true
aws-java-sdk 1.11.68.1 true
bitbucket 1.1.5 true
bitbucket-approve 1.0.3 true
bitbucket-oauth 0.5 true
blueocean 1.0.0 true
blueocean-autofavorite 0.6 true
blueocean-commons 1.0.0 true
blueocean-config 1.0.0 true
blueocean-dashboard 1.0.0 true
blueocean-display-url 1.5.1 true
blueocean-events 1.0.0 true
blueocean-git-pipeline 1.0.0 true
blueocean-github-pipeline 1.0.0 true
blueocean-i18n 1.0.0 true
blueocean-jwt 1.0.0 true
blueocean-personalization 1.0.0 true
blueocean-pipeline-api-impl 1.0.0 true
blueocean-pipeline-editor 0.2.0 true
blueocean-rest 1.0.0 true
blueocean-rest-impl 1.0.0 true
blueocean-web 1.0.0 true
bouncycastle-api 2.16.1 true
branch-api 2.0.8 true
build-failure-analyzer 1.18.1 true
build-monitor-plugin 1.11+build.201701152243 true
build-name-setter 1.6.5 true
build-timeout 1.18 true
checkstyle 3.48 true
claim 2.9 true
cloudbees-folder 6.0.3 true
credentials 2.1.13 true
credentials-binding 1.11 true
cvs 2.13 true
dashboard-view 2.9.10 true
description-setter 1.10 true
display-url-api 1.1.1 true
docker-commons 1.6 true
docker-workflow 1.10 true
durable-task 1.13 true
ec2-fleet 1.1.2 true
email-ext 2.57.2 true
external-monitor-job 1.7 true
extra-columns 1.18 true
favorite 2.0.4 true
findbugs 4.70 true
git 3.2.0 true
git-client 2.4.1 true
git-notes 0.0.4 true
git-server 1.7 true
github 1.26.2 true
github-api 1.85 true
github-branch-source 2.0.5 true
github-oauth 0.25 true
github-organization-folder 1.6 true
gradle 1.26 true
handlebars 1.1.1 true
htmlpublisher 1.12 true
icon-shim 2.0.3 true
jackson2-api 2.7.3 true
javadoc 1.4 true
jquery-detached 1.2.1 true
junit 1.20 true
ldap 1.14 true
mailer 1.20 true
mapdb-api 1.0.9.0 true
matrix-auth 1.5 true
matrix-project 1.9 true
maven-plugin 2.15.1 true
mercurial 1.59 true
metrics 3.1.2.9 true
mission-control-view 0.9.9 true
momentjs 1.1.1 true
notification 1.11 true
pam-auth 1.3 true
periodicbackup 1.3 true
pipeline-build-step 2.5 true
pipeline-github-lib 1.0 true
pipeline-graph-analysis 1.3 true
pipeline-input-step 2.5 true
pipeline-milestone-step 1.3.1 true
pipeline-model-api 1.1.2 true
pipeline-model-declarative-agent 1.1.1 true
pipeline-model-definition 1.1.2 true
pipeline-model-extensions 1.1.2 true
pipeline-rest-api 2.6 true
pipeline-stage-step 2.2 true
pipeline-stage-tags-metadata 1.1.2 true
pipeline-stage-view 2.6 true
plain-credentials 1.4 true
pmd 3.47 true
project-health-report 1.2 true
publish-over-ssh 1.17 true
pubsub-light 1.7 true
resource-disposer 0.6 true
role-strategy 2.4.0 true
ruby-runtime 0.13 true
scm-api 2.1.1 true
script-security 1.27 true
slack 2.2 true
sse-gateway 1.15 true
ssh 2.4 true
ssh-agent 1.15 true
ssh-credentials 1.13 true
ssh-slaves 1.16 true
structs 1.6 true
subversion 2.7.2 true
tasks 4.51 true
testng-plugin 1.14 true
timestamper 1.8.8 true
token-macro 2.1 true
translation 1.15 true
variant 1.1 true
violations 0.7.11 true
warnings 4.62 true
windows-slaves 1.3.1 true
workflow-aggregator 2.5 true
workflow-api 2.12 true
workflow-basic-steps 2.4 true
workflow-cps 2.29 true
workflow-cps-global-lib 2.7 true
workflow-durable-task-step 2.10 true
workflow-job 2.10 true
workflow-multibranch 2.14 true
workflow-scm-step 2.4 true
workflow-step-api 2.9 true
workflow-support 2.14 true
ws-cleanup 0.32 true

Show
Jenkins version 2.54 package on EC2 AMI awt.toolkit sun.awt.X11.XToolkit com.sun.akuma.Daemon daemonized executable-war /usr/lib/jenkins/jenkins.war file.encoding UTF-8 file.encoding.pkg sun.io file.separator / java.awt.graphicsenv sun.awt.X11GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.print.PSPrinterJob java.class.path /usr/lib/jenkins/jenkins.war java.class.version 52.0 java.endorsed.dirs /opt/java/jdk1.8.0_121/jre/lib/endorsed java.ext.dirs /opt/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext java.home /opt/java/jdk1.8.0_121/jre java.io.tmpdir /var/lib/jenkins/tmp java.library.path /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib java.net.preferIPv4Stack true java.runtime.name Java(TM) SE Runtime Environment java.runtime.version 1.8.0_121-b13 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.8 java.vendor Oracle Corporation java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.8.0_121 java.vm.info mixed mode java.vm.name Java HotSpot(TM) 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.8 java.vm.vendor Oracle Corporation java.vm.version 25.121-b13 JENKINS_HOME /var/lib/jenkins jna.loaded true jna.platform.library.path /usr/lib64:/lib64:/usr/lib:/lib:/usr/lib64/mysql jnidispatch.path /var/lib/jenkins/tmp/jna--1712433994/jna4771093068434555871.tmp line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true org.apache.commons.jelly.tags.fmt.timeZone America/Chicago org.eclipse.jetty.server.Request.maxFormContentSize 600000 os.arch amd64 os.name Linux os.version 4.9.20-10.30.amzn1.x86_64 path.separator : sun.arch.data.model 64 sun.boot.class.path /opt/java/jdk1.8.0_121/jre/lib/resources.jar:/opt/java/jdk1.8.0_121/jre/lib/rt.jar:/opt/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/opt/java/jdk1.8.0_121/jre/lib/jsse.jar:/opt/java/jdk1.8.0_121/jre/lib/jce.jar:/opt/java/jdk1.8.0_121/jre/lib/charsets.jar:/opt/java/jdk1.8.0_121/jre/lib/jfr.jar:/opt/java/jdk1.8.0_121/jre/classes sun.boot.library.path /opt/java/jdk1.8.0_121/jre/lib/amd64 sun.cpu.endian little sun.cpu.isalist sun.font.fontmanager sun.awt.X11FontManager sun.io.unicode.encoding UnicodeLittle sun.java.command /usr/lib/jenkins/jenkins.war --logfile=/var/log/jenkins/jenkins.log --webroot=/var/cache/jenkins/war --daemon --httpPort=8090 --debug=9 --handlerCountMax=100 --handlerCountMaxIdle=20 sun.java.launcher SUN_STANDARD sun.jnu.encoding UTF-8 sun.management.compiler HotSpot 64-Bit Tiered Compilers sun.os.patch.level unknown svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false user.country US user.dir / user.home /var/lib/jenkins user.language en user.name jenkins user.timezone Etc/UTC Environment Variables Name ↓ Value _ /opt/java/jdk1.8.0_121/bin/java HOME /var/lib/jenkins LANG en_US.UTF-8 LOGNAME jenkins NLSPATH /usr/dt/lib/nls/msg/%L/%N.cat PATH /sbin:/usr/sbin:/bin:/usr/bin PWD / SHELL /bin/bash SHLVL 4 TERM xterm USER jenkins XFILESEARCHPATH /usr/dt/app-defaults/%L/Dt Plugins Name ↓ Version Enabled ace-editor 1.1 true analysis-collector 1.50 true analysis-core 1.86 true ansicolor 0.5.0 true ant 1.4 true antisamy-markup-formatter 1.5 true authentication-tokens 1.3 true aws-credentials 1.19 true aws-java-sdk 1.11.68.1 true bitbucket 1.1.5 true bitbucket-approve 1.0.3 true bitbucket-oauth 0.5 true blueocean 1.0.0 true blueocean-autofavorite 0.6 true blueocean-commons 1.0.0 true blueocean-config 1.0.0 true blueocean-dashboard 1.0.0 true blueocean-display-url 1.5.1 true blueocean-events 1.0.0 true blueocean-git-pipeline 1.0.0 true blueocean-github-pipeline 1.0.0 true blueocean-i18n 1.0.0 true blueocean-jwt 1.0.0 true blueocean-personalization 1.0.0 true blueocean-pipeline-api-impl 1.0.0 true blueocean-pipeline-editor 0.2.0 true blueocean-rest 1.0.0 true blueocean-rest-impl 1.0.0 true blueocean-web 1.0.0 true bouncycastle-api 2.16.1 true branch-api 2.0.8 true build-failure-analyzer 1.18.1 true build-monitor-plugin 1.11+build.201701152243 true build-name-setter 1.6.5 true build-timeout 1.18 true checkstyle 3.48 true claim 2.9 true cloudbees-folder 6.0.3 true credentials 2.1.13 true credentials-binding 1.11 true cvs 2.13 true dashboard-view 2.9.10 true description-setter 1.10 true display-url-api 1.1.1 true docker-commons 1.6 true docker-workflow 1.10 true durable-task 1.13 true ec2-fleet 1.1.2 true email-ext 2.57.2 true external-monitor-job 1.7 true extra-columns 1.18 true favorite 2.0.4 true findbugs 4.70 true git 3.2.0 true git-client 2.4.1 true git-notes 0.0.4 true git-server 1.7 true github 1.26.2 true github-api 1.85 true github-branch-source 2.0.5 true github-oauth 0.25 true github-organization-folder 1.6 true gradle 1.26 true handlebars 1.1.1 true htmlpublisher 1.12 true icon-shim 2.0.3 true jackson2-api 2.7.3 true javadoc 1.4 true jquery-detached 1.2.1 true junit 1.20 true ldap 1.14 true mailer 1.20 true mapdb-api 1.0.9.0 true matrix-auth 1.5 true matrix-project 1.9 true maven-plugin 2.15.1 true mercurial 1.59 true metrics 3.1.2.9 true mission-control-view 0.9.9 true momentjs 1.1.1 true notification 1.11 true pam-auth 1.3 true periodicbackup 1.3 true pipeline-build-step 2.5 true pipeline-github-lib 1.0 true pipeline-graph-analysis 1.3 true pipeline-input-step 2.5 true pipeline-milestone-step 1.3.1 true pipeline-model-api 1.1.2 true pipeline-model-declarative-agent 1.1.1 true pipeline-model-definition 1.1.2 true pipeline-model-extensions 1.1.2 true pipeline-rest-api 2.6 true pipeline-stage-step 2.2 true pipeline-stage-tags-metadata 1.1.2 true pipeline-stage-view 2.6 true plain-credentials 1.4 true pmd 3.47 true project-health-report 1.2 true publish-over-ssh 1.17 true pubsub-light 1.7 true resource-disposer 0.6 true role-strategy 2.4.0 true ruby-runtime 0.13 true scm-api 2.1.1 true script-security 1.27 true slack 2.2 true sse-gateway 1.15 true ssh 2.4 true ssh-agent 1.15 true ssh-credentials 1.13 true ssh-slaves 1.16 true structs 1.6 true subversion 2.7.2 true tasks 4.51 true testng-plugin 1.14 true timestamper 1.8.8 true token-macro 2.1 true translation 1.15 true variant 1.1 true violations 0.7.11 true warnings 4.62 true windows-slaves 1.3.1 true workflow-aggregator 2.5 true workflow-api 2.12 true workflow-basic-steps 2.4 true workflow-cps 2.29 true workflow-cps-global-lib 2.7 true workflow-durable-task-step 2.10 true workflow-job 2.10 true workflow-multibranch 2.14 true workflow-scm-step 2.4 true workflow-step-api 2.9 true workflow-support 2.14 true ws-cleanup 0.32 true

Similar Issues:
Powered by SuggestiMate

Show
Epic Link:
Java 8 upgrade fallout and follow-ups

After upgrading from Jenkins version 2.53 to 2.54, the ec2-fleet-plugin can no longer connect to ec2-fleet nodes. Downgrading to 2.53 resolved the issue.

Apr 11, 2017 6:44:41 PM hudson.slaves.SlaveComputer tryReconnect 
INFO: Attempting to reconnect i-0253ae1397c99cef9 
[04/11/17 18:44:45] SSH Launch of i-0253ae1397c99cef9 on 52.201.254.50 failed in 4,176 ms 
Apr 11, 2017 6:44:45 PM hudson.remoting.SynchronousCommandTransport$ReaderThread run 
SEVERE: I/O error in channel i-0253ae1397c99cef9 
java.io.IOException: Unexpected termination of the channel 
       at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) 
Caused by: java.io.EOFException 
       at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2624) 
       at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3099) 
       at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853) 
       at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349) 
       at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48) 
       at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) 
       at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59)

Russ Tennant created issue - 2017-04-11 18:55

Russ Tennant made changes - 2017-04-11 18:55

Summary

Original: ec2-fleet plugin can no longer connect to nodes on 2.54

New: ec2-fleet plugin can no longer connect to nodes on Jenkins version 2.54

Oleg Nenashev added a comment - 2017-04-11 19:57

Does ec2-fleet plugin configuration use Java 7? I would guess so

Oleg Nenashev added a comment - 2017-04-11 19:57 Does ec2-fleet plugin configuration use Java 7? I would guess so

Russ Tennant added a comment - 2017-04-11 20:20

oleg_nenashev I'm not sure if I understand your question. The Jenkins server runs on java 8.

java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)

Russ Tennant added a comment - 2017-04-11 20:20 oleg_nenashev I'm not sure if I understand your question. The Jenkins server runs on java 8. java version "1.8.0_121" Java(TM) SE Runtime Environment (build 1.8.0_121-b13) Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)

Oleg Nenashev added a comment - 2017-04-11 20:27

Sorry if I was not clear. The question was about Jenkins agents being connected by the plugin.

Oleg Nenashev added a comment - 2017-04-11 20:27 Sorry if I was not clear. The question was about Jenkins agents being connected by the plugin.

Russ Tennant added a comment - 2017-04-11 21:37

I think you're correct. I am fairly certain the secondary ec2 fleet node's run Java 7. I'll check in a bit and add a comment.

Russ Tennant added a comment - 2017-04-11 21:37 I think you're correct. I am fairly certain the secondary ec2 fleet node's run Java 7. I'll check in a bit and add a comment.

Russ Tennant added a comment - 2017-04-11 21:42

The ec2 fleet nodes are running Java 7

java version "1.7.0_131"
OpenJDK Runtime Environment (amzn-2.6.9.0.71.amzn1-x86_64 u131-b00)
OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)

Russ Tennant added a comment - 2017-04-11 21:42 The ec2 fleet nodes are running Java 7 java version "1.7.0_131" OpenJDK Runtime Environment (amzn-2.6.9.0.71.amzn1-x86_64 u131-b00) OpenJDK 64-Bit Server VM (build 24.131-b00, mixed mode)

Oleg Nenashev made changes - 2017-04-12 11:34

Epic Link

New: ~~JENKINS-43500~~ [ 180815 ]

Oleg Nenashev added a comment - 2017-04-12 11:35

The it is an "as designed" behavior. In 2.54 Jenkins' Java minimal requirement has been updated to Java 8, hence all agents need to be updated.

Oleg Nenashev added a comment - 2017-04-12 11:35 The it is an "as designed" behavior. In 2.54 Jenkins' Java minimal requirement has been updated to Java 8, hence all agents need to be updated.

Oleg Nenashev made changes - 2017-04-12 11:35

Resolution		New: Not A Defect [ 7 ]
Status	Original: Open [ 1 ]	New: Resolved [ 5 ]

Assignee:: Chad Schmutzer

Reporter:: Russ Tennant

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Created:: 2017-04-11 18:55

Updated:: 2017-05-16 10:01

Resolved:: 2017-04-12 11:35

Jenkins

Details

Description

Attachments

Activity

Collapse comment: Oleg Nenashev added a comment - 2017-04-11 19:57

Expand comment: Oleg Nenashev added a comment - 2017-04-11 19:57

Collapse comment: Russ Tennant added a comment - 2017-04-11 20:20

Expand comment: Russ Tennant added a comment - 2017-04-11 20:20

Collapse comment: Oleg Nenashev added a comment - 2017-04-11 20:27

Expand comment: Oleg Nenashev added a comment - 2017-04-11 20:27

Collapse comment: Russ Tennant added a comment - 2017-04-11 21:37

Expand comment: Russ Tennant added a comment - 2017-04-11 21:37

Collapse comment: Russ Tennant added a comment - 2017-04-11 21:42

Expand comment: Russ Tennant added a comment - 2017-04-11 21:42

Collapse comment: Oleg Nenashev added a comment - 2017-04-12 11:35

Expand comment: Oleg Nenashev added a comment - 2017-04-12 11:35

People

Dates