-
Bug
-
Resolution: Fixed
-
Major
-
None
-
jenkins 2.138
k8s plugin 1.12.1
We saw some of our existing pod templates start failing in pipeline builds once we upgraded Jenkins to 2.138. Slave and master logs of note below, as well as the def of the pod template.
Not sure where the adjustment is needed to have this flow work again. Please advise.
slave log:
OPENSHIFT_JENKINS_JVM_ARCH='', CONTAINER_MEMORY_IN_MB='8796093022207', using /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-3.b13.el7_5.x86_64/jre/bin/java
Downloading http://172.30.99.113:80//jnlpJars/remoting.jar ... +
cd +
exec java -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -cp /home/jenkins/remoting.jar hudson.remoting.jnlp.Main -headless -url http://172.30.99.113:80/ -tunnel 172.30.205.235:50000 53961ae7fc19701d6d81330d0fe2ce689829d1424e883beea3e52e4d464ab46f nodejs-r66rh Picked up JAVA_TOOL_OPTIONS: -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true
Aug 16, 2018 6:09:21 PM hudson.remoting.jnlp.Main createEngine INFO: Setting up agent: nodejs-r66rh
Aug 16, 2018 6:09:21 PM hudson.remoting.jnlp.Main$CuiListener <init> INFO: Jenkins agent is running in headless mode.
Aug 16, 2018 6:09:21 PM hudson.remoting.Engine startEngine INFO: Using Remoting version: 3.25
Aug 16, 2018 6:09:21 PM hudson.remoting.Engine startEngine WARNING: No Working Directory. Using the legacy JAR Cache location: /home/jenkins/.jenkins/cache/jars
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Locating server among http://172.30.99.113:80/
Aug 16, 2018 6:09:22 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
Aug 16, 2018 6:09:22 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting TCP connection tunneling is enabled. Skipping the TCP Agent Listener Port availability check
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Agent discovery successful Agent address: 172.30.205.235 Agent port: 50000 Identity: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Trying protocol: JNLP4-connect
Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Remote identity confirmed: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
Aug 16, 2018 6:09:23 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connected
Aug 16, 2018 6:09:33 PM org.jenkinsci.remoting.util.AnonymousClassWarnings warn WARNING: Attempt to (de-)serialize anonymous class hudson.FilePath$2; see: https://jenkins.io/redirect/serialization-of-anonymous-classes/
Aug 16, 2018 6:09:34 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Terminated
Aug 16, 2018 6:09:34 PM hudson.remoting.Request$2 run INFO: Failed to send back a reply to the request hudson.remoting.Request$2@590fe63d: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@7c2c0bb3:JNLP4-connect connection to jenkins-jnlp.myproject.svc.cluster.local/172.30.205.235:50000": channel is already closed
Aug 16, 2018 6:09:44 PM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$FindEffectiveRestarters$1 onReconnect INFO: Restarting agent via jenkins.slaves.restarter.UnixSlaveRestarter@74428986 Picked up JAVA_TOOL_OPTIONS: -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main createEngine INFO: Setting up agent: nodejs-r66rh
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener <init> INFO: Jenkins agent is running in headless mode.
Aug 16, 2018 6:09:45 PM hudson.remoting.Engine startEngine INFO: Using Remoting version: 3.25
Aug 16, 2018 6:09:45 PM hudson.remoting.Engine startEngine WARNING: No Working Directory. Using the legacy JAR Cache location: /home/jenkins/.jenkins/cache/jars
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Locating server among http://172.30.99.113:80/
Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting TCP connection tunneling is enabled. Skipping the TCP Agent Listener Port availability check
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Agent discovery successful Agent address: 172.30.205.235 Agent port: 50000 Identity: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Trying protocol: JNLP4-connect
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Remote identity confirmed: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer onRecv INFO: [JNLP4-connect connection to jenkins-jnlp.myproject.svc.cluster.local/172.30.205.235:50000] Local headers refused by remote: Unknown client name: nodejs-r66rh
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Protocol JNLP4-connect encountered an unexpected exception java.util.concurrent.ExecutionException: org.jenkinsci.remoting.protocol.impl.ConnectionRefusalException: Unknown client name: nodejs-r66rh
at org.jenkinsci.remoting.util.SettableFuture.get(SettableFuture.java:223)
at hudson.remoting.Engine.innerRun(Engine.java:614)
at hudson.remoting.Engine.run(Engine.java:474)
Caused by: org.jenkinsci.remoting.protocol.impl.ConnectionRefusalException: Unknown client name: nodejs-r66rh
at org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer.newAbortCause(ConnectionHeadersFilterLayer.java:378)
at org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer.onRecvClosed(ConnectionHeadersFilterLayer.java:433)
at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:172)
at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154)
at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer.access$1500(BIONetworkLayer.java:48)
at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer$Reader.run(BIONetworkLayer.java:247)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
at java.lang.Thread.run(Thread.java:748) Suppressed: java.nio.channels.ClosedChannelException ... 7 more
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP4-plaintext not supported, skipping
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP3-connect not supported, skipping
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP2-connect not supported, skipping
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP-connect not supported, skipping
Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener error SEVERE: The server rejected the connection: None of the protocols were accepted java.lang.Exception: The server rejected the connection: None of the protocols were accepted
at hudson.remoting.Engine.onConnectionRejected(Engine.java:675)
at hudson.remoting.Engine.innerRun(Engine.java:639)
at hudson.remoting.Engine.run(Engine.java:474)
master log:
Aug 16, 2018 6:09:34 PM org.jenkinsci.plugins.workflow.job.WorkflowRun finish INFO: asdf #7 completed: SUCCESS
Aug 16, 2018 6:09:34 PM jenkins.slaves.DefaultJnlpSlaveReceiver channelClosed WARNING: Computer.threadPoolForRemoting 23 for nodejs-r66rh terminated java.nio.channels.ClosedChannelException
at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209)
at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222)
at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200)
at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213)
at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:800)
at org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:173)
at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314)
at hudson.remoting.Channel.close(Channel.java:1450)
at hudson.remoting.Channel.close(Channel.java:1403)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:821)
at hudson.slaves.SlaveComputer.access$800(SlaveComputer.java:105)
at hudson.slaves.SlaveComputer$3.run(SlaveComputer.java:737)
at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Aug 16, 2018 6:09:45 PM hudson.TcpSlaveAgentListener$ConnectionHandler run INFO: Accepted JNLP4-connect connection #2 from /172.17.0.6:59884
Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer onRecv INFO: [JNLP4-connect connection from 172.17.0.6/172.17.0.6:59884] Refusing headers from remote: Unknown client name: nodejs-r66rh
Aug 16, 2018 6:09:46 PM hudson.TcpSlaveAgentListener$ConnectionHandler run WARNING: Connection #3 failed java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:197)
at java.io.DataInputStream.readFully(DataInputStream.java:169)
at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:242)
Aug 16, 2018 6:11:31 PM io.fabric8.jenkins.openshiftsync.BuildWatcher reconcileRunsAndBuilds INFO: Reconciling job runs and builds
Aug 16, 2018 6:16:31 PM io.fabric8.jenkins.openshiftsync.BuildWatcher reconcileRunsAndBuilds INFO: Reconciling job runs and builds
Aug 16, 2018 6:16:31 PM okhttp3.internal.platform.Platform log INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Aug 16, 2018 6:16:31 PM okhttp3.internal.platform.Platform log INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
Pod template:
<org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud>
<name>openshift</name>
<templates>
<org.csanchez.jenkins.plugins.kubernetes.PodTemplate>
<inheritFrom></inheritFrom>
<name>nodejs</name>
<instanceCap>2147483647</instanceCap>
<idleMinutes>0</idleMinutes>
<label>nodejs</label>
<serviceAccount>${oc_serviceaccount_name}</serviceAccount>
<nodeSelector></nodeSelector>
<volumes/>
<containers>
<org.csanchez.jenkins.plugins.kubernetes.ContainerTemplate>
<name>jnlp</name>
<image>${NODEJS_SLAVE}</image>
<privileged>false</privileged>
<alwaysPullImage>true</alwaysPullImage>
<workingDir>/tmp</workingDir>
<command></command>
<args>\${computer.jnlpmac} \${computer.name}</args>
<ttyEnabled>false</ttyEnabled>
<resourceRequestCpu></resourceRequestCpu>
<resourceRequestMemory></resourceRequestMemory>
<resourceLimitCpu></resourceLimitCpu>
<resourceLimitMemory></resourceLimitMemory>
<envVars/>
</org.csanchez.jenkins.plugins.kubernetes.ContainerTemplate>
</containers>
<envVars/>
<annotations/>
<imagePullSecrets/>
<nodeProperties/>
</org.csanchez.jenkins.plugins.kubernetes.PodTemplate>
</templates>
<serverUrl>https://${KUBERNETES_SERVICE_HOST}:${KUBERNETES_SERVICE_PORT}</serverUrl>
<skipTlsVerify>false</skipTlsVerify>
<addMasterProxyEnvVars>true</addMasterProxyEnvVars>
<serverCertificate>${crt_contents}</serverCertificate>
<namespace>${PROJECT_NAME}</namespace>
<jenkinsUrl>http://${JENKINS_SERVICE_HOST}:${JENKINS_SERVICE_PORT}</jenkinsUrl>
<jenkinsTunnel>${JNLP_HOST}:${JNLP_PORT}</jenkinsTunnel>
<credentialsId>1a12dfa4-7fc5-47a7-aa17-cc56572a41c7</credentialsId>
<containerCap>100</containerCap>
<retentionTimeout>5</retentionTimeout>
</org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud>
- is duplicated by
-
JENKINS-53470 Pods are not terminating properly
-
- Closed
-