[JENKINS-35246] Kubernetes agents not getting deleted in Jenkins after pods are deleted

Type: Bug
Resolution: Fixed
Priority: Minor
Component/s: kubernetes-plugin
Labels:
None

Similar Issues:
Powered by SuggestiMate

Show

When you run a failing pipeline job the kubernetes node responsible for doing the job does not get properly deleted and after a while appears as suspended.

These are the logs when the node ab1c5bc857e82 was being deleted and it didn't:

May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:48 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab17c1549fbe3
May 18, 2016 4:18:48 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:18:48 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab17c1549fbe3
May 18, 2016 4:18:48 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab17c1549fbe3
May 18, 2016 4:18:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:18:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab183701b37bc
May 18, 2016 4:18:51 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:18:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab183701b37bc
May 18, 2016 4:18:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab183701b37bc
May 18, 2016 4:18:54 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab1a1b9a6372f
May 18, 2016 4:18:54 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:18:54 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab1a1b9a6372f
May 18, 2016 4:18:54 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab1a1b9a6372f
May 18, 2016 4:18:58 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab1a407748569
May 18, 2016 4:18:58 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:18:58 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab1a407748569
May 18, 2016 4:18:58 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab1a407748569
May 18, 2016 4:19:01 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:01 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:11 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:11 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:16 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:16 PM FINER hudson.slaves.NodeProvisioner update
Consulting com.cloudbees.opscenter.provisioning.ProvisioningLimitEnforcer@4fddbafb provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=0, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:16 PM FINER hudson.slaves.NodeProvisioner update
Consulting com.cloudbees.opscenter.client.cloud.OperationsCenterNodeProvisioningStrategy@2bbfaebd provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=0, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:16 PM FINER hudson.slaves.NodeProvisioner update
Consulting hudson.slaves.NodeProvisioner$StandardStrategyImpl@1f4ccee0 provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=0, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:16 PM FINE hudson.slaves.NodeProvisioner$StandardStrategyImpl apply
Excess workload 1 detected. (planned capacity=0.005,connecting capacity=0,Qlen=0.148,available=0.032&0,online=0,m=0.5)
May 18, 2016 4:19:16 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud provision
Excess workload after pending Spot instances: 1
May 18, 2016 4:19:16 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:16 PM INFO hudson.slaves.NodeProvisioner$StandardStrategyImpl apply
Started provisioning Kubernetes Pod Template from Openshift with 1 executors. Remaining excess workload: 0
May 18, 2016 4:19:16 PM FINER hudson.slaves.NodeProvisioner update
Provisioning strategy hudson.slaves.NodeProvisioner$StandardStrategyImpl@1f4ccee0 declared provisioning complete
May 18, 2016 4:19:16 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:16 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud$ProvisioningCallback call
Created Pod: ab1c5bc857e82
May 18, 2016 4:19:16 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud$ProvisioningCallback call
Waiting for Pod to be scheduled (0/100): ab1c5bc857e82
May 18, 2016 4:19:20 PM FINE hudson.slaves.ChannelPinger install
Set up a remote ping for ab1c5bc857e82
May 18, 2016 4:19:20 PM FINE hudson.slaves.ChannelPinger setUpPingForChannel
Ping thread started for hudson.remoting.Channel@579bb5f6:ab1c5bc857e82 with a 5 minute interval
May 18, 2016 4:19:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 1 is less than the available capacity 1. No provisioning strategy required
May 18, 2016 4:19:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 1. No provisioning strategy required
May 18, 2016 4:19:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:21 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesComputer taskAccepted
 Computer KubernetesComputer name: 
 slave: 
 taskAccepted
May 18, 2016 4:19:21 PM FINE hudson.slaves.WorkspaceList acquire
acquired /home/jenkins/workspace/test
java.lang.Throwable: from hudson.slaves.WorkspaceList@3e1279c
        at hudson.slaves.WorkspaceList.acquire(WorkspaceList.java:261)
        at hudson.slaves.WorkspaceList.allocate(WorkspaceList.java:183)
        at hudson.slaves.WorkspaceList.allocate(WorkspaceList.java:167)
        at org.jenkinsci.plugins.workflow.support.steps.ExecutorStepExecution$PlaceholderTask$PlaceholderExecutable.run(ExecutorStepExecution.java:462)
        at hudson.model.ResourceController.execute(ResourceController.java:98)
        at hudson.model.Executor.run(Executor.java:410)

May 18, 2016 4:19:22 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:23 PM FINE hudson.slaves.WorkspaceList _release
releasing /home/jenkins/workspace/test with lock count 1
java.lang.Throwable: from hudson.slaves.WorkspaceList@3e1279c
        at hudson.slaves.WorkspaceList._release(WorkspaceList.java:208)
        at hudson.slaves.WorkspaceList.access$300(WorkspaceList.java:46)
        at hudson.slaves.WorkspaceList$1.release(WorkspaceList.java:276)
        at org.jenkinsci.plugins.workflow.support.steps.ExecutorStepExecution$PlaceholderTask$Callback.finished(ExecutorStepExecution.java:403)
        at org.jenkinsci.plugins.workflow.steps.BodyExecutionCallback$TailCall.onFailure(BodyExecutionCallback.java:123)
        at org.jenkinsci.plugins.workflow.cps.CpsBodyExecution$FailureAdapter.receive(CpsBodyExecution.java:286)
        at com.cloudbees.groovy.cps.impl.ValueBoundContinuation.receive(ValueBoundContinuation.java:21)
        at com.cloudbees.groovy.cps.Outcome.resumeFrom(Outcome.java:73)
        at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:146)
        at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:164)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:277)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$000(CpsThreadGroup.java:77)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:186)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:184)
        at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:47)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:112)
        at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

May 18, 2016 4:19:23 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesComputer taskCompleted
 Computer KubernetesComputer name: 
 slave: 
 taskCompleted
May 18, 2016 4:19:23 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab1c5bc857e82
May 18, 2016 4:19:23 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:23 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab1c5bc857e82
May 18, 2016 4:19:23 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab1c5bc857e82
May 18, 2016 4:19:23 PM FINE hudson.slaves.ChannelPinger$2 onClosed
Terminating ping thread for ab1c5bc857e82
May 18, 2016 4:19:31 PM INFO hudson.slaves.NodeProvisioner$2 run
Kubernetes Pod Template provisioning successfully completed. We have now 2 computer(s)
May 18, 2016 4:19:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:43 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:43 PM FINER hudson.slaves.NodeProvisioner update
Consulting com.cloudbees.opscenter.provisioning.ProvisioningLimitEnforcer@4fddbafb provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=1, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:43 PM FINER hudson.slaves.NodeProvisioner update
Consulting com.cloudbees.opscenter.client.cloud.OperationsCenterNodeProvisioningStrategy@2bbfaebd provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=1, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:43 PM FINER hudson.slaves.NodeProvisioner update
Consulting hudson.slaves.NodeProvisioner$StandardStrategyImpl@1f4ccee0 provisioning strategy with state StrategyState{label=null, snapshot=LoadStatisticsSnapshot{definedExecutors=1, onlineExecutors=0, connectingExecutors=0, busyExecutors=0, idleExecutors=0, availableExecutors=0, queueLength=1}, plannedCapacitySnapshot=0, additionalPlannedCapacity=1}
May 18, 2016 4:19:43 PM FINE hudson.slaves.NodeProvisioner$StandardStrategyImpl apply
Excess workload 1 detected. (planned capacity=0.076,connecting capacity=0,Qlen=0.189,available=0.023&0,online=0,m=0.5)
May 18, 2016 4:19:43 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud provision
Excess workload after pending Spot instances: 1
May 18, 2016 4:19:43 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:43 PM INFO hudson.slaves.NodeProvisioner$StandardStrategyImpl apply
Started provisioning Kubernetes Pod Template from Openshift with 1 executors. Remaining excess workload: 0
May 18, 2016 4:19:43 PM FINER hudson.slaves.NodeProvisioner update
Provisioning strategy hudson.slaves.NodeProvisioner$StandardStrategyImpl@1f4ccee0 declared provisioning complete
May 18, 2016 4:19:43 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:43 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud$ProvisioningCallback call
Created Pod: ab1cc1126bf11
May 18, 2016 4:19:43 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud$ProvisioningCallback call
Waiting for Pod to be scheduled (0/100): ab1cc1126bf11
May 18, 2016 4:19:47 PM FINE hudson.slaves.ChannelPinger install
Set up a remote ping for ab1cc1126bf11
May 18, 2016 4:19:47 PM FINE hudson.slaves.ChannelPinger setUpPingForChannel
Ping thread started for hudson.remoting.Channel@398e1d68:ab1cc1126bf11 with a 5 minute interval
May 18, 2016 4:19:48 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesComputer taskAccepted
 Computer KubernetesComputer name: 
 slave: 
 taskAccepted
May 18, 2016 4:19:48 PM FINE hudson.slaves.WorkspaceList acquire
acquired /home/jenkins/workspace/test
java.lang.Throwable: from hudson.slaves.WorkspaceList@450e50de
        at hudson.slaves.WorkspaceList.acquire(WorkspaceList.java:261)
        at hudson.slaves.WorkspaceList.allocate(WorkspaceList.java:183)
        at hudson.slaves.WorkspaceList.allocate(WorkspaceList.java:167)
        at org.jenkinsci.plugins.workflow.support.steps.ExecutorStepExecution$PlaceholderTask$PlaceholderExecutable.run(ExecutorStepExecution.java:462)
        at hudson.model.ResourceController.execute(ResourceController.java:98)
        at hudson.model.Executor.run(Executor.java:410)

May 18, 2016 4:19:49 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:51 PM FINE hudson.slaves.WorkspaceList _release
releasing /home/jenkins/workspace/test with lock count 1
java.lang.Throwable: from hudson.slaves.WorkspaceList@450e50de
        at hudson.slaves.WorkspaceList._release(WorkspaceList.java:208)
        at hudson.slaves.WorkspaceList.access$300(WorkspaceList.java:46)
        at hudson.slaves.WorkspaceList$1.release(WorkspaceList.java:276)
        at org.jenkinsci.plugins.workflow.support.steps.ExecutorStepExecution$PlaceholderTask$Callback.finished(ExecutorStepExecution.java:403)
        at org.jenkinsci.plugins.workflow.steps.BodyExecutionCallback$TailCall.onFailure(BodyExecutionCallback.java:123)
        at org.jenkinsci.plugins.workflow.cps.CpsBodyExecution$FailureAdapter.receive(CpsBodyExecution.java:286)
        at com.cloudbees.groovy.cps.impl.ValueBoundContinuation.receive(ValueBoundContinuation.java:21)
        at com.cloudbees.groovy.cps.Outcome.resumeFrom(Outcome.java:73)
        at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:146)
        at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:164)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:277)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$000(CpsThreadGroup.java:77)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:186)
        at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:184)
        at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:47)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:112)
        at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

May 18, 2016 4:19:51 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesComputer taskCompleted
 Computer KubernetesComputer name: 
 slave: 
 taskCompleted
May 18, 2016 4:19:51 PM INFO hudson.slaves.NodeProvisioner$2 run
Kubernetes Pod Template provisioning successfully completed. We have now 3 computer(s)
May 18, 2016 4:19:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:51 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:19:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminating Kubernetes instance for slave ab1cc1126bf11
May 18, 2016 4:19:51 PM FINE org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud connect
Building connection to Kubernetes host Openshift URL https://openshift.default.svc.cluster.local
May 18, 2016 4:19:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Terminated Kubernetes instance for slave ab1cc1126bf11
May 18, 2016 4:19:51 PM INFO org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave _terminate
Disconnected computer ab1cc1126bf11
May 18, 2016 4:19:51 PM FINE hudson.slaves.ChannelPinger$2 onClosed
Terminating ping thread for ab1cc1126bf11
May 18, 2016 4:20:01 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:01 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:01 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:11 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:11 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:11 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:21 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:31 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
May 18, 2016 4:20:41 PM FINER hudson.slaves.NodeProvisioner$2 run
Queue length 0 is less than the available capacity 0. No provisioning strategy required
Clear

To reproduce execute the following pipeline script on a dynamic node with kubernetes plugin:

node {
    try {
       sh 'whoami'
    } finally {
       sh 'pwd'
       sh 'echo $HOME'
    }
}

whoami will fail causing the problem.

- - Sort By Name
  - Sort By Date
  - Ascending
  - Descending
  - Thumbnails
  - List
  - Download All

JENKINS-35246_2.png
48 kB
2017-04-17 12:41
JENKINS-35246.png
22 kB
2017-04-17 11:36
suspended_pods.png
36 kB
2016-11-10 21:04

is duplicated by

JENKINS-46444 Slave Node is Left in "offline" while Slave Pod is terminated

Closed

relates to

JENKINS-49707 Auto retry for elastic agents after channel closure

Resolved

JENKINS-57675 Pipeline steps running forever when executor fails

Resolved

Alvaro Lobato created issue - 2016-05-31 20:50

R. Tyler Croy made changes - 2016-07-25 23:52

Workflow

Original: JNJira [ 171484 ]

New: JNJira + In-Review [ 184324 ]

Elmar Weber made changes - 2016-11-10 21:05

Attachment

New: suspended_pods.png [ 34792 ]

Alexander Dokuchaev made changes - 2017-04-17 11:33

Attachment

New: JENKINS-35246.png [ 37214 ]

Alexander Dokuchaev made changes - 2017-04-17 11:36

Attachment

New: JENKINS-35246.png [ 37215 ]

Alexander Dokuchaev made changes - 2017-04-17 11:38

Attachment

Original: ~~JENKINS-35246~~.png [ 37214 ]

Alexander Dokuchaev made changes - 2017-04-17 12:41

Attachment

New: JENKINS-35246_2.png [ 37216 ]

Carlos Sanchez made changes - 2017-08-22 15:00

Status

Original: Open [ 1 ]

New: In Progress [ 3 ]

Carlos Sanchez made changes - 2017-08-25 07:19

Link

New: This issue is duplicated by ~~JENKINS-46444~~ [ ~~JENKINS-46444~~ ]

Carlos Sanchez made changes - 2017-09-05 13:57

Summary

Original: Kubernetes nodes not getting deleted when a pipeline job fails

New: Kubernetes agents not getting deleted in Jenkins after pods are deleted

Carlos Sanchez made changes - 2017-09-05 13:57

Assignee

Original: Carlos Sanchez [ csanchez ]

New: Vincent Latombe [ vlatombe ]

Assignee:: Vincent Latombe

Reporter:: Alvaro Lobato

Votes:: 8 Vote for this issue

Watchers:: 17 Start watching this issue

Created:: 2016-05-31 20:50

Updated:: 2021-12-22 21:20

Resolved:: 2017-09-05 14:09

Jenkins

Details

Description

Attachments

Attachments

Issue Links

Activity

People

Dates