-
Bug
-
Resolution: Cannot Reproduce
-
Major
-
None
-
Version: Kubernetes operator 8.0.0
Plugins:
Apache HttpComponents Client 4.x API Plugin 4.5.14-208.v438351942757 true
Apache HttpComponents Client 5.x API Plugin 5.3.1-1.0 true
Atlassian Jira Software Cloud 2.0.9 true
Authentication Tokens API Plugin 1.113.v81215a_241826 true
Bitbucket Branch Source Plugin 886.v44cf5e4ecec5 true
Bitbucket Pipeline for Blue Ocean 1.27.11 true
Blue Ocean 1.27.9 true
Blue Ocean Core JS 1.27.11 true
Blue Ocean Pipeline Editor 1.27.11 true
Bootstrap 5 API Plugin 5.3.2-3 true
bouncycastle API Plugin 2.30.1.78.1-233.vfdcdeb_0a_08a_a_ true
Branch API Plugin 2.1128.v717130d4f816 true
Build Monitor View 1.14-745.ve2023a_305f40 true
Caffeine API Plugin 3.1.8-133.v17b_1ff2e0599 true
Checks API plugin 2.0.2 true
Cloud Statistics Plugin 336.v788e4055508b_ true
Common API for Blue Ocean 1.27.11 true
commons-lang3 v3.x Jenkins API Plugin 3.14.0-76.vda_5591261cfe true
commons-text API Plugin 1.11.0-108.v2c41b_8b_2b_269 true
Config API for Blue Ocean 1.27.11 true
Config File Provider Plugin 973.vb_a_80ecb_9a_4d0 true
Configuration as Code Plugin 1775.v810dc950b_514 true
Credentials Binding Plugin 677.vdc9d38cb_254d true
Credentials Plugin 1319.v7eb_51b_3a_c97b_ true
Dashboard for Blue Ocean 1.27.11 true
Design Language 1.27.11 true
Display URL API 2.204.vf6fddd8a_8b_e9 true
Display URL for Blue Ocean 2.4.2 true
Docker API Plugin 3.3.6-90.ve7c5c7535ddd true
Docker Commons Plugin 439.va_3cb_0a_6a_fb_29 true
Docker Pipeline 572.v950f58993843 true
Docker plugin 1.5 true
Durable Task Plugin 555.v6802fe0f0b_82 true
ECharts API Plugin 5.4.0-7 true
Events API for Blue Ocean 1.27.11 true
Favorite 2.218.vd60382506538 true
Folders Plugin 6.858.v898218f3609d true
Font Awesome API Plugin 6.5.1-2 true
Git client plugin 4.7.0 true
Git Pipeline for Blue Ocean 1.27.11 true
Git plugin 5.2.1 true
GitHub API Plugin 1.318-461.v7a_c09c9fa_d63 true
GitHub Branch Source Plugin 1789.v5b_0c0cea_18c3 true
GitHub Pipeline for Blue Ocean 1.27.11 true
GitHub plugin 1.39.0 true
Go Plugin 1.4 true
Google Login Plugin 1.8 true
Gson API Plugin 2.10.1-15.v0d99f670e0a_7 true
Handy Uri Templates 2.x API Plugin 2.1.8-30.v7e777411b_148 true
HTML Publisher plugin 1.34 true
HTTP Request Plugin 1.18 true
i18n for Blue Ocean 1.27.11 true
Instance Identity 185.v303dc7c645f9 true
Ionicons API 74.v93d5eb_813d5f true
Jackson 2 API Plugin 2.17.0-379.v02de8ec9f64c true
Jakarta Activation API 2.1.3-1 true
Jakarta Mail API 2.1.3-1 true
Java JSON Web Token (JJWT) Plugin 0.11.5-112.ve82dfb_224b_a_d true
JavaBeans Activation Framework (JAF) API 1.2.0-7 true
Javadoc Plugin 243.vb_b_503b_b_45537 true
JavaMail API 1.6.2-9 true
JAXB plugin 2.3.9-1 true
Job DSL 1.87 true
Joda Time API Plugin 2.12.7-29.v5a_b_e3a_82269a_ true
JQuery3 API Plugin 3.7.1-1 true
JSch dependency plugin 0.2.16-86.v42e010d9484b_ true
JSON Api Plugin 20240303-41.v94e11e6de726 true
JSON Path API Plugin 2.9.0-33.v2527142f2e1d true
JUnit Plugin 1265.v65b_14fa_f12f0 true
JWT for Blue Ocean 1.27.11 true
Kubernetes Client API Plugin 6.10.0-240.v57880ce8b_0b_2 true
Kubernetes Credentials Plugin 174.va_36e093562d9 true
Kubernetes Credentials Provider 1.234.vf3013b_35f5b_a true
Kubernetes plugin 4029.v5712230ccb_f8 true
Mailer Plugin 470.vc91f60c5d8e2 true
Matrix Project Plugin 822.824.v14451b_c0fd42 true
Maven Integration plugin 3.23 true
Metrics Plugin 4.2.21-451.vd51df8df52ec true
Mina SSHD API :: Common 2.12.1-101.v85b_e08b_780dd true
Mina SSHD API :: Core 2.12.1-101.v85b_e08b_780dd true
NodeJS Plugin 1.6.1 true
OkHttp Plugin 4.11.0-172.vda_da_1feeb_c6e true
Oracle Java SE Development Kit Installer Plugin 73.vddf737284550 true
OWASP Markup Formatter Plugin 162.v0e6ec0fcfcf6 true
Personalization for Blue Ocean 1.27.11 true
Pipeline 596.v8c21c963d92d true
Pipeline Graph Analysis Plugin 216.vfd8b_ece330ca_ true
Pipeline implementation for Blue Ocean 1.27.11 true
Pipeline NPM Integration Plugin 95.v5213efa_9585f true
Pipeline SCM API for Blue Ocean 1.27.11 true
Pipeline Utility Steps 2.16.0 true
Pipeline: API 1291.v51fd2a_625da_7 true
Pipeline: Basic Steps 1058.vcb_fc1e3a_21a_9 true
Pipeline: Build Step 540.vb_e8849e1a_b_d8 true
Pipeline: Declarative 2.2150.v4cfd8916915c true
Pipeline: Declarative Extension Points API 2.2150.v4cfd8916915c true
Pipeline: Groovy 3903.v48a_8836749e9 true
Pipeline: Groovy Libraries 727.ve832a_9244dfa_ true
Pipeline: Input Step 477.v339683a_8d55e true
Pipeline: Job 1385.vb_58b_86ea_fff1 true
Pipeline: Milestone Step 119.vdfdc43fc3b_9a_ true
Pipeline: Model API 2.2150.v4cfd8916915c true
Pipeline: Multibranch 773.vc4fe1378f1d5 true
Pipeline: Nodes and Processes 1331.vc8c2fed35334 true
Pipeline: REST API Plugin 2.34 true
Pipeline: SCM Step 427.v4ca_6512e7df1 true
Pipeline: Stage Step 312.v8cd10304c27a_ true
Pipeline: Stage Tags Metadata 2.2150.v4cfd8916915c true
Pipeline: Stage View Plugin 2.34 true
Pipeline: Step API 657.v03b_e8115821b_ true
Pipeline: Supporting APIs 907.v6713a_ed8a_573 true
Plain Credentials Plugin 182.v468b_97b_9dcb_8 true
Plugin Utilities API Plugin 3.8.0 true
Priority Sorter Plugin 5.0.0 true
Prism API Plugin 1.29.0-8 true
Pub-Sub "light" Bus 1.18 true
Remote Jenkinsfile Provider 1.24 true
REST API for Blue Ocean 1.27.11 true
REST Implementation for Blue Ocean 1.27.11 true
Rich Text Publisher Plugin 1.5 true
SCM API Plugin 676.v886669a_199a_a_ true
Script Security Plugin 1341.va_2819b_414686 true
Server Sent Events (SSE) Gateway Plugin 1.27 true
Slack Notification Plugin 684.v833089650554 true
SnakeYAML API Plugin 2.2-111.vc6598e30cc65 true
SonarQube Scanner for Jenkins 2.16.1 true
SSH Build Agents plugin 2.948.vb_8050d697fec true
SSH Credentials Plugin 337.v395d2403ccd4 true
SSH server 3.303.vefc7119b_ec23 true
Structs Plugin 337.v1b_04ea_4df7c8 true
Token Macro Plugin 400.v35420b_922dcb_ true
Trilead API Plugin 2.142.v748523a_76693 true
Variant Plugin 60.v7290fc0eb_b_cd true
Web for Blue Ocean 1.27.11 trueVersion: Kubernetes operator 8.0.0 Plugins: Apache HttpComponents Client 4.x API Plugin 4.5.14-208.v438351942757 true Apache HttpComponents Client 5.x API Plugin 5.3.1-1.0 true Atlassian Jira Software Cloud 2.0.9 true Authentication Tokens API Plugin 1.113.v81215a_241826 true Bitbucket Branch Source Plugin 886.v44cf5e4ecec5 true Bitbucket Pipeline for Blue Ocean 1.27.11 true Blue Ocean 1.27.9 true Blue Ocean Core JS 1.27.11 true Blue Ocean Pipeline Editor 1.27.11 true Bootstrap 5 API Plugin 5.3.2-3 true bouncycastle API Plugin 2.30.1.78.1-233.vfdcdeb_0a_08a_a_ true Branch API Plugin 2.1128.v717130d4f816 true Build Monitor View 1.14-745.ve2023a_305f40 true Caffeine API Plugin 3.1.8-133.v17b_1ff2e0599 true Checks API plugin 2.0.2 true Cloud Statistics Plugin 336.v788e4055508b_ true Common API for Blue Ocean 1.27.11 true commons-lang3 v3.x Jenkins API Plugin 3.14.0-76.vda_5591261cfe true commons-text API Plugin 1.11.0-108.v2c41b_8b_2b_269 true Config API for Blue Ocean 1.27.11 true Config File Provider Plugin 973.vb_a_80ecb_9a_4d0 true Configuration as Code Plugin 1775.v810dc950b_514 true Credentials Binding Plugin 677.vdc9d38cb_254d true Credentials Plugin 1319.v7eb_51b_3a_c97b_ true Dashboard for Blue Ocean 1.27.11 true Design Language 1.27.11 true Display URL API 2.204.vf6fddd8a_8b_e9 true Display URL for Blue Ocean 2.4.2 true Docker API Plugin 3.3.6-90.ve7c5c7535ddd true Docker Commons Plugin 439.va_3cb_0a_6a_fb_29 true Docker Pipeline 572.v950f58993843 true Docker plugin 1.5 true Durable Task Plugin 555.v6802fe0f0b_82 true ECharts API Plugin 5.4.0-7 true Events API for Blue Ocean 1.27.11 true Favorite 2.218.vd60382506538 true Folders Plugin 6.858.v898218f3609d true Font Awesome API Plugin 6.5.1-2 true Git client plugin 4.7.0 true Git Pipeline for Blue Ocean 1.27.11 true Git plugin 5.2.1 true GitHub API Plugin 1.318-461.v7a_c09c9fa_d63 true GitHub Branch Source Plugin 1789.v5b_0c0cea_18c3 true GitHub Pipeline for Blue Ocean 1.27.11 true GitHub plugin 1.39.0 true Go Plugin 1.4 true Google Login Plugin 1.8 true Gson API Plugin 2.10.1-15.v0d99f670e0a_7 true Handy Uri Templates 2.x API Plugin 2.1.8-30.v7e777411b_148 true HTML Publisher plugin 1.34 true HTTP Request Plugin 1.18 true i18n for Blue Ocean 1.27.11 true Instance Identity 185.v303dc7c645f9 true Ionicons API 74.v93d5eb_813d5f true Jackson 2 API Plugin 2.17.0-379.v02de8ec9f64c true Jakarta Activation API 2.1.3-1 true Jakarta Mail API 2.1.3-1 true Java JSON Web Token (JJWT) Plugin 0.11.5-112.ve82dfb_224b_a_d true JavaBeans Activation Framework (JAF) API 1.2.0-7 true Javadoc Plugin 243.vb_b_503b_b_45537 true JavaMail API 1.6.2-9 true JAXB plugin 2.3.9-1 true Job DSL 1.87 true Joda Time API Plugin 2.12.7-29.v5a_b_e3a_82269a_ true JQuery3 API Plugin 3.7.1-1 true JSch dependency plugin 0.2.16-86.v42e010d9484b_ true JSON Api Plugin 20240303-41.v94e11e6de726 true JSON Path API Plugin 2.9.0-33.v2527142f2e1d true JUnit Plugin 1265.v65b_14fa_f12f0 true JWT for Blue Ocean 1.27.11 true Kubernetes Client API Plugin 6.10.0-240.v57880ce8b_0b_2 true Kubernetes Credentials Plugin 174.va_36e093562d9 true Kubernetes Credentials Provider 1.234.vf3013b_35f5b_a true Kubernetes plugin 4029.v5712230ccb_f8 true Mailer Plugin 470.vc91f60c5d8e2 true Matrix Project Plugin 822.824.v14451b_c0fd42 true Maven Integration plugin 3.23 true Metrics Plugin 4.2.21-451.vd51df8df52ec true Mina SSHD API :: Common 2.12.1-101.v85b_e08b_780dd true Mina SSHD API :: Core 2.12.1-101.v85b_e08b_780dd true NodeJS Plugin 1.6.1 true OkHttp Plugin 4.11.0-172.vda_da_1feeb_c6e true Oracle Java SE Development Kit Installer Plugin 73.vddf737284550 true OWASP Markup Formatter Plugin 162.v0e6ec0fcfcf6 true Personalization for Blue Ocean 1.27.11 true Pipeline 596.v8c21c963d92d true Pipeline Graph Analysis Plugin 216.vfd8b_ece330ca_ true Pipeline implementation for Blue Ocean 1.27.11 true Pipeline NPM Integration Plugin 95.v5213efa_9585f true Pipeline SCM API for Blue Ocean 1.27.11 true Pipeline Utility Steps 2.16.0 true Pipeline: API 1291.v51fd2a_625da_7 true Pipeline: Basic Steps 1058.vcb_fc1e3a_21a_9 true Pipeline: Build Step 540.vb_e8849e1a_b_d8 true Pipeline: Declarative 2.2150.v4cfd8916915c true Pipeline: Declarative Extension Points API 2.2150.v4cfd8916915c true Pipeline: Groovy 3903.v48a_8836749e9 true Pipeline: Groovy Libraries 727.ve832a_9244dfa_ true Pipeline: Input Step 477.v339683a_8d55e true Pipeline: Job 1385.vb_58b_86ea_fff1 true Pipeline: Milestone Step 119.vdfdc43fc3b_9a_ true Pipeline: Model API 2.2150.v4cfd8916915c true Pipeline: Multibranch 773.vc4fe1378f1d5 true Pipeline: Nodes and Processes 1331.vc8c2fed35334 true Pipeline: REST API Plugin 2.34 true Pipeline: SCM Step 427.v4ca_6512e7df1 true Pipeline: Stage Step 312.v8cd10304c27a_ true Pipeline: Stage Tags Metadata 2.2150.v4cfd8916915c true Pipeline: Stage View Plugin 2.34 true Pipeline: Step API 657.v03b_e8115821b_ true Pipeline: Supporting APIs 907.v6713a_ed8a_573 true Plain Credentials Plugin 182.v468b_97b_9dcb_8 true Plugin Utilities API Plugin 3.8.0 true Priority Sorter Plugin 5.0.0 true Prism API Plugin 1.29.0-8 true Pub-Sub "light" Bus 1.18 true Remote Jenkinsfile Provider 1.24 true REST API for Blue Ocean 1.27.11 true REST Implementation for Blue Ocean 1.27.11 true Rich Text Publisher Plugin 1.5 true SCM API Plugin 676.v886669a_199a_a_ true Script Security Plugin 1341.va_2819b_414686 true Server Sent Events (SSE) Gateway Plugin 1.27 true Slack Notification Plugin 684.v833089650554 true SnakeYAML API Plugin 2.2-111.vc6598e30cc65 true SonarQube Scanner for Jenkins 2.16.1 true SSH Build Agents plugin 2.948.vb_8050d697fec true SSH Credentials Plugin 337.v395d2403ccd4 true SSH server 3.303.vefc7119b_ec23 true Structs Plugin 337.v1b_04ea_4df7c8 true Token Macro Plugin 400.v35420b_922dcb_ true Trilead API Plugin 2.142.v748523a_76693 true Variant Plugin 60.v7290fc0eb_b_cd true Web for Blue Ocean 1.27.11 true
We have a Jenkins deployed using our kubernetes operator. We are using version 8.0.0. Last night, we redeployed the jenkins-operator with new values (removing some tools configuration) as configuration as code. However, since then, the jobs will stop working and we saw the following exception:
2024-06-21 21:35:45.647+0000 [id=194] INFO j.j.plugin.JenkinsJobManagement#createOrUpdateConfig: createOrUpdateConfig for cloudmc-automation-engine 2024-06-21 21:35:45.703+0000 [id=194] INFO c.c.h.p.folder.AbstractFolder$3#call: Loading job cloudmc-automation-engine/PR-38 (14000.0%) 2024-06-21 21:35:45.716+0000 [id=517] INFO o.j.p.g.webhook.WebhookManager$1#run: GitHub webhooks activated for job cloudmc-automation-engine with [GitHubRepositoryName[host=github.com,username=cloudops,repository=cloudmc-automation-engine]] (events: [PULL_REQUEST, PUSH]) 2024-06-21 21:36:00.795+0000 [id=29] WARNING c.c.h.p.f.c.PeriodicFolderTrigger#run: Queue refused to schedule org.jenkinsci.plugins.workflow.multibranch.WorkflowMultiBranchProject@1de454f2[plugins/cloudmc-macrometa-plugin] 2024-06-21 21:36:08.914+0000 [id=534] WARNING j.m.api.Metrics$HealthChecker#execute: Some health checks are reporting as unhealthy: [thread-deadlock : [jenkins.util.Timer [#9] locked on org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher@72dd3b4c (owned by Computer.threadPoolForRemoting [#13]): at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.isLaunchSupported(KubernetesLauncher.java:91) at hudson.slaves.SlaveComputer.isLaunchSupported(SlaveComputer.java:247) at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.check(OnceRetentionStrategy.java:81) at org.jenkinsci.plugins.durabletask.executors.OnceRetentionStrategy.check(OnceRetentionStrategy.java:46) at hudson.slaves.ComputerRetentionWork$1.run(ComputerRetentionWork.java:71) at hudson.model.Queue._withLock(Queue.java:1397) at hudson.model.Queue.withLock(Queue.java:1271) at hudson.slaves.ComputerRetentionWork.doRun(ComputerRetentionWork.java:62) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:92) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:67) at java.base@17.0.8.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base@17.0.8.1/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base@17.0.8.1/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@17.0.8.1/java.lang.Thread.run(Thread.java:833) , Computer.threadPoolForRemoting [#13] locked on java.util.concurrent.locks.ReentrantLock$NonfairSync@362255d0 (owned by jenkins.util.Timer [#9]): at java.base@17.0.8.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@17.0.8.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) at java.base@17.0.8.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) at java.base@17.0.8.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:938) at java.base@17.0.8.1/java.util.concurrent.locks.ReentrantLock$Sync.lock(ReentrantLock.java:153) at java.base@17.0.8.1/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:322) at hudson.model.Queue._withLock(Queue.java:1456) at hudson.model.Queue.withLock(Queue.java:1314) at jenkins.model.Nodes.updateNode(Nodes.java:201) at jenkins.model.Jenkins.updateNode(Jenkins.java:2252) at hudson.model.Node.save(Node.java:143) at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:247) at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:297) at hudson.slaves.SlaveComputer$$Lambda$841/0x0000000800e87b00.call(Unknown Source) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:80) at java.base@17.0.8.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@17.0.8.1/java.lang.Thread.run(Thread.java:833) , jenkins.util.Timer [#7] locked on java.util.concurrent.locks.ReentrantLock$NonfairSync@362255d0 (owned by jenkins.util.Timer [#9]): at java.base@17.0.8.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@17.0.8.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) at java.base@17.0.8.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) at java.base@17.0.8.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:938) at java.base@17.0.8.1/java.util.concurrent.locks.ReentrantLock$Sync.lock(ReentrantLock.java:153) at java.base@17.0.8.1/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:322) at hudson.model.Queue.maintain(Queue.java:1481) at hudson.model.Queue$MaintainTask.doRun(Queue.java:2919) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:92) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:67) at java.base@17.0.8.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base@17.0.8.1/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base@17.0.8.1/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base@17.0.8.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@17.0.8.1/java.lang.Thread.run(Thread.java:833) ]]
We need to redeployment the jenkins pod to allow to work again. This been awful since then. Can you help us figure out a solution to resolve this.
