-
Bug
-
Resolution: Won't Fix
-
Blocker
-
None
-
Operating System: CentOS 7.9 - 64 bits
JRE/JDK: java-1.8.0-openjdk.x86_64 default openJDK 8 from "@updates".
Jenkins installation from yum repo http://pkg.jenkins.io/redhat-stable
Reverse proxy: nginx (enforces SSL offloading). Happy to provide details, but using guidelines as described here https://wiki.jenkins.io/display/JENKINS/Jenkins+behind+an+NGinX+reverse+proxy
Browser: n/a
Output of version and plugins:
Jenkins: 2.277.1
OS: Linux - 3.10.0-1160.15.2.el7.x86_64
---
credentials:2.3.15
structs:1.22
trilead-api:1.0.13
jdk-tool:1.5
apache-httpcomponents-client-4-api:4.5.13-1.0
authentication-tokens:1.4
bitbucket:1.1.27
branch-api:2.6.3
build-blocker-plugin:1.7.7
claim:2.18.2
conditional-buildstep:1.4.1
credentials-binding:1.24
dashboard-view:2.15
display-url-api:2.3.4
docker-commons:1.17
docker-workflow:1.26
durable-task:1.35
email-ext:2.82
embeddable-build-status:2.0.3
extra-columns:1.22
cloudbees-folder:6.15
git-client:3.6.0
git-server:1.9
groovy:2.3
http_request:1.8.27
jquery:1.12.4-1
jsch:0.1.55.2
ant:1.11
ldap:2.4
lockable-resources:2.10
influxdb:2.5
git:4.6.0
maven-plugin:3.10
mercurial:2.13
pam-auth:1.6
parameterized-trigger:2.40
performance:3.19
pipeline-utility-steps:2.6.1
workflow-api:2.41
workflow-basic-steps:2.23
pipeline-build-step:2.13
pipeline-model-definition:1.8.4
pipeline-model-extensions:1.8.4
workflow-cps:2.90
pipeline-input-step:2.12
workflow-job:2.40
pipeline-milestone-step:1.3.2
pipeline-model-api:1.8.4
workflow-multibranch:2.22
workflow-durable-task-step:2.38
pipeline-rest-api:2.19
workflow-scm-step:2.12
workflow-cps-global-lib:2.18
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.8.4
pipeline-stage-view:2.19
workflow-step-api:2.23
workflow-support:3.8
plain-credentials:1.7
htmlpublisher:1.25
resource-disposer:0.15
run-condition:1.5
scm-api:2.6.4
script-security:1.76
swarm:3.24
sonar:2.13
ssh-agent:1.21
ssh-credentials:1.18.1
text-finder:1.15
throttle-concurrents:2.2
token-macro:2.15
view-job-filters:2.3
jackson2-api:2.12.1
ws-cleanup:0.39
mailer:1.33
badge:1.8
command-launcher:1.5
javadoc:1.6
windows-slaves:1.7
junit:1.49
matrix-auth:2.6.5
matrix-project:1.18
antisamy-markup-formatter:2.1
gatling:1.3.0
bouncycastle-api:2.20
blueocean-config:1.24.4
pubsub-light:1.13
jira:3.2
github-api:1.123
blueocean-commons:1.24.4
active-directory:2.23
job-dsl:1.77
permissive-script-security:0.6
jenkins-design-language:1.24.4
blueocean-rest:1.24.4
variant:1.4
groovy-postbuild:2.5
blueocean-web:1.24.4
postgresql-api:42.2.5
blueocean-jira:1.24.4
blueocean-core-js:1.24.4
github-branch-source:2.10.2
blueocean-jwt:1.24.4
github:1.33.1
sse-gateway:1.24
blueocean-events:1.24.4
favorite:2.3.3
authorize-project:1.4.0
blueocean-rest-impl:1.24.4
shiningpanda:0.24
handy-uri-templates-2-api:2.1.8-1.0
blueocean-dashboard:1.24.4
blueocean-personalization:1.24.4
popper-api:1.16.1-2
blueocean-i18n:1.24.4
blueocean-autofavorite:1.2.4
bootstrap4-api:4.6.0-2
checks-api:1.6.0
blueocean-display-url:2.4.1
blueocean-git-pipeline:1.24.4
heavy-job:1.1
blueocean-pipeline-scm-api:1.24.4
blueocean-pipeline-api-impl:1.24.4
blueocean-github-pipeline:1.24.4
blueocean-bitbucket-pipeline:1.24.4
blueocean-pipeline-editor:1.24.4
blueocean:1.24.4
okhttp-api:3.14.9
ansicolor:0.7.5
cloudbees-bitbucket-branch-source:2.9.7
font-awesome-api:5.15.2-2
snakeyaml-api:1.27.0
ssh-steps:2.0.0
Office-365-Connector:4.14.0
jquery3-api:3.5.1-3
zap:1.1.0
echarts-api:5.0.1-1
plugin-util-api:2.0.0
h2-api:1.4.199
config-file-provider:3.7.0
pipeline-maven:3.10.0
jjwt-api:0.11.2-9.c8b45b8bb173
plugin-usage-plugin:1.2
all-changes:1.5
display-upstream-changes:0.3.2
downstream-ext:1.8
global-build-stats:1.5
handlebars:1.1.1
jquery-detached:1.2.1
momentjs:1.1.1
mapdb-api:1.0.9.0
maven-info:0.2.0
nested-view:1.17
workflow-aggregator:2.6
pipeline-graph-analysis:1.10
progress-bar-column-plugin:1.0
saferestart:0.3
sonar-quality-gates:1.3.1
xvfb:1.1.3
ace-editor:1.1
scripttrigger:0.34
external-monitor-job:1.7
Result: [Plugin:credentials, Plugin:structs, Plugin:trilead-api, Plugin:jdk-tool, Plugin:apache-httpcomponents-client-4-api, Plugin:authentication-tokens, Plugin:bitbucket, Plugin:branch-api, Plugin:build-blocker-plugin, Plugin:claim, Plugin:conditional-buildstep, Plugin:credentials-binding, Plugin:dashboard-view, Plugin:display-url-api, Plugin:docker-commons, Plugin:docker-workflow, Plugin:durable-task, Plugin:email-ext, Plugin:embeddable-build-status, Plugin:extra-columns, Plugin:cloudbees-folder, Plugin:git-client, Plugin:git-server, Plugin:groovy, Plugin:http_request, Plugin:jquery, Plugin:jsch, Plugin:ant, Plugin:ldap, Plugin:lockable-resources, Plugin:influxdb, Plugin:git, Plugin:maven-plugin, Plugin:mercurial, Plugin:pam-auth, Plugin:parameterized-trigger, Plugin:performance, Plugin:pipeline-utility-steps, Plugin:workflow-api, Plugin:workflow-basic-steps, Plugin:pipeline-build-step, Plugin:pipeline-model-definition, Plugin:pipeline-model-extensions, Plugin:workflow-cps, Plugin:pipeline-input-step, Plugin:workflow-job, Plugin:pipeline-milestone-step, Plugin:pipeline-model-api, Plugin:workflow-multibranch, Plugin:workflow-durable-task-step, Plugin:pipeline-rest-api, Plugin:workflow-scm-step, Plugin:workflow-cps-global-lib, Plugin:pipeline-stage-step, Plugin:pipeline-stage-tags-metadata, Plugin:pipeline-stage-view, Plugin:workflow-step-api, Plugin:workflow-support, Plugin:plain-credentials, Plugin:htmlpublisher, Plugin:resource-disposer, Plugin:run-condition, Plugin:scm-api, Plugin:script-security, Plugin:swarm, Plugin:sonar, Plugin:ssh-agent, Plugin:ssh-credentials, Plugin:text-finder, Plugin:throttle-concurrents, Plugin:token-macro, Plugin:view-job-filters, Plugin:jackson2-api, Plugin:ws-cleanup, Plugin:mailer, Plugin:badge, Plugin:command-launcher, Plugin:javadoc, Plugin:windows-slaves, Plugin:junit, Plugin:matrix-auth, Plugin:matrix-project, Plugin:antisamy-markup-formatter, Plugin:gatling, Plugin:bouncycastle-api, Plugin:blueocean-config, Plugin:pubsub-light, Plugin:jira, Plugin:github-api, Plugin:blueocean-commons, Plugin:active-directory, Plugin:job-dsl, Plugin:permissive-script-security, Plugin:jenkins-design-language, Plugin:blueocean-rest, Plugin:variant, Plugin:groovy-postbuild, Plugin:blueocean-web, Plugin:postgresql-api, Plugin:blueocean-jira, Plugin:blueocean-core-js, Plugin:github-branch-source, Plugin:blueocean-jwt, Plugin:github, Plugin:sse-gateway, Plugin:blueocean-events, Plugin:favorite, Plugin:authorize-project, Plugin:blueocean-rest-impl, Plugin:shiningpanda, Plugin:handy-uri-templates-2-api, Plugin:blueocean-dashboard, Plugin:blueocean-personalization, Plugin:popper-api, Plugin:blueocean-i18n, Plugin:blueocean-autofavorite, Plugin:bootstrap4-api, Plugin:checks-api, Plugin:blueocean-display-url, Plugin:blueocean-git-pipeline, Plugin:heavy-job, Plugin:blueocean-pipeline-scm-api, Plugin:blueocean-pipeline-api-impl, Plugin:blueocean-github-pipeline, Plugin:blueocean-bitbucket-pipeline, Plugin:blueocean-pipeline-editor, Plugin:blueocean, Plugin:okhttp-api, Plugin:ansicolor, Plugin:cloudbees-bitbucket-branch-source, Plugin:font-awesome-api, Plugin:snakeyaml-api, Plugin:ssh-steps, Plugin:Office-365-Connector, Plugin:jquery3-api, Plugin:zap, Plugin:echarts-api, Plugin:plugin-util-api, Plugin:h2-api, Plugin:config-file-provider, Plugin:pipeline-maven, Plugin:jjwt-api, Plugin:plugin-usage-plugin, Plugin:all-changes, Plugin:display-upstream-changes, Plugin:downstream-ext, Plugin:global-build-stats, Plugin:handlebars, Plugin:jquery-detached, Plugin:momentjs, Plugin:mapdb-api, Plugin:maven-info, Plugin:nested-view, Plugin:workflow-aggregator, Plugin:pipeline-graph-analysis, Plugin:progress-bar-column-plugin, Plugin:saferestart, Plugin:sonar-quality-gates, Plugin:xvfb, Plugin:ace-editor, Plugin:scripttrigger, Plugin:external-monitor-job]Operating System: CentOS 7.9 - 64 bits JRE/JDK: java-1.8.0-openjdk.x86_64 default openJDK 8 from "@updates". Jenkins installation from yum repo http://pkg.jenkins.io/redhat-stable Reverse proxy: nginx (enforces SSL offloading). Happy to provide details, but using guidelines as described here https://wiki.jenkins.io/display/JENKINS/Jenkins+behind+an+NGinX+reverse+proxy Browser: n/a Output of version and plugins: Jenkins: 2.277.1 OS: Linux - 3.10.0-1160.15.2.el7.x86_64 --- credentials:2.3.15 structs:1.22 trilead-api:1.0.13 jdk-tool:1.5 apache-httpcomponents-client-4-api:4.5.13-1.0 authentication-tokens:1.4 bitbucket:1.1.27 branch-api:2.6.3 build-blocker-plugin:1.7.7 claim:2.18.2 conditional-buildstep:1.4.1 credentials-binding:1.24 dashboard-view:2.15 display-url-api:2.3.4 docker-commons:1.17 docker-workflow:1.26 durable-task:1.35 email-ext:2.82 embeddable-build-status:2.0.3 extra-columns:1.22 cloudbees-folder:6.15 git-client:3.6.0 git-server:1.9 groovy:2.3 http_request:1.8.27 jquery:1.12.4-1 jsch:0.1.55.2 ant:1.11 ldap:2.4 lockable-resources:2.10 influxdb:2.5 git:4.6.0 maven-plugin:3.10 mercurial:2.13 pam-auth:1.6 parameterized-trigger:2.40 performance:3.19 pipeline-utility-steps:2.6.1 workflow-api:2.41 workflow-basic-steps:2.23 pipeline-build-step:2.13 pipeline-model-definition:1.8.4 pipeline-model-extensions:1.8.4 workflow-cps:2.90 pipeline-input-step:2.12 workflow-job:2.40 pipeline-milestone-step:1.3.2 pipeline-model-api:1.8.4 workflow-multibranch:2.22 workflow-durable-task-step:2.38 pipeline-rest-api:2.19 workflow-scm-step:2.12 workflow-cps-global-lib:2.18 pipeline-stage-step:2.5 pipeline-stage-tags-metadata:1.8.4 pipeline-stage-view:2.19 workflow-step-api:2.23 workflow-support:3.8 plain-credentials:1.7 htmlpublisher:1.25 resource-disposer:0.15 run-condition:1.5 scm-api:2.6.4 script-security:1.76 swarm:3.24 sonar:2.13 ssh-agent:1.21 ssh-credentials:1.18.1 text-finder:1.15 throttle-concurrents:2.2 token-macro:2.15 view-job-filters:2.3 jackson2-api:2.12.1 ws-cleanup:0.39 mailer:1.33 badge:1.8 command-launcher:1.5 javadoc:1.6 windows-slaves:1.7 junit:1.49 matrix-auth:2.6.5 matrix-project:1.18 antisamy-markup-formatter:2.1 gatling:1.3.0 bouncycastle-api:2.20 blueocean-config:1.24.4 pubsub-light:1.13 jira:3.2 github-api:1.123 blueocean-commons:1.24.4 active-directory:2.23 job-dsl:1.77 permissive-script-security:0.6 jenkins-design-language:1.24.4 blueocean-rest:1.24.4 variant:1.4 groovy-postbuild:2.5 blueocean-web:1.24.4 postgresql-api:42.2.5 blueocean-jira:1.24.4 blueocean-core-js:1.24.4 github-branch-source:2.10.2 blueocean-jwt:1.24.4 github:1.33.1 sse-gateway:1.24 blueocean-events:1.24.4 favorite:2.3.3 authorize-project:1.4.0 blueocean-rest-impl:1.24.4 shiningpanda:0.24 handy-uri-templates-2-api:2.1.8-1.0 blueocean-dashboard:1.24.4 blueocean-personalization:1.24.4 popper-api:1.16.1-2 blueocean-i18n:1.24.4 blueocean-autofavorite:1.2.4 bootstrap4-api:4.6.0-2 checks-api:1.6.0 blueocean-display-url:2.4.1 blueocean-git-pipeline:1.24.4 heavy-job:1.1 blueocean-pipeline-scm-api:1.24.4 blueocean-pipeline-api-impl:1.24.4 blueocean-github-pipeline:1.24.4 blueocean-bitbucket-pipeline:1.24.4 blueocean-pipeline-editor:1.24.4 blueocean:1.24.4 okhttp-api:3.14.9 ansicolor:0.7.5 cloudbees-bitbucket-branch-source:2.9.7 font-awesome-api:5.15.2-2 snakeyaml-api:1.27.0 ssh-steps:2.0.0 Office-365-Connector:4.14.0 jquery3-api:3.5.1-3 zap:1.1.0 echarts-api:5.0.1-1 plugin-util-api:2.0.0 h2-api:1.4.199 config-file-provider:3.7.0 pipeline-maven:3.10.0 jjwt-api:0.11.2-9.c8b45b8bb173 plugin-usage-plugin:1.2 all-changes:1.5 display-upstream-changes:0.3.2 downstream-ext:1.8 global-build-stats:1.5 handlebars:1.1.1 jquery-detached:1.2.1 momentjs:1.1.1 mapdb-api:1.0.9.0 maven-info:0.2.0 nested-view:1.17 workflow-aggregator:2.6 pipeline-graph-analysis:1.10 progress-bar-column-plugin:1.0 saferestart:0.3 sonar-quality-gates:1.3.1 xvfb:1.1.3 ace-editor:1.1 scripttrigger:0.34 external-monitor-job:1.7 Result: [Plugin:credentials, Plugin:structs, Plugin:trilead-api, Plugin:jdk-tool, Plugin:apache-httpcomponents-client-4-api, Plugin:authentication-tokens, Plugin:bitbucket, Plugin:branch-api, Plugin:build-blocker-plugin, Plugin:claim, Plugin:conditional-buildstep, Plugin:credentials-binding, Plugin:dashboard-view, Plugin:display-url-api, Plugin:docker-commons, Plugin:docker-workflow, Plugin:durable-task, Plugin:email-ext, Plugin:embeddable-build-status, Plugin:extra-columns, Plugin:cloudbees-folder, Plugin:git-client, Plugin:git-server, Plugin:groovy, Plugin:http_request, Plugin:jquery, Plugin:jsch, Plugin:ant, Plugin:ldap, Plugin:lockable-resources, Plugin:influxdb, Plugin:git, Plugin:maven-plugin, Plugin:mercurial, Plugin:pam-auth, Plugin:parameterized-trigger, Plugin:performance, Plugin:pipeline-utility-steps, Plugin:workflow-api, Plugin:workflow-basic-steps, Plugin:pipeline-build-step, Plugin:pipeline-model-definition, Plugin:pipeline-model-extensions, Plugin:workflow-cps, Plugin:pipeline-input-step, Plugin:workflow-job, Plugin:pipeline-milestone-step, Plugin:pipeline-model-api, Plugin:workflow-multibranch, Plugin:workflow-durable-task-step, Plugin:pipeline-rest-api, Plugin:workflow-scm-step, Plugin:workflow-cps-global-lib, Plugin:pipeline-stage-step, Plugin:pipeline-stage-tags-metadata, Plugin:pipeline-stage-view, Plugin:workflow-step-api, Plugin:workflow-support, Plugin:plain-credentials, Plugin:htmlpublisher, Plugin:resource-disposer, Plugin:run-condition, Plugin:scm-api, Plugin:script-security, Plugin:swarm, Plugin:sonar, Plugin:ssh-agent, Plugin:ssh-credentials, Plugin:text-finder, Plugin:throttle-concurrents, Plugin:token-macro, Plugin:view-job-filters, Plugin:jackson2-api, Plugin:ws-cleanup, Plugin:mailer, Plugin:badge, Plugin:command-launcher, Plugin:javadoc, Plugin:windows-slaves, Plugin:junit, Plugin:matrix-auth, Plugin:matrix-project, Plugin:antisamy-markup-formatter, Plugin:gatling, Plugin:bouncycastle-api, Plugin:blueocean-config, Plugin:pubsub-light, Plugin:jira, Plugin:github-api, Plugin:blueocean-commons, Plugin:active-directory, Plugin:job-dsl, Plugin:permissive-script-security, Plugin:jenkins-design-language, Plugin:blueocean-rest, Plugin:variant, Plugin:groovy-postbuild, Plugin:blueocean-web, Plugin:postgresql-api, Plugin:blueocean-jira, Plugin:blueocean-core-js, Plugin:github-branch-source, Plugin:blueocean-jwt, Plugin:github, Plugin:sse-gateway, Plugin:blueocean-events, Plugin:favorite, Plugin:authorize-project, Plugin:blueocean-rest-impl, Plugin:shiningpanda, Plugin:handy-uri-templates-2-api, Plugin:blueocean-dashboard, Plugin:blueocean-personalization, Plugin:popper-api, Plugin:blueocean-i18n, Plugin:blueocean-autofavorite, Plugin:bootstrap4-api, Plugin:checks-api, Plugin:blueocean-display-url, Plugin:blueocean-git-pipeline, Plugin:heavy-job, Plugin:blueocean-pipeline-scm-api, Plugin:blueocean-pipeline-api-impl, Plugin:blueocean-github-pipeline, Plugin:blueocean-bitbucket-pipeline, Plugin:blueocean-pipeline-editor, Plugin:blueocean, Plugin:okhttp-api, Plugin:ansicolor, Plugin:cloudbees-bitbucket-branch-source, Plugin:font-awesome-api, Plugin:snakeyaml-api, Plugin:ssh-steps, Plugin:Office-365-Connector, Plugin:jquery3-api, Plugin:zap, Plugin:echarts-api, Plugin:plugin-util-api, Plugin:h2-api, Plugin:config-file-provider, Plugin:pipeline-maven, Plugin:jjwt-api, Plugin:plugin-usage-plugin, Plugin:all-changes, Plugin:display-upstream-changes, Plugin:downstream-ext, Plugin:global-build-stats, Plugin:handlebars, Plugin:jquery-detached, Plugin:momentjs, Plugin:mapdb-api, Plugin:maven-info, Plugin:nested-view, Plugin:workflow-aggregator, Plugin:pipeline-graph-analysis, Plugin:progress-bar-column-plugin, Plugin:saferestart, Plugin:sonar-quality-gates, Plugin:xvfb, Plugin:ace-editor, Plugin:scripttrigger, Plugin:external-monitor-job]
We scripted update of jenkins and plugins to run automatically each saturday morning. In our update from last saturday it updated
- Jenkins to LTS 2.277.1-1.1 (from the http://pkg.jenkins.io/redhat-stable yum repo)
- Jenkins swarm plugin from 3.24 to 3.25
After restart the jenkins agents won't register themselves to the main node.
Log from one of the jenkins agents:
mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.SwarmClient discoverFromMasterUrl mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: SEVERE: Failed to fetch swarm information from Jenkins, plugin not installed? mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.Client run mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: SEVERE: RetryException occurred mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: hudson.plugins.swarm.RetryException: Failed to fetch swarm information from Jenkins, plugin not installed? mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.SwarmClient.discoverFromMasterUrl(SwarmClient.java:229) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.Client.run(Client.java:146) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.Client.main(Client.java:119) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.Client run mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: INFO: Retrying in 10 seconds
It was unclear to me what is actually happening, as nothing else has changed and was working before. Once I downgraded the swarm-plugin to 3.24 everything started to work again.
We do have some custom config in Jenkins in the "Global security" section
TCP port for inbound agents is fixed to 45250
Inbound TCP Agent Protocol/4 (TLS encryption) is enabled
We use the latest swarm client version 3.9 on each agent
