-
Bug
-
Resolution: Won't Fix
-
Blocker
-
None
-
Operating System: CentOS 7.9 - 64 bits
JRE/JDK: java-1.8.0-openjdk.x86_64 default openJDK 8 from "@updates".
Jenkins installation from yum repo http://pkg.jenkins.io/redhat-stable
Reverse proxy: nginx (enforces SSL offloading). Happy to provide details, but using guidelines as described here https://wiki.jenkins.io/display/JENKINS/Jenkins+behind+an+NGinX+reverse+proxy
Browser: n/a
Output of version and plugins:
Jenkins: 2.277.1
OS: Linux - 3.10.0-1160.15.2.el7.x86_64
---
credentials:2.3.15
structs:1.22
trilead-api:1.0.13
jdk-tool:1.5
apache-httpcomponents-client-4-api:4.5.13-1.0
authentication-tokens:1.4
bitbucket:1.1.27
branch-api:2.6.3
build-blocker-plugin:1.7.7
claim:2.18.2
conditional-buildstep:1.4.1
credentials-binding:1.24
dashboard-view:2.15
display-url-api:2.3.4
docker-commons:1.17
docker-workflow:1.26
durable-task:1.35
email-ext:2.82
embeddable-build-status:2.0.3
extra-columns:1.22
cloudbees-folder:6.15
git-client:3.6.0
git-server:1.9
groovy:2.3
http_request:1.8.27
jquery:1.12.4-1
jsch:0.1.55.2
ant:1.11
ldap:2.4
lockable-resources:2.10
influxdb:2.5
git:4.6.0
maven-plugin:3.10
mercurial:2.13
pam-auth:1.6
parameterized-trigger:2.40
performance:3.19
pipeline-utility-steps:2.6.1
workflow-api:2.41
workflow-basic-steps:2.23
pipeline-build-step:2.13
pipeline-model-definition:1.8.4
pipeline-model-extensions:1.8.4
workflow-cps:2.90
pipeline-input-step:2.12
workflow-job:2.40
pipeline-milestone-step:1.3.2
pipeline-model-api:1.8.4
workflow-multibranch:2.22
workflow-durable-task-step:2.38
pipeline-rest-api:2.19
workflow-scm-step:2.12
workflow-cps-global-lib:2.18
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.8.4
pipeline-stage-view:2.19
workflow-step-api:2.23
workflow-support:3.8
plain-credentials:1.7
htmlpublisher:1.25
resource-disposer:0.15
run-condition:1.5
scm-api:2.6.4
script-security:1.76
swarm:3.24
sonar:2.13
ssh-agent:1.21
ssh-credentials:1.18.1
text-finder:1.15
throttle-concurrents:2.2
token-macro:2.15
view-job-filters:2.3
jackson2-api:2.12.1
ws-cleanup:0.39
mailer:1.33
badge:1.8
command-launcher:1.5
javadoc:1.6
windows-slaves:1.7
junit:1.49
matrix-auth:2.6.5
matrix-project:1.18
antisamy-markup-formatter:2.1
gatling:1.3.0
bouncycastle-api:2.20
blueocean-config:1.24.4
pubsub-light:1.13
jira:3.2
github-api:1.123
blueocean-commons:1.24.4
active-directory:2.23
job-dsl:1.77
permissive-script-security:0.6
jenkins-design-language:1.24.4
blueocean-rest:1.24.4
variant:1.4
groovy-postbuild:2.5
blueocean-web:1.24.4
postgresql-api:42.2.5
blueocean-jira:1.24.4
blueocean-core-js:1.24.4
github-branch-source:2.10.2
blueocean-jwt:1.24.4
github:1.33.1
sse-gateway:1.24
blueocean-events:1.24.4
favorite:2.3.3
authorize-project:1.4.0
blueocean-rest-impl:1.24.4
shiningpanda:0.24
handy-uri-templates-2-api:2.1.8-1.0
blueocean-dashboard:1.24.4
blueocean-personalization:1.24.4
popper-api:1.16.1-2
blueocean-i18n:1.24.4
blueocean-autofavorite:1.2.4
bootstrap4-api:4.6.0-2
checks-api:1.6.0
blueocean-display-url:2.4.1
blueocean-git-pipeline:1.24.4
heavy-job:1.1
blueocean-pipeline-scm-api:1.24.4
blueocean-pipeline-api-impl:1.24.4
blueocean-github-pipeline:1.24.4
blueocean-bitbucket-pipeline:1.24.4
blueocean-pipeline-editor:1.24.4
blueocean:1.24.4
okhttp-api:3.14.9
ansicolor:0.7.5
cloudbees-bitbucket-branch-source:2.9.7
font-awesome-api:5.15.2-2
snakeyaml-api:1.27.0
ssh-steps:2.0.0
Office-365-Connector:4.14.0
jquery3-api:3.5.1-3
zap:1.1.0
echarts-api:5.0.1-1
plugin-util-api:2.0.0
h2-api:1.4.199
config-file-provider:3.7.0
pipeline-maven:3.10.0
jjwt-api:0.11.2-9.c8b45b8bb173
plugin-usage-plugin:1.2
all-changes:1.5
display-upstream-changes:0.3.2
downstream-ext:1.8
global-build-stats:1.5
handlebars:1.1.1
jquery-detached:1.2.1
momentjs:1.1.1
mapdb-api:1.0.9.0
maven-info:0.2.0
nested-view:1.17
workflow-aggregator:2.6
pipeline-graph-analysis:1.10
progress-bar-column-plugin:1.0
saferestart:0.3
sonar-quality-gates:1.3.1
xvfb:1.1.3
ace-editor:1.1
scripttrigger:0.34
external-monitor-job:1.7
Result: [Plugin:credentials, Plugin:structs, Plugin:trilead-api, Plugin:jdk-tool, Plugin:apache-httpcomponents-client-4-api, Plugin:authentication-tokens, Plugin:bitbucket, Plugin:branch-api, Plugin:build-blocker-plugin, Plugin:claim, Plugin:conditional-buildstep, Plugin:credentials-binding, Plugin:dashboard-view, Plugin:display-url-api, Plugin:docker-commons, Plugin:docker-workflow, Plugin:durable-task, Plugin:email-ext, Plugin:embeddable-build-status, Plugin:extra-columns, Plugin:cloudbees-folder, Plugin:git-client, Plugin:git-server, Plugin:groovy, Plugin:http_request, Plugin:jquery, Plugin:jsch, Plugin:ant, Plugin:ldap, Plugin:lockable-resources, Plugin:influxdb, Plugin:git, Plugin:maven-plugin, Plugin:mercurial, Plugin:pam-auth, Plugin:parameterized-trigger, Plugin:performance, Plugin:pipeline-utility-steps, Plugin:workflow-api, Plugin:workflow-basic-steps, Plugin:pipeline-build-step, Plugin:pipeline-model-definition, Plugin:pipeline-model-extensions, Plugin:workflow-cps, Plugin:pipeline-input-step, Plugin:workflow-job, Plugin:pipeline-milestone-step, Plugin:pipeline-model-api, Plugin:workflow-multibranch, Plugin:workflow-durable-task-step, Plugin:pipeline-rest-api, Plugin:workflow-scm-step, Plugin:workflow-cps-global-lib, Plugin:pipeline-stage-step, Plugin:pipeline-stage-tags-metadata, Plugin:pipeline-stage-view, Plugin:workflow-step-api, Plugin:workflow-support, Plugin:plain-credentials, Plugin:htmlpublisher, Plugin:resource-disposer, Plugin:run-condition, Plugin:scm-api, Plugin:script-security, Plugin:swarm, Plugin:sonar, Plugin:ssh-agent, Plugin:ssh-credentials, Plugin:text-finder, Plugin:throttle-concurrents, Plugin:token-macro, Plugin:view-job-filters, Plugin:jackson2-api, Plugin:ws-cleanup, Plugin:mailer, Plugin:badge, Plugin:command-launcher, Plugin:javadoc, Plugin:windows-slaves, Plugin:junit, Plugin:matrix-auth, Plugin:matrix-project, Plugin:antisamy-markup-formatter, Plugin:gatling, Plugin:bouncycastle-api, Plugin:blueocean-config, Plugin:pubsub-light, Plugin:jira, Plugin:github-api, Plugin:blueocean-commons, Plugin:active-directory, Plugin:job-dsl, Plugin:permissive-script-security, Plugin:jenkins-design-language, Plugin:blueocean-rest, Plugin:variant, Plugin:groovy-postbuild, Plugin:blueocean-web, Plugin:postgresql-api, Plugin:blueocean-jira, Plugin:blueocean-core-js, Plugin:github-branch-source, Plugin:blueocean-jwt, Plugin:github, Plugin:sse-gateway, Plugin:blueocean-events, Plugin:favorite, Plugin:authorize-project, Plugin:blueocean-rest-impl, Plugin:shiningpanda, Plugin:handy-uri-templates-2-api, Plugin:blueocean-dashboard, Plugin:blueocean-personalization, Plugin:popper-api, Plugin:blueocean-i18n, Plugin:blueocean-autofavorite, Plugin:bootstrap4-api, Plugin:checks-api, Plugin:blueocean-display-url, Plugin:blueocean-git-pipeline, Plugin:heavy-job, Plugin:blueocean-pipeline-scm-api, Plugin:blueocean-pipeline-api-impl, Plugin:blueocean-github-pipeline, Plugin:blueocean-bitbucket-pipeline, Plugin:blueocean-pipeline-editor, Plugin:blueocean, Plugin:okhttp-api, Plugin:ansicolor, Plugin:cloudbees-bitbucket-branch-source, Plugin:font-awesome-api, Plugin:snakeyaml-api, Plugin:ssh-steps, Plugin:Office-365-Connector, Plugin:jquery3-api, Plugin:zap, Plugin:echarts-api, Plugin:plugin-util-api, Plugin:h2-api, Plugin:config-file-provider, Plugin:pipeline-maven, Plugin:jjwt-api, Plugin:plugin-usage-plugin, Plugin:all-changes, Plugin:display-upstream-changes, Plugin:downstream-ext, Plugin:global-build-stats, Plugin:handlebars, Plugin:jquery-detached, Plugin:momentjs, Plugin:mapdb-api, Plugin:maven-info, Plugin:nested-view, Plugin:workflow-aggregator, Plugin:pipeline-graph-analysis, Plugin:progress-bar-column-plugin, Plugin:saferestart, Plugin:sonar-quality-gates, Plugin:xvfb, Plugin:ace-editor, Plugin:scripttrigger, Plugin:external-monitor-job]Operating System: CentOS 7.9 - 64 bits JRE/JDK: java-1.8.0-openjdk.x86_64 default openJDK 8 from "@updates". Jenkins installation from yum repo http://pkg.jenkins.io/redhat-stable Reverse proxy: nginx (enforces SSL offloading). Happy to provide details, but using guidelines as described here https://wiki.jenkins.io/display/JENKINS/Jenkins+behind+an+NGinX+reverse+proxy Browser: n/a Output of version and plugins: Jenkins: 2.277.1 OS: Linux - 3.10.0-1160.15.2.el7.x86_64 --- credentials:2.3.15 structs:1.22 trilead-api:1.0.13 jdk-tool:1.5 apache-httpcomponents-client-4-api:4.5.13-1.0 authentication-tokens:1.4 bitbucket:1.1.27 branch-api:2.6.3 build-blocker-plugin:1.7.7 claim:2.18.2 conditional-buildstep:1.4.1 credentials-binding:1.24 dashboard-view:2.15 display-url-api:2.3.4 docker-commons:1.17 docker-workflow:1.26 durable-task:1.35 email-ext:2.82 embeddable-build-status:2.0.3 extra-columns:1.22 cloudbees-folder:6.15 git-client:3.6.0 git-server:1.9 groovy:2.3 http_request:1.8.27 jquery:1.12.4-1 jsch:0.1.55.2 ant:1.11 ldap:2.4 lockable-resources:2.10 influxdb:2.5 git:4.6.0 maven-plugin:3.10 mercurial:2.13 pam-auth:1.6 parameterized-trigger:2.40 performance:3.19 pipeline-utility-steps:2.6.1 workflow-api:2.41 workflow-basic-steps:2.23 pipeline-build-step:2.13 pipeline-model-definition:1.8.4 pipeline-model-extensions:1.8.4 workflow-cps:2.90 pipeline-input-step:2.12 workflow-job:2.40 pipeline-milestone-step:1.3.2 pipeline-model-api:1.8.4 workflow-multibranch:2.22 workflow-durable-task-step:2.38 pipeline-rest-api:2.19 workflow-scm-step:2.12 workflow-cps-global-lib:2.18 pipeline-stage-step:2.5 pipeline-stage-tags-metadata:1.8.4 pipeline-stage-view:2.19 workflow-step-api:2.23 workflow-support:3.8 plain-credentials:1.7 htmlpublisher:1.25 resource-disposer:0.15 run-condition:1.5 scm-api:2.6.4 script-security:1.76 swarm:3.24 sonar:2.13 ssh-agent:1.21 ssh-credentials:1.18.1 text-finder:1.15 throttle-concurrents:2.2 token-macro:2.15 view-job-filters:2.3 jackson2-api:2.12.1 ws-cleanup:0.39 mailer:1.33 badge:1.8 command-launcher:1.5 javadoc:1.6 windows-slaves:1.7 junit:1.49 matrix-auth:2.6.5 matrix-project:1.18 antisamy-markup-formatter:2.1 gatling:1.3.0 bouncycastle-api:2.20 blueocean-config:1.24.4 pubsub-light:1.13 jira:3.2 github-api:1.123 blueocean-commons:1.24.4 active-directory:2.23 job-dsl:1.77 permissive-script-security:0.6 jenkins-design-language:1.24.4 blueocean-rest:1.24.4 variant:1.4 groovy-postbuild:2.5 blueocean-web:1.24.4 postgresql-api:42.2.5 blueocean-jira:1.24.4 blueocean-core-js:1.24.4 github-branch-source:2.10.2 blueocean-jwt:1.24.4 github:1.33.1 sse-gateway:1.24 blueocean-events:1.24.4 favorite:2.3.3 authorize-project:1.4.0 blueocean-rest-impl:1.24.4 shiningpanda:0.24 handy-uri-templates-2-api:2.1.8-1.0 blueocean-dashboard:1.24.4 blueocean-personalization:1.24.4 popper-api:1.16.1-2 blueocean-i18n:1.24.4 blueocean-autofavorite:1.2.4 bootstrap4-api:4.6.0-2 checks-api:1.6.0 blueocean-display-url:2.4.1 blueocean-git-pipeline:1.24.4 heavy-job:1.1 blueocean-pipeline-scm-api:1.24.4 blueocean-pipeline-api-impl:1.24.4 blueocean-github-pipeline:1.24.4 blueocean-bitbucket-pipeline:1.24.4 blueocean-pipeline-editor:1.24.4 blueocean:1.24.4 okhttp-api:3.14.9 ansicolor:0.7.5 cloudbees-bitbucket-branch-source:2.9.7 font-awesome-api:5.15.2-2 snakeyaml-api:1.27.0 ssh-steps:2.0.0 Office-365-Connector:4.14.0 jquery3-api:3.5.1-3 zap:1.1.0 echarts-api:5.0.1-1 plugin-util-api:2.0.0 h2-api:1.4.199 config-file-provider:3.7.0 pipeline-maven:3.10.0 jjwt-api:0.11.2-9.c8b45b8bb173 plugin-usage-plugin:1.2 all-changes:1.5 display-upstream-changes:0.3.2 downstream-ext:1.8 global-build-stats:1.5 handlebars:1.1.1 jquery-detached:1.2.1 momentjs:1.1.1 mapdb-api:1.0.9.0 maven-info:0.2.0 nested-view:1.17 workflow-aggregator:2.6 pipeline-graph-analysis:1.10 progress-bar-column-plugin:1.0 saferestart:0.3 sonar-quality-gates:1.3.1 xvfb:1.1.3 ace-editor:1.1 scripttrigger:0.34 external-monitor-job:1.7 Result: [Plugin:credentials, Plugin:structs, Plugin:trilead-api, Plugin:jdk-tool, Plugin:apache-httpcomponents-client-4-api, Plugin:authentication-tokens, Plugin:bitbucket, Plugin:branch-api, Plugin:build-blocker-plugin, Plugin:claim, Plugin:conditional-buildstep, Plugin:credentials-binding, Plugin:dashboard-view, Plugin:display-url-api, Plugin:docker-commons, Plugin:docker-workflow, Plugin:durable-task, Plugin:email-ext, Plugin:embeddable-build-status, Plugin:extra-columns, Plugin:cloudbees-folder, Plugin:git-client, Plugin:git-server, Plugin:groovy, Plugin:http_request, Plugin:jquery, Plugin:jsch, Plugin:ant, Plugin:ldap, Plugin:lockable-resources, Plugin:influxdb, Plugin:git, Plugin:maven-plugin, Plugin:mercurial, Plugin:pam-auth, Plugin:parameterized-trigger, Plugin:performance, Plugin:pipeline-utility-steps, Plugin:workflow-api, Plugin:workflow-basic-steps, Plugin:pipeline-build-step, Plugin:pipeline-model-definition, Plugin:pipeline-model-extensions, Plugin:workflow-cps, Plugin:pipeline-input-step, Plugin:workflow-job, Plugin:pipeline-milestone-step, Plugin:pipeline-model-api, Plugin:workflow-multibranch, Plugin:workflow-durable-task-step, Plugin:pipeline-rest-api, Plugin:workflow-scm-step, Plugin:workflow-cps-global-lib, Plugin:pipeline-stage-step, Plugin:pipeline-stage-tags-metadata, Plugin:pipeline-stage-view, Plugin:workflow-step-api, Plugin:workflow-support, Plugin:plain-credentials, Plugin:htmlpublisher, Plugin:resource-disposer, Plugin:run-condition, Plugin:scm-api, Plugin:script-security, Plugin:swarm, Plugin:sonar, Plugin:ssh-agent, Plugin:ssh-credentials, Plugin:text-finder, Plugin:throttle-concurrents, Plugin:token-macro, Plugin:view-job-filters, Plugin:jackson2-api, Plugin:ws-cleanup, Plugin:mailer, Plugin:badge, Plugin:command-launcher, Plugin:javadoc, Plugin:windows-slaves, Plugin:junit, Plugin:matrix-auth, Plugin:matrix-project, Plugin:antisamy-markup-formatter, Plugin:gatling, Plugin:bouncycastle-api, Plugin:blueocean-config, Plugin:pubsub-light, Plugin:jira, Plugin:github-api, Plugin:blueocean-commons, Plugin:active-directory, Plugin:job-dsl, Plugin:permissive-script-security, Plugin:jenkins-design-language, Plugin:blueocean-rest, Plugin:variant, Plugin:groovy-postbuild, Plugin:blueocean-web, Plugin:postgresql-api, Plugin:blueocean-jira, Plugin:blueocean-core-js, Plugin:github-branch-source, Plugin:blueocean-jwt, Plugin:github, Plugin:sse-gateway, Plugin:blueocean-events, Plugin:favorite, Plugin:authorize-project, Plugin:blueocean-rest-impl, Plugin:shiningpanda, Plugin:handy-uri-templates-2-api, Plugin:blueocean-dashboard, Plugin:blueocean-personalization, Plugin:popper-api, Plugin:blueocean-i18n, Plugin:blueocean-autofavorite, Plugin:bootstrap4-api, Plugin:checks-api, Plugin:blueocean-display-url, Plugin:blueocean-git-pipeline, Plugin:heavy-job, Plugin:blueocean-pipeline-scm-api, Plugin:blueocean-pipeline-api-impl, Plugin:blueocean-github-pipeline, Plugin:blueocean-bitbucket-pipeline, Plugin:blueocean-pipeline-editor, Plugin:blueocean, Plugin:okhttp-api, Plugin:ansicolor, Plugin:cloudbees-bitbucket-branch-source, Plugin:font-awesome-api, Plugin:snakeyaml-api, Plugin:ssh-steps, Plugin:Office-365-Connector, Plugin:jquery3-api, Plugin:zap, Plugin:echarts-api, Plugin:plugin-util-api, Plugin:h2-api, Plugin:config-file-provider, Plugin:pipeline-maven, Plugin:jjwt-api, Plugin:plugin-usage-plugin, Plugin:all-changes, Plugin:display-upstream-changes, Plugin:downstream-ext, Plugin:global-build-stats, Plugin:handlebars, Plugin:jquery-detached, Plugin:momentjs, Plugin:mapdb-api, Plugin:maven-info, Plugin:nested-view, Plugin:workflow-aggregator, Plugin:pipeline-graph-analysis, Plugin:progress-bar-column-plugin, Plugin:saferestart, Plugin:sonar-quality-gates, Plugin:xvfb, Plugin:ace-editor, Plugin:scripttrigger, Plugin:external-monitor-job]
We scripted update of jenkins and plugins to run automatically each saturday morning. In our update from last saturday it updated
- Jenkins to LTS 2.277.1-1.1 (from the http://pkg.jenkins.io/redhat-stable yum repo)
- Jenkins swarm plugin from 3.24 to 3.25
After restart the jenkins agents won't register themselves to the main node.
Log from one of the jenkins agents:
mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.SwarmClient discoverFromMasterUrl mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: SEVERE: Failed to fetch swarm information from Jenkins, plugin not installed? mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.Client run mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: SEVERE: RetryException occurred mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: hudson.plugins.swarm.RetryException: Failed to fetch swarm information from Jenkins, plugin not installed? mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.SwarmClient.discoverFromMasterUrl(SwarmClient.java:229) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.Client.run(Client.java:146) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: at hudson.plugins.swarm.Client.main(Client.java:119) mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: Mar 13, 2021 10:55:41 AM hudson.plugins.swarm.Client run mrt 13 10:55:41 la-02 linux_agent_run_main.sh[21487]: INFO: Retrying in 10 seconds
It was unclear to me what is actually happening, as nothing else has changed and was working before. Once I downgraded the swarm-plugin to 3.24 everything started to work again.
We do have some custom config in Jenkins in the "Global security" section
TCP port for inbound agents is fixed to 45250
Inbound TCP Agent Protocol/4 (TLS encryption) is enabled
We use the latest swarm client version 3.9 on each agent
[JENKINS-65119] Updating swarm plugin to 3.25 breaks connection with main node
Marco
added a comment - Oops! My bad. Will check that next saturday when I have a maintenance window. As for now I think this ticket can be closed, presuming it will be solved when we use the 3.25 client. If not I'll reopen it.
Marco
added a comment - Oops! My bad. Will check that next saturday when I have a maintenance window. As for now I think this ticket can be closed, presuming it will be solved when we use the 3.25 client. If not I'll reopen it. 
Hi. Is it possible you fell into the same trap as we did? swarm client 3.9 is NOT the latest: See here:
Perhaps using the latest version on the agents will solve the problem?