-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
Jenkins: 2.289.2
OS: Linux - 3.16.0-11-amd64
openjdk version "1.8.0_171"
PrioritySorter:4.0.0
ace-editor:1.1
ant:1.11
antisamy-markup-formatter:2.1
apache-httpcomponents-client-4-api:4.5.13-1.0
async-http-client:1.9.40.0
authentication-tokens:1.4
bootstrap4-api:4.6.0-3
bootstrap5-api:5.0.2-1
bouncycastle-api:2.21
branch-api:2.6.5
build-alias-setter:0.4
build-failure-analyzer:2.0.0
build-timeout:1.20
caffeine-api:2.9.1-23.v51c4e2c879c8
checks-api:1.7.2
cloudbees-folder:6.16
command-launcher:1.6
conditional-buildstep:1.4.1
copyartifact:1.46.1
credentials:2.5
credentials-binding:1.27
display-url-api:2.3.5
docker-commons:1.17
docker-workflow:1.26
durable-task:1.38
echarts-api:5.1.2-3
email-ext:2.83
extended-read-permission:3.2
external-monitor-job:1.7
font-awesome-api:5.15.3-4
ghprb:1.42.2
git:4.8.0
git-client:3.8.0
git-server:1.10
github:1.33.1
github-api:1.123
github-branch-source:2.11.2
github-oauth:0.33
github-organization-folder:1.6
gradle:1.37.1
groovy:2.4
handlebars:3.0.8
icon-shim:3.0.0
jackson2-api:2.12.4
javadoc:1.6
jdk-tool:1.5
jjwt-api:0.11.2-9.c8b45b8bb173
job-dsl:1.77
jobConfigHistory:2.28.1
jquery:1.12.4-1
jquery-detached:1.2.1
jquery-ui:1.0.2
jquery3-api:3.6.0-2
jsch:0.1.55.2
junit:1.51
ldap:2.7
lockable-resources:2.11
logfilesizechecker:1.5
mailer:1.34
mapdb-api:1.0.9.0
matrix-auth:2.6.8
matrix-project:1.19
maven-plugin:3.12
metrics:4.0.2.8
momentjs:1.1.1
msbuild:1.30
nodelabelparameter:1.8.1
okhttp-api:3.14.9
pam-auth:1.6
parameterized-trigger:2.41
pipeline-build-step:2.14
pipeline-github-lib:1.0
pipeline-graph-analysis:1.11
pipeline-input-step:2.12
pipeline-milestone-step:1.3.2
pipeline-model-api:1.8.5
pipeline-model-declarative-agent:1.1.1
pipeline-model-definition:1.8.5
pipeline-model-extensions:1.8.5
pipeline-rest-api:2.19
pipeline-stage-step:2.5
pipeline-stage-tags-metadata:1.8.5
pipeline-stage-view:2.19
pipeline-utility-steps:2.8.0
plain-credentials:1.7
plugin-util-api:2.4.0
popper-api:1.16.1-2
popper2-api:2.5.4-3
promoted-builds:3.10
rebuild:1.32
resource-disposer:0.16
run-condition:1.5
scm-api:2.6.4
script-security:1.77
snakeyaml-api:1.29.1
ssh-agent:1.23
ssh-credentials:1.19
ssh-slaves:1.32.0
sshd:3.1.0
structs:1.23
subversion:2.14.4
throttle-concurrents:2.3
timestamper:1.13
token-macro:2.15
trilead-api:1.0.13
variant:1.4
windows-slaves:1.8
workflow-aggregator:2.6
workflow-api:2.46
workflow-basic-steps:2.23
workflow-cps:2.93
workflow-cps-global-lib:2.21
workflow-durable-task-step:2.39
workflow-job:2.41
workflow-multibranch:2.26
workflow-scm-step:2.13
workflow-step-api:2.24
workflow-support:3.8
ws-cleanup:0.39
Jenkins: 2.289.2 OS: Linux - 3.16.0-11-amd64 openjdk version "1.8.0_171" PrioritySorter:4.0.0 ace-editor:1.1 ant:1.11 antisamy-markup-formatter:2.1 apache-httpcomponents-client-4-api:4.5.13-1.0 async-http-client:1.9.40.0 authentication-tokens:1.4 bootstrap4-api:4.6.0-3 bootstrap5-api:5.0.2-1 bouncycastle-api:2.21 branch-api:2.6.5 build-alias-setter:0.4 build-failure-analyzer:2.0.0 build-timeout:1.20 caffeine-api:2.9.1-23.v51c4e2c879c8 checks-api:1.7.2 cloudbees-folder:6.16 command-launcher:1.6 conditional-buildstep:1.4.1 copyartifact:1.46.1 credentials:2.5 credentials-binding:1.27 display-url-api:2.3.5 docker-commons:1.17 docker-workflow:1.26 durable-task:1.38 echarts-api:5.1.2-3 email-ext:2.83 extended-read-permission:3.2 external-monitor-job:1.7 font-awesome-api:5.15.3-4 ghprb:1.42.2 git:4.8.0 git-client:3.8.0 git-server:1.10 github:1.33.1 github-api:1.123 github-branch-source:2.11.2 github-oauth:0.33 github-organization-folder:1.6 gradle:1.37.1 groovy:2.4 handlebars:3.0.8 icon-shim:3.0.0 jackson2-api:2.12.4 javadoc:1.6 jdk-tool:1.5 jjwt-api:0.11.2-9.c8b45b8bb173 job-dsl:1.77 jobConfigHistory:2.28.1 jquery:1.12.4-1 jquery-detached:1.2.1 jquery-ui:1.0.2 jquery3-api:3.6.0-2 jsch:0.1.55.2 junit:1.51 ldap:2.7 lockable-resources:2.11 logfilesizechecker:1.5 mailer:1.34 mapdb-api:1.0.9.0 matrix-auth:2.6.8 matrix-project:1.19 maven-plugin:3.12 metrics:4.0.2.8 momentjs:1.1.1 msbuild:1.30 nodelabelparameter:1.8.1 okhttp-api:3.14.9 pam-auth:1.6 parameterized-trigger:2.41 pipeline-build-step:2.14 pipeline-github-lib:1.0 pipeline-graph-analysis:1.11 pipeline-input-step:2.12 pipeline-milestone-step:1.3.2 pipeline-model-api:1.8.5 pipeline-model-declarative-agent:1.1.1 pipeline-model-definition:1.8.5 pipeline-model-extensions:1.8.5 pipeline-rest-api:2.19 pipeline-stage-step:2.5 pipeline-stage-tags-metadata:1.8.5 pipeline-stage-view:2.19 pipeline-utility-steps:2.8.0 plain-credentials:1.7 plugin-util-api:2.4.0 popper-api:1.16.1-2 popper2-api:2.5.4-3 promoted-builds:3.10 rebuild:1.32 resource-disposer:0.16 run-condition:1.5 scm-api:2.6.4 script-security:1.77 snakeyaml-api:1.29.1 ssh-agent:1.23 ssh-credentials:1.19 ssh-slaves:1.32.0 sshd:3.1.0 structs:1.23 subversion:2.14.4 throttle-concurrents:2.3 timestamper:1.13 token-macro:2.15 trilead-api:1.0.13 variant:1.4 windows-slaves:1.8 workflow-aggregator:2.6 workflow-api:2.46 workflow-basic-steps:2.23 workflow-cps:2.93 workflow-cps-global-lib:2.21 workflow-durable-task-step:2.39 workflow-job:2.41 workflow-multibranch:2.26 workflow-scm-step:2.13 workflow-step-api:2.24 workflow-support:3.8 ws-cleanup:0.39
After running Jenkins for a couple of weeks, we start seeing high load when multiple jobs are copying artifacts at the same time.
During investigation I found that instead of copying artifacts all in one go, it's copyied in chucks of 5 seconds with a 15 second delay between chucks. This not only means that copying artifcats take 4 times as long, but it also seems to increase loading times on the web interface which in turns triggers our monitoring system for Jenkins healthcheck
The Jenkins Dashboard also shows a number of jobs in progress on the master, but also not using the single executor on the master. I assume this means it's running on the master, but it's not a job component ? Maybe a clearer way of show what the jobs is doing on the master would help with troubleshooting as well ? I've attached a screenshot as well.
I've attached a screenshot of nload while experiencing the issue as well as a jstack
![2021-09-13 10_33_58-Dashboard [Jenkins]-1.png](/secure/attachment/56309/2021-09-13%2010_33_58-Dashboard%20%5BJenkins%5D-1.png)