-
Bug
-
Resolution: Duplicate
-
Major
-
Operating System: RedHat 7 (master), RedHat 7 (master/agents)
Jenkins and plugin versions:
Command Agent Launcher Plugin (command-launcher): 1.3
External Monitor Job Type Plugin (external-monitor-job): 1.7
JavaScript GUI Lib: ACE Editor bundle plugin (ace-editor): 1.1
Extra Columns Plugin (extra-columns): 1.20
Active Directory plugin (active-directory): 2.13
diskcheck (diskcheck): 0.30
Active Choices Plug-in (uno-choice): 2.1
Script Security Plugin (script-security): 1.56
Static Analysis Utilities (analysis-core): 1.95
Javadoc Plugin (javadoc): 1.5
Ant Plugin (ant): 1.9
Git client plugin (git-client): 3.0.0-rc
Branch API Plugin (branch-api): 2.2.0
OWASP Markup Formatter Plugin (antisamy-markup-formatter): 1.5
disk-usage plugin (disk-usage): 0.28
Metrics Plugin (metrics): 4.0.2.3
Apache HttpComponents Client 4.x API Plugin (apache-httpcomponents-client-4-api): 4.5.5-3.0
Authentication Tokens API Plugin (authentication-tokens): 1.3
GIT server Plugin (git-server): 1.7
bouncycastle API Plugin (bouncycastle-api): 2.17
Email Extension Plugin (email-ext): 2.66
Git plugin (git): 4.0.0-rc
Groovy Postbuild (groovy-postbuild): 2.4.3
SCM API Plugin (scm-api): 2.4.0
Display URL API (display-url-api): 2.3.1
JavaScript GUI Lib: Handlebars bundle plugin (handlebars): 1.1.1
Docker Commons Plugin (docker-commons): 1.13
user build vars plugin (build-user-vars-plugin): 1.5
Docker Pipeline (docker-workflow): 1.17
Build With Parameters (build-with-parameters): 1.4
HTML Publisher plugin (htmlpublisher): 1.18
Folders Plugin (cloudbees-folder): 6.7
Durable Task Plugin (durable-task): 1.29
Conditional BuildStep (conditional-buildstep): 1.3.6
LDAP Plugin (ldap): 1.20
jQuery plugin (jquery): 1.12.4-0
Config File Provider Plugin (config-file-provider): 3.6
Plot plugin (plot): 2.1.0
Schedule Build Plugin (schedule-build): 0.5.1
Copy Artifact Plugin (copyartifact): 1.42
JSch dependency plugin (jsch): 0.1.55
Environment Injector Plugin (envinject): 2.1.6
Credentials Binding Plugin (credentials-binding): 1.18
Jackson 2 API Plugin (jackson2-api): 2.9.8
Credentials Plugin (credentials): 2.1.18
Job Configuration History Plugin (jobConfigHistory): 2.19
GitHub plugin (github): 1.29.4
Timestamper (timestamper): 1.9
Synergy Plugin (synergy): 1.7
Job Generator (jobgenerator): 1.22
JUnit Plugin (junit): 1.27
Role-based Authorization Strategy (role-strategy): 2.10
Run Condition Plugin (run-condition): 1.2
JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin (jquery-detached): 1.2.1
EnvInject API Plugin (envinject-api): 1.5
Matrix Authorization Strategy Plugin (matrix-auth): 2.3
Mercurial plugin (mercurial): 2.5
Pipeline: Groovy (workflow-cps): 2.65
Log Parser Plugin (log-parser): 2.0
Pipeline: Job (workflow-job): 2.32
Mailer Plugin (mailer): 1.23
Pipeline: Step API (workflow-step-api): 2.19
TextFinder plugin (text-finder): 1.10
MapDB API Plugin (mapdb-api): 1.0.9.0
Pipeline: API (workflow-api): 2.33
Pipeline: Stage Step (pipeline-stage-step): 2.3
SSH Credentials Plugin (ssh-credentials): 1.15
Matrix Project Plugin (matrix-project): 1.14
Pipeline: Stage Tags Metadata (pipeline-stage-tags-metadata): 1.3.7
SSH Slaves plugin (ssh-slaves): 1.29.4
Maven Integration plugin (maven-plugin): 3.2
ThinBackup (thinBackup): 1.9
Modern Status (modernstatus): 1.2
Common API for Blue Ocean (blueocean-commons): 1.14.0
JavaScript GUI Lib: Moment.js bundle plugin (momentjs): 1.1.1
next-executions (next-executions): 1.0.12
Node and Label parameter plugin (nodelabelparameter): 1.7.2
PAM Authentication plugin (pam-auth): 1.4
Subversion Plug-in (subversion): 2.12.1
Pipeline: Stage View Plugin (pipeline-stage-view): 2.10
Parameterized Trigger plugin (parameterized-trigger): 2.35.2
Plain Credentials Plugin (plain-credentials): 1.5
Pipeline: Build Step (pipeline-build-step): 2.8
Variant Plugin (variant): 1.2
Pipeline Graph Analysis Plugin (pipeline-graph-analysis): 1.9
Pipeline: Input Step (pipeline-input-step): 2.10
promoted builds plugin (promoted-builds): 3.2
Pipeline: Milestone Step (pipeline-milestone-step): 1.3.1
Favorite (favorite): 2.3.2
Pipeline: Model API (pipeline-model-api): 1.3.7
Pipeline: REST API Plugin (pipeline-rest-api): 2.10
Structs Plugin (structs): 1.17
Pipeline: Declarative Agent API (pipeline-model-declarative-agent): 1.1.1
Rebuilder (rebuild): 1.30
Pipeline: Declarative (pipeline-model-definition): 1.3.7
Resource Disposer Plugin (resource-disposer): 0.12
Pipeline: Declarative Extension Points API (pipeline-model-extensions): 1.3.7
Badge (badge): 1.7
Blue Ocean Pipeline Editor (blueocean-pipeline-editor): 1.14.0
Blue Ocean Core JS (blueocean-core-js): 1.14.0
WMI Windows Agents Plugin (windows-slaves): 1.4
jQuery UI plugin (jquery-ui): 1.0.2
Pipeline Utility Steps (pipeline-utility-steps): 2.3.0
Pipeline (workflow-aggregator): 2.6
Config API for Blue Ocean (blueocean-config): 1.14.0
Token Macro Plugin (token-macro): 2.7
JDK Tool Plugin (jdk-tool): 1.2
Pipeline: Basic Steps (workflow-basic-steps): 2.15
Pipeline: Shared Groovy Libraries (workflow-cps-global-lib): 2.13
Pipeline implementation for Blue Ocean (blueocean-pipeline-api-impl): 1.14.0
Dashboard for Blue Ocean (blueocean-dashboard): 1.14.0
Pipeline: Nodes and Processes (workflow-durable-task-step): 2.29
Display URL for Blue Ocean (blueocean-display-url): 2.2.0
GitHub Branch Source Plugin (github-branch-source): 2.4.5
Pipeline: Multibranch (workflow-multibranch): 2.21
Pipeline: SCM Step (workflow-scm-step): 2.7
Git Pipeline for Blue Ocean (blueocean-git-pipeline): 1.14.0
Events API for Blue Ocean (blueocean-events): 1.14.0
Pyenv Pipeline Plugin (pyenv-pipeline): 2.1.1-STAGING
Workspace Cleanup Plugin (ws-cleanup): 0.37
Design Language (jenkins-design-language): 1.14.0
Bitbucket Pipeline for Blue Ocean (blueocean-bitbucket-pipeline): 1.14.0
REST Implementation for Blue Ocean (blueocean-rest-impl): 1.14.0
Personalization for Blue Ocean (blueocean-personalization): 1.14.0
i18n for Blue Ocean (blueocean-i18n): 1.14.0
Pipeline: Supporting APIs (workflow-support): 3.2
JWT for Blue Ocean (blueocean-jwt): 1.14.0
Web for Blue Ocean (blueocean-web): 1.14.0
Plugin Usage - Plugin (plugin-usage-plugin): 0.4
GitHub API Plugin (github-api): 1.95
Support Core Plugin (support-core): 2.56
Pipeline SCM API for Blue Ocean (blueocean-pipeline-scm-api): 1.14.0
Pub-Sub "light" Bus (pubsub-light): 1.12
Bitbucket Branch Source Plugin (cloudbees-bitbucket-branch-source): 2.4.2
Server Sent Events (SSE) Gateway Plugin (sse-gateway): 1.17
REST API for Blue Ocean (blueocean-rest): 1.14.0
Handy Uri Templates 2.x API Plugin (handy-uri-templates-2-api): 2.1.7-1.0
Blue Ocean Executor Info (blueocean-executor-info): 1.14.0
Lockable Resources plugin (lockable-resources): 2.5
Jenkins is installed directly using rpm from official Jenkins repoOperating System: RedHat 7 (master), RedHat 7 (master/agents) Jenkins and plugin versions: Command Agent Launcher Plugin (command-launcher): 1.3 External Monitor Job Type Plugin (external-monitor-job): 1.7 JavaScript GUI Lib: ACE Editor bundle plugin (ace-editor): 1.1 Extra Columns Plugin (extra-columns): 1.20 Active Directory plugin (active-directory): 2.13 diskcheck (diskcheck): 0.30 Active Choices Plug-in (uno-choice): 2.1 Script Security Plugin (script-security): 1.56 Static Analysis Utilities (analysis-core): 1.95 Javadoc Plugin (javadoc): 1.5 Ant Plugin (ant): 1.9 Git client plugin (git-client): 3.0.0-rc Branch API Plugin (branch-api): 2.2.0 OWASP Markup Formatter Plugin (antisamy-markup-formatter): 1.5 disk-usage plugin (disk-usage): 0.28 Metrics Plugin (metrics): 4.0.2.3 Apache HttpComponents Client 4.x API Plugin (apache-httpcomponents-client-4-api): 4.5.5-3.0 Authentication Tokens API Plugin (authentication-tokens): 1.3 GIT server Plugin (git-server): 1.7 bouncycastle API Plugin (bouncycastle-api): 2.17 Email Extension Plugin (email-ext): 2.66 Git plugin (git): 4.0.0-rc Groovy Postbuild (groovy-postbuild): 2.4.3 SCM API Plugin (scm-api): 2.4.0 Display URL API (display-url-api): 2.3.1 JavaScript GUI Lib: Handlebars bundle plugin (handlebars): 1.1.1 Docker Commons Plugin (docker-commons): 1.13 user build vars plugin (build-user-vars-plugin): 1.5 Docker Pipeline (docker-workflow): 1.17 Build With Parameters (build-with-parameters): 1.4 HTML Publisher plugin (htmlpublisher): 1.18 Folders Plugin (cloudbees-folder): 6.7 Durable Task Plugin (durable-task): 1.29 Conditional BuildStep (conditional-buildstep): 1.3.6 LDAP Plugin (ldap): 1.20 jQuery plugin (jquery): 1.12.4-0 Config File Provider Plugin (config-file-provider): 3.6 Plot plugin (plot): 2.1.0 Schedule Build Plugin (schedule-build): 0.5.1 Copy Artifact Plugin (copyartifact): 1.42 JSch dependency plugin (jsch): 0.1.55 Environment Injector Plugin (envinject): 2.1.6 Credentials Binding Plugin (credentials-binding): 1.18 Jackson 2 API Plugin (jackson2-api): 2.9.8 Credentials Plugin (credentials): 2.1.18 Job Configuration History Plugin (jobConfigHistory): 2.19 GitHub plugin (github): 1.29.4 Timestamper (timestamper): 1.9 Synergy Plugin (synergy): 1.7 Job Generator (jobgenerator): 1.22 JUnit Plugin (junit): 1.27 Role-based Authorization Strategy (role-strategy): 2.10 Run Condition Plugin (run-condition): 1.2 JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin (jquery-detached): 1.2.1 EnvInject API Plugin (envinject-api): 1.5 Matrix Authorization Strategy Plugin (matrix-auth): 2.3 Mercurial plugin (mercurial): 2.5 Pipeline: Groovy (workflow-cps): 2.65 Log Parser Plugin (log-parser): 2.0 Pipeline: Job (workflow-job): 2.32 Mailer Plugin (mailer): 1.23 Pipeline: Step API (workflow-step-api): 2.19 TextFinder plugin (text-finder): 1.10 MapDB API Plugin (mapdb-api): 1.0.9.0 Pipeline: API (workflow-api): 2.33 Pipeline: Stage Step (pipeline-stage-step): 2.3 SSH Credentials Plugin (ssh-credentials): 1.15 Matrix Project Plugin (matrix-project): 1.14 Pipeline: Stage Tags Metadata (pipeline-stage-tags-metadata): 1.3.7 SSH Slaves plugin (ssh-slaves): 1.29.4 Maven Integration plugin (maven-plugin): 3.2 ThinBackup (thinBackup): 1.9 Modern Status (modernstatus): 1.2 Common API for Blue Ocean (blueocean-commons): 1.14.0 JavaScript GUI Lib: Moment.js bundle plugin (momentjs): 1.1.1 next-executions (next-executions): 1.0.12 Node and Label parameter plugin (nodelabelparameter): 1.7.2 PAM Authentication plugin (pam-auth): 1.4 Subversion Plug-in (subversion): 2.12.1 Pipeline: Stage View Plugin (pipeline-stage-view): 2.10 Parameterized Trigger plugin (parameterized-trigger): 2.35.2 Plain Credentials Plugin (plain-credentials): 1.5 Pipeline: Build Step (pipeline-build-step): 2.8 Variant Plugin (variant): 1.2 Pipeline Graph Analysis Plugin (pipeline-graph-analysis): 1.9 Pipeline: Input Step (pipeline-input-step): 2.10 promoted builds plugin (promoted-builds): 3.2 Pipeline: Milestone Step (pipeline-milestone-step): 1.3.1 Favorite (favorite): 2.3.2 Pipeline: Model API (pipeline-model-api): 1.3.7 Pipeline: REST API Plugin (pipeline-rest-api): 2.10 Structs Plugin (structs): 1.17 Pipeline: Declarative Agent API (pipeline-model-declarative-agent): 1.1.1 Rebuilder (rebuild): 1.30 Pipeline: Declarative (pipeline-model-definition): 1.3.7 Resource Disposer Plugin (resource-disposer): 0.12 Pipeline: Declarative Extension Points API (pipeline-model-extensions): 1.3.7 Badge (badge): 1.7 Blue Ocean Pipeline Editor (blueocean-pipeline-editor): 1.14.0 Blue Ocean Core JS (blueocean-core-js): 1.14.0 WMI Windows Agents Plugin (windows-slaves): 1.4 jQuery UI plugin (jquery-ui): 1.0.2 Pipeline Utility Steps (pipeline-utility-steps): 2.3.0 Pipeline (workflow-aggregator): 2.6 Config API for Blue Ocean (blueocean-config): 1.14.0 Token Macro Plugin (token-macro): 2.7 JDK Tool Plugin (jdk-tool): 1.2 Pipeline: Basic Steps (workflow-basic-steps): 2.15 Pipeline: Shared Groovy Libraries (workflow-cps-global-lib): 2.13 Pipeline implementation for Blue Ocean (blueocean-pipeline-api-impl): 1.14.0 Dashboard for Blue Ocean (blueocean-dashboard): 1.14.0 Pipeline: Nodes and Processes (workflow-durable-task-step): 2.29 Display URL for Blue Ocean (blueocean-display-url): 2.2.0 GitHub Branch Source Plugin (github-branch-source): 2.4.5 Pipeline: Multibranch (workflow-multibranch): 2.21 Pipeline: SCM Step (workflow-scm-step): 2.7 Git Pipeline for Blue Ocean (blueocean-git-pipeline): 1.14.0 Events API for Blue Ocean (blueocean-events): 1.14.0 Pyenv Pipeline Plugin (pyenv-pipeline): 2.1.1-STAGING Workspace Cleanup Plugin (ws-cleanup): 0.37 Design Language (jenkins-design-language): 1.14.0 Bitbucket Pipeline for Blue Ocean (blueocean-bitbucket-pipeline): 1.14.0 REST Implementation for Blue Ocean (blueocean-rest-impl): 1.14.0 Personalization for Blue Ocean (blueocean-personalization): 1.14.0 i18n for Blue Ocean (blueocean-i18n): 1.14.0 Pipeline: Supporting APIs (workflow-support): 3.2 JWT for Blue Ocean (blueocean-jwt): 1.14.0 Web for Blue Ocean (blueocean-web): 1.14.0 Plugin Usage - Plugin (plugin-usage-plugin): 0.4 GitHub API Plugin (github-api): 1.95 Support Core Plugin (support-core): 2.56 Pipeline SCM API for Blue Ocean (blueocean-pipeline-scm-api): 1.14.0 Pub-Sub "light" Bus (pubsub-light): 1.12 Bitbucket Branch Source Plugin (cloudbees-bitbucket-branch-source): 2.4.2 Server Sent Events (SSE) Gateway Plugin (sse-gateway): 1.17 REST API for Blue Ocean (blueocean-rest): 1.14.0 Handy Uri Templates 2.x API Plugin (handy-uri-templates-2-api): 2.1.7-1.0 Blue Ocean Executor Info (blueocean-executor-info): 1.14.0 Lockable Resources plugin (lockable-resources): 2.5 Jenkins is installed directly using rpm from official Jenkins repo
This issue resembles very much JENKINS-43106.
We have a pipeline job that is run in parallel on 10 different executors every night, multiple times.
For the past week, the jobs get stuck on gitSCM checkout which is configured as follows:
dir(sourceDir) {
deleteDir()
echo "Checking out ${commitId} from ${url}"
checkout changelog: updateChanges, scm: [
$class: 'GitSCM', branches: [[name: commitId]],
userRemoteConfigs: [[url: url]]]
commitId = sh returnStdout: true, script: "git rev-parse HEAD"
echo "Checked out ${commitId} from ${url}"
When this code is run in another job, it never fails.
The difference is that when it fails, we have a "manager" job that runs the following:
def call(testRunners, maxNumberOfTests, buildId) {
def parallelRuns = [:]
def numberOfRuns = 0
for (int i = 0; i < availableExecutors; i++) {
parallelRuns[i] = {
waitUntil {
build job: 'TestRunner', parameters: [
string(name: 'sessionId', value: buildId),
string(name: 'randomBit', value: "${randomBit}")
], propagate: false
return (numberOfRuns > maxNumberOfRuns)}}}
parallel parallelRuns
}
On the other hand it passes when we have a single pipeline, running in parallel the same function.
Randomly, the TestRunner job will hang on checkout: I can see the first echo. There's no access to the git server (according to the git-daemon logs).
- duplicates
-
JENKINS-19022 GIT Plugin (any version) heavily bloats memory use and size of build.xml with "BuildData" fields
- Open
- is related to
-
JENKINS-19022 GIT Plugin (any version) heavily bloats memory use and size of build.xml with "BuildData" fields
- Open