-
Bug
-
Resolution: Unresolved
-
Critical
-
* CentOS release 6.5 (Final)
* Jenkins ver. 1.588
* plugins list:
Plugin:github
Plugin:cloudbees-enterprise-plugins
Plugin:cvs
Plugin:git-server
Plugin:windows-slaves
Plugin:ant
Plugin:github-api
Plugin:build-pipeline-plugin
Plugin:pam-auth
Plugin:ssh-slaves
Plugin:antisamy-markup-formatter
Plugin:javadoc
Plugin:subversion
Plugin:mailer
Plugin:ownership
Plugin:groovy-postbuild
Plugin:credentials
Plugin:postbuild-task
Plugin:ldap
Plugin:git
Plugin:external-monitor-job
Plugin:junit
Plugin:matrix-auth
Plugin:git-client
Plugin:ssh-credentials
Plugin:matrix-project
Plugin:cloudbees-folder
Plugin:maven-plugin
Plugin:next-build-number
Plugin:translation
Plugin:cloudbees-credentials
Plugin:mercurial
Plugin:openid
Plugin:active-directory
Plugin:testopia
Plugin:scm-api
Plugin:scriptler
Plugin:suppress-stack-trace
Plugin:jobrequeue
Plugin:conditional-buildstep
Plugin:build-name-setter
Plugin:promoted-builds
Plugin:shelve-project-plugin
Plugin:ansicolor
Plugin:ssh-agent
Plugin:copy-project-link
Plugin:async-http-client
Plugin:copyartifact
Plugin:rebuild
Plugin:greenballs
Plugin:script-security
Plugin:preSCMbuildstep
Plugin:job-import-plugin
Plugin:metrics
Plugin:template-project
Plugin:build-view-column
Plugin:instant-messaging
Plugin:gitlab-merge-request-jenkins
Plugin:durable-task
Plugin:jobConfigHistory
Plugin:parameterized-trigger
Plugin:ssh
Plugin:thinBackup
Plugin:config-file-provider
Plugin:support-core
Plugin:build-token-root
Plugin:mapdb-api
Plugin:groovy
Plugin:view-job-filters
Plugin:monitoring
Plugin:description-setter
Plugin:role-strategy
Plugin:job-dsl
Plugin:managed-scripts
Plugin:envinject
Plugin:swarm
Plugin:postbuildscript
Plugin:extended-choice-parameter
Plugin:jquery
Plugin:openid4java
Plugin:build-monitor-plugin
Plugin:run-condition
Plugin:node-iterator-api
Plugin:nodelabelparameter
Plugin:token-macro
Plugin:gravatar
Plugin:bugzilla
Plugin:publish-over-ssh
Plugin:build-timeout
Plugin:ircbot
Plugin:PrioritySorter
Plugin:build-user-vars-plugin
Plugin:dashboard-view
Plugin:dynamic_extended_choice_parameter* CentOS release 6.5 (Final) * Jenkins ver. 1.588 * plugins list: Plugin:github Plugin:cloudbees-enterprise-plugins Plugin:cvs Plugin:git-server Plugin:windows-slaves Plugin:ant Plugin:github-api Plugin:build-pipeline-plugin Plugin:pam-auth Plugin:ssh-slaves Plugin:antisamy-markup-formatter Plugin:javadoc Plugin:subversion Plugin:mailer Plugin:ownership Plugin:groovy-postbuild Plugin:credentials Plugin:postbuild-task Plugin:ldap Plugin:git Plugin:external-monitor-job Plugin:junit Plugin:matrix-auth Plugin:git-client Plugin:ssh-credentials Plugin:matrix-project Plugin:cloudbees-folder Plugin:maven-plugin Plugin:next-build-number Plugin:translation Plugin:cloudbees-credentials Plugin:mercurial Plugin:openid Plugin:active-directory Plugin:testopia Plugin:scm-api Plugin:scriptler Plugin:suppress-stack-trace Plugin:jobrequeue Plugin:conditional-buildstep Plugin:build-name-setter Plugin:promoted-builds Plugin:shelve-project-plugin Plugin:ansicolor Plugin:ssh-agent Plugin:copy-project-link Plugin:async-http-client Plugin:copyartifact Plugin:rebuild Plugin:greenballs Plugin:script-security Plugin:preSCMbuildstep Plugin:job-import-plugin Plugin:metrics Plugin:template-project Plugin:build-view-column Plugin:instant-messaging Plugin:gitlab-merge-request-jenkins Plugin:durable-task Plugin:jobConfigHistory Plugin:parameterized-trigger Plugin:ssh Plugin:thinBackup Plugin:config-file-provider Plugin:support-core Plugin:build-token-root Plugin:mapdb-api Plugin:groovy Plugin:view-job-filters Plugin:monitoring Plugin:description-setter Plugin:role-strategy Plugin:job-dsl Plugin:managed-scripts Plugin:envinject Plugin:swarm Plugin:postbuildscript Plugin:extended-choice-parameter Plugin:jquery Plugin:openid4java Plugin:build-monitor-plugin Plugin:run-condition Plugin:node-iterator-api Plugin:nodelabelparameter Plugin:token-macro Plugin:gravatar Plugin:bugzilla Plugin:publish-over-ssh Plugin:build-timeout Plugin:ircbot Plugin:PrioritySorter Plugin:build-user-vars-plugin Plugin:dashboard-view Plugin:dynamic_extended_choice_parameter
Steps to re-create the issue.
1) setup an irc server.
2) setup 2 jenkins instances
3) Install the ircbot 2.25 latest on each server
4) in global configurations of each server point both servers to the same channel #waldo.
5) wait approx 5 days
6) Monitor the server with the error log:
Caused by: org.pircbotx.exception.NickAlreadyInUseException: Nickname is already in use.
Eventually the botXX-outputs threads will reach 1024 threads and lock up jenkins server however, the error will just be:
java.lang.OutOfMemoryError: unable to create new native thread
The backtrace is useless because it will be cause by whatever thread you started.
-
-
-
- Use Jconsole and enable jmx on jenkins.war and you can see the botXX-output threads stackup and slowly strangle Jenkins into a grave.
-
-
I think I might have seen this earlier already. If I remember correctly, this was a bug in the PircBotX library.
Think I'll eventually need to update to PircBotX 2.0 where the output threads were completely removed, so no thread leaaking anymore.