Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-1946

Process leaked file descriptors - Workaround does not work

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • clearcase-plugin
    • None
    • Platform: All, OS: other

      Hi all,

      I am running Hudson 1.227 clear case plugin 0.5.2. I am not able run more than
      on job on Hudson, I
      installed Tomcat 6 on Windows 2003 server. This one job also hangs after some
      time because of file
      descriptor leak. Is there any way to work around to stop this leak on 2003
      server, by the way I tried the
      documented work around but it doest not help much, still i see the same exception.

      Pls Help me,
      -Arshad

      WARNING: Process leaked file descriptors. See
      http://hudson.gotdns.com/wiki/display/JENKINS/Spawning+processes+from+build for
      more information
      java.lang.Exception
      at hudson.Proc$LocalProc.join(Proc.java:128)
      at
      hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:54)
      at hudson.plugins.clearcase.ClearToolExec.catcs(ClearToolExec.java:139)
      at
      hudson.plugins.clearcase.action.SnapshotCheckoutAction.checkout(SnapshotCheckoutAction.java:33)
      at
      hudson.plugins.clearcase.AbstractClearCaseScm.checkout(AbstractClearCaseScm.java:133)
      at
      hudson.plugins.clearcase.AbstractClearCaseScm.checkout(AbstractClearCaseScm.java:113)
      at hudson.model.AbstractProject.checkout(AbstractProject.java:574)
      at
      hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:251)
      at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:225)
      at hudson.model.Run.run(Run.java:778)
      at hudson.model.Build.run(Build.java:85)
      at hudson.model.ResourceController.execute(ResourceController.java:70)
      at hudson.model.Executor.run(Executor.java:85)

          [JENKINS-1946] Process leaked file descriptors - Workaround does not work

          redsolo added a comment -

          Fixed through using 0.6 (trunk) instead of 0.5.2

          redsolo added a comment - Fixed through using 0.6 (trunk) instead of 0.5.2

          Andrew Bayer added a comment -

          Bulk-updating all bugs fixed through 0.8.1 to VERIFIED. Part of cleanup for
          0.8.2 release.

          Andrew Bayer added a comment - Bulk-updating all bugs fixed through 0.8.1 to VERIFIED. Part of cleanup for 0.8.2 release.

          Shawn Garner added a comment -

          I'm seeing a similar issue but not quite the same stack trace.
          It seems to happen quite a few times a day.
          I think this happens when the plugin polls clearcase for changes.
          ClearCase Plugin 1.3.7
          Jenkins 1.452
          Windows Server 2008 R2

          Mar 23, 2012 7:31:21 AM hudson.Proc$LocalProc join
          WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:104)
          at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:72)
          at hudson.plugins.clearcase.ClearToolExec.doesViewExist(ClearToolExec.java:179)
          at hudson.plugins.clearcase.history.AbstractHistoryAction.needsLsHistoryForHasChanges(AbstractHistoryAction.java:206)
          at hudson.plugins.clearcase.history.AbstractHistoryAction.hasChanges(AbstractHistoryAction.java:111)
          at hudson.plugins.clearcase.AbstractClearCaseScm.compareRemoteRevisionWith(AbstractClearCaseScm.java:583)
          at hudson.scm.SCM._compareRemoteRevisionWith(SCM.java:356)
          at hudson.scm.SCM.poll(SCM.java:373)
          at hudson.model.AbstractProject.poll(AbstractProject.java:1310)
          at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:420)
          at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:449)
          at hudson.util.SequentialExecutionQueue$QueueEntry.run(SequentialExecutionQueue.java:118)
          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
          at java.lang.Thread.run(Thread.java:662)

          Shawn Garner added a comment - I'm seeing a similar issue but not quite the same stack trace. It seems to happen quite a few times a day. I think this happens when the plugin polls clearcase for changes. ClearCase Plugin 1.3.7 Jenkins 1.452 Windows Server 2008 R2 Mar 23, 2012 7:31:21 AM hudson.Proc$LocalProc join WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:104) at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:72) at hudson.plugins.clearcase.ClearToolExec.doesViewExist(ClearToolExec.java:179) at hudson.plugins.clearcase.history.AbstractHistoryAction.needsLsHistoryForHasChanges(AbstractHistoryAction.java:206) at hudson.plugins.clearcase.history.AbstractHistoryAction.hasChanges(AbstractHistoryAction.java:111) at hudson.plugins.clearcase.AbstractClearCaseScm.compareRemoteRevisionWith(AbstractClearCaseScm.java:583) at hudson.scm.SCM._compareRemoteRevisionWith(SCM.java:356) at hudson.scm.SCM.poll(SCM.java:373) at hudson.model.AbstractProject.poll(AbstractProject.java:1310) at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:420) at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:449) at hudson.util.SequentialExecutionQueue$QueueEntry.run(SequentialExecutionQueue.java:118) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)

          HI Am also facing problem while triggering shell script which internally calls expect script then expect script calls python script whic will execute more than 13 hrs
          i have set the BUILD_ID as dontkillMe as mentioned in the work around.but still it is not working.

          malarmannan JB added a comment - HI Am also facing problem while triggering shell script which internally calls expect script then expect script calls python script whic will execute more than 13 hrs i have set the BUILD_ID as dontkillMe as mentioned in the work around.but still it is not working.

          Manas Giri added a comment -

          Even i am facing this issue even with work around, this is now long time no hear , any update on this.

          I am seeing below in latest Jenkins version :

          Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.Proc.joinWithTimeout(Proc.java:168)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299)
          at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761)
          at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012)
          at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043)
          at hudson.scm.SCM.checkout(SCM.java:485)
          at hudson.model.AbstractProject.checkout(AbstractProject.java:1284)
          at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610)
          at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532)
          at hudson.model.Run.execute(Run.java:1741)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:381)

          Jul 29, 2015 4:52:58 PM WARNING hudson.Proc$LocalProc join
          Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.Proc.joinWithTimeout(Proc.java:168)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299)
          at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761)
          at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012)
          at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043)
          at hudson.scm.SCM.checkout(SCM.java:485)
          at hudson.model.AbstractProject.checkout(AbstractProject.java:1284)
          at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610)
          at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532)
          at hudson.model.Run.execute(Run.java:1741)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:381)

          Manas Giri added a comment - Even i am facing this issue even with work around, this is now long time no hear , any update on this. I am seeing below in latest Jenkins version : Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.Proc.joinWithTimeout(Proc.java:168) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043) at hudson.scm.SCM.checkout(SCM.java:485) at hudson.model.AbstractProject.checkout(AbstractProject.java:1284) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532) at hudson.model.Run.execute(Run.java:1741) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381) Jul 29, 2015 4:52:58 PM WARNING hudson.Proc$LocalProc join Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.Proc.joinWithTimeout(Proc.java:168) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043) at hudson.scm.SCM.checkout(SCM.java:485) at hudson.model.AbstractProject.checkout(AbstractProject.java:1284) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532) at hudson.model.Run.execute(Run.java:1741) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381)

          manasgiri from the stacktrace you posted, I think it's a different bug. This is is about the Clearcase Plugin, and you seem to be using Git, not Clearcase.

          Daniel Serodio added a comment - manasgiri from the stacktrace you posted, I think it's a different bug. This is is about the Clearcase Plugin, and you seem to be using Git, not Clearcase.

          Shah jain added a comment -

          Irrespective of both workarounds BUILD_ID and processkill... Still we are seeing the below warnings and jenkins shuts itself down after the below error.

          Sep 14, 2016 6:39:00 PM hudson.Proc$LocalProc join
          WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:135)
          at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:95)
          at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:64)
          at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
          at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:782)
          at hudson.model.Build$BuildExecution.build(Build.java:205)
          at hudson.model.Build$BuildExecution.doRun(Build.java:162)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
          at hudson.model.Run.execute(Run.java:1738)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:410)

          Any immediate fix is most welcome, as it impacts my current production.

          Shah jain added a comment - Irrespective of both workarounds BUILD_ID and processkill... Still we are seeing the below warnings and jenkins shuts itself down after the below error. Sep 14, 2016 6:39:00 PM hudson.Proc$LocalProc join WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:135) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:95) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:64) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:782) at hudson.model.Build$BuildExecution.build(Build.java:205) at hudson.model.Build$BuildExecution.doRun(Build.java:162) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534) at hudson.model.Run.execute(Run.java:1738) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:410) Any immediate fix is most welcome, as it impacts my current production.

            redsolo redsolo
            sdudhara sdudhara
            Votes:
            4 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated: