Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-1946

Process leaked file descriptors - Workaround does not work

    XMLWordPrintable

Details

    • Bug
    • Status: Reopened (View Workflow)
    • Critical
    • Resolution: Unresolved
    • clearcase-plugin
    • None
    • Platform: All, OS: other

    Description

      Hi all,

      I am running Hudson 1.227 clear case plugin 0.5.2. I am not able run more than
      on job on Hudson, I
      installed Tomcat 6 on Windows 2003 server. This one job also hangs after some
      time because of file
      descriptor leak. Is there any way to work around to stop this leak on 2003
      server, by the way I tried the
      documented work around but it doest not help much, still i see the same exception.

      Pls Help me,
      -Arshad

      WARNING: Process leaked file descriptors. See
      http://hudson.gotdns.com/wiki/display/JENKINS/Spawning+processes+from+build for
      more information
      java.lang.Exception
      at hudson.Proc$LocalProc.join(Proc.java:128)
      at
      hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:54)
      at hudson.plugins.clearcase.ClearToolExec.catcs(ClearToolExec.java:139)
      at
      hudson.plugins.clearcase.action.SnapshotCheckoutAction.checkout(SnapshotCheckoutAction.java:33)
      at
      hudson.plugins.clearcase.AbstractClearCaseScm.checkout(AbstractClearCaseScm.java:133)
      at
      hudson.plugins.clearcase.AbstractClearCaseScm.checkout(AbstractClearCaseScm.java:113)
      at hudson.model.AbstractProject.checkout(AbstractProject.java:574)
      at
      hudson.model.AbstractBuild$AbstractRunner.checkout(AbstractBuild.java:251)
      at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:225)
      at hudson.model.Run.run(Run.java:778)
      at hudson.model.Build.run(Build.java:85)
      at hudson.model.ResourceController.execute(ResourceController.java:70)
      at hudson.model.Executor.run(Executor.java:85)

      Attachments

        Activity

          redsolo redsolo added a comment -

          Fixed through using 0.6 (trunk) instead of 0.5.2

          redsolo redsolo added a comment - Fixed through using 0.6 (trunk) instead of 0.5.2
          abayer Andrew Bayer added a comment -

          Bulk-updating all bugs fixed through 0.8.1 to VERIFIED. Part of cleanup for
          0.8.2 release.

          abayer Andrew Bayer added a comment - Bulk-updating all bugs fixed through 0.8.1 to VERIFIED. Part of cleanup for 0.8.2 release.
          busybyte Shawn Garner added a comment -

          I'm seeing a similar issue but not quite the same stack trace.
          It seems to happen quite a few times a day.
          I think this happens when the plugin polls clearcase for changes.
          ClearCase Plugin 1.3.7
          Jenkins 1.452
          Windows Server 2008 R2

          Mar 23, 2012 7:31:21 AM hudson.Proc$LocalProc join
          WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:104)
          at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:72)
          at hudson.plugins.clearcase.ClearToolExec.doesViewExist(ClearToolExec.java:179)
          at hudson.plugins.clearcase.history.AbstractHistoryAction.needsLsHistoryForHasChanges(AbstractHistoryAction.java:206)
          at hudson.plugins.clearcase.history.AbstractHistoryAction.hasChanges(AbstractHistoryAction.java:111)
          at hudson.plugins.clearcase.AbstractClearCaseScm.compareRemoteRevisionWith(AbstractClearCaseScm.java:583)
          at hudson.scm.SCM._compareRemoteRevisionWith(SCM.java:356)
          at hudson.scm.SCM.poll(SCM.java:373)
          at hudson.model.AbstractProject.poll(AbstractProject.java:1310)
          at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:420)
          at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:449)
          at hudson.util.SequentialExecutionQueue$QueueEntry.run(SequentialExecutionQueue.java:118)
          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
          at java.lang.Thread.run(Thread.java:662)

          busybyte Shawn Garner added a comment - I'm seeing a similar issue but not quite the same stack trace. It seems to happen quite a few times a day. I think this happens when the plugin polls clearcase for changes. ClearCase Plugin 1.3.7 Jenkins 1.452 Windows Server 2008 R2 Mar 23, 2012 7:31:21 AM hudson.Proc$LocalProc join WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:104) at hudson.plugins.clearcase.HudsonClearToolLauncher.run(HudsonClearToolLauncher.java:72) at hudson.plugins.clearcase.ClearToolExec.doesViewExist(ClearToolExec.java:179) at hudson.plugins.clearcase.history.AbstractHistoryAction.needsLsHistoryForHasChanges(AbstractHistoryAction.java:206) at hudson.plugins.clearcase.history.AbstractHistoryAction.hasChanges(AbstractHistoryAction.java:111) at hudson.plugins.clearcase.AbstractClearCaseScm.compareRemoteRevisionWith(AbstractClearCaseScm.java:583) at hudson.scm.SCM._compareRemoteRevisionWith(SCM.java:356) at hudson.scm.SCM.poll(SCM.java:373) at hudson.model.AbstractProject.poll(AbstractProject.java:1310) at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:420) at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:449) at hudson.util.SequentialExecutionQueue$QueueEntry.run(SequentialExecutionQueue.java:118) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)

          HI Am also facing problem while triggering shell script which internally calls expect script then expect script calls python script whic will execute more than 13 hrs
          i have set the BUILD_ID as dontkillMe as mentioned in the work around.but still it is not working.

          malar_jenkins malarmannan JB added a comment - HI Am also facing problem while triggering shell script which internally calls expect script then expect script calls python script whic will execute more than 13 hrs i have set the BUILD_ID as dontkillMe as mentioned in the work around.but still it is not working.
          manasgiri Manas Giri added a comment -

          Even i am facing this issue even with work around, this is now long time no hear , any update on this.

          I am seeing below in latest Jenkins version :

          Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.Proc.joinWithTimeout(Proc.java:168)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299)
          at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761)
          at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012)
          at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043)
          at hudson.scm.SCM.checkout(SCM.java:485)
          at hudson.model.AbstractProject.checkout(AbstractProject.java:1284)
          at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610)
          at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532)
          at hudson.model.Run.execute(Run.java:1741)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:381)

          Jul 29, 2015 4:52:58 PM WARNING hudson.Proc$LocalProc join
          Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.Proc.joinWithTimeout(Proc.java:168)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61)
          at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299)
          at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761)
          at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012)
          at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043)
          at hudson.scm.SCM.checkout(SCM.java:485)
          at hudson.model.AbstractProject.checkout(AbstractProject.java:1284)
          at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610)
          at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532)
          at hudson.model.Run.execute(Run.java:1741)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:381)

          manasgiri Manas Giri added a comment - Even i am facing this issue even with work around, this is now long time no hear , any update on this. I am seeing below in latest Jenkins version : Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.Proc.joinWithTimeout(Proc.java:168) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043) at hudson.scm.SCM.checkout(SCM.java:485) at hudson.model.AbstractProject.checkout(AbstractProject.java:1284) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532) at hudson.model.Run.execute(Run.java:1741) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381) Jul 29, 2015 4:52:58 PM WARNING hudson.Proc$LocalProc join Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.Proc.joinWithTimeout(Proc.java:168) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1596) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1363) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:61) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:299) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:761) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043) at hudson.scm.SCM.checkout(SCM.java:485) at hudson.model.AbstractProject.checkout(AbstractProject.java:1284) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:610) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:532) at hudson.model.Run.execute(Run.java:1741) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:381)

          manasgiri from the stacktrace you posted, I think it's a different bug. This is is about the Clearcase Plugin, and you seem to be using Git, not Clearcase.

          dserodio Daniel Serodio added a comment - manasgiri from the stacktrace you posted, I think it's a different bug. This is is about the Clearcase Plugin, and you seem to be using Git, not Clearcase.
          sjainala Shah jain added a comment -

          Irrespective of both workarounds BUILD_ID and processkill... Still we are seeing the below warnings and jenkins shuts itself down after the below error.

          Sep 14, 2016 6:39:00 PM hudson.Proc$LocalProc join
          WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information
          java.lang.Exception
          at hudson.Proc$LocalProc.join(Proc.java:329)
          at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:135)
          at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:95)
          at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:64)
          at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
          at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:782)
          at hudson.model.Build$BuildExecution.build(Build.java:205)
          at hudson.model.Build$BuildExecution.doRun(Build.java:162)
          at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
          at hudson.model.Run.execute(Run.java:1738)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
          at hudson.model.ResourceController.execute(ResourceController.java:98)
          at hudson.model.Executor.run(Executor.java:410)

          Any immediate fix is most welcome, as it impacts my current production.

          sjainala Shah jain added a comment - Irrespective of both workarounds BUILD_ID and processkill... Still we are seeing the below warnings and jenkins shuts itself down after the below error. Sep 14, 2016 6:39:00 PM hudson.Proc$LocalProc join WARNING: Process leaked file descriptors. See http://wiki.jenkins-ci.org/display/JENKINS/Spawning+processes+from+build for more information java.lang.Exception at hudson.Proc$LocalProc.join(Proc.java:329) at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:135) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:95) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:64) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:782) at hudson.model.Build$BuildExecution.build(Build.java:205) at hudson.model.Build$BuildExecution.doRun(Build.java:162) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534) at hudson.model.Run.execute(Run.java:1738) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:410) Any immediate fix is most welcome, as it impacts my current production.

          People

            redsolo redsolo
            sdudhara sdudhara
            Votes:
            4 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: