• Icon: Bug Bug
    • Resolution: Incomplete
    • Icon: Trivial Trivial
    • build-timeout-plugin
    • None
    • Platform: Other, OS: other

      Running hudson in a vmWare virtualized environment we tend to get some hangs
      when hudson is performing builds. Here are the requested stack dumps:

      Skip to content
      title
      search
      help for search

      *
      *
      *
      *
      *
      *
      *
      *
      *
      *

      Hudson ENABLE AUTO REFRESH
      New Job
      Manage Hudson
      People
      Build History
      Build Queue
      No builds in the queue.
      Build Executor Status

      1. Status
        1
        Building skolvcm #241

      terminate this build
      2 Idle

      Thread Dump
      ant clean-all test: stdout copier

      "ant clean-all test: stdout copier" Id=72 RUNNABLE (in native)
      at java.io.FileInputStream.readBytes(Native Method)
      at java.io.FileInputStream.read(FileInputStream.java:199)
      at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
      at java.io.BufferedInputStream.read(BufferedInputStream.java:317)

      • locked java.io.BufferedInputStream@14c02d4
        at java.io.FilterInputStream.read(FilterInputStream.java:90)
        at hudson.util.StreamCopyThread.run(StreamCopyThread.java:56)

      process reaper

      "process reaper" Id=71 RUNNABLE (in native)
      at java.lang.UNIXProcess.waitForProcessExit(Native Method)
      at java.lang.UNIXProcess.access$900(UNIXProcess.java:20)
      at java.lang.UNIXProcess$1$1.run(UNIXProcess.java:132)

      RequestHandlerThread3

      "RequestHandlerThread3" Id=11 WAITING on winstone.RequestHandlerThread@14db52b
      at java.lang.Object.wait(Native Method)

      • waiting on winstone.RequestHandlerThread@14db52b
        at java.lang.Object.wait(Object.java:485)
        at winstone.RequestHandlerThread.run(RequestHandlerThread.java:216)
        at java.lang.Thread.run(Thread.java:619)

      RequestHandlerThread4

      "RequestHandlerThread4" Id=12 RUNNABLE
      at sun.management.ThreadImpl.dumpThreads0(Native Method)
      at sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:359)
      at hudson.Functions.getThreadInfos(Functions.java:746)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at
      org.apache.commons.jexl.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:258)
      at org.apache.commons.jexl.parser.ASTMethod.execute(ASTMethod.java:104)
      at org.apache.commons.jexl.parser.ASTReference.execute(ASTReference.java:83)
      at org.apache.commons.jexl.parser.ASTReference.value(ASTReference.java:57)
      at
      org.apache.commons.jexl.parser.ASTReferenceExpression.value(ASTReferenceExpression.java:51)
      at org.apache.commons.jexl.ExpressionImpl.evaluate(ExpressionImpl.java:80)
      at hudson.ExpressionFactory2$JexlExpression.evaluate(ExpressionFactory2.java:71)
      at
      org.apache.commons.jelly.expression.ExpressionSupport.evaluateRecurse(ExpressionSupport.java:61)
      at
      org.apache.commons.jelly.expression.ExpressionSupport.evaluateAsIterator(ExpressionSupport.java:94)
      at org.apache.commons.jelly.tags.core.ForEachTag.doTag(ForEachTag.java:89)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.WhenTag.doTag(WhenTag.java:46)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at
      org.kohsuke.stapler.jelly.CustomTagLibrary$StaplerDynamicTag$1.run(CustomTagLibrary.java:147)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.IfTag.doTag(IfTag.java:42)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.JellyTag.doTag(JellyTag.java:45)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.DynamicTag.doTag(DynamicTag.java:81)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at
      org.kohsuke.stapler.jelly.CustomTagLibrary$StaplerDynamicTag$1.run(CustomTagLibrary.java:147)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.impl.StaticTag.doTag(StaticTag.java:65)
      at org.apache.commons.jelly.impl.StaticTagScript.run(StaticTagScript.java:112)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.impl.StaticTag.doTag(StaticTag.java:65)
      at org.apache.commons.jelly.impl.StaticTagScript.run(StaticTagScript.java:112)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.impl.StaticTag.doTag(StaticTag.java:65)
      at org.apache.commons.jelly.impl.StaticTagScript.run(StaticTagScript.java:112)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.impl.StaticTag.doTag(StaticTag.java:65)
      at org.apache.commons.jelly.impl.StaticTagScript.run(StaticTagScript.java:112)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.impl.StaticTag.doTag(StaticTag.java:65)
      at org.apache.commons.jelly.impl.StaticTagScript.run(StaticTagScript.java:112)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.JellyTag.doTag(JellyTag.java:45)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.DynamicTag.doTag(DynamicTag.java:81)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:186)
      at org.apache.commons.jelly.tags.core.JellyTag.doTag(JellyTag.java:45)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:262)
      at
      org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:29)
      at org.kohsuke.stapler.jelly.JellyFacet$1.dispatch(JellyFacet.java:56)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:485)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:403)
      at org.kohsuke.stapler.Stapler.service(Stapler.java:116)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:45)
      at winstone.ServletConfiguration.execute(ServletConfiguration.java:249)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:335)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:378)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:94)
      at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:86)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:195)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:368)
      at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:49)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:195)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:368)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
      at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76)
      at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:155)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:195)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:368)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:333)
      at winstone.RequestHandlerThread.processRequest(RequestHandlerThread.java:244)
      at winstone.RequestHandlerThread.run(RequestHandlerThread.java:150)
      at java.lang.Thread.run(Thread.java:619)

      Executor #1 for master

      "Executor #1 for master" Id=28 WAITING on hudson.util.OneShotEvent@b124fa
      at java.lang.Object.wait(Native Method)

      • waiting on hudson.util.OneShotEvent@b124fa
        at java.lang.Object.wait(Object.java:485)
        at hudson.util.OneShotEvent.block(OneShotEvent.java:60)
        at hudson.model.Queue.pop(Queue.java:725)
        at hudson.model.Executor.grabJob(Executor.java:160)
        at hudson.model.Executor.run(Executor.java:102)

      Executor #0 for master : executing skolvcm #241

      "Executor #0 for master : executing skolvcm #241" Id=27 WAITING on
      java.lang.UNIXProcess@1f2a9da
      at java.lang.Object.wait(Native Method)

      • waiting on java.lang.UNIXProcess@1f2a9da
        at java.lang.Object.wait(Object.java:485)
        at java.lang.UNIXProcess.waitFor(UNIXProcess.java:165)
        at hudson.Proc$LocalProc.join(Proc.java:166)
        at hudson.Launcher$ProcStarter.join(Launcher.java:275)
        at hudson.tasks.Ant.perform(Ant.java:206)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
        at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:480)
        at hudson.model.Build$RunnerImpl.build(Build.java:158)
        at hudson.model.Build$RunnerImpl.doRun(Build.java:98)
        at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:354)
        at hudson.model.Run.run(Run.java:1106)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
        at hudson.model.ResourceController.execute(ResourceController.java:93)
        at hudson.model.Executor.run(Executor.java:122)

      Hudson UDP 33848 monitoring thread

      "Hudson UDP 33848 monitoring thread" Id=26 RUNNABLE (in native)
      at sun.nio.ch.DatagramChannelImpl.receive0(Native Method)
      at
      sun.nio.ch.DatagramChannelImpl.receiveIntoNativeBuffer(DatagramChannelImpl.java:202)
      at sun.nio.ch.DatagramChannelImpl.receive(DatagramChannelImpl.java:188)
      at sun.nio.ch.DatagramChannelImpl.receive(DatagramChannelImpl.java:132)

      • locked java.lang.Object@1368c5d
        at hudson.UDPBroadcastThread.run(UDPBroadcastThread.java:63)

      TCP slave agent listener port=0

      "TCP slave agent listener port=0" Id=25 RUNNABLE (in native)
      at java.net.PlainSocketImpl.socketAccept(Native Method)
      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)

      • locked java.net.SocksSocketImpl@3945e2
        at java.net.ServerSocket.implAccept(ServerSocket.java:453)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at hudson.TcpSlaveAgentListener.run(TcpSlaveAgentListener.java:117)

      Thread-3

      "Thread-3" Id=24 TIMED_WAITING on java.util.LinkedHashSet@1b0c08
      at java.lang.Object.wait(Native Method)

      • waiting on java.util.LinkedHashSet@1b0c08
        at hudson.model.ViewJob$ReloadThread.getNext(ViewJob.java:159)
        at hudson.model.ViewJob$ReloadThread.run(ViewJob.java:175)

      pool-1-thread-1

      "pool-1-thread-1" Id=23 WAITING on
      java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1b31fd9
      at sun.misc.Unsafe.park(Native Method)

      • waiting on
        java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1b31fd9
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at
        java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:619)

      Hudson cron thread

      "Hudson cron thread" Id=22 TIMED_WAITING on java.util.TaskQueue@efe27b
      at java.lang.Object.wait(Native Method)

      • waiting on java.util.TaskQueue@efe27b
        at java.util.TimerThread.mainLoop(Timer.java:509)
        at java.util.TimerThread.run(Timer.java:462)

      DestroyJavaVM

      "DestroyJavaVM" Id=21 RUNNABLE

      LauncherControlThread[ControlPort=-1]

      "LauncherControlThread[ControlPort=-1]" Id=19 TIMED_WAITING
      at java.lang.Thread.sleep(Native Method)
      at winstone.Launcher.run(Launcher.java:279)
      at java.lang.Thread.run(Thread.java:619)

      ConnectorThread:[http-9000]

      "ConnectorThread:[http-9000]" Id=18 RUNNABLE (in native)
      at java.net.PlainSocketImpl.socketAccept(Native Method)
      at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)

      • locked java.net.SocksSocketImpl@fe135d
        at java.net.ServerSocket.implAccept(ServerSocket.java:453)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at winstone.HttpListener.run(HttpListener.java:127)
        at java.lang.Thread.run(Thread.java:619)

      WinstoneHostConfigurationMgmt:default

      "WinstoneHostConfigurationMgmt:default" Id=17 TIMED_WAITING
      at java.lang.Thread.sleep(Native Method)
      at winstone.HostConfiguration.run(HostConfiguration.java:176)
      at java.lang.Thread.run(Thread.java:619)

      Java2D Disposer

      "Java2D Disposer" Id=15 WAITING on java.lang.ref.ReferenceQueue$Lock@a9509d
      at java.lang.Object.wait(Native Method)

      • waiting on java.lang.ref.ReferenceQueue$Lock@a9509d
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at sun.java2d.Disposer.run(Disposer.java:125)
        at java.lang.Thread.run(Thread.java:619)

      WinstoneObjectPoolMgmt

      "WinstoneObjectPoolMgmt" Id=13 TIMED_WAITING
      at java.lang.Thread.sleep(Native Method)
      at winstone.ObjectPool.run(ObjectPool.java:103)
      at java.lang.Thread.run(Thread.java:619)

      Signal Dispatcher

      "Signal Dispatcher" Id=4 RUNNABLE

      Finalizer

      "Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@1eb9fde
      at java.lang.Object.wait(Native Method)

      • waiting on java.lang.ref.ReferenceQueue$Lock@1eb9fde
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

      Reference Handler

      "Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@4caadb
      at java.lang.Object.wait(Native Method)

      • waiting on java.lang.ref.Reference$Lock@4caadb
        at java.lang.Object.wait(Object.java:485)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)

      Hudson ver. 1.321

      No slave thread dump is available.

      Sure hope this is good information for you!

          [JENKINS-4338] Hudson hangs

          mnordlund added a comment -

          OS is Debian:
          skolvcm:~# uname --all
          Linux skolvcm 2.6.24-etchnhalf.1-686 #1 SMP Sat Aug 15 16:51:49 UTC 2009 i686
          GNU/Linux

          mnordlund added a comment - OS is Debian: skolvcm:~# uname --all Linux skolvcm 2.6.24-etchnhalf.1-686 #1 SMP Sat Aug 15 16:51:49 UTC 2009 i686 GNU/Linux

          mnordlund added a comment -

          It seems that this was related to the kernel we were using. After moving down to
          2.6.18 we have had so far only successful builds.

          skolvcm:~# uname -a
          Linux skolvcm 2.6.18-6-686 #1 SMP Thu Aug 20 21:56:59 UTC 2009 i686 GNU/Linux

          Changing priority to lowest.

          mnordlund added a comment - It seems that this was related to the kernel we were using. After moving down to 2.6.18 we have had so far only successful builds. skolvcm:~# uname -a Linux skolvcm 2.6.18-6-686 #1 SMP Thu Aug 20 21:56:59 UTC 2009 i686 GNU/Linux Changing priority to lowest.

          evernat added a comment -

          Hi mnordlund,
          Did you or any others had again this issue? with recent kernels?
          I think that whatever the issue was, it could well be fixed now, 1.5 years later, either in Jenkins, in the kernel or in vmWare.
          Are you ok to close this issue?

          evernat added a comment - Hi mnordlund, Did you or any others had again this issue? with recent kernels? I think that whatever the issue was, it could well be fixed now, 1.5 years later, either in Jenkins, in the kernel or in vmWare. Are you ok to close this issue?

          evernat added a comment -

          No response, so resolving as incomplete.

          evernat added a comment - No response, so resolving as incomplete.

            kohsuke Kohsuke Kawaguchi
            mnordlund mnordlund
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: