Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-51249

Job never finishes, appears to be deadlocked

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Critical Critical
    • workflow-cps-plugin
    • workflow-cps 2.53

      We have jobs that frequently never finish (and seemed to have finished successfully). I attached a thread dump. The following thread that is one that is hung/blocked is:

      Running CpsFlowExecutionOwner[EW.MasterPlanning/3:EW.MasterPlanning #3

      "Running CpsFlowExecutionOwner[EW.MasterPlanning/3:EW.MasterPlanning #3" Id=2423 Group=main WAITING on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@adbc3d at sun.misc.Unsafe.park(Native Method) - waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@adbc3d at java.util.concurrent.locks.LockSupport.park(Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(Unknown Source) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(Unknown Source) at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution$TimingFlowNodeStorage.flush(CpsFlowExecution.java:1797) at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution.onProgramEnd(CpsFlowExecution.java:1251) - locked org.jenkinsci.plugins.workflow.cps.CpsFlowExecution@d3da02 at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:355) at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$200(CpsThreadGroup.java:83) at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:244) at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:232) at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:64) at java.util.concurrent.FutureTask.run(Unknown Source) at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:131) at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Number of locked synchronizers = 1 - java.util.concurrent.ThreadPoolExecutor$Worker@c965b3

      This seems to get worse and worse to the point where I can't even go to /manage or anything. I can't abort the jobs.  I have to manually restart the service to clean everything up.

        1. jenkins-jabba35-systeminfo.pdf
          140 kB
          Lance Jessup
        2. jenkins-jabba35-threaddump.pdf
          294 kB
          Lance Jessup
        3. Jenkins-plugins.pdf
          385 kB
          Lance Jessup
        4. Jenkins-threaddump.pdf
          373 kB
          Lance Jessup

            Unassigned Unassigned
            lance_jessup Lance Jessup
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: