• Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Blocker Blocker
    • core, remoting
    • None

      I just deployed 1.378 and now I have several jobs frozen on step : [HUDSON] Archiving ...
      This is probably related to the change : JENKINS-7013
      But there is no stacktrace or error reported.
      Jobs are in this state after several hours.
      I killed them.

        1. threadDump-pamdirac.txt
          27 kB
        2. pom.xml
          2 kB
        3. threaddump.txt
          42 kB

          [JENKINS-7572] Endless Archiving step ..

          Arnaud Héritier created issue -

          Olivier Lamy added a comment -

          due to JENKINS-5977 ?

          Olivier Lamy added a comment - due to JENKINS-5977 ?
          Olivier Lamy made changes -
          Link New: This issue depends on JENKINS-5977 [ JENKINS-5977 ]

          jieryn added a comment -

          jieryn added a comment - http://wiki.jenkins-ci.org/display/JENKINS/Build+is+hanging

          sinkha added a comment -

          I encountered the same problem with multiple jobs hanging while trying to archive. I was forced to revert to 1.377. I've attached my thread dump in case it helps.

          sinkha added a comment - I encountered the same problem with multiple jobs hanging while trying to archive. I was forced to revert to 1.377. I've attached my thread dump in case it helps.
          sinkha made changes -
          Attachment New: threaddump.txt [ 19799 ]

          lynn_lin added a comment -

          I also have this issue after I upgrade to 1.378,
          downgrade to 1.377,it works

          lynn_lin added a comment - I also have this issue after I upgrade to 1.378, downgrade to 1.377,it works

          azgard added a comment -

          Same here. We use windows slaves, but it also hangs on archiving artifacts with 1.378!

          Downgrade helps.

          azgard added a comment - Same here. We use windows slaves, but it also hangs on archiving artifacts with 1.378! Downgrade helps.

          robertredd added a comment -

          I'm having the same issue after going to 1.378. It happened on both Linux and Windows slaves. I'm pretty sure I had it happen on the Master as well, though, which is Linux. I had to downgrade as well.

          robertredd added a comment - I'm having the same issue after going to 1.378. It happened on both Linux and Windows slaves. I'm pretty sure I had it happen on the Master as well, though, which is Linux. I had to downgrade as well.

          rsteele added a comment -

          I think we're seeing something similar, though it's while collecting test results. Here's a stack dump of the slave:

          Thread Dump
          Channel reader thread: channel

          "Channel reader thread: channel" Id=8 Group=main RUNNABLE (in native)
          at java.net.SocketInputStream.socketRead0(Native Method)
          at java.net.SocketInputStream.read(Unknown Source)
          at java.io.FilterInputStream.read(Unknown Source)
          at java.io.BufferedInputStream.fill(Unknown Source)
          at java.io.BufferedInputStream.read(Unknown Source)

          • locked java.io.BufferedInputStream@87107e
            at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
            at java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source)
            at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source)
            at java.io.ObjectInputStream.readObject0(Unknown Source)
            at java.io.ObjectInputStream.readObject(Unknown Source)
            at hudson.remoting.Channel$ReaderThread.run(Channel.java:925)

          main

          "main" Id=1 Group=main WAITING on hudson.remoting.Channel@14f8dab
          at java.lang.Object.wait(Native Method)

          • waiting on hudson.remoting.Channel@14f8dab
            at java.lang.Object.wait(Object.java:485)
            at hudson.remoting.Channel.join(Channel.java:706)
            at hudson.remoting.Launcher.main(Launcher.java:419)
            at hudson.remoting.Launcher.runOnSocket(Launcher.java:313)
            at hudson.remoting.Launcher.runAsTcpServer(Launcher.java:309)
            at hudson.remoting.Launcher.run(Launcher.java:202)
            at hudson.remoting.Launcher.main(Launcher.java:167)

          Ping thread for channel hudson.remoting.Channel@14f8dab:channel

          "Ping thread for channel hudson.remoting.Channel@14f8dab:channel" Id=9 Group=main TIMED_WAITING
          at java.lang.Thread.sleep(Native Method)
          at hudson.remoting.PingThread.run(PingThread.java:86)

          Pipe writer thread: channel

          "Pipe writer thread: channel" Id=11 Group=main WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54f3b2
          at sun.misc.Unsafe.park(Native Method)

          • waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54f3b2
            at java.util.concurrent.locks.LockSupport.park(Unknown Source)
            at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
            at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
            at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
            at java.lang.Thread.run(Unknown Source)

          pool-1-thread-1

          "pool-1-thread-1" Id=10 Group=main RUNNABLE (in native)
          at java.io.WinNTFileSystem.list(Native Method)
          at java.io.File.list(Unknown Source)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1230)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1184)
          at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1146)
          at org.apache.tools.ant.DirectoryScanner.checkIncludePatterns(DirectoryScanner.java:928)
          at org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:882)

          • locked org.apache.tools.ant.DirectoryScanner@e419c5
            at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:490)
            at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:451)
            at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:105)
            at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:87)
            at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1899)
            at hudson.remoting.UserRequest.perform(UserRequest.java:114)
            at hudson.remoting.UserRequest.perform(UserRequest.java:48)
            at hudson.remoting.Request$2.run(Request.java:270)
            at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
            at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
            at java.util.concurrent.FutureTask.run(Unknown Source)
            at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
            at java.lang.Thread.run(Unknown Source)

          Number of locked synchronizers = 1

          • java.util.concurrent.locks.ReentrantLock$NonfairSync@157e147

          pool-1-thread-10

          "pool-1-thread-10" Id=51 Group=main RUNNABLE
          at sun.management.ThreadImpl.dumpThreads0(Native Method)
          at sun.management.ThreadImpl.dumpAllThreads(Unknown Source)
          at hudson.Functions.getThreadInfos(Functions.java:775)
          at hudson.util.RemotingDiagnostics$GetThreadDump.call(RemotingDiagnostics.java:75)
          at hudson.util.RemotingDiagnostics$GetThreadDump.call(RemotingDiagnostics.java:71)
          at hudson.remoting.UserRequest.perform(UserRequest.java:114)
          at hudson.remoting.UserRequest.perform(UserRequest.java:48)
          at hudson.remoting.Request$2.run(Request.java:270)
          at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
          at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
          at java.util.concurrent.FutureTask.run(Unknown Source)
          at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
          at java.lang.Thread.run(Unknown Source)

          Number of locked synchronizers = 1

          • java.util.concurrent.locks.ReentrantLock$NonfairSync@25747a

          Attach Listener

          "Attach Listener" Id=4 Group=system RUNNABLE

          Finalizer

          "Finalizer" Id=3 Group=system WAITING on java.lang.ref.ReferenceQueue$Lock@14bff0a
          at java.lang.Object.wait(Native Method)

          • waiting on java.lang.ref.ReferenceQueue$Lock@14bff0a
            at java.lang.ref.ReferenceQueue.remove(Unknown Source)
            at java.lang.ref.ReferenceQueue.remove(Unknown Source)
            at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)

          Reference Handler

          "Reference Handler" Id=2 Group=system WAITING on java.lang.ref.Reference$Lock@5506e9
          at java.lang.Object.wait(Native Method)

          • waiting on java.lang.ref.Reference$Lock@5506e9
            at java.lang.Object.wait(Object.java:485)
            at java.lang.ref.Reference$ReferenceHandler.run(Unknown Source)

          rsteele added a comment - I think we're seeing something similar, though it's while collecting test results. Here's a stack dump of the slave: Thread Dump Channel reader thread: channel "Channel reader thread: channel" Id=8 Group=main RUNNABLE (in native) at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(Unknown Source) at java.io.FilterInputStream.read(Unknown Source) at java.io.BufferedInputStream.fill(Unknown Source) at java.io.BufferedInputStream.read(Unknown Source) locked java.io.BufferedInputStream@87107e at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source) at java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source) at java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source) at java.io.ObjectInputStream.readObject0(Unknown Source) at java.io.ObjectInputStream.readObject(Unknown Source) at hudson.remoting.Channel$ReaderThread.run(Channel.java:925) main "main" Id=1 Group=main WAITING on hudson.remoting.Channel@14f8dab at java.lang.Object.wait(Native Method) waiting on hudson.remoting.Channel@14f8dab at java.lang.Object.wait(Object.java:485) at hudson.remoting.Channel.join(Channel.java:706) at hudson.remoting.Launcher.main(Launcher.java:419) at hudson.remoting.Launcher.runOnSocket(Launcher.java:313) at hudson.remoting.Launcher.runAsTcpServer(Launcher.java:309) at hudson.remoting.Launcher.run(Launcher.java:202) at hudson.remoting.Launcher.main(Launcher.java:167) Ping thread for channel hudson.remoting.Channel@14f8dab:channel "Ping thread for channel hudson.remoting.Channel@14f8dab:channel" Id=9 Group=main TIMED_WAITING at java.lang.Thread.sleep(Native Method) at hudson.remoting.PingThread.run(PingThread.java:86) Pipe writer thread: channel "Pipe writer thread: channel" Id=11 Group=main WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54f3b2 at sun.misc.Unsafe.park(Native Method) waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54f3b2 at java.util.concurrent.locks.LockSupport.park(Unknown Source) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source) at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) pool-1-thread-1 "pool-1-thread-1" Id=10 Group=main RUNNABLE (in native) at java.io.WinNTFileSystem.list(Native Method) at java.io.File.list(Unknown Source) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1230) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1259) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1184) at org.apache.tools.ant.DirectoryScanner.scandir(DirectoryScanner.java:1146) at org.apache.tools.ant.DirectoryScanner.checkIncludePatterns(DirectoryScanner.java:928) at org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:882) locked org.apache.tools.ant.DirectoryScanner@e419c5 at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:490) at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:451) at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:105) at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:87) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:1899) at hudson.remoting.UserRequest.perform(UserRequest.java:114) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:270) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Number of locked synchronizers = 1 java.util.concurrent.locks.ReentrantLock$NonfairSync@157e147 pool-1-thread-10 "pool-1-thread-10" Id=51 Group=main RUNNABLE at sun.management.ThreadImpl.dumpThreads0(Native Method) at sun.management.ThreadImpl.dumpAllThreads(Unknown Source) at hudson.Functions.getThreadInfos(Functions.java:775) at hudson.util.RemotingDiagnostics$GetThreadDump.call(RemotingDiagnostics.java:75) at hudson.util.RemotingDiagnostics$GetThreadDump.call(RemotingDiagnostics.java:71) at hudson.remoting.UserRequest.perform(UserRequest.java:114) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:270) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Number of locked synchronizers = 1 java.util.concurrent.locks.ReentrantLock$NonfairSync@25747a Attach Listener "Attach Listener" Id=4 Group=system RUNNABLE Finalizer "Finalizer" Id=3 Group=system WAITING on java.lang.ref.ReferenceQueue$Lock@14bff0a at java.lang.Object.wait(Native Method) waiting on java.lang.ref.ReferenceQueue$Lock@14bff0a at java.lang.ref.ReferenceQueue.remove(Unknown Source) at java.lang.ref.ReferenceQueue.remove(Unknown Source) at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source) Reference Handler "Reference Handler" Id=2 Group=system WAITING on java.lang.ref.Reference$Lock@5506e9 at java.lang.Object.wait(Native Method) waiting on java.lang.ref.Reference$Lock@5506e9 at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Unknown Source)

            kohsuke Kohsuke Kawaguchi
            aheritier Arnaud Héritier
            Votes:
            20 Vote for this issue
            Watchers:
            21 Start watching this issue

              Created:
              Updated:
              Resolved: