• Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • cvs-plugin
    • None
    • Platform: Other, OS: Linux

      Our environment is:
      We have a limited threadCound for SCMPolling (8)
      We have a system with remoteclients

      if one client has problems, all scm threads are hanging on this client and no
      more cvs actions are possible
      it seams that there is no timeout implemented
      if the node (with the problems) is killed you get following

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.triggers.SCMTrigger$Runner runPolling
      SEVERE: Failed to record SCM polling
      hudson.remoting.RequestAbortedException: java.io.EOFException
      at hudson.remoting.Request.abort(Request.java:187)
      at hudson.remoting.Channel.terminate(Channel.java:437)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:593)
      Caused by: java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

      May 6, 2008 8:39:22 AM hudson.remoting.Channel$ReaderThread run
      SEVERE: I/O error in channel compiler ci-dev@george
      java.io.EOFException
      at
      java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2498)
      at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1273)
      at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
      at hudson.remoting.Channel$ReaderThread.run(Channel.java:574)

          [JENKINS-1646] Hudson hangup and poll never on CVS

          tspengler added a comment -

          Created an attachment (id=242)
          ThreadDump from the master

          tspengler added a comment - Created an attachment (id=242) ThreadDump from the master

          tspengler added a comment -

          corrected the component

          tspengler added a comment - corrected the component

          Thanks for the thread dump.

          I'm trying to understand your bug report. When you say "if one client has
          problems", are you talking about one CVS client having a problem? Or are you
          talking about one slave having a problem? Can you elaborate on what you mean by
          "a problem"?

          Is the hang in CVS process itself?

          Kohsuke Kawaguchi added a comment - Thanks for the thread dump. I'm trying to understand your bug report. When you say "if one client has problems", are you talking about one CVS client having a problem? Or are you talking about one slave having a problem? Can you elaborate on what you mean by "a problem"? Is the hang in CVS process itself?

          tspengler added a comment -

          the cvs client hangs
          and of course it is not reproducible

          tspengler added a comment - the cvs client hangs and of course it is not reproducible

          The thread stack trace indicates that all the polling is happening remotely, and
          waiting for its completion.

          "pool-6-thread-8" prio=1 tid=0x0e042ef0 nid=0x2f8 in Object.wait()
          [0x142ec000..0x142ed140]
          at java.lang.Object.wait(Native Method)
          at java.lang.Object.wait(Object.java:474)
          at hudson.remoting.Request.call(Request.java:88)

          • locked <0x37d133f0> (a hudson.remoting.UserRequest)
            at hudson.remoting.Channel.call(Channel.java:390)
            at hudson.FilePath.act(FilePath.java:305)
            at hudson.FilePath.exists(FilePath.java:506)
            at hudson.model.AbstractProject.pollSCMChanges(AbstractProject.java:595)
            at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:259)
            at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:291)
            at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417)
            at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)
            at java.util.concurrent.FutureTask.run(FutureTask.java:123)
            at
            java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
            at java.lang.Thread.run(Thread.java:595)

          Kohsuke Kawaguchi added a comment - The thread stack trace indicates that all the polling is happening remotely, and waiting for its completion. "pool-6-thread-8" prio=1 tid=0x0e042ef0 nid=0x2f8 in Object.wait() [0x142ec000..0x142ed140] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:474) at hudson.remoting.Request.call(Request.java:88) locked <0x37d133f0> (a hudson.remoting.UserRequest) at hudson.remoting.Channel.call(Channel.java:390) at hudson.FilePath.act(FilePath.java:305) at hudson.FilePath.exists(FilePath.java:506) at hudson.model.AbstractProject.pollSCMChanges(AbstractProject.java:595) at hudson.triggers.SCMTrigger$Runner.runPolling(SCMTrigger.java:259) at hudson.triggers.SCMTrigger$Runner.run(SCMTrigger.java:291) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) at java.util.concurrent.FutureTask.run(FutureTask.java:123) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675) at java.lang.Thread.run(Thread.java:595)

          Code changed in hudson
          User: : kohsuke
          Path:
          trunk/hudson/main/core/src/main/java/hudson/scm/SubversionSCM.java
          trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java
          trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.jelly
          trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties
          http://fisheye4.cenqua.com/changelog/hudson/?cs=14354
          Log:
          JENKINS-1646 In 1.273, Added http://server/hudson/descriptor/hudson.triggers.SCMTrigger/ to show the summary of SCM polling activities and how long it's taking, to assist the trouble-shooting of this issue.

          SCM/JIRA link daemon added a comment - Code changed in hudson User: : kohsuke Path: trunk/hudson/main/core/src/main/java/hudson/scm/SubversionSCM.java trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.jelly trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties http://fisheye4.cenqua.com/changelog/hudson/?cs=14354 Log: JENKINS-1646 In 1.273, Added http://server/hudson/descriptor/hudson.triggers.SCMTrigger/ to show the summary of SCM polling activities and how long it's taking, to assist the trouble-shooting of this issue.

          Code changed in hudson
          User: : kohsuke
          Path:
          trunk/hudson/main/core/src/main/java/hudson/model/AdministrativeMonitor.java
          trunk/hudson/main/core/src/main/java/hudson/model/Hudson.java
          trunk/www/changelog.html
          http://fisheye4.cenqua.com/changelog/hudson/?cs=14356
          Log:
          JENKINS-1646 Formalized an extension point to monitor the system for self diagnosis.

          SCM/JIRA link daemon added a comment - Code changed in hudson User: : kohsuke Path: trunk/hudson/main/core/src/main/java/hudson/model/AdministrativeMonitor.java trunk/hudson/main/core/src/main/java/hudson/model/Hudson.java trunk/www/changelog.html http://fisheye4.cenqua.com/changelog/hudson/?cs=14356 Log: JENKINS-1646 Formalized an extension point to monitor the system for self diagnosis.

          Code changed in hudson
          User: : kohsuke
          Path:
          trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java
          trunk/hudson/main/core/src/main/resources/hudson/model/Hudson/manage.jelly
          trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.jelly
          trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.properties
          trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties
          trunk/www/changelog.html
          http://fisheye4.cenqua.com/changelog/hudson/?cs=14357
          Log:
          JENKINS-1646 Formalized an extension point to monitor the system for self diagnosis.

          SCM/JIRA link daemon added a comment - Code changed in hudson User: : kohsuke Path: trunk/hudson/main/core/src/main/java/hudson/triggers/SCMTrigger.java trunk/hudson/main/core/src/main/resources/hudson/model/Hudson/manage.jelly trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.jelly trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/AdministrativeMonitorImpl/message.properties trunk/hudson/main/core/src/main/resources/hudson/triggers/SCMTrigger/DescriptorImpl/index.properties trunk/www/changelog.html http://fisheye4.cenqua.com/changelog/hudson/?cs=14357 Log: JENKINS-1646 Formalized an extension point to monitor the system for self diagnosis.

          I need to refresh my memory on the additional status monitoring my changes have
          added.

          Kohsuke Kawaguchi added a comment - I need to refresh my memory on the additional status monitoring my changes have added.

          Fixed in version 2.0 of the cvs plugin with the use of a java cvs library which stops running on polling failure

          Michael Clarke added a comment - Fixed in version 2.0 of the cvs plugin with the use of a java cvs library which stops running on polling failure

            mc1arke Michael Clarke
            tspengler tspengler
            Votes:
            4 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: