Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-61023

Jenkins agent threads deadlock due to remoting.jar

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Blocker Blocker
    • core, remoting
    • None

      ref) https://wiki.jenkins.io/display/JENKINS/Remoting+issue

       

      description:

      we setup jenkins master and several agents. one of agents periodically deadlocked and cpu spiked. I found It because SynchronousCommandTransport$ReaderThread.run from remoting.jar. (ref: https://wiki.jenkins.io/display/JENKINS/Remoting+issue)

      I added some screenshots. I really appreciate if you take a look and help us to find root cause.

       

      agent server stats:

       

      cpu usage:

       

      tracking PID 15699: ( It was remoting.jar )

       

      agentthread dump:  

       

       

      Thanks!

        1. channel thread.png
          channel thread.png
          77 kB
        2. cpu usage of remoting_jar.png
          cpu usage of remoting_jar.png
          20 kB
        3. remoting_jar ps.png
          remoting_jar ps.png
          13 kB
        4. stats.png
          stats.png
          134 kB

            Unassigned Unassigned
            doubleknd26 Kideok Kim
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: