100% CPU remoting.jar or slave.jar on EC2 (connection refused)

This issue is archived. You can view it, but you can't modify it. Learn more

XMLWordPrintable

      Jenkins EC2 nodes are constantly crashing with 100% cpu usage:

       

      java.util.concurrent.TimeoutException: Ping started at 1563548484233 hasn't completed by 1563548724233
  at hudson.remoting.PingThread.ping(PingThread.java:134)
  at hudson.remoting.PingThread.run(PingThread.java:90)

       

      I tried both using "native ssh" and via jenkins-ssh and both have the same issue. It looks like the remoting.jar is hung up:

       

       

      JvmTop 0.8.0 alpha - 14:58:59, amd64, 4 cpus, Linux 4.9.0-9-a, load avg 7.89
 http://code.google.com/p/jvmtop
PID MAIN-CLASS HPCUR HPMAX NHCUR NHMAX CPU GC VM USERNAME #T DL
 4093 m.jvmtop.JvmTop 21m 1698m 18m n/a 0.50% 0.00% O8U21 root 12 
 3973 remoting.jar [ERROR: Connection refused/access denied] 
 6406 remoting.jar [ERROR: Connection refused/access denied]

       

       

      Not sure how to further debug this.

        1. Screenshot from 2019-07-22 20-43-32.png
          Screenshot from 2019-07-22 20-43-32.png
          138 kB

            Assignee:
            FABRIZIO MANFREDI
            Reporter:
            Günter Grodotzki
            Archiver:
            Jenkins Service Account

              Created:
              Updated:
              Resolved:
              Archived: