Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-58301

Kubernetes Plugin Repeated Socket Ping Timeout Exceptions

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • kubernetes-plugin
    • Jenkins version: 2.182
      Kubernetes Plugin: 1.16.2
      Kubernetes: v1.13.7-eks-c57ff8

      I often get issues like this:
      java.net.SocketTimeoutException: sent ping but didn't receive pong within 1000ms (after 330 successful ping/pongs)

      One single issue breaks the entire task and makes it hard to even cancel the task. Should this not be retried rather than break execution? Our Jenkins will run longer running tasks as well. Any single task breaking stop in the middle is a real issue, and I don't see why one network issue after 330 successful ones (in this case) is such a big issue.

      x

          [JENKINS-58301] Kubernetes Plugin Repeated Socket Ping Timeout Exceptions

          autarch princeps created issue -

          Deiwin Sarjas added a comment -

          We've also been seeing quite a bit of this recently on EKS with Jenkins 2.164.2, Kubernetes plugin 1.15.2.

          Deiwin Sarjas added a comment - We've also been seeing quite a bit of this recently on EKS with Jenkins 2.164.2, Kubernetes plugin 1.15.2.
          autarch princeps made changes -
          Environment Original: Jenkins version: 2.182
          Kubernetes Plugin: 1.6.2
          Kubernetes: v1.13.7-eks-c57ff8           		New: Jenkins version: 2.182
          Kubernetes Plugin: 1.16.2
          Kubernetes: v1.13.7-eks-c57ff8
          Jesse Glick made changes -
          Link New: This issue relates to JENKINS-53532 [ JENKINS-53532 ]
          Jesse Glick made changes -
          Remote Link New: This issue links to "CloudBees-internal issue (Web Link)" [ 23217 ]
          Jesse Glick made changes -
          Labels Original: kubernetes kubernetes-plugin plugin timeout New: timeout
          Jesse Glick made changes -
          Assignee Original: Carlos Sanchez [ csanchez ]

          cheng jingtao added a comment -

          +1

          cheng jingtao added a comment - +1

          Tyrone Grech added a comment -

          We are also encountering this issue fairly often in our CI system running:

          • On premises Kubernetes cluster on version 1.14.1
          • Jenkins version 2.186
          • Kubernetes Plugin version 1.17.2

          Tyrone Grech added a comment - We are also encountering this issue fairly often in our CI system running: On premises Kubernetes cluster on version 1.14.1 Jenkins version 2.186 Kubernetes Plugin version 1.17.2

          Deiwin Sarjas added a comment -

          We configured -Dkubernetes.websocket.ping.interval=30000 for Jenkins based on this comment on another issue. I'll report back if it helps or not.

          Deiwin Sarjas added a comment - We configured -Dkubernetes.websocket.ping.interval=30000 for Jenkins based on this comment on another issue . I'll report back if it helps or not.

            Unassigned Unassigned
            autarchprinceps autarch princeps
            Votes:
            5 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated: