Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-64443

EOF from OkHttp in kubernetes plugin 1.23.4 during building job

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • kubernetes-plugin
    • None
    • Jenkins Version: 2.204.6
      Kubernetes Plugin Version: 1.23.4

      Hi all, 

      Environment:
      Jenkins Version: 2.204.6
      Kubernetes Plugin Version: 1.23.4

      When I build a project sometimes it build successfully but sometimes it failed with below error:

      Logs of Jenkins Slave Pod:

      Warning: JnlpProtocol3 is disabled by default, use JNLP_PROTOCOL_OPTS to alter the behavior
      Dec 10, 2020 10:19:53 AM hudson.remoting.jnlp.Main createEngine
      INFO: Setting up agent: dockerbuild-4pf2x-hbgvw
      Dec 10, 2020 10:19:53 AM hudson.remoting.jnlp.Main$CuiListener <init>
      INFO: Jenkins agent is running in headless mode.
      Dec 10, 2020 10:19:53 AM hudson.remoting.Engine startEngine
      INFO: Using Remoting version: 3.35
      Dec 10, 2020 10:19:53 AM org.jenkinsci.remoting.engine.WorkDirManager initializeWorkDir
      INFO: Using /home/jenkins/agent/remoting as a remoting work directory
      Dec 10, 2020 10:19:53 AM org.jenkinsci.remoting.engine.WorkDirManager setupLogging
      INFO: Both error and output logs will be printed to /home/jenkins/agent/remoting
      Dec 10, 2020 10:19:53 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Locating server among http://jenkins-master:10000/
      Dec 10, 2020 10:19:53 AM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve
      INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
      Dec 10, 2020 10:19:54 AM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve
      INFO: Remoting TCP connection tunneling is enabled. Skipping the TCP Agent Listener Port availability check
      Dec 10, 2020 10:19:54 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Agent discovery successful
        Agent address: jenkins-master
        Agent port:    10003
        Identity:      56:69:6c:8f:c1:8b:cd:7e:c2:3f:f6:73:7e:a7:12:3f
      Dec 10, 2020 10:19:54 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Handshaking
      Dec 10, 2020 10:19:54 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Connecting to jenkins-master:10003
      Dec 10, 2020 10:19:54 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Trying protocol: JNLP4-connect
      Dec 10, 2020 10:19:54 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Remote identity confirmed: 56:69:6c:8f:c1:8b:cd:7e:c2:3f:f6:73:7e:a7:12:3f
      Dec 10, 2020 10:19:55 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Connected
      Dec 10, 2020 10:20:02 AM org.eclipse.jgit.util.FS$FileStoreAttributes saveToConfig
      WARNING: locking FileBasedConfig[/home/jenkins/.config/jgit/config] failed after 5 retries
      Dec 10, 2020 10:20:05 AM org.csanchez.jenkins.plugins.kubernetes.KubernetesSlave$SlaveDisconnector call
      INFO: Disabled slave engine reconnects.
      Dec 10, 2020 10:20:05 AM hudson.util.ProcessTree get
      WARNING: Error while determining if vetoers exist
      hudson.remoting.RequestAbortedException: java.nio.channels.ClosedChannelException
              at hudson.remoting.Request.abort(Request.java:340)
              at hudson.remoting.Channel.terminate(Channel.java:1038)
              at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209)
              at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:221)
              at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816)
              at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213)
              at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:784)
              at org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:172)
              at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314)
              at hudson.remoting.Channel.close(Channel.java:1450)
              at hudson.remoting.Channel.close(Channel.java:1403)
              at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1270)
              at hudson.remoting.Channel$1.handle(Channel.java:563)
              at hudson.remoting.AbstractByteBufferCommandTransport.processCommand(AbstractByteBufferCommandTransport.java:203)
              at hudson.remoting.AbstractByteBufferCommandTransport.receive(AbstractByteBufferCommandTransport.java:189)
              at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onRead(ChannelApplicationLayer.java:187)
              at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecv(ApplicationLayer.java:206)
              at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecv(ProtocolStack.java:668)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processRead(SSLEngineFilterLayer.java:369)
              at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecv(SSLEngineFilterLayer.java:117)
              at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecv(ProtocolStack.java:668)
              at org.jenkinsci.remoting.protocol.NetworkLayer.onRead(NetworkLayer.java:136)
              at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer.access$2200(BIONetworkLayer.java:48)
              at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer$Reader.run(BIONetworkLayer.java:283)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:97)
              at java.lang.Thread.run(Thread.java:748)
              Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection to jenkins-master/x.x.x.x:10003
                      at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                      at hudson.remoting.Request.call(Request.java:202)
                      at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
                      at com.sun.proxy.$Proxy5.fetch3(Unknown Source)
                      at hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:209)
                      at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
                      at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
                      at hudson.util.ProcessTree.get(ProcessTree.java:432)
                      at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:1103)
                      at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:1094)
                      at hudson.remoting.UserRequest.perform(UserRequest.java:211)
                      at hudson.remoting.UserRequest.perform(UserRequest.java:54)
                      at hudson.remoting.Request$2.run(Request.java:369)
                      at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
                      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
                      ... 4 more
      Caused by: java.nio.channels.ClosedChannelException
              ... 32 more
       
      Dec 10, 2020 10:20:05 AM hudson.remoting.jnlp.Main$CuiListener status
      INFO: Terminated
      Dec 10, 2020 10:20:05 AM hudson.util.ProcessTree get
      WARNING: Failed to load winp. Reverting to the default
      java.lang.NoClassDefFoundError: hudson/util/ProcessTree$Linux$LinuxProcess
              at hudson.util.ProcessTree.get(ProcessTree.java:451)
              at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:1103)
              at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:1094)
              at hudson.remoting.UserRequest.perform(UserRequest.java:211)
              at hudson.remoting.UserRequest.perform(UserRequest.java:54)
              at hudson.remoting.Request$2.run(Request.java:369)
              at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
              at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:97)
              at java.lang.Thread.run(Thread.java:748)
      Caused by: java.lang.ClassNotFoundException: hudson.util.ProcessTree$Linux$LinuxProcess
              at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
              at hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:171)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
              ... 12 more
       
      Dec 10, 2020 10:20:05 AM hudson.remoting.Request$2 run
      INFO: Failed to send back a reply to the request hudson.remoting.Request$2@7586ee1b: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@71cdad61:JNLP4-connect connection to jenkins-master/x.x.x.x:10003": channel is already closed
      

       

       

       

          [JENKINS-64443] EOF from OkHttp in kubernetes plugin 1.23.4 during building job

          Vivek added a comment - - edited

          I have attached the Jenkins Jobs UI error message as well the Jenkinsfile which I am using it. 

          Vivek added a comment - - edited I have attached the Jenkins Jobs UI error message as well the Jenkinsfile which I am using it. 

          Sounds like an infrastructure issue when running the kubectl exec call.

          Vincent Latombe added a comment - Sounds like an infrastructure issue when running the kubectl exec call.

          Vivek added a comment -

           Hi  vlatombe, actually we are running jenkins master in DC/OS and spinning  up Jenkins agent in kubernetes dynamically and issue is occurring intermittently.

          Vivek added a comment -  Hi  vlatombe , actually we are running jenkins master in DC/OS and spinning  up Jenkins agent in kubernetes dynamically and issue is occurring intermittently.

            Unassigned Unassigned
            l0calh0st Vivek
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: