Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-68322

sh command hangs, no errors, pod hangs. sporadic.

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Trivial Trivial
    • kubernetes-plugin
    • None
    • Jenkins: 2.342
      OS: Linux - 5.4.0-1060-aws
      Kubernetes plugin: latest

      Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

      2 nodes:

      Windows node - JNLP connects works fine running powershell in container and then it hangs if parallel linux container runs, Jenkins hangs and dies error 404

      Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

      POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

      The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

      Terminating Jenkins Job does not work - jenkins hangs until full reboot

       

      running ubuntu container after running SH and jenkins hangs

      Cannot contact aws-nuke-227-hqk39-nm7mx-28qkh: java.lang.InterruptedException

       

       

          [JENKINS-68322] sh command hangs, no errors, pod hangs. sporadic.

          george f created issue -
          george f made changes -
          Summary Original: sh command hangs, no erros, pod hangs. sporadic. New: sh command hangs, no errors, pod hangs. sporadic.
          george f made changes -
          Description Original: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container 

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

           

           
          New: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container 

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

           

           
          george f made changes -
          Description Original: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container 

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

           

           
          New: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container 

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

          Terminating Jenkins Job does not work - jenkins hangs until full reboot

           

           
          george f made changes -
          Description Original: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container 

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

          Terminating Jenkins Job does not work - jenkins hangs until full reboot

           

           
          New: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container and then it hangs if parallel linux container runs, Jenkins hangs and dies error 404

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

          Terminating Jenkins Job does not work - jenkins hangs until full reboot

           

           
          george f made changes -
          Description Original: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container and then it hangs if parallel linux container runs, Jenkins hangs and dies error 404

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

          Terminating Jenkins Job does not work - jenkins hangs until full reboot

           

           
          New: Jenkins behind NGINX with websockets. kubernetes 1.21 on EKS

          2 nodes:

          Windows node - JNLP connects works fine running powershell in container and then it hangs if parallel linux container runs, Jenkins hangs and dies error 404

          Linux node - JNLP connects, SH command hangs, no error appear, sometimes jenkins hangs with error and fails. Sporadic. 50% works, sometimes it passes fine.

          POD not being destroyed at all if it hangs. Sometimes may appear error 500 sometimes NosuchMethodError.

          The problem started appearing after adding changes needed to have windows containers, changes where made to AWS Roles.

          Terminating Jenkins Job does not work - jenkins hangs until full reboot

           

          running ubuntu container after running SH and jenkins hangs

          Cannot contact aws-nuke-227-hqk39-nm7mx-28qkh: java.lang.InterruptedException

           

           
          george f made changes -
          Priority Original: Major [ 3 ] New: Trivial [ 5 ]
          george f made changes -
          Comment [ after reading this article i think i managed to solve it, 5 second (default Jenkins) timeout for EKS API is too short, i extended everything to 120 seconds and seems it works now.

          [https://support.cloudbees.com/hc/en-us/articles/360054642231-Considerations-for-Kubernetes-Clients-Connections-when-using-Kubernetes-Plugin] ]
          george f made changes -
          Priority Original: Trivial [ 5 ] New: Major [ 3 ]
          george f made changes -
          Assignee New: george f [ george_f ]
          george f made changes -
          Priority Original: Major [ 3 ] New: Trivial [ 5 ]

            Unassigned Unassigned
            george_f george f
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: