Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-48829

Linux slaves disconnect intermittently

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Minor Minor
    • ssh-slaves-plugin
    • None

      Tracking issue for https://github.com/jenkinsci/ssh-slaves-plugin/issues/69, see the attached PDF

      We are running into a strange issue where the linux slaves would disconnect intermittently
      (happening at least once a day) with the below error:

      Slave	JVM	has	terminated.	Exit	code=0
ERROR:	[09/11/17	08:00:37]	[SSH]	Error	deleting	file.
ha:////4BJzQ5KK22T5KWhPnJrxKFXkoZSAiG2JwcOgVPNHFspbAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz
/PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==com.trilead.ssh2.SFTPException:	No	
such	file	(SSH_FX_NO_SUCH_FILE:	A	reference	was	made	to	a	file	which	does	not	exist.)
								at	com.trilead.ssh2.SFTPv3Client.expectStatusOKMessage(SFTPv3Client.java:555)
								at	com.trilead.ssh2.SFTPv3Client.rm(SFTPv3Client.java:973)
								at	hudson.plugins.sshslaves.SSHLauncher$3.run(SSHLauncher.java:1255)
								at	
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
								at	java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
								at	java.util.concurrent.FutureTask.run(FutureTask.java:266)
								at	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
								at	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
								at	java.lang.Thread.run(Thread.java:745)
[09/11/17	08:00:37]	[SSH]	Connection	closed.

      Jenkins version = 2.60.3
      SSH Slave Plugin = 1.11
      JDK = 1.8
      Master OS = CentOS 6
      Slave OS = CentOS 7

        1. ssh-slaves-issue.pdf
          199 kB

          [JENKINS-48829] Linux slaves disconnect intermittently

          Oleg Nenashev created issue -
          Oleg Nenashev made changes -
          Assignee Original: Oleg Nenashev [ oleg_nenashev ]
          Ivan Fernandez Calvo made changes -
          Assignee New: Ivan Fernandez Calvo [ ifernandezcalvo ]
          Ivan Fernandez Calvo made changes -
          Link New: This issue is related to JENKINS-49309 [ JENKINS-49309 ]
          Ivan Fernandez Calvo made changes -
          Link New: This issue is duplicated by JENKINS-47401 [ JENKINS-47401 ]
          Ivan Fernandez Calvo made changes -
          Description Original: Tracking issue for https://github.com/jenkinsci/ssh-slaves-plugin/issues/69, see the attached PDF New: Tracking issue for https://github.com/jenkinsci/ssh-slaves-plugin/issues/69, see the attached PDF

          We are running into a strange issue where the linux slaves would disconnect intermittently
          (happening at least once a day) with the below error:

          {code}
          Slave JVM has terminated. Exit code=0
          ERROR: [09/11/17 08:00:37] [SSH] Error deleting file.
          ha:////4BJzQ5KK22T5KWhPnJrxKFXkoZSAiG2JwcOgVPNHFspbAAAAVx+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz
          /PLL0mV3NWzufebKBsTA0NFEYMUmgZnCA1SyAABjCCFBQC2xNaiYAAAAA==com.trilead.ssh2.SFTPException: No
          such file (SSH_FX_NO_SUCH_FILE: A reference was made to a file which does not exist.)
          at com.trilead.ssh2.SFTPv3Client.expectStatusOKMessage(SFTPv3Client.java:555)
          at com.trilead.ssh2.SFTPv3Client.rm(SFTPv3Client.java:973)
          at hudson.plugins.sshslaves.SSHLauncher$3.run(SSHLauncher.java:1255)
          at
          jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
          at java.util.concurrent.FutureTask.run(FutureTask.java:266)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
          at java.lang.Thread.run(Thread.java:745)
          [09/11/17 08:00:37] [SSH] Connection closed.
          {code}

          Jenkins version = 2.60.3
          SSH Slave Plugin = 1.11
          JDK = 1.8
          Master OS = CentOS 6
          Slave OS = CentOS 7

          Ivan Fernandez Calvo added a comment -

          Last comment on the Thread

          I have the same issue on 3 linux slaves. To fix the problem I move the plugin back to 1.21 and now it's
          1 month no more connection lost with slaves.

          Ivan Fernandez Calvo added a comment - Last comment on the Thread I have the same issue on 3 linux slaves. To fix the problem I move the plugin back to 1.21 and now it's 1 month no more connection lost with slaves.
          Ivan Fernandez Calvo made changes -
          Resolution New: Cannot Reproduce [ 5 ]
          Status Original: Open [ 1 ] New: Fixed but Unreleased [ 10203 ]
          Ivan Fernandez Calvo made changes -
          Status Original: Fixed but Unreleased [ 10203 ] New: Closed [ 6 ]

            ifernandezcalvo Ivan Fernandez Calvo
            oleg_nenashev Oleg Nenashev
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: