Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-24179

Intermittent git timeouts with error "Could not create directory 'c/users/user/.ssh'"

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Fix
    • Icon: Critical Critical
    • git-client-plugin, git-plugin, ssh-plugin
    • None
    • Windows Server 2008
      Jenkins 1.532.2
      Git Client Plugin 1.8.0
      Git Plugin 2.1.0

      The full error received is:

      Fetching upstream changes from ssh://git@git.dev.faked:7999/re/core-binaries.git
ERROR: Timeout after 10 minutes
FATAL: Failed to fetch from ssh://git@git.dev.faked:7999/re/core-binaries.git
hudson.plugins.git.GitException: Failed to fetch from ssh://git@git.dev.faked:7999/re/core-binaries.git
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:622)
	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:854)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:879)
	at org.jenkinsci.plugins.multiplescms.MultiSCM.checkout(MultiSCM.java:117)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1411)
	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:652)
	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:561)
	at hudson.model.Run.execute(Run.java:1665)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:246)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress ssh://git@git.dev.faked:7999/re/core-binaries.git +refs/heads/master:refs/remotes/core-binaries/master" returned status code 128:
stdout: 
stderr: Could not create directory 'c/users/user/.ssh'.
fatal: Could not read from remote repository.

      The git server hardware had been upgraded from a VM to a physical machine with 24 cores and 16G of RAM. The repositories are pretty small, and the machine isn't under much load at all. No networking issues are evident. I am confident this is not a true timeout, but an actual hang. It is intermittent. It seems similar to the issue found here:

      http://stackoverflow.com/questions/10732940/git-operations-occasionally-hang-in-jenkins-on-windows

      It also seems like it could be related to https://issues.jenkins-ci.org/browse/JENKINS-21654.

      We are using the "cmd" directory instead of the "bin" directory, i.e. "C:\Program Files (x86)\Git\cmd\git.exe".

      The HOME environment variable is set to "c:\users\user"

      The c:\users\user\.ssh directory exists, and the permissions seem to be fine (besides, it's intermittent...)

      Our c:\users\user\.ssh\config file looks like this:

      Host git.dev.faked
        StrictHostKeyChecking no
        UserKnownHostsFile NUL

      We have multiple executors for our build machines, so it could be that another git command is locking the .ssh directory while it's working. However, the likelihood of locking the database for 10 minutes if very, very unlikely.

            ndeloof Nicolas De Loof
            robduff Rob Duff
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: