Details
-
Type:
Bug
-
Status: Closed (View Workflow)
-
Priority:
Major
-
Resolution: Cannot Reproduce
-
Component/s: git-client-plugin, ssh-credentials-plugin
-
Labels:
-
Environment:Linux server (debian/Wheezy), Windows build agent (Windows XP)
-
Similar Issues:
Description
System is configured to use an SSH agent to get the build from the Git server, and build on the build agent. The system works intermittently, and when it doesn't, the error reported is:
Started by an SCM change
Started by an SCM change
Started by an SCM change
Building remotely on Build Agent 1 in workspace C:\Jenkins\workspace\Fusion 3.69
FATAL: java.io.IOException: Remote call on Build Agent 1 failed
hudson.remoting.RemotingSystemException: java.io.IOException: Remote call on Build Agent 1 failed
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:183)
at com.sun.proxy.$Proxy75.addCredentials(Unknown Source)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl.addCredentials(RemoteGitImpl.java:196)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:584)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:561)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:866)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1411)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:652)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:557)
at hudson.model.Run.execute(Run.java:1665)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:230)
Caused by: java.io.IOException: Remote call on Build Agent 1 failed
at hudson.remoting.Channel.call(Channel.java:723)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:167)
... 13 more
Caused by: java.lang.Error: Failed to deserialize the Callable object.
at hudson.remoting.UserRequest.perform(UserRequest.java:104)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at hudson.remoting.Engine$1$1.run(Engine.java:58)
at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.ClassCastException: cannot assign instance of com.cloudbees.plugins.credentials.CredentialsScope$2 to field com.cloudbees.plugins.credentials.BaseCredentials.scope of type com.cloudbees.plugins.credentials.CredentialsScope in instance of com.cloudbees.jenkins.plugins.sshcredentials.impl.BasicSSHUserPrivateKey
at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(Unknown Source)
at java.io.ObjectStreamClass.setObjFieldValues(Unknown Source)
at java.io.ObjectInputStream.defaultReadFields(Unknown Source)
at java.io.ObjectInputStream.readSerialData(Unknown Source)
at java.io.ObjectInputStream.readOrdinaryObject(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.readArray(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.defaultReadFields(Unknown Source)
at java.io.ObjectInputStream.readSerialData(Unknown Source)
at java.io.ObjectInputStream.readOrdinaryObject(Unknown Source)
at java.io.ObjectInputStream.readObject0(Unknown Source)
at java.io.ObjectInputStream.readObject(Unknown Source)
at hudson.remoting.UserRequest.deserialize(UserRequest.java:182)
at hudson.remoting.UserRequest.perform(UserRequest.java:98)
... 9 more
This seems similar to a few other SSH/Git related issues that are there, so any patches and/or pointers to fix this would be appreciated.
Attachments
Activity
Aaron Blew have you tried the suggestions listed earlier (confirm you're only using one set of ssh credentials, confirm the slave jar matches your Jenkins version, etc.)?
Swarm slaves may also have an additional complexity because I believe they embed a copy of slave.jar in the swarm jar file. You might do a test drive with one of your swarm slaves and switch it temporarily to use Java web start or ssh to launch the slave. If that shows a different behavior, then your case may indicate that the swarm jar needs an update.
I just upgraded our swarm jar and haven't seen an issue in a few builds, but I'll keep an eye on it. We went from version 1.09 to version 1.20 (didn't realize it'd been updated so much between now and then).
Thanks for the tip!
Aaron Blew
added a comment - I just upgraded our swarm jar and haven't seen an issue in a few builds, but I'll keep an eye on it. We went from version 1.09 to version 1.20 (didn't realize it'd been updated so much between now and then).
Thanks for the tip! Since I can't duplicate it and the comments on the bug have been quiet for over a month, I'm closing this bug as "Cannot Reproduce".
I maybe find the reason for this error. In my test bed, I have encounter the same problem that error likes the follows, when I build my jenkins project.
FATAL: java.io.IOException: Remote call on <a-slave-host> failed
hudson.remoting.RemotingSystemException: java.io.IOException: Remote call on <a-slave-host> failed
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:195)
at com.sun.proxy.$Proxy75.addCredentials(Unknown Source)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl.addCredentials(RemoteGitImpl.java:197)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:662)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:638)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:978)
at hudson.scm.SCM.checkout(SCM.java:484)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1265)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:622)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:528)
at hudson.model.Run.execute(Run.java:1718)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:89)
at hudson.model.Executor.run(Executor.java:240)
Caused by: java.io.IOException: Remote call on rpmbuild-172.16.102.46 failed
at hudson.remoting.Channel.call(Channel.java:760)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:179)
... 14 more
At first, my jenkins project had fill the Git Repository URL with a type of Credentials. And I have put the <a-slave-host>'s id_rsa.pub which location '/root/.ssh/' to my gitlab server with 'Add SSH Key' operation.
So you may known that the real reason. After above build errors, I set the Git Credentials to none by the jenkins server WEBUI for my project configure. Then I build the project successful. Without comment, we can get a conclusion that the multiple credential types for gitlab server is the real reason. So you known how to deal with the problem too.
Thanks all. 
zhang guoqing
added a comment - I maybe find the reason for this error. In my test bed, I have encounter the same problem that error likes the follows, when I build my jenkins project.
FATAL: java.io.IOException: Remote call on <a-slave-host> failed
hudson.remoting.RemotingSystemException: java.io.IOException: Remote call on <a-slave-host> failed
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:195)
at com.sun.proxy.$Proxy75.addCredentials(Unknown Source)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl.addCredentials(RemoteGitImpl.java:197)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:662)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:638)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:978)
at hudson.scm.SCM.checkout(SCM.java:484)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1265)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:622)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:528)
at hudson.model.Run.execute(Run.java:1718)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:89)
at hudson.model.Executor.run(Executor.java:240)
Caused by: java.io.IOException: Remote call on rpmbuild-172.16.102.46 failed
at hudson.remoting.Channel.call(Channel.java:760)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:179)
... 14 more
At first, my jenkins project had fill the Git Repository URL with a type of Credentials. And I have put the <a-slave-host>'s id_rsa.pub which location '/root/.ssh/' to my gitlab server with 'Add SSH Key' operation.
So you may known that the real reason. After above build errors, I set the Git Credentials to none by the jenkins server WEBUI for my project configure. Then I build the project successful. Without comment, we can get a conclusion that the multiple credential types for gitlab server is the real reason. So you known how to deal with the problem too.
Thanks all.
Same issue with swarm slaves, no SSH credentials handled via Jenkins. I can restart the master and it will build successfully. We've also had success building before the restart by removing the wildcards from the branches we want the job to build.
This is kind of a painful one. Is there any other info we could provide that would help find a solution?
Thanks!