[JENKINS-48453] java.nio.file.NoSuchFileException when materializing ServerKey

Type: Bug
Resolution: Fixed
Priority: Blocker
Component/s: docker-commons-plugin
Labels:
None
Environment:
jenkins: 2.93
docker-commons: 1.9

Similar Issues:
Powered by SuggestiMate

Show

Since https://issues.jenkins-ci.org/browse/JENKINS-36088, materializing a server key triggers an exception:

15:38:55 java.nio.file.NoSuchFileException: /var/lib/jenkins/.docker/7d36d1a6-4917-4dc8-97b6-2babbb2ae3d7
15:38:55 at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
15:38:55 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
15:38:55 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
15:38:55 at sun.nio.fs.UnixFileAttributeViews$Posix.setMode(UnixFileAttributeViews.java:238)
15:38:55 at sun.nio.fs.UnixFileAttributeViews$Posix.setPermissions(UnixFileAttributeViews.java:260)
15:38:55 at java.nio.file.Files.setPosixFilePermissions(Files.java:2045)
15:38:55 at hudson.FilePath._chmod(FilePath.java:1618)
15:38:55 at hudson.FilePath.access$1500(FilePath.java:197)
15:38:55 at hudson.FilePath$29.invoke(FilePath.java:1600)
15:38:55 at hudson.FilePath$29.invoke(FilePath.java:1597)
15:38:55 at hudson.FilePath.act(FilePath.java:998)
15:38:55 at hudson.FilePath.act(FilePath.java:976)
15:38:55 at hudson.FilePath.chmod(FilePath.java:1597)
15:38:55 at org.jenkinsci.plugins.docker.commons.impl.ServerKeyMaterialFactory.materialize(ServerKeyMaterialFactory.java:86)
15:38:55 at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)
15:38:55 at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:459)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:431)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder$Perform.buildAndTag(DockerBuilder.java:373)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder$Perform.exec(DockerBuilder.java:311)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder$Perform.access$100(DockerBuilder.java:291)
15:38:55 at com.cloudbees.dockerpublish.DockerBuilder.perform(DockerBuilder.java:262)
15:38:55 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
15:38:55 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
15:38:55 at hudson.model.Build$BuildExecution.build(Build.java:206)
15:38:55 at hudson.model.Build$BuildExecution.doRun(Build.java:163)
15:38:55 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
15:38:55 at hudson.model.Run.execute(Run.java:1727)
15:38:55 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
15:38:55 at hudson.model.ResourceController.execute(ResourceController.java:97)
15:38:55 at hudson.model.Executor.run(Executor.java:429)
15:38:55 Build step 'Docker Build and Publish' marked build as failure

This happens when the new (default) NIO mode is used to perform the chmod: the posix API seems to automatically create the folder, which the NIO implementation expects the file/folder to actually exist.

blocks

JENKINS-36088 Use NIO rather than JNR whenever possible

Resolved

is duplicated by

JENKINS-40843 Credentials for docker.withServer Not Found

Resolved

links to

PR 62

mentioned in: Page Failed to load

Francois Ferrand created issue - 2017-12-08 15:09

Francois Ferrand added a comment - 2017-12-08 15:10

A workaround may be to set the `hudson.Util.useNativeChmodAndMode` system property to `true`, to revert back to the old code (and behavior)

Francois Ferrand added a comment - 2017-12-08 15:10 A workaround may be to set the `hudson.Util.useNativeChmodAndMode` system property to `true`, to revert back to the old code (and behavior)

Francois Ferrand made changes - 2017-12-08 15:10

Description

Original: Since https://issues.jenkins-ci.org/browse/JENKINS-36088, materializing a server key triggers an exception:

{{*15:38:55* java.nio.file.NoSuchFileException: /var/lib/jenkins/.docker/7d36d1a6-4917-4dc8-97b6-2babbb2ae3d7}}
{{*15:38:55* at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
{{*15:38:55* at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
{{*15:38:55* at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)}}
{{*15:38:55* at sun.nio.fs.UnixFileAttributeViews$Posix.setMode(UnixFileAttributeViews.java:238)}}
{{*15:38:55* at sun.nio.fs.UnixFileAttributeViews$Posix.setPermissions(UnixFileAttributeViews.java:260)*15:38:55* at java.nio.file.Files.setPosixFilePermissions(Files.java:2045)}}
{{*15:38:55* at hudson.FilePath._chmod(FilePath.java:1618) *15:38:55* at hudson.FilePath.access$1500(FilePath.java:197)}}
{{*15:38:55* at hudson.FilePath$29.invoke(FilePath.java:1600)}}
{{*15:38:55* at hudson.FilePath$29.invoke(FilePath.java:1597)}}
{{*15:38:55* at hudson.FilePath.act(FilePath.java:998)}}
{{*15:38:55* at hudson.FilePath.act(FilePath.java:976)}}
{{*15:38:55* at hudson.FilePath.chmod(FilePath.java:1597)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.ServerKeyMaterialFactory.materialize(ServerKeyMaterialFactory.java:86)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:459)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:431)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.buildAndTag(DockerBuilder.java:373)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.exec(DockerBuilder.java:311)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.access$100(DockerBuilder.java:291)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder.perform(DockerBuilder.java:262)}}
{{*15:38:55* at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)}}
{{*15:38:55* at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)}}
{{*15:38:55* at hudson.model.Build$BuildExecution.build(Build.java:206)}}
{{*15:38:55* at hudson.model.Build$BuildExecution.doRun(Build.java:163)}}
{{*15:38:55* at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)}}
{{*15:38:55* at hudson.model.Run.execute(Run.java:1727)}}
{{*15:38:55* at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)}}
{{*15:38:55* at hudson.model.ResourceController.execute(ResourceController.java:97)}}
{{*15:38:55* at hudson.model.Executor.run(Executor.java:429)}}
{{*15:38:55* Build step 'Docker Build and Publish' marked build as failure}}

This happens when the new (default) NIO mode is used to perform the chmod: the posix API seems to automatically create the folder, which the NIO implementation expects the file/folder to actually exist.

New: Since https://issues.jenkins-ci.org/browse/JENKINS-36088, materializing a server key triggers an exception:

{{*15:38:55* java.nio.file.NoSuchFileException: /var/lib/jenkins/.docker/7d36d1a6-4917-4dc8-97b6-2babbb2ae3d7}}
{{*15:38:55* at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
{{*15:38:55* at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
{{*15:38:55* at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)}}
{{*15:38:55* at sun.nio.fs.UnixFileAttributeViews$Posix.setMode(UnixFileAttributeViews.java:238)}}
{{*15:38:55* at sun.nio.fs.UnixFileAttributeViews$Posix.setPermissions(UnixFileAttributeViews.java:260)}}
{{*15:38:55* at java.nio.file.Files.setPosixFilePermissions(Files.java:2045)}}
{{*15:38:55* at hudson.FilePath._chmod(FilePath.java:1618)}}
{{*15:38:55* at hudson.FilePath.access$1500(FilePath.java:197)}}
{{*15:38:55* at hudson.FilePath$29.invoke(FilePath.java:1600)}}
{{*15:38:55* at hudson.FilePath$29.invoke(FilePath.java:1597)}}
{{*15:38:55* at hudson.FilePath.act(FilePath.java:998)}}
{{*15:38:55* at hudson.FilePath.act(FilePath.java:976)}}
{{*15:38:55* at hudson.FilePath.chmod(FilePath.java:1597)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.ServerKeyMaterialFactory.materialize(ServerKeyMaterialFactory.java:86)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)}}
{{*15:38:55* at org.jenkinsci.plugins.docker.commons.impl.CompositeKeyMaterialFactory.materialize(CompositeKeyMaterialFactory.java:69)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:459)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.executeCmd(DockerBuilder.java:431)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.buildAndTag(DockerBuilder.java:373)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.exec(DockerBuilder.java:311)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder$Perform.access$100(DockerBuilder.java:291)}}
{{*15:38:55* at com.cloudbees.dockerpublish.DockerBuilder.perform(DockerBuilder.java:262)}}
{{*15:38:55* at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)}}
{{*15:38:55* at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)}}
{{*15:38:55* at hudson.model.Build$BuildExecution.build(Build.java:206)}}
{{*15:38:55* at hudson.model.Build$BuildExecution.doRun(Build.java:163)}}
{{*15:38:55* at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)}}
{{*15:38:55* at hudson.model.Run.execute(Run.java:1727)}}
{{*15:38:55* at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)}}
{{*15:38:55* at hudson.model.ResourceController.execute(ResourceController.java:97)}}
{{*15:38:55* at hudson.model.Executor.run(Executor.java:429)}}
{{*15:38:55* Build step 'Docker Build and Publish' marked build as failure}}

This happens when the new (default) NIO mode is used to perform the chmod: the posix API seems to automatically create the folder, which the NIO implementation expects the file/folder to actually exist.

Francois Ferrand added a comment - 2017-12-08 15:59 - edited

Not sure how best to fix this:

Explicitely create the directory before chmod'ing it (`tempCredsDir.chmod(0600)`)
Fix `Filepath.chmod` to create directory or ignore non-existant file in NIO mode (e.g. implement same behavior as 'native' implementation)

Francois Ferrand added a comment - 2017-12-08 15:59 - edited Not sure how best to fix this: Explicitely create the directory before chmod'ing it (`tempCredsDir.chmod(0600)`) Fix `Filepath.chmod` to create directory or ignore non-existant file in NIO mode (e.g. implement same behavior as 'native' implementation)

Jesse Glick added a comment - 2017-12-11 21:57

Please use JIRA issue linking where appropriate.

Jesse Glick added a comment - 2017-12-11 21:57 Please use JIRA issue linking where appropriate.

Jesse Glick made changes - 2017-12-11 21:57

Link

New: This issue blocks ~~JENKINS-36088~~ [ ~~JENKINS-36088~~ ]

Jesse Glick made changes - 2017-12-11 21:57

Remote Link

New: This issue links to "PR 62 (Web Link)" [ 19350 ]

Jesse Glick made changes - 2017-12-11 21:57

Resolution		New: Fixed [ 1 ]
Status	Original: Open [ 1 ]	New: Resolved [ 5 ]

Jesse Glick made changes - 2017-12-11 22:05

Remote Link

New: This issue links to "Page (Jenkins Wiki)" [ 19351 ]

Jesse Glick made changes - 2018-05-18 13:56

Link

New: This issue is duplicated by ~~JENKINS-40843~~ [ ~~JENKINS-40843~~ ]

Assignee:: Unassigned

Reporter:: Francois Ferrand

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Created:: 2017-12-08 15:09

Updated:: 2018-05-18 13:56

Resolved:: 2017-12-11 21:57

Jenkins

Details

Description

Attachments

Issue Links

Activity

Collapse comment: Francois Ferrand added a comment - 2017-12-08 15:10

Expand comment: Francois Ferrand added a comment - 2017-12-08 15:10

Collapse comment: Francois Ferrand added a comment - 2017-12-08 15:59, Edited by Francois Ferrand - 2017-12-08 16:00

Expand comment: Francois Ferrand added a comment - 2017-12-08 15:59, Edited by Francois Ferrand - 2017-12-08 16:00

Collapse comment: Jesse Glick added a comment - 2017-12-11 21:57

Expand comment: Jesse Glick added a comment - 2017-12-11 21:57

People

Dates