Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-13202

Artifact archiving from an ssh slave fails if symlinks are present

    XMLWordPrintable

Details

    • Bug
    • Status: Reopened (View Workflow)
    • Major
    • Resolution: Unresolved
    • core
    • Slave must be a "Unix via SSH" slave. I suspect the master must be Unix-based also. I tested with both the master and slave on Linux.

    Description

      When archiving artifacts from a job executed on a "Unix via SSH" slave, if a symlink is present and archived before its target, the archiving will fail. It looks like the master is trying to chmod the local symlink (because it has executable permissions stored in the tar used to do the remote copy), but that fails because the target doesn't exist yet, and the exception aborts the archiving. I think the solution is to just not chmod symlinks, since they don't have modes of their own. This was a regression from 1.455 to 1.456. I suspect the fixes for JENKINS-9118 are the cause.

      To reproduce this problem, install the Jenkins master on a Linux machine and add a "Unix via SSH" slave that is also a Linux machine. Create a job with the following build script:

      rm -rf stuff
mkdir stuff
cd stuff
touch zzfile
ln -s zzfile aafile
ln -s zzfile bbfile

      Restrict this project to build on the slave. Set up archiving for "stuff/*". Run the job. The job will complete successfully, but archiving will abort partway though with a stack trace in the console.

      Archiving artifacts
ERROR: Failed to archive artifacts: stuff/*
hudson.util.IOException2: Failed to extract /tmp/jenkins-slave-home/workspace/create_symlinks/stuff/*
	at hudson.FilePath.readFromTar(FilePath.java:1817)
	at hudson.FilePath.copyRecursiveTo(FilePath.java:1729)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:116)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
	at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:703)
	at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:678)
	at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:656)
	at hudson.model.Build$RunnerImpl.post2(Build.java:162)
	at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:625)
	at hudson.model.Run.run(Run.java:1435)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:238)
Caused by: java.io.IOException: Failed to chmod /tmp/jenkins-home/jobs/create_symlinks/builds/2012-03-21_16-53-15/archive/stuff/aafile : No such file or directory
	at hudson.FilePath._chmod(FilePath.java:1248)
	at hudson.FilePath.readFromTar(FilePath.java:1813)
	... 12 more

      Attachments

        Issue Links

          depends on

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-14351 Outdated JRuby libs

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-13241 Artifact archiving from remote slave fails

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-13280 Fix for JENKINS-9118 breaks archival if symlink referent is in the archive

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-13645 Symlinks in archives cause archiving to fail

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-14021 HP-UX doesn't have readlink

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-14947 Build fail from UnsupportedOperationException during Doxygen post-build step

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-15301 HTML Publisher failure: Failed to extract directory from slave

          • Major - Major loss of function.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. JENKINS-13614 archiving artefacts from remote MacOS X, IBM AIX slave fails

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Activity

            Ascending order - Click to sort in descending order
            View 55 older comments
            ntshako Hannes Kogler added a comment -

            same problem here:
            1.531

            ntshako Hannes Kogler added a comment - same problem here: 1.531
            pjos Pawel Josefsson added a comment -

            What is the status of this problem. Getting a lot of readlink complains in Jenkins 1.565.3 running as master on HP-UX 11.31.

            pjos Pawel Josefsson added a comment - What is the status of this problem. Getting a lot of readlink complains in Jenkins 1.565.3 running as master on HP-UX 11.31.
            jglick Jesse Glick added a comment -

            pjos best to recheck in 1.586 with the fix of JENKINS-24521. Or if you can run Java 7, do so.

            jglick Jesse Glick added a comment - pjos best to recheck in 1.586 with the fix of JENKINS-24521 . Or if you can run Java 7, do so.
            danielbeck Daniel Beck added a comment -

            Is this still an issue in Jenkins 1.600+ / 1.596.x?

            danielbeck Daniel Beck added a comment - Is this still an issue in Jenkins 1.600+ / 1.596.x?
            patelakhil Akhilkumar Patel added a comment -

            Hi ,

            I am also observing the "copyRecursiveTo" is not completely copying artifacts/files to master from slave.

            What i noticed that it had stopped copying one of the json file half. Because of same the next step which parse the json on master is failing.

            Same is working fine on master. Let me know any other information is required.

            I am writing this very first time on jenkins so let me know if i missed/not following any standard process here.

            There is relevant issue but this issue marked as duplicate issue hence writing the comment here.

            Thanks n Regards,
            Akhilkumar Patel

            patelakhil Akhilkumar Patel added a comment - Hi , I am also observing the "copyRecursiveTo" is not completely copying artifacts/files to master from slave. What i noticed that it had stopped copying one of the json file half. Because of same the next step which parse the json on master is failing. Same is working fine on master. Let me know any other information is required. I am writing this very first time on jenkins so let me know if i missed/not following any standard process here. There is relevant issue but this issue marked as duplicate issue hence writing the comment here. Thanks n Regards, Akhilkumar Patel

            People

              Unassigned Unassigned
              dreiss David Reiss
              Votes:
              23 Vote for this issue
              Watchers:
              37 Start watching this issue

              Dates

                Created:
                Updated: