Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17903

PeriodicBackup Full-backups not working

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      I initiated a full backup and it took about 12 hours to complete. The tar.gz it created was only 23 KB in size and only contained 4 job dirs from the Jenkins workspace dir (nothing else). I'm using periodic backup v1.3 and Jenkins v1.514 (problem also occurred using Jenkins 1.510).

      Note: the config-only backup seems to work OK

        Attachments

          Activity

          Hide
          npbiles66 Nathan Biles added a comment -

          Note, the warnings regarding the dead links are probably not a problem, looking in TarGzStorage:

          @Override
          public void backupAddFile(File fileToStore) throws PeriodicBackupException {
          try

          { archiver.addFile(fileToStore, Util.getRelativePath(fileToStore, Hudson.getInstance().getRootDir())); }

          catch (ArchiverException e)

          { LOGGER.warning("Could not add file to the archive. " + e.getMessage()); }

          }

          Show
          npbiles66 Nathan Biles added a comment - Note, the warnings regarding the dead links are probably not a problem, looking in TarGzStorage: @Override public void backupAddFile(File fileToStore) throws PeriodicBackupException { try { archiver.addFile(fileToStore, Util.getRelativePath(fileToStore, Hudson.getInstance().getRootDir())); } catch (ArchiverException e) { LOGGER.warning("Could not add file to the archive. " + e.getMessage()); } }
          Hide
          npbiles66 Nathan Biles added a comment -

          that is, assuming org.codehaus.plexus.archiver.tar.TarArchiver doesn't start messing up once it is asked to add one of them

          Show
          npbiles66 Nathan Biles added a comment - that is, assuming org.codehaus.plexus.archiver.tar.TarArchiver doesn't start messing up once it is asked to add one of them
          Hide
          npbiles66 Nathan Biles added a comment -

          Disregarding the fact that the .tar.gz was missing all of the files, I'm wondering if one reason it could be so slow is due to using archiver.addFile() instead of using the addArchivedFileSet() method (to add a directory in one step)?

          Show
          npbiles66 Nathan Biles added a comment - Disregarding the fact that the .tar.gz was missing all of the files, I'm wondering if one reason it could be so slow is due to using archiver.addFile() instead of using the addArchivedFileSet() method (to add a directory in one step)?
          Hide
          npbiles66 Nathan Biles added a comment -

          Another obvious reason I missed is because when it scans files it follows links, so it will effectively try to backup everything in our /opt/build/jenkins/workspace/ directory too.

          /var/lib/jenkins is 6.9 GB, and /opt/build/jenkins/workspace/ is 13G

          Show
          npbiles66 Nathan Biles added a comment - Another obvious reason I missed is because when it scans files it follows links, so it will effectively try to backup everything in our /opt/build/jenkins/workspace/ directory too. /var/lib/jenkins is 6.9 GB, and /opt/build/jenkins/workspace/ is 13G
          Hide
          npbiles66 Nathan Biles added a comment -

          so i had removed all those dead links (and loop links) and restarted the full backup to a local dir under the user's home dir, and it's been running (with no warnings/errors) for 18 hours now, still not finished.

          I'm sure it would only take 1-2 minutes to just copy the /var/lib/jenkins/ (including the workspace dir)

          Show
          npbiles66 Nathan Biles added a comment - so i had removed all those dead links (and loop links) and restarted the full backup to a local dir under the user's home dir, and it's been running (with no warnings/errors) for 18 hours now, still not finished. I'm sure it would only take 1-2 minutes to just copy the /var/lib/jenkins/ (including the workspace dir)

            People

            Assignee:
            mriedem Matt Riedemann
            Reporter:
            npbiles66 Nathan Biles
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: