Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-69415

[pipeline-groovy-lib] /libs folder of every build clogs up file system

    XMLWordPrintable

Details

    Description

      Hello, we have a lot of jobs running on our jenkins and each job (mostly multi-branch pipelines) are using multiple libraries. The libraries are downloaded from GitHub and configured to all download the same default version. We now face the issue that everytime a build is started each library seems to be re-downloaded from GitHub into the individual build directories, say:

      /var/jenkins_home/jobs/<name>/branches/main/builds/46/libs/...
      /var/jenkins_home/jobs/<name>/branches/main/builds/47/libs/...
      ...
      

      As some libraries come with hundrets of files, we have hundrets of jobs, that do hundrets of builds, that results in literally millions of duplicated files on our Jenkins clogging up the whole file system. At that is even if the version of the libraries in question do not change between build the same library is downloaded all over again for every build.

      Is there a way to prevent this massive duplication of files between builds, like a way to clone the library to a central folder on Jenkins instead of the individual build directories instead? Thanks!

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kriskra Kristian Kraljic
              Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: