Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-63711

GitHub branch source caches were using 13 GB on ci.jenkins.io

    XMLWordPrintable

    Details

    • Similar Issues:
    • Released As:
      github-branch-source-2.9.2

      Description

      The org.jenkinsci.plugins.github_branch_source.GitHubSCMProbe.cache directory in the Jenkins home directory of ci.jenkins.io included 13 GB of directories (over 27 000) from July 30, 2020 through Sep 16, 2020.

      Liam Newman indicated that he expects those caches should be cleaned automatically.

        Attachments

          Issue Links

          links to

          Web Link PR-341

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            sookad Hans Koster added a comment -

            It took several hours to clean 75GB ....

            Show
            sookad Hans Koster added a comment - It took several hours to clean 75GB ....
            Hide
            Permalink
            bitwiseman Liam Newman added a comment - - edited

            NOTE: this fix cleans up cache folders as the connections are discarded, however cache folders that were created before the fix was introduced are ignored. Adminstrators will need to remove those manually. This choice was made to avoid potential performance issues removing large numbers of folders.

            Show
            bitwiseman Liam Newman added a comment - - edited NOTE: this fix cleans up cache folders as the connections are discarded, however cache folders that were created before the fix was introduced are ignored. Adminstrators will need to remove those manually. This choice was made to avoid potential performance issues removing large numbers of folders.
            Hide
            Permalink
            jtjeferreira Joao added a comment -

            I am still seeing this problem. Running Jenkins 2.263.4 and GitHub Branch Source 2.9.5...

            Show
            jtjeferreira Joao added a comment - I am still seeing this problem. Running Jenkins 2.263.4 and GitHub Branch Source 2.9.5...
            Hide
            Permalink
            bitwiseman Liam Newman added a comment - - edited

            Joao
            You'll need to be more specific. Describe what folders are being added over time.

            EDIT:
            I think this might be related to the code path I'm removing in https://issues.jenkins.io/browse/JENKINS-64911

            Show
            bitwiseman Liam Newman added a comment - - edited Joao You'll need to be more specific. Describe what folders are being added over time. EDIT: I think this might be related to the code path I'm removing in https://issues.jenkins.io/browse/JENKINS-64911
            Hide
            Permalink
            jtjeferreira Joao added a comment -

            Liam Newman I meant the `org.jenkinsci.plugins.github_branch_source.GitHubSCMProbe.cache` folder but now that I looked in more detail I see that maybe some occupied space are leftovers... I will keep monitoring and let you know

            Show
            jtjeferreira Joao added a comment - Liam Newman I meant the `org.jenkinsci.plugins.github_branch_source.GitHubSCMProbe.cache` folder but now that I looked in more detail I see that maybe some occupied space are leftovers... I will keep monitoring and let you know

              People

              Assignee:
              bitwiseman Liam Newman
              Reporter:
              markewaite Mark Waite
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: