Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-73242

GitHub Organization scan fails when repository is DMCA'd

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • github-api-plugin, pipeline, scm-api-plugin
    • None

      Scanning a github organization/user fails if a repository is blocked due to a DMCA takedown.

       

      Here is an excerpt from the end of my scan log:

       

      Ignoring krypton
20:13:09 Skipping repository krypton because it is a fork
Ignoring laptop-setup-ubuntu-18.04
20:13:09 Skipping repository laptop-setup-ubuntu-18.04 because it is a fork
Ignoring LearningDesignPattern
20:13:09 Skipping repository LearningDesignPattern because it is a fork
Ignoring Ledger
20:13:10 Skipping repository Ledger because it is a fork
Ignoring LiquidBurner
20:13:10 Skipping repository LiquidBurner because it is a fork
ERROR: [Sun Jun 02 20:13:10 EDT 2024] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@7010654c
[Sun Jun 02 20:13:10 EDT 2024] Finished organization scan. Scan took 17 sec FATAL: Failed to recompute children of solonovamax
org.kohsuke.github.HttpException: {"message":"Repository access blocked","block":{"reason":"dmca","created_at":"2023-05-08T22:39:57Z","html_url":"
https://github.com/github/dmca/blob/master/2023/05/2023-05-04-nintendo-4.md
"}}
at PluginClassLoader for github-api//org.kohsuke.github.GitHubConnectorResponseErrorHandler$1.onError(GitHubConnectorResponseErrorHandler.java:62)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.detectKnownErrors(GitHubClient.java:504)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:464)
at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:427)
at PluginClassLoader for github-api//org.kohsuke.github.Requester.fetchInto(Requester.java:102)
at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.populate(GHRepository.java:3599)
at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.getSource(GHRepository.java:2979)
at PluginClassLoader for github-branch-source//org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:1068)
at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:530)
at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269)
at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167)
at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:915)
at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:446)
Finished: FAILURE

       

       

      The repository in question is most likely one of the following:

       

      These repositories cannot be removed through github. The DMCA was automatic and affected any users which had forked this repository (of which there were many, including me), so being unable to scan repositories due to this is quite annoying.

       

      this is my first time reporting an issue for jenkins, so lmk if I left out any information (tho I think I got everything)

          [JENKINS-73242] GitHub Organization scan fails when repository is DMCA'd

          solo created issue -
          solo made changes -
          Assignee New: solo [ solonovamax ]
          solo made changes -
          Description Original: Scanning a github organization/user fails if a repository is blocked due to a DMCA takedown.

           

          Here is an excerpt from the end of my scan log:

           
          {code:java}
          Ignoring krypton 20:13:09 Skipping repository krypton because it is a fork Ignoring laptop-setup-ubuntu-18.04 20:13:09 Skipping repository laptop-setup-ubuntu-18.04 because it is a fork Ignoring LearningDesignPattern 20:13:09 Skipping repository LearningDesignPattern because it is a fork Ignoring Ledger 20:13:10 Skipping repository Ledger because it is a fork Ignoring LiquidBurner 20:13:10 Skipping repository LiquidBurner because it is a fork ERROR: [Sun Jun 02 20:13:10 EDT 2024] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@7010654c [Sun Jun 02 20:13:10 EDT 2024] Finished organization scan. Scan took 17 sec FATAL: Failed to recompute children of solonovamax org.kohsuke.github.HttpException: {"message":"Repository access blocked","block":{"reason":"dmca","created_at":"2023-05-08T22:39:57Z","html_url":"
          https://github.com/github/dmca/blob/master/2023/05/2023-05-04-nintendo-4.md
          "}} at PluginClassLoader for github-api//org.kohsuke.github.GitHubConnectorResponseErrorHandler$1.onError(GitHubConnectorResponseErrorHandler.java:62) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.detectKnownErrors(GitHubClient.java:504) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:464) at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:427) at PluginClassLoader for github-api//org.kohsuke.github.Requester.fetchInto(Requester.java:102) at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.populate(GHRepository.java:3599) at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.getSource(GHRepository.java:2979) at PluginClassLoader for github-branch-source//org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:1068) at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:530) at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269) at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167) at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:915) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:446) Finished: FAILURE {code}
           

           

          The repository in question is most likely one of the following:
           * [https://github.com/solonovamax/Lockpick]
           * [https://github.com/solonovamax/Lockpick_RCM]

           

          These repositories _cannot_ be removed through github. The DMCA was automatic and affected any users which had forked [this repository|https://github.com/shchmue/Lockpick] (of which there were many, including me), so being unable to scan repositories due to this is quite annoying.

           

          this is my first time reporting an issue for jenkins, so lmk if I left out any information (tho I think I got everything)           		New: Scanning a github organization/user fails if a repository is blocked due to a DMCA takedown.

           

          Here is an excerpt from the end of my scan log:

           
          {code:java}
          Ignoring krypton
          20:13:09 Skipping repository krypton because it is a fork
          Ignoring laptop-setup-ubuntu-18.04
          20:13:09 Skipping repository laptop-setup-ubuntu-18.04 because it is a fork
          Ignoring LearningDesignPattern
          20:13:09 Skipping repository LearningDesignPattern because it is a fork
          Ignoring Ledger
          20:13:10 Skipping repository Ledger because it is a fork
          Ignoring LiquidBurner
          20:13:10 Skipping repository LiquidBurner because it is a fork
          ERROR: [Sun Jun 02 20:13:10 EDT 2024] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@7010654c
          [Sun Jun 02 20:13:10 EDT 2024] Finished organization scan. Scan took 17 sec FATAL: Failed to recompute children of solonovamax
          org.kohsuke.github.HttpException: {"message":"Repository access blocked","block":{"reason":"dmca","created_at":"2023-05-08T22:39:57Z","html_url":"
          https://github.com/github/dmca/blob/master/2023/05/2023-05-04-nintendo-4.md
          "}}
          at PluginClassLoader for github-api//org.kohsuke.github.GitHubConnectorResponseErrorHandler$1.onError(GitHubConnectorResponseErrorHandler.java:62)
          at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.detectKnownErrors(GitHubClient.java:504)
          at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:464)
          at PluginClassLoader for github-api//org.kohsuke.github.GitHubClient.sendRequest(GitHubClient.java:427)
          at PluginClassLoader for github-api//org.kohsuke.github.Requester.fetchInto(Requester.java:102)
          at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.populate(GHRepository.java:3599)
          at PluginClassLoader for github-api//org.kohsuke.github.GHRepository.getSource(GHRepository.java:2979)
          at PluginClassLoader for github-branch-source//org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:1068)
          at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:530)
          at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:269)
          at PluginClassLoader for cloudbees-folder//com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:167)
          at PluginClassLoader for branch-api//jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:915)
          at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:446)
          Finished: FAILURE {code}
           

           

          The repository in question is most likely one of the following:
           * [https://github.com/solonovamax/Lockpick]
           * [https://github.com/solonovamax/Lockpick_RCM]

           

          These repositories _cannot_ be removed through github. The DMCA was automatic and affected any users which had forked [this repository|https://github.com/shchmue/Lockpick] (of which there were many, including me), so being unable to scan repositories due to this is quite annoying.

           

          this is my first time reporting an issue for jenkins, so lmk if I left out any information (tho I think I got everything)
          solo made changes -
          Remote Link New: This issue links to "PR (Web Link)" [ 29692 ]

            solonovamax solo
            solonovamax solo
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: