• Type: Improvement
• Resolution: Unresolved
• Priority: Major
• Component/s: github-branch-source-plugin
• Labels:

  None
• Environment:

  Jenkins 2.289
  GitHub Api 1.117
  GitHub Branch Source 2.9.3

1. 

   screenshot-1.png

   129 kB

   2021-05-26 18:15

[JENKINS-65725] Too many calls to the GitHub API cause throttling

Alexandre Gaudreault created issue - 2021-05-26 18:08

Alexandre Gaudreault made changes - 2021-05-26 18:13

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints. ``` path_info request_method count /repos/{owner}/{repository} get 798 /repos/{owner}/{repository}/git/refs/heads/branch1 get 75 /repos/{owner}/{repository}/git/refs/heads/branch2 get 38 /repos/{owner}/{repository}/contents/ get 21 /repos/{owner}/{repository}/git/refs/heads/branch3 get 20 /repos/{owner}/{repository}/git/refs/heads/branch4 get 20 /repos/{owner}/{repository}/git/refs/heads/branch5 get 20 /repos/{owner}/{repository}/git/refs/heads/branch6 get 20 /repos/{owner}/{repository}/git/refs/heads/branch7 get 17 /repos/{owner}/{repository}/contents/Jenkinsfile get 13 /repos/{owner}/{repository}/git/refs/heads/branch8 get 11 /repos/{owner}/{repository}/branches/branch1 get 9 /repos/{owner}/{repository}/git/refs/heads/master get 9 /repos/{owner}/{repository}/branches/branch2 get 2 /repos/{owner}/{repository}/branches/branch8 get 2 /repos/{owner}/{repository}/branches/branch3 get 2 /repos/{owner}/{repository}/branches/branch7 get 2 /repos/{owner}/{repository}/branches/branch4 get 2 /repos/{owner}/{repository}/branches/branch5 get 1 /repos/{owner}/{repository}/branches/branch6 get 1 ``` The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints. ||path_info||request_method|count|| |/repos/{owner}/{repository}|get|798| |/repos/{owner}/{repository}/git/refs/heads/branch1|get|75| |/repos/{owner}/{repository}/git/refs/heads/branch2|get|38| |/repos/{owner}/{repository}/contents/|get|21| |/repos/{owner}/{repository}/git/refs/heads/branch3|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch4|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch5|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch6|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch7|get|17| |/repos/{owner}/{repository}/contents/Jenkinsfile|get|13| |/repos/{owner}/{repository}/git/refs/heads/branch8|get|11| |/repos/{owner}/{repository}/branches/branch1|get|9| |/repos/{owner}/{repository}/git/refs/heads/master|get|9| |/repos/{owner}/{repository}/branches/branch2|get|2| |/repos/{owner}/{repository}/branches/branch8|get|2| |/repos/{owner}/{repository}/branches/branch3|get|2| |/repos/{owner}/{repository}/branches/branch7|get|2| |/repos/{owner}/{repository}/branches/branch4|get|2| |/repos/{owner}/{repository}/branches/branch5|get|1| |/repos/{owner}/{repository}/branches/branch6|get|1| The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:14

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints. ||path_info||request_method|count|| |/repos/{owner}/{repository}|get|798| |/repos/{owner}/{repository}/git/refs/heads/branch1|get|75| |/repos/{owner}/{repository}/git/refs/heads/branch2|get|38| |/repos/{owner}/{repository}/contents/|get|21| |/repos/{owner}/{repository}/git/refs/heads/branch3|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch4|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch5|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch6|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch7|get|17| |/repos/{owner}/{repository}/contents/Jenkinsfile|get|13| |/repos/{owner}/{repository}/git/refs/heads/branch8|get|11| |/repos/{owner}/{repository}/branches/branch1|get|9| |/repos/{owner}/{repository}/git/refs/heads/master|get|9| |/repos/{owner}/{repository}/branches/branch2|get|2| |/repos/{owner}/{repository}/branches/branch8|get|2| |/repos/{owner}/{repository}/branches/branch3|get|2| |/repos/{owner}/{repository}/branches/branch7|get|2| |/repos/{owner}/{repository}/branches/branch4|get|2| |/repos/{owner}/{repository}/branches/branch5|get|1| |/repos/{owner}/{repository}/branches/branch6|get|1| The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints. ||Heading 1||Heading 2|| |Col A1|Col A2| ||path_info||request_method||count|| |/repos/{owner}/{repository}|get|798| |/repos/{owner}/{repository}/git/refs/heads/branch1|get|75| |/repos/{owner}/{repository}/git/refs/heads/branch2|get|38| |/repos/{owner}/{repository}/contents/|get|21| |/repos/{owner}/{repository}/git/refs/heads/branch3|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch4|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch5|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch6|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch7|get|17| |/repos/{owner}/{repository}/contents/Jenkinsfile|get|13| |/repos/{owner}/{repository}/git/refs/heads/branch8|get|11| |/repos/{owner}/{repository}/branches/branch1|get|9| |/repos/{owner}/{repository}/git/refs/heads/master|get|9| |/repos/{owner}/{repository}/branches/branch2|get|2| |/repos/{owner}/{repository}/branches/branch8|get|2| |/repos/{owner}/{repository}/branches/branch3|get|2| |/repos/{owner}/{repository}/branches/branch7|get|2| |/repos/{owner}/{repository}/branches/branch4|get|2| |/repos/{owner}/{repository}/branches/branch5|get|1| |/repos/{owner}/{repository}/branches/branch6|get|1| The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:15

Attachment

New: screenshot-1.png [ 54881 ]

Alexandre Gaudreault made changes - 2021-05-26 18:15

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints. ||Heading 1||Heading 2|| |Col A1|Col A2| ||path_info||request_method||count|| |/repos/{owner}/{repository}|get|798| |/repos/{owner}/{repository}/git/refs/heads/branch1|get|75| |/repos/{owner}/{repository}/git/refs/heads/branch2|get|38| |/repos/{owner}/{repository}/contents/|get|21| |/repos/{owner}/{repository}/git/refs/heads/branch3|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch4|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch5|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch6|get|20| |/repos/{owner}/{repository}/git/refs/heads/branch7|get|17| |/repos/{owner}/{repository}/contents/Jenkinsfile|get|13| |/repos/{owner}/{repository}/git/refs/heads/branch8|get|11| |/repos/{owner}/{repository}/branches/branch1|get|9| |/repos/{owner}/{repository}/git/refs/heads/master|get|9| |/repos/{owner}/{repository}/branches/branch2|get|2| |/repos/{owner}/{repository}/branches/branch8|get|2| |/repos/{owner}/{repository}/branches/branch3|get|2| |/repos/{owner}/{repository}/branches/branch7|get|2| |/repos/{owner}/{repository}/branches/branch4|get|2| |/repos/{owner}/{repository}/branches/branch5|get|1| |/repos/{owner}/{repository}/branches/branch6|get|1| The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:15

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the `/repos/{owner}/{repository}/git/refs/heads/{branch}` and `/repos/{owner}/{repository}` endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/{owner}/{repository}/git/refs/heads/{branch} and /repos/{owner}/{repository} endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:15

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/{owner}/{repository}/git/refs/heads/{branch} and /repos/{owner}/{repository} endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/{owner}/{repository}/git/refs/heads/{branch} and {{/repos/{owner}/{repository}}} endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:17

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/{owner}/{repository}/git/refs/heads/{branch} and {{/repos/{owner}/{repository}}} endpoints.  !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/\{owner}/\{repository}/git/refs/heads/\{branch} and /repos/\{owner}/\{repository} endpoints. !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

Alexandre Gaudreault made changes - 2021-05-26 18:18

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/\{owner}/\{repository}/git/refs/heads/\{branch} and /repos/\{owner}/\{repository} endpoints. !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these call

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/\{owner}/\{repository}/git/refs/heads/\{branch} and /repos/\{owner}/\{repository} endpoints. !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these calls. The repo is not configured for polling and it is configured with the Discover All branches strategy.

Alexandre Gaudreault made changes - 2021-05-26 18:19

Description

Original: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/\{owner}/\{repository}/git/refs/heads/\{branch} and /repos/\{owner}/\{repository} endpoints. !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these calls. The repo is not configured for polling and it is configured with the Discover All branches strategy.

New: We have a multibranch pipeline configured with a GitHub App credential. We use the SSH checkout trait with another ssh credential to perform the checkout. For one repository only, we hit about 1000 calls, excluding our shared library, to the github API with our GitHub App token. Here is the details of these calls for 1h in a single repository. We can see that there is quite a high amount of calls to the /repos/\{owner}/\{repository}/git/refs/heads/\{branch} and /repos/\{owner}/\{repository} endpoints. !screenshot-1.png|thumbnail! The high amount of calls cause our builds to sleep so we avoid being rate limited by GitHub. I believe Github branch source plugin is making most of these calls. The repo is *not* configured for polling and it is configured with the _Discover All branches_ strategy.

Load more newer events