-
Bug
-
Resolution: Fixed
-
Major
-
None
-
warnings-ng 12.4.1
analysis-model-api 13.2.0
jenkins 2.492.2-lts.jdk21
After recent jenkins & plugins updates we have encountered severe performance issues on blueocean and normal job listings. These issues show as long loadtimes (more than a minute) of the branch lists and blueocean UI and occur on multibranch jobs with many branches (200+) that have issue scanning with the warnings-ng plugin enabled.
I've analyzed memory and allocation profiles of our jenkins controller and it lists getParserId as the main culprit:
This high CPU usage is also accompanied by high memory allocations and gc churn.
(note: images are not necessarily of the same time range)
I've downgraded the warnings-ng plugin to 11.12.0 and analysis-model-api to 12.9.1. This has completely resolved both the cpu usage and memory allocation issues.
- duplicates
-
JENKINS-75478 slow job list rendering when "# issues" column has high values
-
- Closed
-
- links to
Can you provide more details that describe how you have enabled issue scanning with the warnings plugin? My initial guesses trying to duplicate the problem were not successful.
I've created over 200 branches on https://ci.jenkins.io/job/Plugins/job/xshell-plugin/ and am allowing it to run the jobs on those branches to completion. The load of starting and running 200 concurrent jobs that each require a Windows and a Linux agent for 2-4 minutes is certainly slowing response time, but it is a matter of seconds delay.
Those jobs are using recordIssues(). The script they are running is https://github.com/jenkins-infra/pipeline-library/blob/master/vars/buildPlugin.groovy
Now that the 200 jobs have all completed, when I open the jobs page, it takes about 15 seconds to finish loading the entire page. The page is already displaying in the first few seconds, but the "page loading' indicator in the browser tab shows that data is still arriving. The blue ocean page needs about 10 seconds to finish loading. A specific Pipeline run loads immediately.