Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-58282

Heath metrics produces serious performance issues

XMLWordPrintable

      1. The issue

      The weather icon at folder level is very expensive to be computed and it produces serious performance issues.

      Usually, the issue is manifested because the main Jenkins dashboard can't be accessible, but you can access to /manage or /whatever - as long as you don't reach out the main dashboard

      The issue happend with cloudbees-folder:6.7:not-pinned and `2.164.3.2`

      1. Thread dump
      Handling GET / from XX.XX : qtp2007328737-18019 View/index.jelly WeatherColumn/column.jelly
"Handling GET / from XX.XX : qtp2007328737-18019 View/index.jelly WeatherColumn/column.jelly" Id=18019 Group=main BLOCKED on hudson.model.RunMap@54e0b52f owned by "Handling GET / from XX.XX : qtp2007328737-17568 View/index.jelly WeatherColumn/column.jelly" Id=17568
	at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:370)
	-  blocked on hudson.model.RunMap@54e0b52f
	at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:346)
	at jenkins.model.lazy.AbstractLazyLoadRunMap.newestBuild(AbstractLazyLoadRunMap.java:276)
	at jenkins.model.lazy.LazyBuildMixIn.getLastBuild(LazyBuildMixIn.java:245)
	at org.jenkinsci.plugins.workflow.job.WorkflowJob.getLastBuild(WorkflowJob.java:242)
	at org.jenkinsci.plugins.workflow.job.WorkflowJob.getLastBuild(WorkflowJob.java:105)
	at hudson.model.Job.getBuildHealthReports(Job.java:1205)
	at hudson.model.Job.getBuildHealth(Job.java:1198)
	at com.cloudbees.hudson.plugins.folder.health.FolderHealthMetric.getHealthReport(FolderHealthMetric.java:48)
	at com.cloudbees.hudson.plugins.folder.health.WorstChildHealthMetric$ReporterImpl.observe(WorstChildHealthMetric.java:86)
	at com.cloudbees.hudson.plugins.folder.AbstractFolder.getBuildHealthReports(AbstractFolder.java:939)
	at sun.reflect.GeneratedMethodAccessor757.invoke(Unknown Source)

          [JENKINS-58282] Heath metrics produces serious performance issues

          Félix Belzunce Arcos added a comment -

          The issue is fixed after executing the groovy script from the kb article below

          https://support.cloudbees.com/hc/en-us/articles/216973327-How-to-disable-the-weather-column-to-resolve-instance-slowness-

          Félix Belzunce Arcos added a comment - The issue is fixed after executing the groovy script from the kb article below https://support.cloudbees.com/hc/en-us/articles/216973327-How-to-disable-the-weather-column-to-resolve-instance-slowness-

          Allan BURDAJEWICZ added a comment - - edited

          We could have the Folder health metrics disabled by default when creating new folders or add a system property that could be used to disable it when creating new folders.
          We could also add a global configuration of Folder metrics so that any new folder that is created follow the global configuration.

          Allan BURDAJEWICZ added a comment - - edited We could have the Folder health metrics disabled by default when creating new folders or add a system property that could be used to disable it when creating new folders. We could also add a global configuration of Folder metrics so that any new folder that is created follow the global configuration.

          Allan BURDAJEWICZ added a comment -

          Could be related and soon addressed by https://issues.jenkins-ci.org/browse/JENKINS-18377 (see also https://issues.jenkins-ci.org/browse/JENKINS-25075). In the meantime, I think that being able to define the default health metrics that are to be used when creating a folder could be a good addition.

          Allan BURDAJEWICZ added a comment - Could be related and soon addressed by https://issues.jenkins-ci.org/browse/JENKINS-18377 (see also https://issues.jenkins-ci.org/browse/JENKINS-25075 ). In the meantime, I think that being able to define the default health metrics that are to be used when creating a folder could be a good addition.

          Allan BURDAJEWICZ added a comment -

          proposed: https://github.com/jenkinsci/cloudbees-folder-plugin/pull/129

          Allan BURDAJEWICZ added a comment - proposed: https://github.com/jenkinsci/cloudbees-folder-plugin/pull/129

            allan_burdajewicz Allan BURDAJEWICZ
            fbelzunc Félix Belzunce Arcos
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: