Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-72994

Improve Parallelization of Job loading on Startup

XMLWordPrintable

      Jenkins startup loads only top items in parallel.

      On Startup, the loading of Items is parallelized but only across top level items, not down the hierarchy. Therefore the item loading is very dependent on the Folder structure and that first level. A flat top level structure would load so much quicker than a deep structure.

      If you have 4 top level items, the item loading can be parallelized with a maximum of 4 threads. And if one of those folders is small and another huge, the parallelization is pointless.

      This could be improved and would considerably decrease the startup time for moderate to large instances.

      Reference: https://github.com/jenkinsci/jenkins/blob/jenkins-2.453/core/src/main/java/jenkins/model/Jenkins.java#L3505-L3518

          [JENKINS-72994] Improve Parallelization of Job loading on Startup

          Allan BURDAJEWICZ created issue -

          Allan BURDAJEWICZ added a comment - - edited

          cc basil I mentioned that to you a few month ago and realized I did not create an issue.

          Allan BURDAJEWICZ added a comment - - edited cc basil I mentioned that to you a few month ago and realized I did not create an issue.
          Allan BURDAJEWICZ made changes -
          Summary Original: Improve Job loading on Startup New: Parallelize Job loading on Startup
          Allan BURDAJEWICZ made changes -
          Summary Original: Parallelize Job loading on Startup New: Better Parallelize Job loading on Startup
          Allan BURDAJEWICZ made changes -
          Description Original: Jenkins startup loads only top items in parallel. A flat folder hierarchy would load so much quicker than a deep folder hierarchy.

          On Startup, the loading of Items is parallelized but only across top level items, not down the hierarchy. Therefore the item loading is very dependent on the Folder structure and that first level. A flat top level structure would load so much quicker than a deep structure.

          If you have 4 top level items, the item loading can be parallelized with a maximum of 4 threads. And if one of those folders is small and another huge, the parallelization is pointless.

          This could be improved and would considerably decrease the startup time for moderate to large instances.

          		New: Jenkins startup loads only top items in parallel. A flat folder hierarchy would load so much quicker than a deep folder hierarchy.

          On Startup, the loading of Items is parallelized but only across top level items, not down the hierarchy. Therefore the item loading is very dependent on the Folder structure and that first level. A flat top level structure would load so much quicker than a deep structure.

          If you have 4 top level items, the item loading can be parallelized with a maximum of 4 threads. And if one of those folders is small and another huge, the parallelization is pointless.

          This could be improved and would considerably decrease the startup time for moderate to large instances.

          Reference: https://github.com/jenkinsci/jenkins/blob/jenkins-2.453/core/src/main/java/jenkins/model/Jenkins.java#L3505-L3518
          Allan BURDAJEWICZ made changes -
          Description Original: Jenkins startup loads only top items in parallel. A flat folder hierarchy would load so much quicker than a deep folder hierarchy.

          On Startup, the loading of Items is parallelized but only across top level items, not down the hierarchy. Therefore the item loading is very dependent on the Folder structure and that first level. A flat top level structure would load so much quicker than a deep structure.

          If you have 4 top level items, the item loading can be parallelized with a maximum of 4 threads. And if one of those folders is small and another huge, the parallelization is pointless.

          This could be improved and would considerably decrease the startup time for moderate to large instances.

          Reference: https://github.com/jenkinsci/jenkins/blob/jenkins-2.453/core/src/main/java/jenkins/model/Jenkins.java#L3505-L3518
          		New: Jenkins startup loads only top items in parallel.

          On Startup, the loading of Items is parallelized but only across top level items, not down the hierarchy. Therefore the item loading is very dependent on the Folder structure and that first level. A flat top level structure would load so much quicker than a deep structure.

          If you have 4 top level items, the item loading can be parallelized with a maximum of 4 threads. And if one of those folders is small and another huge, the parallelization is pointless.

          This could be improved and would considerably decrease the startup time for moderate to large instances.

          Reference: https://github.com/jenkinsci/jenkins/blob/jenkins-2.453/core/src/main/java/jenkins/model/Jenkins.java#L3505-L3518
          Allan BURDAJEWICZ made changes -
          Summary Original: Better Parallelize Job loading on Startup New: Improve Parallelization of Job loading on Startup

          Jesse Glick added a comment -

          Is this related to https://github.com/jenkinsci/cloudbees-folder-plugin/pull/220?

          Jesse Glick added a comment - Is this related to https://github.com/jenkinsci/cloudbees-folder-plugin/pull/220?
          Jesse Glick made changes -
          Component/s New: cloudbees-folder-plugin [ 18137 ]

            Unassigned Unassigned
            allan_burdajewicz Allan BURDAJEWICZ
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: